[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:05:37.637626 20382 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.231.190:33345
I20260709 13:05:37.639353 20382 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:05:37.640434 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:37.658473 20391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:37.658470 20388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:37.658463 20389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:37.660298 20382 server_base.cc:1061] running on GCE node
I20260709 13:05:38.862501 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:38.862756 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:38.863004 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602338862983 us; error 0 us; skew 500 ppm
I20260709 13:05:38.863811 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:38.869297 20382 webserver.cc:533] Webserver started at http://127.19.231.190:40065/ using document root <none> and password file <none>
I20260709 13:05:38.870159 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:38.870369 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:38.870771 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:38.876776 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/master-0-root/instance:
uuid: "b0c8912242254a7bb24afa7f17751cda"
format_stamp: "Formatted at 2026-07-09 13:05:38 on dist-test-slave-1t6m"
I20260709 13:05:38.885040 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:05:38.890391 20397 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:38.891800 20382 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:38.892141 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/master-0-root
uuid: "b0c8912242254a7bb24afa7f17751cda"
format_stamp: "Formatted at 2026-07-09 13:05:38 on dist-test-slave-1t6m"
I20260709 13:05:38.892473 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:38.946061 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:38.947718 20382 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:05:38.948146 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.022045 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.190:33345
I20260709 13:05:39.022117 20448 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.190:33345 every 8 connection(s)
I20260709 13:05:39.030829 20449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.053241 20449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda: Bootstrap starting.
I20260709 13:05:39.059702 20449 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.061717 20449 log.cc:826] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda: Log is configured to *not* fsync() on all Append() calls
I20260709 13:05:39.066635 20449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda: No bootstrap required, opened a new log
I20260709 13:05:39.087591 20449 raft_consensus.cc:359] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c8912242254a7bb24afa7f17751cda" member_type: VOTER }
I20260709 13:05:39.088192 20449 raft_consensus.cc:385] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.088451 20449 raft_consensus.cc:740] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c8912242254a7bb24afa7f17751cda, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.089489 20449 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c8912242254a7bb24afa7f17751cda" member_type: VOTER }
I20260709 13:05:39.090008 20449 raft_consensus.cc:399] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:39.090310 20449 raft_consensus.cc:493] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:39.090660 20449 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.094961 20449 raft_consensus.cc:515] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c8912242254a7bb24afa7f17751cda" member_type: VOTER }
I20260709 13:05:39.095813 20449 leader_election.cc:304] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0c8912242254a7bb24afa7f17751cda; no voters: 
I20260709 13:05:39.097564 20449 leader_election.cc:290] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:39.097998 20452 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.100672 20452 raft_consensus.cc:697] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 1 LEADER]: Becoming Leader. State: Replica: b0c8912242254a7bb24afa7f17751cda, State: Running, Role: LEADER
I20260709 13:05:39.101617 20452 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c8912242254a7bb24afa7f17751cda" member_type: VOTER }
I20260709 13:05:39.102198 20449 sys_catalog.cc:565] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:39.114601 20453 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0c8912242254a7bb24afa7f17751cda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c8912242254a7bb24afa7f17751cda" member_type: VOTER } }
I20260709 13:05:39.115365 20453 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:39.114446 20454 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0c8912242254a7bb24afa7f17751cda. Latest consensus state: current_term: 1 leader_uuid: "b0c8912242254a7bb24afa7f17751cda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c8912242254a7bb24afa7f17751cda" member_type: VOTER } }
I20260709 13:05:39.116367 20454 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:39.118625 20462 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:39.132507 20462 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:39.134753 20382 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:39.152204 20462 catalog_manager.cc:1383] Generated new cluster ID: 16ed49773ede4484a30fde0c2a2264b3
I20260709 13:05:39.152580 20462 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:39.182013 20462 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:39.184336 20462 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:39.203651 20462 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda: Generated new TSK 0
I20260709 13:05:39.204749 20462 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:39.266064 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.275094 20471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.276341 20472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.280807 20382 server_base.cc:1061] running on GCE node
W20260709 13:05:39.281018 20474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.282035 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.282301 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.282500 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602339282480 us; error 0 us; skew 500 ppm
I20260709 13:05:39.283166 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.287863 20382 webserver.cc:533] Webserver started at http://127.19.231.129:42637/ using document root <none> and password file <none>
I20260709 13:05:39.288452 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.288692 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.289013 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.290200 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-0-root/instance:
uuid: "717c3872f5204497bd6c4daf65227603"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-1t6m"
I20260709 13:05:39.296303 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:05:39.301116 20479 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.302045 20382 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:05:39.302363 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-0-root
uuid: "717c3872f5204497bd6c4daf65227603"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-1t6m"
I20260709 13:05:39.302688 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.336354 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.337798 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.340747 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.345538 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.345767 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.346118 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.346359 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.456529 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.129:32779
I20260709 13:05:39.457298 20541 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.129:32779 every 8 connection(s)
I20260709 13:05:39.464643 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.474527 20546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.476496 20547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.486553 20549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.487429 20382 server_base.cc:1061] running on GCE node
I20260709 13:05:39.488446 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.488678 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.488881 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602339488861 us; error 0 us; skew 500 ppm
I20260709 13:05:39.489504 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.494031 20382 webserver.cc:533] Webserver started at http://127.19.231.130:38495/ using document root <none> and password file <none>
I20260709 13:05:39.494786 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.495080 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.495441 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.495414 20542 heartbeater.cc:344] Connected to a master server at 127.19.231.190:33345
I20260709 13:05:39.496084 20542 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.497184 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-1-root/instance:
uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-1t6m"
I20260709 13:05:39.497401 20542 heartbeater.cc:507] Master 127.19.231.190:33345 requested a full tablet report, sending...
I20260709 13:05:39.501439 20414 ts_manager.cc:194] Registered new tserver with Master: 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779)
I20260709 13:05:39.504422 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.006s
I20260709 13:05:39.504838 20414 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57968
I20260709 13:05:39.509851 20554 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.510953 20382 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:05:39.511291 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-1-root
uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-1t6m"
I20260709 13:05:39.511605 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.528182 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.529681 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.531971 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.535162 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.535435 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.535701 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.535881 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.632041 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.130:33741
I20260709 13:05:39.632210 20616 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.130:33741 every 8 connection(s)
I20260709 13:05:39.638077 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.648936 20620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.652110 20621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.654245 20382 server_base.cc:1061] running on GCE node
I20260709 13:05:39.654810 20617 heartbeater.cc:344] Connected to a master server at 127.19.231.190:33345
I20260709 13:05:39.655177 20617 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:39.655635 20623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.655962 20617 heartbeater.cc:507] Master 127.19.231.190:33345 requested a full tablet report, sending...
I20260709 13:05:39.656776 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.657060 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.657271 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602339657249 us; error 0 us; skew 500 ppm
I20260709 13:05:39.658113 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.658732 20414 ts_manager.cc:194] Registered new tserver with Master: f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:39.661161 20414 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57970
I20260709 13:05:39.665277 20382 webserver.cc:533] Webserver started at http://127.19.231.131:33407/ using document root <none> and password file <none>
I20260709 13:05:39.665843 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.666054 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.666358 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.667477 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-2-root/instance:
uuid: "2f82287054524c0f94caef5db7aad840"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-1t6m"
I20260709 13:05:39.672505 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:39.676350 20628 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.677282 20382 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:39.677680 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-2-root
uuid: "2f82287054524c0f94caef5db7aad840"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-1t6m"
I20260709 13:05:39.678052 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337466250-20382-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.698369 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.700065 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.702039 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.705137 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.705425 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.705709 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.705922 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.799288 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.131:46263
I20260709 13:05:39.799435 20690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.131:46263 every 8 connection(s)
I20260709 13:05:39.817539 20691 heartbeater.cc:344] Connected to a master server at 127.19.231.190:33345
I20260709 13:05:39.817967 20691 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.819023 20691 heartbeater.cc:507] Master 127.19.231.190:33345 requested a full tablet report, sending...
I20260709 13:05:39.821099 20414 ts_manager.cc:194] Registered new tserver with Master: 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:39.821632 20382 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016766299s
I20260709 13:05:39.822863 20414 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57980
I20260709 13:05:39.874419 20414 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57992:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:39.878084 20414 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:40.009795 20656 tablet_service.cc:1511] Processing CreateTablet for tablet 8f828ddc540c4648885bc99170858398 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:40.011513 20656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f828ddc540c4648885bc99170858398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.015208 20654 tablet_service.cc:1511] Processing CreateTablet for tablet b813d0f6b2da4729be61473224af10a5 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:40.015810 20653 tablet_service.cc:1511] Processing CreateTablet for tablet cc94eb705d2743e088bf9994628bb835 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:40.018076 20655 tablet_service.cc:1511] Processing CreateTablet for tablet a2a6ee3c1de142bd8d93c9cd6372bd9c (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:40.020537 20654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b813d0f6b2da4729be61473224af10a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.027073 20655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a6ee3c1de142bd8d93c9cd6372bd9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.025835 20652 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd3920f6285466385adaf95603dc9a2 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:40.027747 20582 tablet_service.cc:1511] Processing CreateTablet for tablet 8f828ddc540c4648885bc99170858398 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:40.036233 20580 tablet_service.cc:1511] Processing CreateTablet for tablet b813d0f6b2da4729be61473224af10a5 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:40.025928 20581 tablet_service.cc:1511] Processing CreateTablet for tablet a2a6ee3c1de142bd8d93c9cd6372bd9c (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:40.035792 20577 tablet_service.cc:1511] Processing CreateTablet for tablet b165ff347030430d9ad05f407511a4ba (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:40.028652 20579 tablet_service.cc:1511] Processing CreateTablet for tablet cc94eb705d2743e088bf9994628bb835 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:40.037097 20578 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd3920f6285466385adaf95603dc9a2 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:40.040966 20580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b813d0f6b2da4729be61473224af10a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.039264 20653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc94eb705d2743e088bf9994628bb835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.045217 20651 tablet_service.cc:1511] Processing CreateTablet for tablet b165ff347030430d9ad05f407511a4ba (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:40.045218 20582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f828ddc540c4648885bc99170858398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.048542 20652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd3920f6285466385adaf95603dc9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.050316 20651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b165ff347030430d9ad05f407511a4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.048524 20578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd3920f6285466385adaf95603dc9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.052868 20579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc94eb705d2743e088bf9994628bb835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.056453 20577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b165ff347030430d9ad05f407511a4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.063572 20581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a6ee3c1de142bd8d93c9cd6372bd9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.085350 20650 tablet_service.cc:1511] Processing CreateTablet for tablet 151dfc4f93d746078732d50f17ddd32d (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:40.087836 20650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151dfc4f93d746078732d50f17ddd32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.072965 20576 tablet_service.cc:1511] Processing CreateTablet for tablet 151dfc4f93d746078732d50f17ddd32d (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:40.093621 20576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151dfc4f93d746078732d50f17ddd32d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:40.120643 20461 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:40.122752 20575 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3cfc3a7caa4757a263e65e4f979fa1 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:40.124289 20709 tablet_bootstrap.cc:492] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840: Bootstrap starting.
I20260709 13:05:40.124338 20575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3cfc3a7caa4757a263e65e4f979fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.138237 20654 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3cfc3a7caa4757a263e65e4f979fa1 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:40.139635 20654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3cfc3a7caa4757a263e65e4f979fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.154831 20574 tablet_service.cc:1511] Processing CreateTablet for tablet d1b93d3df3054ce3937b95beb244909e (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:40.163668 20507 tablet_service.cc:1511] Processing CreateTablet for tablet 8f828ddc540c4648885bc99170858398 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:40.163764 20505 tablet_service.cc:1511] Processing CreateTablet for tablet b813d0f6b2da4729be61473224af10a5 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:40.165211 20506 tablet_service.cc:1511] Processing CreateTablet for tablet a2a6ee3c1de142bd8d93c9cd6372bd9c (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:40.161962 20574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b93d3df3054ce3937b95beb244909e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.178567 20503 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd3920f6285466385adaf95603dc9a2 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:40.187275 20507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f828ddc540c4648885bc99170858398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.193421 20504 tablet_service.cc:1511] Processing CreateTablet for tablet cc94eb705d2743e088bf9994628bb835 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:40.193711 20650 tablet_service.cc:1511] Processing CreateTablet for tablet d1b93d3df3054ce3937b95beb244909e (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:40.204630 20501 tablet_service.cc:1511] Processing CreateTablet for tablet 151dfc4f93d746078732d50f17ddd32d (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:40.203219 20502 tablet_service.cc:1511] Processing CreateTablet for tablet b165ff347030430d9ad05f407511a4ba (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:40.209121 20650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b93d3df3054ce3937b95beb244909e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.209522 20503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd3920f6285466385adaf95603dc9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.216713 20710 tablet_bootstrap.cc:492] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Bootstrap starting.
I20260709 13:05:40.216704 20500 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3cfc3a7caa4757a263e65e4f979fa1 (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:40.223055 20499 tablet_service.cc:1511] Processing CreateTablet for tablet d1b93d3df3054ce3937b95beb244909e (DEFAULT_TABLE table=test-workload [id=38144310b36c4a42bf135f51b872e1ca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:40.226286 20502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b165ff347030430d9ad05f407511a4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.241396 20506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a6ee3c1de142bd8d93c9cd6372bd9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.243428 20500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3cfc3a7caa4757a263e65e4f979fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.246426 20499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b93d3df3054ce3937b95beb244909e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.248153 20501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151dfc4f93d746078732d50f17ddd32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.266000 20709 tablet_bootstrap.cc:654] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.266851 20505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b813d0f6b2da4729be61473224af10a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.269255 20504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc94eb705d2743e088bf9994628bb835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.316808 20709 tablet_bootstrap.cc:492] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840: No bootstrap required, opened a new log
I20260709 13:05:40.317376 20709 ts_tablet_manager.cc:1403] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840: Time spent bootstrapping tablet: real 0.193s	user 0.011s	sys 0.008s
I20260709 13:05:40.322597 20710 tablet_bootstrap.cc:654] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.325767 20709 raft_consensus.cc:359] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:40.327450 20709 raft_consensus.cc:385] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.327832 20709 raft_consensus.cc:740] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.328840 20709 consensus_queue.cc:260] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:40.359719 20712 tablet_bootstrap.cc:492] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603: Bootstrap starting.
I20260709 13:05:40.360229 20709 ts_tablet_manager.cc:1434] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.023s
I20260709 13:05:40.360718 20691 heartbeater.cc:499] Master 127.19.231.190:33345 was elected leader, sending a full tablet report...
I20260709 13:05:40.361385 20709 tablet_bootstrap.cc:492] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840: Bootstrap starting.
I20260709 13:05:40.369971 20710 tablet_bootstrap.cc:492] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e: No bootstrap required, opened a new log
I20260709 13:05:40.370553 20710 ts_tablet_manager.cc:1403] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent bootstrapping tablet: real 0.166s	user 0.017s	sys 0.000s
I20260709 13:05:40.372488 20709 tablet_bootstrap.cc:654] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.375814 20712 tablet_bootstrap.cc:654] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.375685 20710 raft_consensus.cc:359] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.376502 20710 raft_consensus.cc:385] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.378087 20710 raft_consensus.cc:740] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.379632 20710 consensus_queue.cc:260] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.393772 20712 tablet_bootstrap.cc:492] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603: No bootstrap required, opened a new log
I20260709 13:05:40.394359 20712 ts_tablet_manager.cc:1403] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.016s
I20260709 13:05:40.395368 20709 tablet_bootstrap.cc:492] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840: No bootstrap required, opened a new log
I20260709 13:05:40.395946 20709 ts_tablet_manager.cc:1403] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.022s
I20260709 13:05:40.397030 20617 heartbeater.cc:499] Master 127.19.231.190:33345 was elected leader, sending a full tablet report...
I20260709 13:05:40.397171 20712 raft_consensus.cc:359] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:40.397893 20712 raft_consensus.cc:385] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.398073 20710 ts_tablet_manager.cc:1434] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:05:40.398193 20712 raft_consensus.cc:740] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.399117 20710 tablet_bootstrap.cc:492] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Bootstrap starting.
I20260709 13:05:40.398893 20709 raft_consensus.cc:359] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.399034 20712 consensus_queue.cc:260] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:40.399600 20709 raft_consensus.cc:385] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.402585 20709 raft_consensus.cc:740] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.404436 20709 consensus_queue.cc:260] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.406358 20710 tablet_bootstrap.cc:654] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.411336 20709 ts_tablet_manager.cc:1434] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:40.412438 20709 tablet_bootstrap.cc:492] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840: Bootstrap starting.
I20260709 13:05:40.419552 20542 heartbeater.cc:499] Master 127.19.231.190:33345 was elected leader, sending a full tablet report...
I20260709 13:05:40.420065 20712 ts_tablet_manager.cc:1434] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.014s
I20260709 13:05:40.421001 20712 tablet_bootstrap.cc:492] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603: Bootstrap starting.
I20260709 13:05:40.422749 20709 tablet_bootstrap.cc:654] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.427891 20712 tablet_bootstrap.cc:654] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.434270 20718 raft_consensus.cc:493] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.435683 20713 raft_consensus.cc:493] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.436630 20713 raft_consensus.cc:515] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:40.436061 20718 raft_consensus.cc:515] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:40.445035 20713 leader_election.cc:290] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779)
I20260709 13:05:40.446080 20712 tablet_bootstrap.cc:492] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603: No bootstrap required, opened a new log
I20260709 13:05:40.446720 20712 ts_tablet_manager.cc:1403] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.003s
I20260709 13:05:40.450538 20712 raft_consensus.cc:359] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.451565 20712 raft_consensus.cc:385] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.451951 20712 raft_consensus.cc:740] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.452782 20712 consensus_queue.cc:260] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.464205 20712 ts_tablet_manager.cc:1434] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
W20260709 13:05:40.465754 20543 tablet.cc:2406] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:40.471199 20712 tablet_bootstrap.cc:492] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603: Bootstrap starting.
I20260709 13:05:40.473939 20718 leader_election.cc:290] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:40.485929 20712 tablet_bootstrap.cc:654] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.524003 20710 tablet_bootstrap.cc:492] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e: No bootstrap required, opened a new log
I20260709 13:05:40.524935 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f828ddc540c4648885bc99170858398" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:40.526137 20666 raft_consensus.cc:2468] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 0.
I20260709 13:05:40.524591 20710 ts_tablet_manager.cc:1403] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent bootstrapping tablet: real 0.126s	user 0.019s	sys 0.018s
I20260709 13:05:40.529157 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f828ddc540c4648885bc99170858398" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:40.528728 20483 leader_election.cc:304] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:40.531865 20718 raft_consensus.cc:2804] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.532226 20718 raft_consensus.cc:493] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.532552 20718 raft_consensus.cc:3060] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.532800 20709 tablet_bootstrap.cc:492] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840: No bootstrap required, opened a new log
I20260709 13:05:40.533380 20709 ts_tablet_manager.cc:1403] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840: Time spent bootstrapping tablet: real 0.121s	user 0.027s	sys 0.016s
W20260709 13:05:40.541167 20629 leader_election.cc:343] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.539330 20710 raft_consensus.cc:359] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:40.543246 20710 raft_consensus.cc:385] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.543640 20710 raft_consensus.cc:740] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.544479 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f828ddc540c4648885bc99170858398" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603" is_pre_election: true
I20260709 13:05:40.546890 20709 raft_consensus.cc:359] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.547650 20709 raft_consensus.cc:385] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.547588 20718 raft_consensus.cc:515] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:40.548008 20709 raft_consensus.cc:740] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.550881 20517 raft_consensus.cc:2393] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f82287054524c0f94caef5db7aad840 in current term 1: Already voted for candidate 717c3872f5204497bd6c4daf65227603 in this term.
I20260709 13:05:40.550772 20717 raft_consensus.cc:493] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.551753 20717 raft_consensus.cc:515] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.553582 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f828ddc540c4648885bc99170858398" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:40.555131 20629 leader_election.cc:304] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f82287054524c0f94caef5db7aad840; no voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:40.556084 20717 leader_election.cc:290] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:40.568367 20713 raft_consensus.cc:3060] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.549440 20709 consensus_queue.cc:260] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.551288 20710 consensus_queue.cc:260] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:40.574317 20592 raft_consensus.cc:2468] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 0.
I20260709 13:05:40.577744 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f828ddc540c4648885bc99170858398" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:40.578528 20718 leader_election.cc:290] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Requested vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:40.578620 20712 tablet_bootstrap.cc:492] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603: No bootstrap required, opened a new log
I20260709 13:05:40.585358 20713 raft_consensus.cc:2749] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.587819 20713 raft_consensus.cc:493] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.588306 20713 raft_consensus.cc:515] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.590444 20713 leader_election.cc:290] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:40.586606 20712 ts_tablet_manager.cc:1403] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603: Time spent bootstrapping tablet: real 0.116s	user 0.039s	sys 0.026s
I20260709 13:05:40.591576 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603" is_pre_election: true
W20260709 13:05:40.593466 20629 leader_election.cc:343] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.595649 20710 ts_tablet_manager.cc:1434] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 13:05:40.596661 20710 tablet_bootstrap.cc:492] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Bootstrap starting.
I20260709 13:05:40.594329 20712 raft_consensus.cc:359] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.598774 20712 raft_consensus.cc:385] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.594327 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:40.599222 20712 raft_consensus.cc:740] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Initialized, Role: FOLLOWER
W20260709 13:05:40.600450 20629 leader_election.cc:343] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.600901 20629 leader_election.cc:304] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f82287054524c0f94caef5db7aad840; no voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:40.601033 20712 consensus_queue.cc:260] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.602095 20713 raft_consensus.cc:2749] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.594695 20666 raft_consensus.cc:2468] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 1.
I20260709 13:05:40.606120 20712 ts_tablet_manager.cc:1434] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:05:40.607228 20712 tablet_bootstrap.cc:492] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603: Bootstrap starting.
I20260709 13:05:40.623714 20712 tablet_bootstrap.cc:654] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.626935 20483 leader_election.cc:304] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:40.628000 20718 raft_consensus.cc:2804] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.628530 20718 raft_consensus.cc:697] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Becoming Leader. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:40.629392 20718 consensus_queue.cc:237] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:40.631654 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f828ddc540c4648885bc99170858398" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:40.632444 20592 raft_consensus.cc:3060] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.636631 20709 ts_tablet_manager.cc:1434] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840: Time spent starting tablet: real 0.099s	user 0.015s	sys 0.010s
I20260709 13:05:40.637666 20709 tablet_bootstrap.cc:492] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840: Bootstrap starting.
I20260709 13:05:40.638346 20710 tablet_bootstrap.cc:654] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.641362 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd3920f6285466385adaf95603dc9a2" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603" is_pre_election: true
I20260709 13:05:40.642023 20517 raft_consensus.cc:2468] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 0.
I20260709 13:05:40.643748 20555 leader_election.cc:304] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:40.644646 20717 raft_consensus.cc:2804] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.644980 20717 raft_consensus.cc:493] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.645308 20717 raft_consensus.cc:3060] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.651517 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd3920f6285466385adaf95603dc9a2" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:40.652756 20717 raft_consensus.cc:515] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
W20260709 13:05:40.653798 20558 leader_election.cc:343] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.654552 20709 tablet_bootstrap.cc:654] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.646569 20592 raft_consensus.cc:2468] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 1.
I20260709 13:05:40.655581 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd3920f6285466385adaf95603dc9a2" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:40.656809 20517 raft_consensus.cc:3060] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.663849 20712 tablet_bootstrap.cc:492] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603: No bootstrap required, opened a new log
I20260709 13:05:40.664252 20712 ts_tablet_manager.cc:1403] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.011s
I20260709 13:05:40.666772 20712 raft_consensus.cc:359] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.667814 20712 raft_consensus.cc:385] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.668207 20712 raft_consensus.cc:740] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.669288 20517 raft_consensus.cc:2468] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 1.
I20260709 13:05:40.672843 20709 tablet_bootstrap.cc:492] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840: No bootstrap required, opened a new log
I20260709 13:05:40.673360 20709 ts_tablet_manager.cc:1403] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 13:05:40.673414 20555 leader_election.cc:304] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:40.676517 20709 raft_consensus.cc:359] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.677350 20709 raft_consensus.cc:385] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.677687 20709 raft_consensus.cc:740] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.676896 20412 catalog_manager.cc:5697] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 reported cstate change: term changed from 0 to 1, leader changed from <none> to 717c3872f5204497bd6c4daf65227603 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "717c3872f5204497bd6c4daf65227603" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.678474 20709 consensus_queue.cc:260] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.668998 20712 consensus_queue.cc:260] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.668426 20717 leader_election.cc:290] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:40.669723 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd3920f6285466385adaf95603dc9a2" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:40.681734 20717 raft_consensus.cc:2804] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.682264 20717 raft_consensus.cc:697] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Becoming Leader. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
W20260709 13:05:40.682621 20558 leader_election.cc:343] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.685056 20712 ts_tablet_manager.cc:1434] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:05:40.691252 20712 tablet_bootstrap.cc:492] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603: Bootstrap starting.
I20260709 13:05:40.689663 20717 consensus_queue.cc:237] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.689308 20709 ts_tablet_manager.cc:1434] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:05:40.691560 20710 tablet_bootstrap.cc:492] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e: No bootstrap required, opened a new log
I20260709 13:05:40.692790 20710 ts_tablet_manager.cc:1403] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.000s
I20260709 13:05:40.693394 20709 tablet_bootstrap.cc:492] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840: Bootstrap starting.
I20260709 13:05:40.696007 20710 raft_consensus.cc:359] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.696762 20710 raft_consensus.cc:385] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.697084 20710 raft_consensus.cc:740] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.697817 20710 consensus_queue.cc:260] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.701112 20732 raft_consensus.cc:493] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.701812 20732 raft_consensus.cc:515] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.703945 20710 ts_tablet_manager.cc:1434] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:40.706550 20712 tablet_bootstrap.cc:654] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.706732 20732 leader_election.cc:290] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:40.707662 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603" is_pre_election: true
I20260709 13:05:40.709937 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
W20260709 13:05:40.710268 20629 leader_election.cc:343] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:40.711359 20629 leader_election.cc:343] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.711810 20710 tablet_bootstrap.cc:492] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Bootstrap starting.
I20260709 13:05:40.711781 20629 leader_election.cc:304] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f82287054524c0f94caef5db7aad840; no voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:40.712620 20732 raft_consensus.cc:2749] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.713585 20709 tablet_bootstrap.cc:654] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.721191 20710 tablet_bootstrap.cc:654] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.736070 20709 tablet_bootstrap.cc:492] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840: No bootstrap required, opened a new log
I20260709 13:05:40.736589 20709 ts_tablet_manager.cc:1403] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.007s
I20260709 13:05:40.736342 20413 catalog_manager.cc:5697] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130). New cstate: current_term: 1 leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.739671 20709 raft_consensus.cc:359] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.740396 20709 raft_consensus.cc:385] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.740676 20709 raft_consensus.cc:740] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.741842 20709 consensus_queue.cc:260] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.743904 20709 ts_tablet_manager.cc:1434] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:40.745095 20709 tablet_bootstrap.cc:492] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840: Bootstrap starting.
I20260709 13:05:40.745877 20712 tablet_bootstrap.cc:492] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603: No bootstrap required, opened a new log
I20260709 13:05:40.746353 20712 ts_tablet_manager.cc:1403] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.001s
I20260709 13:05:40.749369 20712 raft_consensus.cc:359] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.750174 20712 raft_consensus.cc:385] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.751259 20709 tablet_bootstrap.cc:654] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.750538 20712 raft_consensus.cc:740] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.757611 20710 tablet_bootstrap.cc:492] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e: No bootstrap required, opened a new log
I20260709 13:05:40.758123 20710 ts_tablet_manager.cc:1403] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.012s
I20260709 13:05:40.761775 20718 raft_consensus.cc:493] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.761902 20710 raft_consensus.cc:359] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.762346 20718 raft_consensus.cc:515] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.759097 20712 consensus_queue.cc:260] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.766072 20718 leader_election.cc:290] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:40.767657 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:40.762671 20710 raft_consensus.cc:385] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.768317 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:40.768527 20666 raft_consensus.cc:2468] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 0.
I20260709 13:05:40.774896 20483 leader_election.cc:304] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:40.775781 20718 raft_consensus.cc:2804] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.776293 20718 raft_consensus.cc:493] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.776430 20712 ts_tablet_manager.cc:1434] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.001s
I20260709 13:05:40.776676 20718 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.777828 20712 tablet_bootstrap.cc:492] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603: Bootstrap starting.
I20260709 13:05:40.772428 20710 raft_consensus.cc:740] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Initialized, Role: FOLLOWER
W20260709 13:05:40.780809 20480 leader_election.cc:343] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.787782 20710 consensus_queue.cc:260] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.794312 20718 raft_consensus.cc:515] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.794977 20710 ts_tablet_manager.cc:1434] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent starting tablet: real 0.036s	user 0.000s	sys 0.008s
I20260709 13:05:40.796067 20709 tablet_bootstrap.cc:492] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840: No bootstrap required, opened a new log
I20260709 13:05:40.796066 20710 tablet_bootstrap.cc:492] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Bootstrap starting.
I20260709 13:05:40.797534 20709 ts_tablet_manager.cc:1403] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840: Time spent bootstrapping tablet: real 0.053s	user 0.028s	sys 0.016s
I20260709 13:05:40.803190 20718 leader_election.cc:290] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Requested vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:40.803716 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:40.804695 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:40.805249 20666 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:40.806432 20480 leader_election.cc:343] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.812866 20709 raft_consensus.cc:359] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.813853 20709 raft_consensus.cc:385] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.814247 20709 raft_consensus.cc:740] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.816562 20709 consensus_queue.cc:260] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.817029 20666 raft_consensus.cc:2468] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 1.
I20260709 13:05:40.818683 20483 leader_election.cc:304] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:40.819491 20709 ts_tablet_manager.cc:1434] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:05:40.819904 20718 raft_consensus.cc:2804] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.820410 20718 raft_consensus.cc:697] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Becoming Leader. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:40.820509 20709 tablet_bootstrap.cc:492] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840: Bootstrap starting.
I20260709 13:05:40.821249 20718 consensus_queue.cc:237] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.824559 20710 tablet_bootstrap.cc:654] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.824848 20712 tablet_bootstrap.cc:654] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.841863 20412 catalog_manager.cc:5697] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 reported cstate change: term changed from 0 to 1, leader changed from <none> to 717c3872f5204497bd6c4daf65227603 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "717c3872f5204497bd6c4daf65227603" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.842716 20709 tablet_bootstrap.cc:654] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.852723 20710 tablet_bootstrap.cc:492] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e: No bootstrap required, opened a new log
I20260709 13:05:40.853235 20710 ts_tablet_manager.cc:1403] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.007s
I20260709 13:05:40.853840 20718 raft_consensus.cc:493] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.854384 20718 raft_consensus.cc:515] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.856138 20710 raft_consensus.cc:359] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.859292 20710 raft_consensus.cc:385] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.859608 20710 raft_consensus.cc:740] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.859897 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b165ff347030430d9ad05f407511a4ba" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:40.860357 20710 consensus_queue.cc:260] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
W20260709 13:05:40.861570 20483 leader_election.cc:343] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.859916 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b165ff347030430d9ad05f407511a4ba" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:40.862651 20710 ts_tablet_manager.cc:1434] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
W20260709 13:05:40.863611 20480 leader_election.cc:343] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.864022 20480 leader_election.cc:304] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 717c3872f5204497bd6c4daf65227603; no voters: 2f82287054524c0f94caef5db7aad840, f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:40.858736 20718 leader_election.cc:290] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:40.865141 20720 raft_consensus.cc:2749] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.869117 20712 tablet_bootstrap.cc:492] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603: No bootstrap required, opened a new log
I20260709 13:05:40.869783 20712 ts_tablet_manager.cc:1403] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.014s
I20260709 13:05:40.873813 20712 raft_consensus.cc:359] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.874727 20712 raft_consensus.cc:385] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.876312 20712 raft_consensus.cc:740] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.877456 20709 tablet_bootstrap.cc:492] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840: No bootstrap required, opened a new log
I20260709 13:05:40.877064 20712 consensus_queue.cc:260] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.877945 20709 ts_tablet_manager.cc:1403] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.024s
I20260709 13:05:40.877991 20710 tablet_bootstrap.cc:492] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e: Bootstrap starting.
I20260709 13:05:40.879573 20712 ts_tablet_manager.cc:1434] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:05:40.880805 20712 tablet_bootstrap.cc:492] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603: Bootstrap starting.
I20260709 13:05:40.881549 20709 raft_consensus.cc:359] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.882308 20709 raft_consensus.cc:385] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.882591 20709 raft_consensus.cc:740] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.883359 20709 consensus_queue.cc:260] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.886121 20709 ts_tablet_manager.cc:1434] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:40.887176 20709 tablet_bootstrap.cc:492] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840: Bootstrap starting.
I20260709 13:05:40.888132 20712 tablet_bootstrap.cc:654] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.894937 20709 tablet_bootstrap.cc:654] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.900197 20710 tablet_bootstrap.cc:654] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.901321 20712 tablet_bootstrap.cc:492] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603: No bootstrap required, opened a new log
I20260709 13:05:40.902020 20712 ts_tablet_manager.cc:1403] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:05:40.906188 20712 raft_consensus.cc:359] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.907280 20712 raft_consensus.cc:385] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.907667 20712 raft_consensus.cc:740] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.908773 20712 consensus_queue.cc:260] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.911625 20709 tablet_bootstrap.cc:492] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840: No bootstrap required, opened a new log
I20260709 13:05:40.912094 20709 ts_tablet_manager.cc:1403] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:05:40.912554 20712 ts_tablet_manager.cc:1434] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:05:40.913637 20712 tablet_bootstrap.cc:492] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603: Bootstrap starting.
I20260709 13:05:40.914855 20709 raft_consensus.cc:359] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.915524 20709 raft_consensus.cc:385] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.915808 20709 raft_consensus.cc:740] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.916307 20710 tablet_bootstrap.cc:492] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e: No bootstrap required, opened a new log
I20260709 13:05:40.916879 20710 ts_tablet_manager.cc:1403] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.003s
I20260709 13:05:40.916467 20709 consensus_queue.cc:260] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.919418 20709 ts_tablet_manager.cc:1434] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:40.920346 20709 tablet_bootstrap.cc:492] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840: Bootstrap starting.
I20260709 13:05:40.921095 20712 tablet_bootstrap.cc:654] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.927500 20709 tablet_bootstrap.cc:654] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.930549 20732 raft_consensus.cc:493] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.931329 20732 raft_consensus.cc:515] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.934604 20732 leader_election.cc:290] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:40.935063 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3cfc3a7caa4757a263e65e4f979fa1" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603" is_pre_election: true
I20260709 13:05:40.935786 20517 raft_consensus.cc:2468] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 0.
I20260709 13:05:40.930584 20710 raft_consensus.cc:359] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.937228 20710 raft_consensus.cc:385] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.937565 20710 raft_consensus.cc:740] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.937656 20629 leader_election.cc:304] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:40.938477 20732 raft_consensus.cc:2804] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.938390 20710 consensus_queue.cc:260] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.939098 20732 raft_consensus.cc:493] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.939189 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3cfc3a7caa4757a263e65e4f979fa1" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:40.939637 20732 raft_consensus.cc:3060] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.939832 20592 raft_consensus.cc:2468] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 0.
I20260709 13:05:40.940872 20710 ts_tablet_manager.cc:1434] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:05:40.941884 20710 tablet_bootstrap.cc:492] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e: Bootstrap starting.
I20260709 13:05:40.946641 20712 tablet_bootstrap.cc:492] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603: No bootstrap required, opened a new log
I20260709 13:05:40.947232 20712 ts_tablet_manager.cc:1403] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.011s
I20260709 13:05:40.949973 20710 tablet_bootstrap.cc:654] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.949929 20712 raft_consensus.cc:359] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.950691 20712 raft_consensus.cc:385] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.951016 20712 raft_consensus.cc:740] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.951742 20712 consensus_queue.cc:260] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.954113 20712 ts_tablet_manager.cc:1434] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:40.955536 20712 tablet_bootstrap.cc:492] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603: Bootstrap starting.
I20260709 13:05:40.956180 20709 tablet_bootstrap.cc:492] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840: No bootstrap required, opened a new log
I20260709 13:05:40.956609 20709 ts_tablet_manager.cc:1403] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:05:40.959409 20709 raft_consensus.cc:359] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.960147 20709 raft_consensus.cc:385] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.960445 20709 raft_consensus.cc:740] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.961138 20709 consensus_queue.cc:260] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.963183 20709 ts_tablet_manager.cc:1434] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:40.964828 20712 tablet_bootstrap.cc:654] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.966167 20710 tablet_bootstrap.cc:492] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e: No bootstrap required, opened a new log
I20260709 13:05:40.966686 20710 ts_tablet_manager.cc:1403] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.004s
I20260709 13:05:40.970193 20710 raft_consensus.cc:359] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.971010 20710 raft_consensus.cc:385] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.971340 20710 raft_consensus.cc:740] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.972064 20710 consensus_queue.cc:260] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.975286 20710 ts_tablet_manager.cc:1434] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:40.976585 20710 tablet_bootstrap.cc:492] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e: Bootstrap starting.
I20260709 13:05:40.980479 20712 tablet_bootstrap.cc:492] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603: No bootstrap required, opened a new log
I20260709 13:05:40.981101 20712 ts_tablet_manager.cc:1403] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.010s
I20260709 13:05:40.983554 20710 tablet_bootstrap.cc:654] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.983795 20712 raft_consensus.cc:359] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.984494 20712 raft_consensus.cc:385] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.984787 20712 raft_consensus.cc:740] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.985466 20712 consensus_queue.cc:260] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.987895 20712 ts_tablet_manager.cc:1434] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:40.991622 20717 raft_consensus.cc:493] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.992061 20717 raft_consensus.cc:515] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:40.993817 20717 leader_election.cc:290] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:40.995002 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b165ff347030430d9ad05f407511a4ba" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:40.995318 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b165ff347030430d9ad05f407511a4ba" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603" is_pre_election: true
I20260709 13:05:40.995680 20666 raft_consensus.cc:2468] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 0.
I20260709 13:05:40.996156 20517 raft_consensus.cc:2468] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 0.
I20260709 13:05:40.997285 20558 leader_election.cc:304] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:40.998164 20717 raft_consensus.cc:2804] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.998538 20717 raft_consensus.cc:493] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.998885 20717 raft_consensus.cc:3060] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.999434 20732 raft_consensus.cc:515] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.001564 20732 leader_election.cc:290] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:41.003364 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3cfc3a7caa4757a263e65e4f979fa1" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:41.003975 20592 raft_consensus.cc:3060] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.005182 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3cfc3a7caa4757a263e65e4f979fa1" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:41.005785 20517 raft_consensus.cc:3060] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.009191 20720 raft_consensus.cc:493] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.009756 20720 raft_consensus.cc:515] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.013756 20718 raft_consensus.cc:493] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.013844 20592 raft_consensus.cc:2468] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 1.
I20260709 13:05:41.014575 20720 leader_election.cc:290] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.014482 20718 raft_consensus.cc:515] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.015264 20629 leader_election.cc:304] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:41.018445 20710 tablet_bootstrap.cc:492] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e: No bootstrap required, opened a new log
I20260709 13:05:41.018934 20710 ts_tablet_manager.cc:1403] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.012s
I20260709 13:05:41.019966 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:41.019145 20591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b93d3df3054ce3937b95beb244909e" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:41.020141 20718 leader_election.cc:290] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.025555 20666 raft_consensus.cc:2468] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 0.
I20260709 13:05:41.024775 20732 raft_consensus.cc:2804] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.024600 20517 raft_consensus.cc:2468] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 1.
W20260709 13:05:41.027721 20480 leader_election.cc:343] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.027269 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b93d3df3054ce3937b95beb244909e" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:41.033389 20717 raft_consensus.cc:515] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.034693 20665 raft_consensus.cc:2468] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 0.
I20260709 13:05:41.035904 20732 raft_consensus.cc:697] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 1 LEADER]: Becoming Leader. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Running, Role: LEADER
I20260709 13:05:41.025604 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:41.036098 20483 leader_election.cc:304] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:41.036825 20592 raft_consensus.cc:2468] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 0.
I20260709 13:05:41.037287 20718 raft_consensus.cc:2804] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.037114 20732 consensus_queue.cc:237] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.037680 20718 raft_consensus.cc:493] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.037729 20483 leader_election.cc:304] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:41.038208 20718 raft_consensus.cc:3060] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.038656 20720 raft_consensus.cc:2804] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.039057 20720 raft_consensus.cc:493] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.039413 20720 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.046931 20718 raft_consensus.cc:515] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.034648 20710 raft_consensus.cc:359] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.050185 20710 raft_consensus.cc:385] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.050530 20710 raft_consensus.cc:740] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.050388 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b165ff347030430d9ad05f407511a4ba" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:41.052094 20517 raft_consensus.cc:3060] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.052223 20710 consensus_queue.cc:260] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.053812 20718 leader_election.cc:290] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Requested vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.055441 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b93d3df3054ce3937b95beb244909e" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:41.060159 20666 raft_consensus.cc:3060] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.051095 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b93d3df3054ce3937b95beb244909e" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:41.057560 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b165ff347030430d9ad05f407511a4ba" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:41.056159 20717 leader_election.cc:290] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.060269 20718 raft_consensus.cc:493] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.058683 20710 ts_tablet_manager.cc:1434] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:05:41.061995 20665 raft_consensus.cc:3060] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.063105 20710 tablet_bootstrap.cc:492] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e: Bootstrap starting.
I20260709 13:05:41.069202 20517 raft_consensus.cc:2468] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 1.
I20260709 13:05:41.070525 20555 leader_election.cc:304] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:41.071405 20717 raft_consensus.cc:2804] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.071619 20665 raft_consensus.cc:2468] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 1.
I20260709 13:05:41.071972 20717 raft_consensus.cc:697] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Becoming Leader. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:41.072889 20717 consensus_queue.cc:237] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.061653 20720 raft_consensus.cc:515] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.075044 20718 raft_consensus.cc:515] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.066481 20414 catalog_manager.cc:5697] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f82287054524c0f94caef5db7aad840 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "2f82287054524c0f94caef5db7aad840" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.084571 20737 raft_consensus.cc:493] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.085131 20718 leader_election.cc:290] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.085057 20737 raft_consensus.cc:515] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.084299 20732 raft_consensus.cc:493] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.086005 20732 raft_consensus.cc:515] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.088739 20710 tablet_bootstrap.cc:654] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:41.083441 20480 leader_election.cc:343] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.090139 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603" is_pre_election: true
I20260709 13:05:41.090565 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:41.091050 20517 raft_consensus.cc:2468] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 0.
I20260709 13:05:41.091194 20664 raft_consensus.cc:2468] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 0.
I20260709 13:05:41.092489 20555 leader_election.cc:304] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:41.093559 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:41.090277 20737 leader_election.cc:290] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.094203 20664 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.094347 20737 raft_consensus.cc:2804] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.094851 20737 raft_consensus.cc:493] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.095412 20737 raft_consensus.cc:3060] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.084023 20666 raft_consensus.cc:2468] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 1.
I20260709 13:05:41.097738 20720 leader_election.cc:290] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Requested vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.102032 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd3920f6285466385adaf95603dc9a2" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603" is_pre_election: true
I20260709 13:05:41.104809 20517 raft_consensus.cc:2393] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f82287054524c0f94caef5db7aad840 in current term 1: Already voted for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in this term.
I20260709 13:05:41.107240 20483 leader_election.cc:304] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:41.107762 20591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd3920f6285466385adaf95603dc9a2" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:41.107793 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:41.108783 20720 raft_consensus.cc:2804] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.109767 20591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:41.110984 20591 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.111691 20629 leader_election.cc:304] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f82287054524c0f94caef5db7aad840; no voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:41.112545 20731 raft_consensus.cc:3060] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.102837 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:41.102074 20732 leader_election.cc:290] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:41.116907 20665 raft_consensus.cc:2468] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 0.
I20260709 13:05:41.118247 20483 leader_election.cc:304] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:41.121014 20710 tablet_bootstrap.cc:492] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e: No bootstrap required, opened a new log
I20260709 13:05:41.121202 20760 raft_consensus.cc:2804] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.121037 20731 raft_consensus.cc:2749] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.119810 20720 raft_consensus.cc:697] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Becoming Leader. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:41.124935 20760 raft_consensus.cc:493] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.125510 20760 raft_consensus.cc:3060] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.125718 20591 raft_consensus.cc:2468] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 1.
I20260709 13:05:41.119472 20664 raft_consensus.cc:2468] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 1.
I20260709 13:05:41.125835 20720 consensus_queue.cc:237] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.122550 20710 ts_tablet_manager.cc:1403] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.007s
I20260709 13:05:41.128336 20483 leader_election.cc:304] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
W20260709 13:05:41.128871 20461 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:41.129411 20718 raft_consensus.cc:2804] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.129522 20411 catalog_manager.cc:5697] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130). New cstate: current_term: 1 leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.134516 20710 raft_consensus.cc:359] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.135439 20710 raft_consensus.cc:385] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.135777 20710 raft_consensus.cc:740] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.139456 20718 raft_consensus.cc:697] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Becoming Leader. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:41.141328 20737 raft_consensus.cc:515] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.142513 20592 raft_consensus.cc:2393] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 717c3872f5204497bd6c4daf65227603 in current term 1: Already voted for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in this term.
I20260709 13:05:41.140492 20718 consensus_queue.cc:237] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.148317 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:41.153898 20664 raft_consensus.cc:3060] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.154052 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:41.158438 20764 raft_consensus.cc:493] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.147986 20710 consensus_queue.cc:260] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.167158 20764 raft_consensus.cc:515] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.157872 20411 catalog_manager.cc:5697] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 reported cstate change: term changed from 0 to 1, leader changed from <none> to 717c3872f5204497bd6c4daf65227603 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "717c3872f5204497bd6c4daf65227603" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.155064 20762 consensus_queue.cc:1048] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:05:41.168838 20766 consensus_queue.cc:1048] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.170540 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:41.171106 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" is_pre_election: true
I20260709 13:05:41.171813 20592 raft_consensus.cc:2468] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 0.
I20260709 13:05:41.171202 20666 raft_consensus.cc:2468] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 0.
I20260709 13:05:41.173328 20710 ts_tablet_manager.cc:1434] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:05:41.173584 20483 leader_election.cc:304] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:41.154320 20760 raft_consensus.cc:515] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.177627 20766 raft_consensus.cc:2804] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.169729 20764 leader_election.cc:290] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.178488 20517 raft_consensus.cc:2393] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in current term 1: Already voted for candidate 717c3872f5204497bd6c4daf65227603 in this term.
I20260709 13:05:41.179509 20760 leader_election.cc:290] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Requested vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.146203 20737 leader_election.cc:290] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.181478 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:41.178077 20766 raft_consensus.cc:493] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.181457 20591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:41.165072 20664 raft_consensus.cc:2468] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 1.
I20260709 13:05:41.194958 20766 raft_consensus.cc:3060] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.195283 20591 raft_consensus.cc:2393] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 717c3872f5204497bd6c4daf65227603 in current term 1: Already voted for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in this term.
I20260709 13:05:41.199496 20558 leader_election.cc:304] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 717c3872f5204497bd6c4daf65227603
I20260709 13:05:41.200507 20411 catalog_manager.cc:5697] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 reported cstate change: term changed from 0 to 1, leader changed from <none> to 717c3872f5204497bd6c4daf65227603 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "717c3872f5204497bd6c4daf65227603" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.203311 20766 raft_consensus.cc:515] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.200986 20737 raft_consensus.cc:2804] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.204907 20483 leader_election.cc:304] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 717c3872f5204497bd6c4daf65227603; no voters: 2f82287054524c0f94caef5db7aad840, f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:41.205111 20737 raft_consensus.cc:697] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Becoming Leader. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:41.205760 20760 raft_consensus.cc:2749] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.206105 20766 leader_election.cc:290] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Requested vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.205965 20737 consensus_queue.cc:237] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.208598 20591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:41.209138 20591 raft_consensus.cc:3060] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.213387 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:41.214102 20666 raft_consensus.cc:3060] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.216295 20591 raft_consensus.cc:2468] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 1.
I20260709 13:05:41.217572 20480 leader_election.cc:304] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:41.218451 20766 raft_consensus.cc:2804] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.218942 20766 raft_consensus.cc:697] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Becoming Leader. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:41.219750 20766 consensus_queue.cc:237] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.228353 20666 raft_consensus.cc:2468] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 1.
I20260709 13:05:41.237576 20411 catalog_manager.cc:5697] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130). New cstate: current_term: 1 leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.249585 20766 consensus_queue.cc:1048] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.252615 20414 catalog_manager.cc:5697] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 reported cstate change: term changed from 0 to 1, leader changed from <none> to 717c3872f5204497bd6c4daf65227603 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "717c3872f5204497bd6c4daf65227603" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.254945 20762 consensus_queue.cc:1048] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.293229 20717 raft_consensus.cc:493] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.293769 20717 raft_consensus.cc:515] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.295982 20717 leader_election.cc:290] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.297628 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:41.297712 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603" is_pre_election: true
I20260709 13:05:41.298532 20666 raft_consensus.cc:2393] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in current term 1: Already voted for candidate 717c3872f5204497bd6c4daf65227603 in this term.
I20260709 13:05:41.300827 20555 leader_election.cc:304] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603
I20260709 13:05:41.301697 20717 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.309273 20717 raft_consensus.cc:2749] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.320422 20718 consensus_queue.cc:1048] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.334681 20718 consensus_queue.cc:1048] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.417012 20591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
mode: GRACEFUL
new_leader_uuid: "717c3872f5204497bd6c4daf65227603"
 from {username='slave'} at 127.0.0.1:42106
I20260709 13:05:41.417934 20591 raft_consensus.cc:606] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Received request to transfer leadership to TS 717c3872f5204497bd6c4daf65227603
I20260709 13:05:41.441418 20517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d"
dest_uuid: "717c3872f5204497bd6c4daf65227603"
mode: GRACEFUL
new_leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:50206
I20260709 13:05:41.442047 20517 raft_consensus.cc:606] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Received request to transfer leadership to TS f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:41.456676 20666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e3cfc3a7caa4757a263e65e4f979fa1"
dest_uuid: "2f82287054524c0f94caef5db7aad840"
mode: GRACEFUL
new_leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:38696
I20260709 13:05:41.457224 20666 raft_consensus.cc:606] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 1 LEADER]: Received request to transfer leadership to TS f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:41.462900 20517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b93d3df3054ce3937b95beb244909e"
dest_uuid: "717c3872f5204497bd6c4daf65227603"
mode: GRACEFUL
new_leader_uuid: "2f82287054524c0f94caef5db7aad840"
 from {username='slave'} at 127.0.0.1:50206
I20260709 13:05:41.463459 20517 raft_consensus.cc:606] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Received request to transfer leadership to TS 2f82287054524c0f94caef5db7aad840
I20260709 13:05:41.482339 20717 consensus_queue.cc:1048] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.493937 20737 consensus_queue.cc:1048] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.496337 20731 consensus_queue.cc:1048] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.517911 20731 consensus_queue.cc:1048] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.530891 20732 raft_consensus.cc:993] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840: : Instructing follower f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:41.531386 20732 raft_consensus.cc:1081] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 1 LEADER]: Signalling peer f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:41.533810 20591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e3cfc3a7caa4757a263e65e4f979fa1"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:42090
I20260709 13:05:41.534452 20591 raft_consensus.cc:493] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.534874 20591 raft_consensus.cc:3060] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.542039 20591 raft_consensus.cc:515] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.544718 20591 leader_election.cc:290] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 2 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.545204 20516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3cfc3a7caa4757a263e65e4f979fa1" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:41.545380 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3cfc3a7caa4757a263e65e4f979fa1" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:41.545982 20516 raft_consensus.cc:3060] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.546039 20666 raft_consensus.cc:3055] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.546550 20666 raft_consensus.cc:740] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Running, Role: LEADER
I20260709 13:05:41.547556 20666 consensus_queue.cc:260] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.549036 20666 raft_consensus.cc:3060] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.553555 20516 raft_consensus.cc:2468] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 2.
I20260709 13:05:41.554934 20555 leader_election.cc:304] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:41.555807 20737 raft_consensus.cc:2804] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.556046 20666 raft_consensus.cc:2468] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 2.
I20260709 13:05:41.556313 20737 raft_consensus.cc:697] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Becoming Leader. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:41.557592 20737 consensus_queue.cc:237] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.566843 20411 catalog_manager.cc:5697] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e reported cstate change: term changed from 1 to 2, leader changed from 2f82287054524c0f94caef5db7aad840 (127.19.231.131) to f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130). New cstate: current_term: 2 leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.583976 20737 raft_consensus.cc:493] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.584498 20737 raft_consensus.cc:515] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.586648 20737 leader_election.cc:290] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.587954 20516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b93d3df3054ce3937b95beb244909e" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "717c3872f5204497bd6c4daf65227603" is_pre_election: true
I20260709 13:05:41.588053 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b93d3df3054ce3937b95beb244909e" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f82287054524c0f94caef5db7aad840" is_pre_election: true
I20260709 13:05:41.588869 20666 raft_consensus.cc:2393] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in current term 1: Already voted for candidate 717c3872f5204497bd6c4daf65227603 in this term.
I20260709 13:05:41.590104 20558 leader_election.cc:304] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603
I20260709 13:05:41.590909 20737 raft_consensus.cc:3060] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.597270 20737 raft_consensus.cc:2749] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.606194 20718 consensus_queue.cc:1048] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.615537 20764 raft_consensus.cc:993] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603: : Instructing follower 2f82287054524c0f94caef5db7aad840 to start an election
I20260709 13:05:41.616037 20764 raft_consensus.cc:1081] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Signalling peer 2f82287054524c0f94caef5db7aad840 to start an election
I20260709 13:05:41.619808 20665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1b93d3df3054ce3937b95beb244909e"
dest_uuid: "2f82287054524c0f94caef5db7aad840"
 from {username='slave'} at 127.0.0.1:38670
I20260709 13:05:41.621598 20665 raft_consensus.cc:493] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.622044 20665 raft_consensus.cc:3060] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.626185 20764 consensus_queue.cc:1048] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.629424 20665 raft_consensus.cc:515] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.633460 20665 leader_election.cc:290] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 2 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:41.635345 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b93d3df3054ce3937b95beb244909e" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:41.637866 20516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b93d3df3054ce3937b95beb244909e" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:41.638573 20516 raft_consensus.cc:3055] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.638590 20762 consensus_queue.cc:1048] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.639120 20516 raft_consensus.cc:740] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:41.640173 20516 consensus_queue.cc:260] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.641310 20516 raft_consensus.cc:3060] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.648555 20516 raft_consensus.cc:2468] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 2.
I20260709 13:05:41.653263 20764 consensus_queue.cc:1048] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.660810 20629 leader_election.cc:304] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:41.661716 20732 raft_consensus.cc:2804] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.662225 20732 raft_consensus.cc:697] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 2 LEADER]: Becoming Leader. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Running, Role: LEADER
I20260709 13:05:41.663115 20732 consensus_queue.cc:237] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.672704 20737 consensus_queue.cc:1048] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.677170 20411 catalog_manager.cc:5697] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 reported cstate change: term changed from 1 to 2, leader changed from 717c3872f5204497bd6c4daf65227603 (127.19.231.129) to 2f82287054524c0f94caef5db7aad840 (127.19.231.131). New cstate: current_term: 2 leader_uuid: "2f82287054524c0f94caef5db7aad840" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.683192 20760 consensus_queue.cc:1048] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.691253 20737 raft_consensus.cc:993] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e: : Instructing follower 717c3872f5204497bd6c4daf65227603 to start an election
I20260709 13:05:41.691704 20737 raft_consensus.cc:1081] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Signalling peer 717c3872f5204497bd6c4daf65227603 to start an election
I20260709 13:05:41.694188 20517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5"
dest_uuid: "717c3872f5204497bd6c4daf65227603"
 from {username='slave'} at 127.0.0.1:50202
I20260709 13:05:41.694878 20517 raft_consensus.cc:493] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.695276 20517 raft_consensus.cc:3060] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.698287 20760 raft_consensus.cc:993] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603: : Instructing follower f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:41.698755 20760 raft_consensus.cc:1081] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Signalling peer f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:41.701062 20591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:42094
I20260709 13:05:41.701654 20591 raft_consensus.cc:493] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.702042 20591 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.703537 20517 raft_consensus.cc:515] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.710925 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:41.711525 20592 raft_consensus.cc:3055] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.711856 20592 raft_consensus.cc:740] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:41.712240 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:41.712831 20665 raft_consensus.cc:3060] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.712626 20592 consensus_queue.cc:260] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.713889 20592 raft_consensus.cc:3060] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.718393 20517 leader_election.cc:290] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 2 election: Requested vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.719784 20720 consensus_queue.cc:1048] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.720719 20665 raft_consensus.cc:2468] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 2.
I20260709 13:05:41.721035 20592 raft_consensus.cc:2468] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 2.
I20260709 13:05:41.709897 20591 raft_consensus.cc:515] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.722638 20483 leader_election.cc:304] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:41.724370 20720 raft_consensus.cc:2804] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.724860 20720 raft_consensus.cc:697] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 2 LEADER]: Becoming Leader. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:41.725637 20720 consensus_queue.cc:237] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.728518 20591 leader_election.cc:290] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 2 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:41.729753 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:41.730330 20666 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.736078 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:41.737533 20666 raft_consensus.cc:2468] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 2.
I20260709 13:05:41.736702 20517 raft_consensus.cc:3055] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.738467 20517 raft_consensus.cc:740] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:41.739078 20558 leader_election.cc:304] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:41.739434 20517 consensus_queue.cc:260] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.740232 20762 raft_consensus.cc:2804] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.740916 20762 raft_consensus.cc:697] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Becoming Leader. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:41.741899 20762 consensus_queue.cc:237] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:41.740695 20517 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.746048 20720 consensus_queue.cc:1048] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.750087 20517 raft_consensus.cc:2468] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 2.
I20260709 13:05:41.754546 20414 catalog_manager.cc:5697] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 reported cstate change: term changed from 1 to 2, leader changed from f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130) to 717c3872f5204497bd6c4daf65227603 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "717c3872f5204497bd6c4daf65227603" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.755466 20411 catalog_manager.cc:5697] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e reported cstate change: term changed from 1 to 2, leader changed from 717c3872f5204497bd6c4daf65227603 (127.19.231.129) to f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130). New cstate: current_term: 2 leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.058358 20517 raft_consensus.cc:1275] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Refusing update from remote peer 2f82287054524c0f94caef5db7aad840: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.059775 20732 consensus_queue.cc:1048] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.067655 20591 raft_consensus.cc:3060] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.074975 20591 raft_consensus.cc:1275] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Refusing update from remote peer 2f82287054524c0f94caef5db7aad840: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.076628 20799 consensus_queue.cc:1048] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.087173 20665 raft_consensus.cc:1275] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.088672 20762 consensus_queue.cc:1048] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.097802 20517 raft_consensus.cc:1275] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.101190 20737 consensus_queue.cc:1048] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.162281 20665 raft_consensus.cc:1275] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Refusing update from remote peer 717c3872f5204497bd6c4daf65227603: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.163947 20720 consensus_queue.cc:1048] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.177793 20591 raft_consensus.cc:1275] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Refusing update from remote peer 717c3872f5204497bd6c4daf65227603: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.179126 20760 consensus_queue.cc:1048] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.200053 20517 raft_consensus.cc:1275] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.201363 20737 consensus_queue.cc:1048] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.209908 20665 raft_consensus.cc:1275] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.211665 20717 consensus_queue.cc:1048] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.494395 20382 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:05:44.495378 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:44.515960 20592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
mode: GRACEFUL
new_leader_uuid: "2f82287054524c0f94caef5db7aad840"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:05:44.516458 20592 raft_consensus.cc:606] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Received request to transfer leadership to TS 2f82287054524c0f94caef5db7aad840
I20260709 13:05:44.527293 20517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835"
dest_uuid: "717c3872f5204497bd6c4daf65227603"
mode: GRACEFUL
new_leader_uuid: "2f82287054524c0f94caef5db7aad840"
 from {username='slave'} at 127.0.0.1:50214
I20260709 13:05:44.527895 20517 raft_consensus.cc:606] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Received request to transfer leadership to TS 2f82287054524c0f94caef5db7aad840
I20260709 13:05:44.529219 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:44.529846 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:44.890690 20762 raft_consensus.cc:993] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e: : Instructing follower 2f82287054524c0f94caef5db7aad840 to start an election
I20260709 13:05:44.891180 20803 raft_consensus.cc:1081] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Signalling peer 2f82287054524c0f94caef5db7aad840 to start an election
I20260709 13:05:44.892726 20665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d"
dest_uuid: "2f82287054524c0f94caef5db7aad840"
 from {username='slave'} at 127.0.0.1:38686
I20260709 13:05:44.893234 20665 raft_consensus.cc:493] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.893543 20665 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.898171 20665 raft_consensus.cc:515] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:44.899840 20665 leader_election.cc:290] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 3 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:44.900743 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:44.901150 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:44.901345 20517 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.901695 20592 raft_consensus.cc:3055] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.902014 20592 raft_consensus.cc:740] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:44.902812 20592 consensus_queue.cc:260] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:44.904063 20592 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.908509 20517 raft_consensus.cc:2468] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 3.
I20260709 13:05:44.909793 20629 leader_election.cc:304] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:44.910519 20799 raft_consensus.cc:2804] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.910615 20592 raft_consensus.cc:2468] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 3.
I20260709 13:05:44.911916 20799 raft_consensus.cc:697] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 3 LEADER]: Becoming Leader. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Running, Role: LEADER
I20260709 13:05:44.912726 20799 consensus_queue.cc:237] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:44.922276 20414 catalog_manager.cc:5697] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 reported cstate change: term changed from 2 to 3, leader changed from f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130) to 2f82287054524c0f94caef5db7aad840 (127.19.231.131). New cstate: current_term: 3 leader_uuid: "2f82287054524c0f94caef5db7aad840" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.939404 20766 raft_consensus.cc:993] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603: : Instructing follower 2f82287054524c0f94caef5db7aad840 to start an election
I20260709 13:05:44.939932 20766 raft_consensus.cc:1081] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Signalling peer 2f82287054524c0f94caef5db7aad840 to start an election
I20260709 13:05:44.941505 20665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835"
dest_uuid: "2f82287054524c0f94caef5db7aad840"
 from {username='slave'} at 127.0.0.1:38670
I20260709 13:05:44.942106 20665 raft_consensus.cc:493] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.942497 20665 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:44.947201 20665 raft_consensus.cc:515] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:44.948833 20665 leader_election.cc:290] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 2 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:44.949771 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:44.950132 20592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:44.950420 20517 raft_consensus.cc:3055] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:44.950682 20592 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:44.950774 20517 raft_consensus.cc:740] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:44.951659 20517 consensus_queue.cc:260] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:44.952907 20517 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:44.957767 20592 raft_consensus.cc:2468] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 2.
I20260709 13:05:44.959165 20629 leader_election.cc:304] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:44.959436 20517 raft_consensus.cc:2468] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 2.
I20260709 13:05:44.959915 20799 raft_consensus.cc:2804] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:44.960413 20799 raft_consensus.cc:697] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 2 LEADER]: Becoming Leader. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Running, Role: LEADER
I20260709 13:05:44.961215 20799 consensus_queue.cc:237] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:44.968163 20414 catalog_manager.cc:5697] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 reported cstate change: term changed from 1 to 2, leader changed from 717c3872f5204497bd6c4daf65227603 (127.19.231.129) to 2f82287054524c0f94caef5db7aad840 (127.19.231.131). New cstate: current_term: 2 leader_uuid: "2f82287054524c0f94caef5db7aad840" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:45.350391 20592 raft_consensus.cc:1275] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Refusing update from remote peer 2f82287054524c0f94caef5db7aad840: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.351785 20799 consensus_queue.cc:1048] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.363067 20517 raft_consensus.cc:1275] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Refusing update from remote peer 2f82287054524c0f94caef5db7aad840: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.364961 20799 consensus_queue.cc:1048] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.458132 20592 raft_consensus.cc:1275] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Refusing update from remote peer 2f82287054524c0f94caef5db7aad840: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.459600 20799 consensus_queue.cc:1048] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.468737 20517 raft_consensus.cc:1275] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Refusing update from remote peer 2f82287054524c0f94caef5db7aad840: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.471033 20804 consensus_queue.cc:1048] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.530642 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:45.540452 20517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f828ddc540c4648885bc99170858398"
dest_uuid: "717c3872f5204497bd6c4daf65227603"
mode: GRACEFUL
new_leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:50206
I20260709 13:05:45.540951 20517 raft_consensus.cc:606] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Received request to transfer leadership to TS f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:45.545861 20517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c"
dest_uuid: "717c3872f5204497bd6c4daf65227603"
mode: GRACEFUL
new_leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:50206
I20260709 13:05:45.546352 20517 raft_consensus.cc:606] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Received request to transfer leadership to TS f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:45.551249 20517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5"
dest_uuid: "717c3872f5204497bd6c4daf65227603"
mode: GRACEFUL
new_leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:50206
I20260709 13:05:45.551715 20517 raft_consensus.cc:606] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 2 LEADER]: Received request to transfer leadership to TS f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:45.556627 20665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835"
dest_uuid: "2f82287054524c0f94caef5db7aad840"
mode: GRACEFUL
new_leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:38696
I20260709 13:05:45.557314 20665 raft_consensus.cc:606] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 2 LEADER]: Received request to transfer leadership to TS f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:45.567610 20665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d"
dest_uuid: "2f82287054524c0f94caef5db7aad840"
mode: GRACEFUL
new_leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:38696
I20260709 13:05:45.568156 20665 raft_consensus.cc:606] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 3 LEADER]: Received request to transfer leadership to TS f4aa75920ba34a40ab04cb3c5ddb0b4e
I20260709 13:05:45.672137 20766 raft_consensus.cc:993] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603: : Instructing follower f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:45.672533 20766 raft_consensus.cc:1081] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 2 LEADER]: Signalling peer f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:45.673890 20592 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:42094
I20260709 13:05:45.674392 20592 raft_consensus.cc:493] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.674686 20592 raft_consensus.cc:3060] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.680001 20592 raft_consensus.cc:515] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:45.682358 20592 leader_election.cc:290] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 3 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:45.682717 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:45.682971 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813d0f6b2da4729be61473224af10a5" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:45.683380 20517 raft_consensus.cc:3055] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.683611 20665 raft_consensus.cc:3060] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.683738 20517 raft_consensus.cc:740] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:45.684625 20517 consensus_queue.cc:260] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:45.685726 20517 raft_consensus.cc:3060] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.688628 20665 raft_consensus.cc:2468] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 3.
I20260709 13:05:45.689759 20517 raft_consensus.cc:2468] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 3.
I20260709 13:05:45.689764 20558 leader_election.cc:304] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:45.690649 20803 raft_consensus.cc:2804] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:45.691591 20803 raft_consensus.cc:697] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 LEADER]: Becoming Leader. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:45.692274 20803 consensus_queue.cc:237] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:45.698880 20413 catalog_manager.cc:5697] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e reported cstate change: term changed from 2 to 3, leader changed from 717c3872f5204497bd6c4daf65227603 (127.19.231.129) to f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130). New cstate: current_term: 3 leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.841552 20814 raft_consensus.cc:993] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840: : Instructing follower f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:45.841939 20804 raft_consensus.cc:1081] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 2 LEADER]: Signalling peer f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:45.843616 20592 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:42090
I20260709 13:05:45.844110 20592 raft_consensus.cc:493] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.844444 20592 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.845551 20820 raft_consensus.cc:993] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603: : Instructing follower f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:45.845995 20766 raft_consensus.cc:1081] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Signalling peer f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:45.847615 20591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f828ddc540c4648885bc99170858398"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:42094
I20260709 13:05:45.848179 20591 raft_consensus.cc:493] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.848553 20591 raft_consensus.cc:3060] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.850863 20592 raft_consensus.cc:515] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:45.852999 20592 leader_election.cc:290] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 3 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:45.853695 20517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:45.854076 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:45.854278 20517 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.854647 20665 raft_consensus.cc:3055] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.854998 20665 raft_consensus.cc:740] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Running, Role: LEADER
I20260709 13:05:45.855430 20591 raft_consensus.cc:515] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:45.855756 20665 consensus_queue.cc:260] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:45.856839 20665 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.857558 20591 leader_election.cc:290] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 2 election: Requested vote from peers 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263), 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779)
I20260709 13:05:45.858595 20516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f828ddc540c4648885bc99170858398" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:45.859187 20516 raft_consensus.cc:3055] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.859486 20516 raft_consensus.cc:740] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:45.859822 20517 raft_consensus.cc:2468] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 3.
I20260709 13:05:45.860503 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f828ddc540c4648885bc99170858398" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:45.860271 20516 consensus_queue.cc:260] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:45.860886 20555 leader_election.cc:304] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:45.861052 20666 raft_consensus.cc:3060] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.861539 20516 raft_consensus.cc:3060] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.861810 20803 raft_consensus.cc:2804] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:45.862298 20803 raft_consensus.cc:697] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 LEADER]: Becoming Leader. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:45.863129 20665 raft_consensus.cc:2468] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 3.
I20260709 13:05:45.863122 20803 consensus_queue.cc:237] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:45.868064 20516 raft_consensus.cc:2468] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 2.
I20260709 13:05:45.868064 20666 raft_consensus.cc:2468] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 2.
I20260709 13:05:45.869400 20558 leader_election.cc:304] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:45.870726 20803 raft_consensus.cc:2804] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.871263 20803 raft_consensus.cc:697] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Becoming Leader. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:45.871533 20413 catalog_manager.cc:5697] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e reported cstate change: term changed from 2 to 3, leader changed from 2f82287054524c0f94caef5db7aad840 (127.19.231.131) to f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130). New cstate: current_term: 3 leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.872064 20803 consensus_queue.cc:237] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:45.883697 20413 catalog_manager.cc:5697] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e reported cstate change: term changed from 1 to 2, leader changed from 717c3872f5204497bd6c4daf65227603 (127.19.231.129) to f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130). New cstate: current_term: 2 leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.986003 20814 raft_consensus.cc:993] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840: : Instructing follower f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:45.986533 20814 raft_consensus.cc:1081] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 3 LEADER]: Signalling peer f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:45.988590 20591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:42090
I20260709 13:05:45.989161 20591 raft_consensus.cc:493] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.989553 20591 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.994557 20591 raft_consensus.cc:515] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:45.996366 20591 leader_election.cc:290] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 4 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:45.997287 20516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:45.997339 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151dfc4f93d746078732d50f17ddd32d" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:45.998025 20516 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.998030 20666 raft_consensus.cc:3055] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:45.998545 20666 raft_consensus.cc:740] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Running, Role: LEADER
I20260709 13:05:45.999405 20666 consensus_queue.cc:260] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:46.000633 20666 raft_consensus.cc:3060] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.005257 20516 raft_consensus.cc:2468] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 4.
I20260709 13:05:46.006646 20555 leader_election.cc:304] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 717c3872f5204497bd6c4daf65227603, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:46.007354 20666 raft_consensus.cc:2468] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 4.
I20260709 13:05:46.007441 20803 raft_consensus.cc:2804] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:46.007982 20803 raft_consensus.cc:697] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 4 LEADER]: Becoming Leader. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:46.008842 20803 consensus_queue.cc:237] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:46.014762 20413 catalog_manager.cc:5697] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e reported cstate change: term changed from 3 to 4, leader changed from 2f82287054524c0f94caef5db7aad840 (127.19.231.131) to f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130). New cstate: current_term: 4 leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.058918 20820 raft_consensus.cc:993] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603: : Instructing follower f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:46.059350 20766 raft_consensus.cc:1081] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Signalling peer f4aa75920ba34a40ab04cb3c5ddb0b4e to start an election
I20260709 13:05:46.060822 20591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
 from {username='slave'} at 127.0.0.1:42094
I20260709 13:05:46.061269 20591 raft_consensus.cc:493] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:46.061532 20591 raft_consensus.cc:3060] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:46.066119 20591 raft_consensus.cc:515] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:46.067819 20591 leader_election.cc:290] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 2 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:46.068820 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:46.068761 20516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c" candidate_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:46.069413 20666 raft_consensus.cc:3060] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:46.069556 20516 raft_consensus.cc:3055] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:46.069921 20516 raft_consensus.cc:740] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:46.070761 20516 consensus_queue.cc:260] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:46.072012 20516 raft_consensus.cc:3060] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:46.076541 20666 raft_consensus.cc:2468] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 2.
I20260709 13:05:46.077807 20558 leader_election.cc:304] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, f4aa75920ba34a40ab04cb3c5ddb0b4e; no voters: 
I20260709 13:05:46.078532 20803 raft_consensus.cc:2804] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:46.078503 20516 raft_consensus.cc:2468] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4aa75920ba34a40ab04cb3c5ddb0b4e in term 2.
I20260709 13:05:46.079201 20803 raft_consensus.cc:697] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Becoming Leader. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:46.080112 20803 consensus_queue.cc:237] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:46.087206 20413 catalog_manager.cc:5697] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e reported cstate change: term changed from 1 to 2, leader changed from 717c3872f5204497bd6c4daf65227603 (127.19.231.129) to f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130). New cstate: current_term: 2 leader_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.111377 20666 raft_consensus.cc:1275] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.112567 20803 consensus_queue.cc:1048] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.122187 20516 raft_consensus.cc:1275] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.126730 20821 consensus_queue.cc:1048] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:46.288278 20666 raft_consensus.cc:1275] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.289655 20821 consensus_queue.cc:1048] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.297206 20516 raft_consensus.cc:1275] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.299113 20821 consensus_queue.cc:1048] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.340353 20666 raft_consensus.cc:1275] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.341606 20832 consensus_queue.cc:1048] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.349691 20516 raft_consensus.cc:1275] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.351471 20821 consensus_queue.cc:1048] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.475365 20516 raft_consensus.cc:1275] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 4 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.476595 20830 consensus_queue.cc:1048] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.485455 20666 raft_consensus.cc:1275] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 4 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.486850 20821 consensus_queue.cc:1048] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.541661 20666 raft_consensus.cc:1275] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.543102 20821 consensus_queue.cc:1048] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.552284 20516 raft_consensus.cc:1275] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Refusing update from remote peer f4aa75920ba34a40ab04cb3c5ddb0b4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.553781 20821 consensus_queue.cc:1048] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.575678 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:48.583371 20591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f828ddc540c4648885bc99170858398"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
mode: GRACEFUL
new_leader_uuid: "717c3872f5204497bd6c4daf65227603"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:05:48.584021 20591 raft_consensus.cc:606] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Received request to transfer leadership to TS 717c3872f5204497bd6c4daf65227603
I20260709 13:05:48.586548 20591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fd3920f6285466385adaf95603dc9a2"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
mode: GRACEFUL
new_leader_uuid: "717c3872f5204497bd6c4daf65227603"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:05:48.586997 20591 raft_consensus.cc:606] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Received request to transfer leadership to TS 717c3872f5204497bd6c4daf65227603
I20260709 13:05:48.589146 20591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
mode: GRACEFUL
new_leader_uuid: "2f82287054524c0f94caef5db7aad840"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:05:48.589740 20591 raft_consensus.cc:606] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Received request to transfer leadership to TS 2f82287054524c0f94caef5db7aad840
I20260709 13:05:48.592756 20591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b165ff347030430d9ad05f407511a4ba"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
mode: GRACEFUL
new_leader_uuid: "717c3872f5204497bd6c4daf65227603"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:05:48.593312 20591 raft_consensus.cc:606] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Received request to transfer leadership to TS 717c3872f5204497bd6c4daf65227603
I20260709 13:05:48.595556 20591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835"
dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
mode: GRACEFUL
new_leader_uuid: "2f82287054524c0f94caef5db7aad840"
 from {username='slave'} at 127.0.0.1:42122
I20260709 13:05:48.596024 20591 raft_consensus.cc:606] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 LEADER]: Received request to transfer leadership to TS 2f82287054524c0f94caef5db7aad840
I20260709 13:05:48.597077 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:48.597499 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:48.729871 20830 raft_consensus.cc:993] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e: : Instructing follower 2f82287054524c0f94caef5db7aad840 to start an election
I20260709 13:05:48.730512 20845 raft_consensus.cc:1081] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Signalling peer 2f82287054524c0f94caef5db7aad840 to start an election
I20260709 13:05:48.732156 20665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c"
dest_uuid: "2f82287054524c0f94caef5db7aad840"
 from {username='slave'} at 127.0.0.1:38686
I20260709 13:05:48.732666 20665 raft_consensus.cc:493] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.733006 20665 raft_consensus.cc:3060] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.737929 20665 raft_consensus.cc:515] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:48.739581 20665 leader_election.cc:290] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 3 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:48.740739 20516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:48.740931 20591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a6ee3c1de142bd8d93c9cd6372bd9c" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:48.741429 20516 raft_consensus.cc:3060] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.741494 20591 raft_consensus.cc:3055] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:48.741869 20591 raft_consensus.cc:740] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:48.742686 20591 consensus_queue.cc:260] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:48.743777 20591 raft_consensus.cc:3060] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.746708 20516 raft_consensus.cc:2468] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 3.
I20260709 13:05:48.748148 20629 leader_election.cc:304] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:48.749091 20842 raft_consensus.cc:2804] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.749367 20591 raft_consensus.cc:2468] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 3.
I20260709 13:05:48.750221 20842 raft_consensus.cc:697] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 3 LEADER]: Becoming Leader. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Running, Role: LEADER
I20260709 13:05:48.751186 20842 consensus_queue.cc:237] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:48.759177 20414 catalog_manager.cc:5697] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 reported cstate change: term changed from 2 to 3, leader changed from f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130) to 2f82287054524c0f94caef5db7aad840 (127.19.231.131). New cstate: current_term: 3 leader_uuid: "2f82287054524c0f94caef5db7aad840" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.911767 20830 raft_consensus.cc:993] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e: : Instructing follower 717c3872f5204497bd6c4daf65227603 to start an election
I20260709 13:05:48.912261 20845 raft_consensus.cc:1081] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Signalling peer 717c3872f5204497bd6c4daf65227603 to start an election
I20260709 13:05:48.913844 20516 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b165ff347030430d9ad05f407511a4ba"
dest_uuid: "717c3872f5204497bd6c4daf65227603"
 from {username='slave'} at 127.0.0.1:50202
I20260709 13:05:48.914372 20516 raft_consensus.cc:493] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.914846 20516 raft_consensus.cc:3060] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.919610 20516 raft_consensus.cc:515] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:48.921559 20516 leader_election.cc:290] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 2 election: Requested vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:48.922452 20591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b165ff347030430d9ad05f407511a4ba" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:48.922753 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b165ff347030430d9ad05f407511a4ba" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:48.923091 20591 raft_consensus.cc:3055] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.923317 20665 raft_consensus.cc:3060] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.923461 20591 raft_consensus.cc:740] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:48.924243 20591 consensus_queue.cc:260] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:48.925194 20591 raft_consensus.cc:3060] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.928262 20665 raft_consensus.cc:2468] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 2.
I20260709 13:05:48.929765 20483 leader_election.cc:304] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:48.930356 20591 raft_consensus.cc:2468] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 2.
I20260709 13:05:48.931805 20852 raft_consensus.cc:2804] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.933048 20852 raft_consensus.cc:697] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 2 LEADER]: Becoming Leader. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:48.933842 20852 consensus_queue.cc:237] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:48.941397 20414 catalog_manager.cc:5697] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 reported cstate change: term changed from 1 to 2, leader changed from f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130) to 717c3872f5204497bd6c4daf65227603 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "717c3872f5204497bd6c4daf65227603" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.943898 20845 raft_consensus.cc:993] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e: : Instructing follower 717c3872f5204497bd6c4daf65227603 to start an election
I20260709 13:05:48.944412 20830 raft_consensus.cc:1081] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Signalling peer 717c3872f5204497bd6c4daf65227603 to start an election
I20260709 13:05:48.946010 20516 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f828ddc540c4648885bc99170858398"
dest_uuid: "717c3872f5204497bd6c4daf65227603"
 from {username='slave'} at 127.0.0.1:50202
I20260709 13:05:48.946591 20516 raft_consensus.cc:493] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.947028 20516 raft_consensus.cc:3060] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.952558 20516 raft_consensus.cc:515] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:48.954093 20516 leader_election.cc:290] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 3 election: Requested vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:48.955075 20591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f828ddc540c4648885bc99170858398" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:48.955209 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f828ddc540c4648885bc99170858398" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:48.955777 20665 raft_consensus.cc:3060] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.955780 20591 raft_consensus.cc:3055] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:48.956367 20591 raft_consensus.cc:740] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:48.957146 20591 consensus_queue.cc:260] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:48.958281 20591 raft_consensus.cc:3060] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.958986 20845 raft_consensus.cc:993] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e: : Instructing follower 2f82287054524c0f94caef5db7aad840 to start an election
I20260709 13:05:48.959461 20830 raft_consensus.cc:1081] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 LEADER]: Signalling peer 2f82287054524c0f94caef5db7aad840 to start an election
I20260709 13:05:48.961326 20666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835"
dest_uuid: "2f82287054524c0f94caef5db7aad840"
 from {username='slave'} at 127.0.0.1:38686
I20260709 13:05:48.961481 20665 raft_consensus.cc:2468] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 3.
I20260709 13:05:48.961845 20666 raft_consensus.cc:493] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.962235 20666 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.962388 20483 leader_election.cc:304] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:48.963253 20852 raft_consensus.cc:2804] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.963719 20852 raft_consensus.cc:697] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 3 LEADER]: Becoming Leader. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:48.964715 20852 consensus_queue.cc:237] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } }
I20260709 13:05:48.965687 20591 raft_consensus.cc:2468] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 3.
I20260709 13:05:48.967650 20666 raft_consensus.cc:515] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:48.969722 20666 leader_election.cc:290] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 4 election: Requested vote from peers 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779), f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741)
I20260709 13:05:48.971360 20591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:48.971489 20516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc94eb705d2743e088bf9994628bb835" candidate_uuid: "2f82287054524c0f94caef5db7aad840" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "717c3872f5204497bd6c4daf65227603"
I20260709 13:05:48.971827 20591 raft_consensus.cc:3055] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:48.972055 20516 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.972178 20591 raft_consensus.cc:740] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:48.972918 20591 consensus_queue.cc:260] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:48.972576 20414 catalog_manager.cc:5697] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 reported cstate change: term changed from 2 to 3, leader changed from f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130) to 717c3872f5204497bd6c4daf65227603 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "717c3872f5204497bd6c4daf65227603" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.973848 20591 raft_consensus.cc:3060] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.977159 20516 raft_consensus.cc:2468] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 4.
I20260709 13:05:48.978229 20629 leader_election.cc:304] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:48.979024 20842 raft_consensus.cc:2804] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:48.979414 20591 raft_consensus.cc:2468] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f82287054524c0f94caef5db7aad840 in term 4.
I20260709 13:05:48.979526 20842 raft_consensus.cc:697] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 4 LEADER]: Becoming Leader. State: Replica: 2f82287054524c0f94caef5db7aad840, State: Running, Role: LEADER
I20260709 13:05:48.980553 20842 consensus_queue.cc:237] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:48.988530 20414 catalog_manager.cc:5697] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 reported cstate change: term changed from 3 to 4, leader changed from f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130) to 2f82287054524c0f94caef5db7aad840 (127.19.231.131). New cstate: current_term: 4 leader_uuid: "2f82287054524c0f94caef5db7aad840" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.995481 20845 raft_consensus.cc:993] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e: : Instructing follower 717c3872f5204497bd6c4daf65227603 to start an election
I20260709 13:05:48.995954 20830 raft_consensus.cc:1081] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Signalling peer 717c3872f5204497bd6c4daf65227603 to start an election
I20260709 13:05:48.997509 20516 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fd3920f6285466385adaf95603dc9a2"
dest_uuid: "717c3872f5204497bd6c4daf65227603"
 from {username='slave'} at 127.0.0.1:50202
I20260709 13:05:48.997911 20516 raft_consensus.cc:493] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.998136 20516 raft_consensus.cc:3060] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.002183 20516 raft_consensus.cc:515] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:49.003880 20516 leader_election.cc:290] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 2 election: Requested vote from peers f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130:33741), 2f82287054524c0f94caef5db7aad840 (127.19.231.131:46263)
I20260709 13:05:49.004824 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd3920f6285466385adaf95603dc9a2" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f82287054524c0f94caef5db7aad840"
I20260709 13:05:49.005142 20591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd3920f6285466385adaf95603dc9a2" candidate_uuid: "717c3872f5204497bd6c4daf65227603" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e"
I20260709 13:05:49.005332 20666 raft_consensus.cc:3060] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.005661 20591 raft_consensus.cc:3055] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.005940 20591 raft_consensus.cc:740] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4aa75920ba34a40ab04cb3c5ddb0b4e, State: Running, Role: LEADER
I20260709 13:05:49.006616 20591 consensus_queue.cc:260] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:49.007526 20591 raft_consensus.cc:3060] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.009816 20666 raft_consensus.cc:2468] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 2.
I20260709 13:05:49.010870 20483 leader_election.cc:304] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f82287054524c0f94caef5db7aad840, 717c3872f5204497bd6c4daf65227603; no voters: 
I20260709 13:05:49.011569 20591 raft_consensus.cc:2468] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 717c3872f5204497bd6c4daf65227603 in term 2.
I20260709 13:05:49.011597 20852 raft_consensus.cc:2804] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.012259 20852 raft_consensus.cc:697] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 2 LEADER]: Becoming Leader. State: Replica: 717c3872f5204497bd6c4daf65227603, State: Running, Role: LEADER
I20260709 13:05:49.013103 20852 consensus_queue.cc:237] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } }
I20260709 13:05:49.020927 20414 catalog_manager.cc:5697] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 reported cstate change: term changed from 1 to 2, leader changed from f4aa75920ba34a40ab04cb3c5ddb0b4e (127.19.231.130) to 717c3872f5204497bd6c4daf65227603 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "717c3872f5204497bd6c4daf65227603" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.244045 20516 raft_consensus.cc:1275] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Refusing update from remote peer 2f82287054524c0f94caef5db7aad840: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.245050 20842 consensus_queue.cc:1048] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.255908 20591 raft_consensus.cc:1275] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Refusing update from remote peer 2f82287054524c0f94caef5db7aad840: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.257611 20860 consensus_queue.cc:1048] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:49.360675 20591 raft_consensus.cc:1275] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Refusing update from remote peer 717c3872f5204497bd6c4daf65227603: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.361828 20852 consensus_queue.cc:1048] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.371141 20666 raft_consensus.cc:1275] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Refusing update from remote peer 717c3872f5204497bd6c4daf65227603: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.372644 20853 consensus_queue.cc:1048] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.454106 20666 raft_consensus.cc:1275] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Refusing update from remote peer 717c3872f5204497bd6c4daf65227603: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.455495 20853 consensus_queue.cc:1048] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.460584 20591 raft_consensus.cc:1275] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 4 FOLLOWER]: Refusing update from remote peer 2f82287054524c0f94caef5db7aad840: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:49.462095 20860 consensus_queue.cc:1048] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:49.465911 20591 raft_consensus.cc:1275] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Refusing update from remote peer 717c3872f5204497bd6c4daf65227603: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.467446 20853 consensus_queue.cc:1048] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.480540 20516 raft_consensus.cc:1275] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 4 FOLLOWER]: Refusing update from remote peer 2f82287054524c0f94caef5db7aad840: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:49.481931 20842 consensus_queue.cc:1048] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "717c3872f5204497bd6c4daf65227603" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:49.526582 20666 raft_consensus.cc:1275] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Refusing update from remote peer 717c3872f5204497bd6c4daf65227603: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.527844 20852 consensus_queue.cc:1048] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f82287054524c0f94caef5db7aad840" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.537322 20592 raft_consensus.cc:1275] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Refusing update from remote peer 717c3872f5204497bd6c4daf65227603: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.539227 20865 consensus_queue.cc:1048] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4aa75920ba34a40ab04cb3c5ddb0b4e" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.598302 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:49.603849 20382 tablet_server.cc:179] TabletServer@127.19.231.129:0 shutting down...
I20260709 13:05:49.631997 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.632752 20382 tablet_replica.cc:333] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603: stopping tablet replica
I20260709 13:05:49.633502 20382 raft_consensus.cc:2243] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.634083 20382 raft_consensus.cc:2272] T d1b93d3df3054ce3937b95beb244909e P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.636353 20382 tablet_replica.cc:333] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603: stopping tablet replica
I20260709 13:05:49.636950 20382 raft_consensus.cc:2243] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.637396 20382 raft_consensus.cc:2272] T cc94eb705d2743e088bf9994628bb835 P 717c3872f5204497bd6c4daf65227603 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.640149 20382 tablet_replica.cc:333] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603: stopping tablet replica
I20260709 13:05:49.640686 20382 raft_consensus.cc:2243] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.641433 20382 raft_consensus.cc:2272] T 9fd3920f6285466385adaf95603dc9a2 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.643951 20382 tablet_replica.cc:333] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603: stopping tablet replica
I20260709 13:05:49.644477 20382 raft_consensus.cc:2243] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.644889 20382 raft_consensus.cc:2272] T b813d0f6b2da4729be61473224af10a5 P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.646525 20382 tablet_replica.cc:333] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603: stopping tablet replica
I20260709 13:05:49.647081 20382 raft_consensus.cc:2243] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.647595 20382 raft_consensus.cc:2272] T 151dfc4f93d746078732d50f17ddd32d P 717c3872f5204497bd6c4daf65227603 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.649223 20382 tablet_replica.cc:333] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603: stopping tablet replica
I20260709 13:05:49.649729 20382 raft_consensus.cc:2243] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.650132 20382 raft_consensus.cc:2272] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.651804 20382 tablet_replica.cc:333] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603: stopping tablet replica
I20260709 13:05:49.652273 20382 raft_consensus.cc:2243] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.653074 20382 raft_consensus.cc:2272] T b165ff347030430d9ad05f407511a4ba P 717c3872f5204497bd6c4daf65227603 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.655063 20382 tablet_replica.cc:333] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603: stopping tablet replica
I20260709 13:05:49.655534 20382 raft_consensus.cc:2243] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.655947 20382 raft_consensus.cc:2272] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.657833 20382 tablet_replica.cc:333] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603: stopping tablet replica
I20260709 13:05:49.658315 20382 raft_consensus.cc:2243] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.659107 20382 raft_consensus.cc:2272] T 8f828ddc540c4648885bc99170858398 P 717c3872f5204497bd6c4daf65227603 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:49.762754 20629 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.129:32779: connect: Connection refused (error 111)
I20260709 13:05:49.763667 20382 tablet_server.cc:196] TabletServer@127.19.231.129:0 shutdown complete.
W20260709 13:05:49.766906 20629 consensus_peers.cc:597] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 -> Peer 717c3872f5204497bd6c4daf65227603 (127.19.231.129:32779): Couldn't send request to peer 717c3872f5204497bd6c4daf65227603. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:32779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.785746 20382 tablet_server.cc:179] TabletServer@127.19.231.130:0 shutting down...
I20260709 13:05:49.813889 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.814605 20382 tablet_replica.cc:333] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e: stopping tablet replica
I20260709 13:05:49.815300 20382 raft_consensus.cc:2243] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.816035 20382 raft_consensus.cc:2272] T 151dfc4f93d746078732d50f17ddd32d P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.817811 20382 tablet_replica.cc:333] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e: stopping tablet replica
I20260709 13:05:49.818277 20382 raft_consensus.cc:2243] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.818753 20382 raft_consensus.cc:2272] T b165ff347030430d9ad05f407511a4ba P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.820953 20382 tablet_replica.cc:333] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e: stopping tablet replica
I20260709 13:05:49.821413 20382 raft_consensus.cc:2243] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.822103 20382 raft_consensus.cc:2272] T 7e3cfc3a7caa4757a263e65e4f979fa1 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.823810 20382 tablet_replica.cc:333] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e: stopping tablet replica
I20260709 13:05:49.824242 20382 raft_consensus.cc:2243] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.825004 20382 raft_consensus.cc:2272] T b813d0f6b2da4729be61473224af10a5 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.826593 20382 tablet_replica.cc:333] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e: stopping tablet replica
I20260709 13:05:49.827109 20382 raft_consensus.cc:2243] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.827472 20382 raft_consensus.cc:2272] T a2a6ee3c1de142bd8d93c9cd6372bd9c P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.829733 20382 tablet_replica.cc:333] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e: stopping tablet replica
I20260709 13:05:49.830258 20382 raft_consensus.cc:2243] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.830651 20382 raft_consensus.cc:2272] T 8f828ddc540c4648885bc99170858398 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.832626 20382 tablet_replica.cc:333] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e: stopping tablet replica
I20260709 13:05:49.833112 20382 raft_consensus.cc:2243] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.833505 20382 raft_consensus.cc:2272] T d1b93d3df3054ce3937b95beb244909e P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.835240 20382 tablet_replica.cc:333] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e: stopping tablet replica
I20260709 13:05:49.835680 20382 raft_consensus.cc:2243] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.836062 20382 raft_consensus.cc:2272] T cc94eb705d2743e088bf9994628bb835 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.837891 20382 tablet_replica.cc:333] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e: stopping tablet replica
I20260709 13:05:49.838341 20382 raft_consensus.cc:2243] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.838717 20382 raft_consensus.cc:2272] T 9fd3920f6285466385adaf95603dc9a2 P f4aa75920ba34a40ab04cb3c5ddb0b4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.866128 20382 tablet_server.cc:196] TabletServer@127.19.231.130:0 shutdown complete.
I20260709 13:05:49.882983 20382 tablet_server.cc:179] TabletServer@127.19.231.131:0 shutting down...
I20260709 13:05:49.907300 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.907985 20382 tablet_replica.cc:333] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840: stopping tablet replica
I20260709 13:05:49.908565 20382 raft_consensus.cc:2243] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.909020 20382 raft_consensus.cc:2272] T 9fd3920f6285466385adaf95603dc9a2 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.911108 20382 tablet_replica.cc:333] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840: stopping tablet replica
I20260709 13:05:49.911655 20382 raft_consensus.cc:2243] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.912386 20382 raft_consensus.cc:2272] T d1b93d3df3054ce3937b95beb244909e P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.914114 20382 tablet_replica.cc:333] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840: stopping tablet replica
I20260709 13:05:49.914659 20382 raft_consensus.cc:2243] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.915489 20382 raft_consensus.cc:2272] T cc94eb705d2743e088bf9994628bb835 P 2f82287054524c0f94caef5db7aad840 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.917964 20382 tablet_replica.cc:333] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840: stopping tablet replica
I20260709 13:05:49.918464 20382 raft_consensus.cc:2243] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.918955 20382 raft_consensus.cc:2272] T b165ff347030430d9ad05f407511a4ba P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.920795 20382 tablet_replica.cc:333] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840: stopping tablet replica
I20260709 13:05:49.921298 20382 raft_consensus.cc:2243] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.921743 20382 raft_consensus.cc:2272] T 7e3cfc3a7caa4757a263e65e4f979fa1 P 2f82287054524c0f94caef5db7aad840 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.923473 20382 tablet_replica.cc:333] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840: stopping tablet replica
I20260709 13:05:49.923961 20382 raft_consensus.cc:2243] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.924394 20382 raft_consensus.cc:2272] T 151dfc4f93d746078732d50f17ddd32d P 2f82287054524c0f94caef5db7aad840 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.926168 20382 tablet_replica.cc:333] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840: stopping tablet replica
I20260709 13:05:49.926638 20382 raft_consensus.cc:2243] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.927098 20382 raft_consensus.cc:2272] T b813d0f6b2da4729be61473224af10a5 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.928898 20382 tablet_replica.cc:333] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840: stopping tablet replica
I20260709 13:05:49.929359 20382 raft_consensus.cc:2243] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.930138 20382 raft_consensus.cc:2272] T a2a6ee3c1de142bd8d93c9cd6372bd9c P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.932113 20382 tablet_replica.cc:333] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840: stopping tablet replica
I20260709 13:05:49.932592 20382 raft_consensus.cc:2243] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.933059 20382 raft_consensus.cc:2272] T 8f828ddc540c4648885bc99170858398 P 2f82287054524c0f94caef5db7aad840 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.951318 20382 tablet_server.cc:196] TabletServer@127.19.231.131:0 shutdown complete.
I20260709 13:05:49.967798 20382 master.cc:562] Master@127.19.231.190:33345 shutting down...
I20260709 13:05:50.169253 20382 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.169816 20382 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.170111 20382 tablet_replica.cc:333] T 00000000000000000000000000000000 P b0c8912242254a7bb24afa7f17751cda: stopping tablet replica
I20260709 13:05:50.189188 20382 master.cc:584] Master@127.19.231.190:33345 shutdown complete.
2f82287054524c0f94caef5db7aad840  1
717c3872f5204497bd6c4daf65227603  4
f4aa75920ba34a40ab04cb3c5ddb0b4e  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12596 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:05:50.231050 20382 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.231.190:37807
I20260709 13:05:50.232124 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:50.238096 20875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.238219 20878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.238248 20876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.240545 20382 server_base.cc:1061] running on GCE node
I20260709 13:05:50.241796 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:50.242063 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:50.242182 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602350242170 us; error 0 us; skew 500 ppm
I20260709 13:05:50.242655 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:50.245110 20382 webserver.cc:533] Webserver started at http://127.19.231.190:37061/ using document root <none> and password file <none>
I20260709 13:05:50.245594 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:50.245750 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:50.245975 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:50.247144 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/master-0-root/instance:
uuid: "8689a6498eda4ca08c8eab9a29a852b4"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-1t6m"
I20260709 13:05:50.251855 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:50.255335 20883 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.256129 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:05:50.256451 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/master-0-root
uuid: "8689a6498eda4ca08c8eab9a29a852b4"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-1t6m"
I20260709 13:05:50.256753 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:50.270725 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:50.272104 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:50.310114 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.190:37807
I20260709 13:05:50.310205 20934 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.190:37807 every 8 connection(s)
I20260709 13:05:50.314154 20935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.324071 20935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4: Bootstrap starting.
I20260709 13:05:50.328954 20935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.333222 20935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4: No bootstrap required, opened a new log
I20260709 13:05:50.335669 20935 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8689a6498eda4ca08c8eab9a29a852b4" member_type: VOTER }
I20260709 13:05:50.336072 20935 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.336349 20935 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8689a6498eda4ca08c8eab9a29a852b4, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.336930 20935 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8689a6498eda4ca08c8eab9a29a852b4" member_type: VOTER }
I20260709 13:05:50.337399 20935 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:50.337649 20935 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:50.337949 20935 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.342042 20935 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8689a6498eda4ca08c8eab9a29a852b4" member_type: VOTER }
I20260709 13:05:50.342621 20935 leader_election.cc:304] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8689a6498eda4ca08c8eab9a29a852b4; no voters: 
I20260709 13:05:50.343883 20935 leader_election.cc:290] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:50.344238 20938 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.345521 20938 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 1 LEADER]: Becoming Leader. State: Replica: 8689a6498eda4ca08c8eab9a29a852b4, State: Running, Role: LEADER
I20260709 13:05:50.346275 20938 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8689a6498eda4ca08c8eab9a29a852b4" member_type: VOTER }
I20260709 13:05:50.346873 20935 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:50.350956 20939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8689a6498eda4ca08c8eab9a29a852b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8689a6498eda4ca08c8eab9a29a852b4" member_type: VOTER } }
I20260709 13:05:50.351737 20939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:50.353159 20940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8689a6498eda4ca08c8eab9a29a852b4. Latest consensus state: current_term: 1 leader_uuid: "8689a6498eda4ca08c8eab9a29a852b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8689a6498eda4ca08c8eab9a29a852b4" member_type: VOTER } }
I20260709 13:05:50.353785 20944 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:50.354060 20940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:50.359346 20944 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:50.363682 20382 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:50.368134 20944 catalog_manager.cc:1383] Generated new cluster ID: 560c545793f847d7ba70b4929e87a539
I20260709 13:05:50.368441 20944 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:50.384788 20944 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:50.386197 20944 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:50.400337 20944 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4: Generated new TSK 0
I20260709 13:05:50.400969 20944 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:50.430002 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:50.436003 20956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.437008 20957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.438514 20959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.439245 20382 server_base.cc:1061] running on GCE node
I20260709 13:05:50.440043 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:50.440260 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:50.440416 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602350440396 us; error 0 us; skew 500 ppm
I20260709 13:05:50.441009 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:50.443342 20382 webserver.cc:533] Webserver started at http://127.19.231.129:38753/ using document root <none> and password file <none>
I20260709 13:05:50.443871 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:50.444072 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:50.444358 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:50.445446 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-0-root/instance:
uuid: "8860dc5b4b2b421983b3e0121142dd22"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-1t6m"
I20260709 13:05:50.450156 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:50.453554 20964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.454310 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:50.454708 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-0-root
uuid: "8860dc5b4b2b421983b3e0121142dd22"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-1t6m"
I20260709 13:05:50.455106 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:50.486761 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:50.488133 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:50.489652 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:50.492081 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:50.492319 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.492576 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:50.492779 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.533214 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.129:36395
I20260709 13:05:50.533308 21026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.129:36395 every 8 connection(s)
I20260709 13:05:50.538190 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:50.545926 21031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.547509 21032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.550354 21034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.550561 20382 server_base.cc:1061] running on GCE node
I20260709 13:05:50.551486 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:50.551738 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:50.551970 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602350551947 us; error 0 us; skew 500 ppm
I20260709 13:05:50.552621 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:50.555567 21027 heartbeater.cc:344] Connected to a master server at 127.19.231.190:37807
I20260709 13:05:50.555702 20382 webserver.cc:533] Webserver started at http://127.19.231.130:34979/ using document root <none> and password file <none>
I20260709 13:05:50.555998 21027 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:50.556360 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:50.556638 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:50.556877 21027 heartbeater.cc:507] Master 127.19.231.190:37807 requested a full tablet report, sending...
I20260709 13:05:50.557010 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:50.558735 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-1-root/instance:
uuid: "5017ae1b74974cf0a8b6fea7131faa92"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-1t6m"
I20260709 13:05:50.559379 20900 ts_manager.cc:194] Registered new tserver with Master: 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395)
I20260709 13:05:50.561112 20900 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53742
I20260709 13:05:50.563622 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:50.566994 21039 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.567715 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:50.568023 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-1-root
uuid: "5017ae1b74974cf0a8b6fea7131faa92"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-1t6m"
I20260709 13:05:50.568302 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:50.594861 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:50.596122 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:50.597718 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:50.601150 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:50.601400 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.601662 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:50.601833 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.641584 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.130:43143
I20260709 13:05:50.641692 21101 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.130:43143 every 8 connection(s)
I20260709 13:05:50.646344 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:50.653537 21105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.655300 21106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.656769 21108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.658936 21102 heartbeater.cc:344] Connected to a master server at 127.19.231.190:37807
I20260709 13:05:50.659062 20382 server_base.cc:1061] running on GCE node
I20260709 13:05:50.659482 21102 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:50.660147 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:50.660342 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:50.660342 21102 heartbeater.cc:507] Master 127.19.231.190:37807 requested a full tablet report, sending...
I20260709 13:05:50.660691 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602350660668 us; error 0 us; skew 500 ppm
I20260709 13:05:50.661360 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:50.662865 20900 ts_manager.cc:194] Registered new tserver with Master: 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:50.664043 20382 webserver.cc:533] Webserver started at http://127.19.231.131:43753/ using document root <none> and password file <none>
I20260709 13:05:50.664441 20900 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53750
I20260709 13:05:50.664556 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:50.664855 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:50.665136 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:50.666366 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-2-root/instance:
uuid: "452db08a116b47c1a40c130129d326fa"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-1t6m"
I20260709 13:05:50.670761 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:05:50.673996 21113 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.674817 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:05:50.675145 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-2-root
uuid: "452db08a116b47c1a40c130129d326fa"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-1t6m"
I20260709 13:05:50.675434 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337466250-20382-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:50.705073 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:50.706343 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:50.707870 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:50.710127 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:50.710311 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.710625 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:50.710788 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.750998 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.131:38747
I20260709 13:05:50.751097 21175 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.131:38747 every 8 connection(s)
I20260709 13:05:50.764912 21176 heartbeater.cc:344] Connected to a master server at 127.19.231.190:37807
I20260709 13:05:50.765311 21176 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:50.766057 21176 heartbeater.cc:507] Master 127.19.231.190:37807 requested a full tablet report, sending...
I20260709 13:05:50.768038 20900 ts_manager.cc:194] Registered new tserver with Master: 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:50.768460 20382 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014345216s
I20260709 13:05:50.769462 20900 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53764
I20260709 13:05:50.795009 20900 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53772:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:50.797827 20900 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:50.870582 21067 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6465571f084d1585a86b2e14e68fba (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:50.872191 21067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6465571f084d1585a86b2e14e68fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.884253 20989 tablet_service.cc:1511] Processing CreateTablet for tablet c3376286300e4b479ce6a63d53a6ed7b (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:50.884956 20992 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6465571f084d1585a86b2e14e68fba (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:50.884812 21066 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf856aa2eaf4795b609c291bd2fd69d (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:50.885820 20989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3376286300e4b479ce6a63d53a6ed7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.886665 21066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf856aa2eaf4795b609c291bd2fd69d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.887379 20991 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf856aa2eaf4795b609c291bd2fd69d (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:50.887815 20988 tablet_service.cc:1511] Processing CreateTablet for tablet 06fcb394546d4fd2a31add17c16a01d1 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:50.888826 20991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf856aa2eaf4795b609c291bd2fd69d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.890010 20987 tablet_service.cc:1511] Processing CreateTablet for tablet 3b947e6221054903ba6b1a78eed46df0 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:50.890832 20990 tablet_service.cc:1511] Processing CreateTablet for tablet 136da1143cc6484a815dd33c61922e19 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:50.891423 20987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b947e6221054903ba6b1a78eed46df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.892143 20990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136da1143cc6484a815dd33c61922e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.892730 20988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fcb394546d4fd2a31add17c16a01d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.894820 20992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6465571f084d1585a86b2e14e68fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.925041 21141 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6465571f084d1585a86b2e14e68fba (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:50.926512 21141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6465571f084d1585a86b2e14e68fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.927083 21065 tablet_service.cc:1511] Processing CreateTablet for tablet 136da1143cc6484a815dd33c61922e19 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:50.928045 20986 tablet_service.cc:1511] Processing CreateTablet for tablet ab132bf70d4f4a8995c3682717eff5ae (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:50.928634 21065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136da1143cc6484a815dd33c61922e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.929374 20986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab132bf70d4f4a8995c3682717eff5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.936622 21140 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf856aa2eaf4795b609c291bd2fd69d (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:50.938262 21140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf856aa2eaf4795b609c291bd2fd69d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.939301 21139 tablet_service.cc:1511] Processing CreateTablet for tablet 136da1143cc6484a815dd33c61922e19 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:50.940742 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136da1143cc6484a815dd33c61922e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.940449 21136 tablet_service.cc:1511] Processing CreateTablet for tablet 3b947e6221054903ba6b1a78eed46df0 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:50.941799 21136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b947e6221054903ba6b1a78eed46df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.942430 21064 tablet_service.cc:1511] Processing CreateTablet for tablet c3376286300e4b479ce6a63d53a6ed7b (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:50.942808 21138 tablet_service.cc:1511] Processing CreateTablet for tablet c3376286300e4b479ce6a63d53a6ed7b (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:50.944159 21064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3376286300e4b479ce6a63d53a6ed7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.944643 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3376286300e4b479ce6a63d53a6ed7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.949237 21063 tablet_service.cc:1511] Processing CreateTablet for tablet 06fcb394546d4fd2a31add17c16a01d1 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:50.950902 21063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fcb394546d4fd2a31add17c16a01d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.951360 21137 tablet_service.cc:1511] Processing CreateTablet for tablet 06fcb394546d4fd2a31add17c16a01d1 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:50.953245 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fcb394546d4fd2a31add17c16a01d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.983856 21062 tablet_service.cc:1511] Processing CreateTablet for tablet 3b947e6221054903ba6b1a78eed46df0 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:50.985373 21062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b947e6221054903ba6b1a78eed46df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.010227 21061 tablet_service.cc:1511] Processing CreateTablet for tablet ab132bf70d4f4a8995c3682717eff5ae (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:51.011744 21061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab132bf70d4f4a8995c3682717eff5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.027127 21135 tablet_service.cc:1511] Processing CreateTablet for tablet ab132bf70d4f4a8995c3682717eff5ae (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:51.028745 21135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab132bf70d4f4a8995c3682717eff5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.032280 20985 tablet_service.cc:1511] Processing CreateTablet for tablet 4cfd26e12c0a4b6093b8362bb92bc263 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:51.033744 20985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cfd26e12c0a4b6093b8362bb92bc263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.050659 21060 tablet_service.cc:1511] Processing CreateTablet for tablet 4cfd26e12c0a4b6093b8362bb92bc263 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:51.052524 21060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cfd26e12c0a4b6093b8362bb92bc263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.060277 21192 tablet_bootstrap.cc:492] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22: Bootstrap starting.
I20260709 13:05:51.078312 21191 tablet_bootstrap.cc:492] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa: Bootstrap starting.
I20260709 13:05:51.091586 21191 tablet_bootstrap.cc:654] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.098207 21192 tablet_bootstrap.cc:654] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.098650 21139 tablet_service.cc:1511] Processing CreateTablet for tablet 4cfd26e12c0a4b6093b8362bb92bc263 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:51.101307 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cfd26e12c0a4b6093b8362bb92bc263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.108376 21137 tablet_service.cc:1511] Processing CreateTablet for tablet 02b9bf42b6f742a5aa8507234d579e94 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:51.110378 20988 tablet_service.cc:1511] Processing CreateTablet for tablet 7a99a29e4e434e58ae6617b376ee53b2 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:51.111043 21060 tablet_service.cc:1511] Processing CreateTablet for tablet 7a99a29e4e434e58ae6617b376ee53b2 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:51.112094 21060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a99a29e4e434e58ae6617b376ee53b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.112215 20988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a99a29e4e434e58ae6617b376ee53b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.115849 21065 tablet_service.cc:1511] Processing CreateTablet for tablet 02b9bf42b6f742a5aa8507234d579e94 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:51.116706 21138 tablet_service.cc:1511] Processing CreateTablet for tablet 7a99a29e4e434e58ae6617b376ee53b2 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:51.118119 21065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b9bf42b6f742a5aa8507234d579e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.117192 21137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b9bf42b6f742a5aa8507234d579e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.120225 21138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a99a29e4e434e58ae6617b376ee53b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.100229 21193 tablet_bootstrap.cc:492] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92: Bootstrap starting.
I20260709 13:05:51.135689 20992 tablet_service.cc:1511] Processing CreateTablet for tablet 02b9bf42b6f742a5aa8507234d579e94 (DEFAULT_TABLE table=test-workload [id=9e7815bd39464edb90eecd7fd3ac15fd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:51.137560 20992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b9bf42b6f742a5aa8507234d579e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.144971 21191 tablet_bootstrap.cc:492] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa: No bootstrap required, opened a new log
I20260709 13:05:51.145663 21191 ts_tablet_manager.cc:1403] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.007s
I20260709 13:05:51.153146 21191 raft_consensus.cc:359] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:51.164680 21191 raft_consensus.cc:385] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.165165 21191 raft_consensus.cc:740] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.166143 21191 consensus_queue.cc:260] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:51.161989 21193 tablet_bootstrap.cc:654] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.172216 21192 tablet_bootstrap.cc:492] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22: No bootstrap required, opened a new log
I20260709 13:05:51.172843 21192 ts_tablet_manager.cc:1403] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22: Time spent bootstrapping tablet: real 0.113s	user 0.034s	sys 0.046s
I20260709 13:05:51.172925 21191 ts_tablet_manager.cc:1434] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.001s
I20260709 13:05:51.175918 21192 raft_consensus.cc:359] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.176764 21176 heartbeater.cc:499] Master 127.19.231.190:37807 was elected leader, sending a full tablet report...
I20260709 13:05:51.176770 21192 raft_consensus.cc:385] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.177430 21192 raft_consensus.cc:740] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.178592 21191 tablet_bootstrap.cc:492] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa: Bootstrap starting.
I20260709 13:05:51.179319 21193 tablet_bootstrap.cc:492] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92: No bootstrap required, opened a new log
I20260709 13:05:51.179394 21192 consensus_queue.cc:260] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.180117 21193 ts_tablet_manager.cc:1403] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.000s
I20260709 13:05:51.185360 21191 tablet_bootstrap.cc:654] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.187247 21193 raft_consensus.cc:359] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:51.188086 21193 raft_consensus.cc:385] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.188493 21193 raft_consensus.cc:740] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.189683 21193 consensus_queue.cc:260] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:51.199751 21193 ts_tablet_manager.cc:1434] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92: Time spent starting tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:05:51.199894 21102 heartbeater.cc:499] Master 127.19.231.190:37807 was elected leader, sending a full tablet report...
I20260709 13:05:51.200938 21193 tablet_bootstrap.cc:492] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92: Bootstrap starting.
I20260709 13:05:51.207237 21027 heartbeater.cc:499] Master 127.19.231.190:37807 was elected leader, sending a full tablet report...
I20260709 13:05:51.207981 21193 tablet_bootstrap.cc:654] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.208392 21191 tablet_bootstrap.cc:492] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa: No bootstrap required, opened a new log
I20260709 13:05:51.208948 21191 ts_tablet_manager.cc:1403] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.008s
I20260709 13:05:51.211951 21191 raft_consensus.cc:359] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.213686 21191 raft_consensus.cc:385] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.214113 21191 raft_consensus.cc:740] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.214329 21192 ts_tablet_manager.cc:1434] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.010s
I20260709 13:05:51.215452 21192 tablet_bootstrap.cc:492] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22: Bootstrap starting.
I20260709 13:05:51.215195 21191 consensus_queue.cc:260] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.217588 21191 ts_tablet_manager.cc:1434] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:51.219038 21191 tablet_bootstrap.cc:492] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa: Bootstrap starting.
I20260709 13:05:51.222762 21192 tablet_bootstrap.cc:654] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.226016 21191 tablet_bootstrap.cc:654] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.228615 21193 tablet_bootstrap.cc:492] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92: No bootstrap required, opened a new log
I20260709 13:05:51.229182 21193 ts_tablet_manager.cc:1403] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.011s
I20260709 13:05:51.230561 21196 raft_consensus.cc:493] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.231289 21196 raft_consensus.cc:515] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.232371 21193 raft_consensus.cc:359] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.233157 21193 raft_consensus.cc:385] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.233460 21193 raft_consensus.cc:740] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.234223 21193 consensus_queue.cc:260] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.235183 21192 tablet_bootstrap.cc:492] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22: No bootstrap required, opened a new log
I20260709 13:05:51.235706 21192 ts_tablet_manager.cc:1403] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.013s
I20260709 13:05:51.236469 21193 ts_tablet_manager.cc:1434] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:51.237535 21193 tablet_bootstrap.cc:492] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92: Bootstrap starting.
I20260709 13:05:51.238857 21192 raft_consensus.cc:359] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.239686 21192 raft_consensus.cc:385] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.239737 21196 leader_election.cc:290] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:51.240095 21192 raft_consensus.cc:740] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.241328 21192 consensus_queue.cc:260] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.244637 21193 tablet_bootstrap.cc:654] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.244693 21192 ts_tablet_manager.cc:1434] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:05:51.246062 21192 tablet_bootstrap.cc:492] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22: Bootstrap starting.
I20260709 13:05:51.250473 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf856aa2eaf4795b609c291bd2fd69d" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22" is_pre_election: true
W20260709 13:05:51.252272 21117 leader_election.cc:343] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.255941 21192 tablet_bootstrap.cc:654] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.257311 21191 tablet_bootstrap.cc:492] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa: No bootstrap required, opened a new log
I20260709 13:05:51.257893 21191 ts_tablet_manager.cc:1403] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa: Time spent bootstrapping tablet: real 0.039s	user 0.003s	sys 0.014s
I20260709 13:05:51.261891 21191 raft_consensus.cc:359] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.263125 21191 raft_consensus.cc:385] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.263612 21191 raft_consensus.cc:740] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.264788 21191 consensus_queue.cc:260] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.271438 21191 ts_tablet_manager.cc:1434] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:05:51.273162 21191 tablet_bootstrap.cc:492] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa: Bootstrap starting.
I20260709 13:05:51.282614 21191 tablet_bootstrap.cc:654] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.282452 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf856aa2eaf4795b609c291bd2fd69d" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92" is_pre_election: true
I20260709 13:05:51.283638 21077 raft_consensus.cc:2468] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 0.
I20260709 13:05:51.285720 21115 leader_election.cc:304] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:51.286975 21196 raft_consensus.cc:2804] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.287521 21196 raft_consensus.cc:493] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.287914 21196 raft_consensus.cc:3060] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.298157 21196 raft_consensus.cc:515] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.302712 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf856aa2eaf4795b609c291bd2fd69d" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
W20260709 13:05:51.304922 21117 leader_election.cc:343] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.309446 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf856aa2eaf4795b609c291bd2fd69d" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:51.310423 21077 raft_consensus.cc:3060] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.313516 21196 leader_election.cc:290] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:51.318732 21191 tablet_bootstrap.cc:492] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa: No bootstrap required, opened a new log
I20260709 13:05:51.319473 21191 ts_tablet_manager.cc:1403] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.010s
I20260709 13:05:51.323307 21191 raft_consensus.cc:359] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.324354 21191 raft_consensus.cc:385] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.324736 21191 raft_consensus.cc:740] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.325809 21191 consensus_queue.cc:260] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.332036 21077 raft_consensus.cc:2468] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 1.
I20260709 13:05:51.333282 21191 ts_tablet_manager.cc:1434] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.008s
I20260709 13:05:51.336642 21115 leader_election.cc:304] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:51.336974 21191 tablet_bootstrap.cc:492] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa: Bootstrap starting.
I20260709 13:05:51.337504 21196 raft_consensus.cc:2804] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.337963 21193 tablet_bootstrap.cc:492] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92: No bootstrap required, opened a new log
I20260709 13:05:51.338488 21193 ts_tablet_manager.cc:1403] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent bootstrapping tablet: real 0.101s	user 0.059s	sys 0.037s
I20260709 13:05:51.339766 21192 tablet_bootstrap.cc:492] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22: No bootstrap required, opened a new log
I20260709 13:05:51.340431 21192 ts_tablet_manager.cc:1403] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22: Time spent bootstrapping tablet: real 0.095s	user 0.045s	sys 0.044s
I20260709 13:05:51.342953 21193 raft_consensus.cc:359] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.343897 21193 raft_consensus.cc:385] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.344272 21193 raft_consensus.cc:740] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.344187 21192 raft_consensus.cc:359] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.345063 21192 raft_consensus.cc:385] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.345387 21193 consensus_queue.cc:260] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.347497 21191 tablet_bootstrap.cc:654] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.345398 21192 raft_consensus.cc:740] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.348366 21192 consensus_queue.cc:260] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.350860 21192 ts_tablet_manager.cc:1434] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:05:51.352708 21192 tablet_bootstrap.cc:492] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22: Bootstrap starting.
I20260709 13:05:51.352735 21198 raft_consensus.cc:493] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.351333 21193 ts_tablet_manager.cc:1434] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:05:51.354045 21198 raft_consensus.cc:515] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.354879 21196 raft_consensus.cc:697] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Becoming Leader. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:51.356389 21193 tablet_bootstrap.cc:492] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92: Bootstrap starting.
I20260709 13:05:51.356161 21196 consensus_queue.cc:237] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
W20260709 13:05:51.358340 20948 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:51.365676 21193 tablet_bootstrap.cc:654] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.366374 21198 leader_election.cc:290] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.374146 21192 tablet_bootstrap.cc:654] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.388208 21193 tablet_bootstrap.cc:492] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92: No bootstrap required, opened a new log
I20260709 13:05:51.389014 21193 ts_tablet_manager.cc:1403] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.006s
I20260709 13:05:51.392419 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92" is_pre_election: true
I20260709 13:05:51.392834 21193 raft_consensus.cc:359] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.393910 21193 raft_consensus.cc:385] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.394307 21193 raft_consensus.cc:740] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.394675 21192 tablet_bootstrap.cc:492] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22: No bootstrap required, opened a new log
I20260709 13:05:51.395179 21192 ts_tablet_manager.cc:1403] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.002s
I20260709 13:05:51.395402 21193 consensus_queue.cc:260] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.396507 21077 raft_consensus.cc:2468] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 0.
I20260709 13:05:51.398387 21192 raft_consensus.cc:359] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.399158 21192 raft_consensus.cc:385] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.399459 21192 raft_consensus.cc:740] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.399775 21198 raft_consensus.cc:493] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.400189 21198 raft_consensus.cc:515] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.400993 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa" is_pre_election: true
I20260709 13:05:51.400975 20966 leader_election.cc:304] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:51.401767 21151 raft_consensus.cc:2468] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 0.
I20260709 13:05:51.402305 21198 leader_election.cc:290] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.402835 21198 raft_consensus.cc:2804] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.401928 20897 catalog_manager.cc:5697] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 452db08a116b47c1a40c130129d326fa (127.19.231.131). New cstate: current_term: 1 leader_uuid: "452db08a116b47c1a40c130129d326fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.403173 21198 raft_consensus.cc:493] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.403558 21198 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.404405 21193 ts_tablet_manager.cc:1434] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:51.405494 21193 tablet_bootstrap.cc:492] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92: Bootstrap starting.
I20260709 13:05:51.400199 21192 consensus_queue.cc:260] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.412511 21193 tablet_bootstrap.cc:654] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.413179 21191 tablet_bootstrap.cc:492] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa: No bootstrap required, opened a new log
I20260709 13:05:51.413869 21191 ts_tablet_manager.cc:1403] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa: Time spent bootstrapping tablet: real 0.077s	user 0.028s	sys 0.020s
I20260709 13:05:51.414248 21192 ts_tablet_manager.cc:1434] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:05:51.418092 21192 tablet_bootstrap.cc:492] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22: Bootstrap starting.
I20260709 13:05:51.417906 21191 raft_consensus.cc:359] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.426743 21191 raft_consensus.cc:385] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.427266 21191 raft_consensus.cc:740] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.414584 21198 raft_consensus.cc:515] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.429669 21191 consensus_queue.cc:260] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.430964 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3376286300e4b479ce6a63d53a6ed7b" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa" is_pre_election: true
I20260709 13:05:51.431321 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3376286300e4b479ce6a63d53a6ed7b" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92" is_pre_election: true
I20260709 13:05:51.431612 21151 raft_consensus.cc:2468] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 0.
I20260709 13:05:51.432085 21191 ts_tablet_manager.cc:1434] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.008s
I20260709 13:05:51.433034 21191 tablet_bootstrap.cc:492] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa: Bootstrap starting.
I20260709 13:05:51.430435 21198 leader_election.cc:290] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.438130 20966 leader_election.cc:304] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:51.439025 21198 raft_consensus.cc:2804] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.439440 21191 tablet_bootstrap.cc:654] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.440171 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:51.439597 21198 raft_consensus.cc:493] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.441028 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:51.443418 21198 raft_consensus.cc:3060] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.443604 21151 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.445621 21192 tablet_bootstrap.cc:654] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:51.442173 20966 leader_election.cc:343] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.441028 21077 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.461735 21198 raft_consensus.cc:515] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.454691 21151 raft_consensus.cc:2468] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 1.
I20260709 13:05:51.465839 21193 tablet_bootstrap.cc:492] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92: No bootstrap required, opened a new log
I20260709 13:05:51.466375 21193 ts_tablet_manager.cc:1403] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.023s
I20260709 13:05:51.467401 20966 leader_election.cc:304] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:51.468778 21215 raft_consensus.cc:2804] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.469094 21192 tablet_bootstrap.cc:492] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22: No bootstrap required, opened a new log
I20260709 13:05:51.472574 21198 leader_election.cc:290] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.474848 21191 tablet_bootstrap.cc:492] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa: No bootstrap required, opened a new log
I20260709 13:05:51.474993 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3376286300e4b479ce6a63d53a6ed7b" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:51.475514 21191 ts_tablet_manager.cc:1403] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.024s
I20260709 13:05:51.475193 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3376286300e4b479ce6a63d53a6ed7b" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:51.475751 21151 raft_consensus.cc:3060] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.470175 21192 ts_tablet_manager.cc:1403] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.010s
W20260709 13:05:51.477340 20966 leader_election.cc:343] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.478540 21193 raft_consensus.cc:359] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.478960 21191 raft_consensus.cc:359] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.479406 21193 raft_consensus.cc:385] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.479692 21077 raft_consensus.cc:2468] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 1.
I20260709 13:05:51.479866 21191 raft_consensus.cc:385] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.479925 21193 raft_consensus.cc:740] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.480293 21191 raft_consensus.cc:740] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.482139 21191 consensus_queue.cc:260] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.480242 21192 raft_consensus.cc:359] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.482339 21193 consensus_queue.cc:260] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.483574 21192 raft_consensus.cc:385] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.483922 21192 raft_consensus.cc:740] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.484634 21151 raft_consensus.cc:2468] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 1.
I20260709 13:05:51.484822 21191 ts_tablet_manager.cc:1434] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:51.485956 21191 tablet_bootstrap.cc:492] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa: Bootstrap starting.
I20260709 13:05:51.486495 21192 consensus_queue.cc:260] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.489216 20966 leader_election.cc:304] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 5017ae1b74974cf0a8b6fea7131faa92
I20260709 13:05:51.491614 21193 ts_tablet_manager.cc:1434] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:05:51.491848 21215 raft_consensus.cc:697] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:51.492863 21193 tablet_bootstrap.cc:492] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92: Bootstrap starting.
I20260709 13:05:51.492827 21215 consensus_queue.cc:237] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.493863 21191 tablet_bootstrap.cc:654] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.497511 21192 ts_tablet_manager.cc:1434] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:05:51.498679 21192 tablet_bootstrap.cc:492] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22: Bootstrap starting.
I20260709 13:05:51.500597 21193 tablet_bootstrap.cc:654] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.506417 21221 raft_consensus.cc:2804] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.507115 21221 raft_consensus.cc:697] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:51.508082 21221 consensus_queue.cc:237] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.513852 21198 raft_consensus.cc:493] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.514587 21198 raft_consensus.cc:515] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.517019 21198 leader_election.cc:290] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.517395 21215 raft_consensus.cc:493] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.517963 21215 raft_consensus.cc:515] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.519948 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf856aa2eaf4795b609c291bd2fd69d" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92" is_pre_election: true
I20260709 13:05:51.520941 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92" is_pre_election: true
I20260709 13:05:51.521122 21215 leader_election.cc:290] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.521056 21077 raft_consensus.cc:2393] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8860dc5b4b2b421983b3e0121142dd22 in current term 1: Already voted for candidate 452db08a116b47c1a40c130129d326fa in this term.
W20260709 13:05:51.523324 20966 leader_election.cc:343] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.525411 20900 catalog_manager.cc:5697] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.527697 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf856aa2eaf4795b609c291bd2fd69d" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa" is_pre_election: true
I20260709 13:05:51.528874 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa" is_pre_election: true
I20260709 13:05:51.527722 21192 tablet_bootstrap.cc:654] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.529620 21150 raft_consensus.cc:2468] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 0.
I20260709 13:05:51.530424 20966 leader_election.cc:304] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8860dc5b4b2b421983b3e0121142dd22; no voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92
I20260709 13:05:51.531018 21193 tablet_bootstrap.cc:492] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92: No bootstrap required, opened a new log
I20260709 13:05:51.531559 21193 ts_tablet_manager.cc:1403] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.007s
I20260709 13:05:51.533839 21191 tablet_bootstrap.cc:492] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa: No bootstrap required, opened a new log
I20260709 13:05:51.534425 21191 ts_tablet_manager.cc:1403] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa: Time spent bootstrapping tablet: real 0.049s	user 0.027s	sys 0.001s
I20260709 13:05:51.535344 20966 leader_election.cc:304] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 5017ae1b74974cf0a8b6fea7131faa92
I20260709 13:05:51.536237 21215 raft_consensus.cc:3060] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.537719 21191 raft_consensus.cc:359] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.538590 21191 raft_consensus.cc:385] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.539052 21191 raft_consensus.cc:740] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.540027 21226 raft_consensus.cc:2804] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.539886 21191 consensus_queue.cc:260] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.541115 21196 raft_consensus.cc:493] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.541548 21226 raft_consensus.cc:493] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.541918 21226 raft_consensus.cc:3060] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.541802 21196 raft_consensus.cc:515] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:51.544034 21196 leader_election.cc:290] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395)
I20260709 13:05:51.544360 21215 raft_consensus.cc:2749] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.535902 21193 raft_consensus.cc:359] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.545830 21193 raft_consensus.cc:385] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.546211 21193 raft_consensus.cc:740] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.547183 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22" is_pre_election: true
I20260709 13:05:51.547577 21193 consensus_queue.cc:260] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.546710 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92" is_pre_election: true
I20260709 13:05:51.548816 21077 raft_consensus.cc:2468] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 0.
W20260709 13:05:51.550210 21117 leader_election.cc:343] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.551394 21115 leader_election.cc:304] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:51.552551 21196 raft_consensus.cc:2804] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.552969 21196 raft_consensus.cc:493] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.553069 21193 ts_tablet_manager.cc:1434] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:05:51.553421 21196 raft_consensus.cc:3060] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.554670 21193 tablet_bootstrap.cc:492] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92: Bootstrap starting.
I20260709 13:05:51.556684 20899 catalog_manager.cc:5697] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.559401 21192 tablet_bootstrap.cc:492] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22: No bootstrap required, opened a new log
I20260709 13:05:51.559980 21192 ts_tablet_manager.cc:1403] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.008s
I20260709 13:05:51.563125 21193 tablet_bootstrap.cc:654] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.563234 21192 raft_consensus.cc:359] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:51.564055 21192 raft_consensus.cc:385] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.564379 21192 raft_consensus.cc:740] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.565330 21192 consensus_queue.cc:260] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:51.568650 21191 ts_tablet_manager.cc:1434] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:05:51.568789 21192 ts_tablet_manager.cc:1434] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:51.570665 21196 raft_consensus.cc:515] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:51.577647 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:51.578238 21077 raft_consensus.cc:3060] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.571648 21192 tablet_bootstrap.cc:492] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22: Bootstrap starting.
I20260709 13:05:51.584751 21208 raft_consensus.cc:493] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.585299 21208 raft_consensus.cc:515] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.580374 21226 raft_consensus.cc:515] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.589187 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22" is_pre_election: true
I20260709 13:05:51.590294 21192 tablet_bootstrap.cc:654] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:51.590725 21117 leader_election.cc:343] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.591496 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:51.592144 21076 raft_consensus.cc:3060] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.592275 21075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92" is_pre_election: true
I20260709 13:05:51.592762 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:51.593016 21075 raft_consensus.cc:2468] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 0.
I20260709 13:05:51.593297 21150 raft_consensus.cc:3060] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.594450 21115 leader_election.cc:304] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:51.595742 21208 leader_election.cc:290] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:51.596375 21208 raft_consensus.cc:2804] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.596807 21208 raft_consensus.cc:493] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.597204 21208 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.600652 21150 raft_consensus.cc:2468] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 1.
I20260709 13:05:51.601789 21076 raft_consensus.cc:2468] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 1.
I20260709 13:05:51.574928 21191 tablet_bootstrap.cc:492] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa: Bootstrap starting.
I20260709 13:05:51.606063 21077 raft_consensus.cc:2468] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 1.
I20260709 13:05:51.607409 20966 leader_election.cc:304] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:51.608675 21215 raft_consensus.cc:2804] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.609328 21215 raft_consensus.cc:697] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:51.610208 21215 consensus_queue.cc:237] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.611593 21226 leader_election.cc:290] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.613058 21196 leader_election.cc:290] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395)
I20260709 13:05:51.614588 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:51.615197 21002 raft_consensus.cc:3060] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.618081 21191 tablet_bootstrap.cc:654] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.621903 21115 leader_election.cc:304] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:51.623344 21231 raft_consensus.cc:2804] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.624424 21231 raft_consensus.cc:697] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Becoming Leader. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:51.626804 21231 consensus_queue.cc:237] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:51.611045 21208 raft_consensus.cc:515] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.634537 21001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
W20260709 13:05:51.636456 21117 leader_election.cc:343] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.624814 21002 raft_consensus.cc:2468] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 1.
I20260709 13:05:51.640771 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:51.640998 21208 leader_election.cc:290] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:51.641582 21076 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.642139 20899 catalog_manager.cc:5697] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.643705 21193 tablet_bootstrap.cc:492] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92: No bootstrap required, opened a new log
I20260709 13:05:51.644201 21193 ts_tablet_manager.cc:1403] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.024s
I20260709 13:05:51.647213 21193 raft_consensus.cc:359] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.648809 21193 raft_consensus.cc:385] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.649082 21193 raft_consensus.cc:740] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.649735 21193 consensus_queue.cc:260] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.651618 21193 ts_tablet_manager.cc:1434] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:51.651980 21076 raft_consensus.cc:2468] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 1.
I20260709 13:05:51.652585 21193 tablet_bootstrap.cc:492] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92: Bootstrap starting.
I20260709 13:05:51.653195 21115 leader_election.cc:304] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:51.654300 21208 raft_consensus.cc:2804] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.654838 21208 raft_consensus.cc:697] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Becoming Leader. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:51.655807 21208 consensus_queue.cc:237] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.658622 21191 tablet_bootstrap.cc:492] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa: No bootstrap required, opened a new log
I20260709 13:05:51.659119 21191 ts_tablet_manager.cc:1403] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa: Time spent bootstrapping tablet: real 0.084s	user 0.005s	sys 0.008s
I20260709 13:05:51.661732 21191 raft_consensus.cc:359] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.662392 21191 raft_consensus.cc:385] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.662657 21191 raft_consensus.cc:740] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.670089 21193 tablet_bootstrap.cc:654] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.668594 21192 tablet_bootstrap.cc:492] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22: No bootstrap required, opened a new log
I20260709 13:05:51.671861 21191 consensus_queue.cc:260] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.671476 20900 catalog_manager.cc:5697] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 452db08a116b47c1a40c130129d326fa (127.19.231.131). New cstate: current_term: 1 leader_uuid: "452db08a116b47c1a40c130129d326fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.674201 21191 ts_tablet_manager.cc:1434] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:51.671499 21192 ts_tablet_manager.cc:1403] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22: Time spent bootstrapping tablet: real 0.100s	user 0.033s	sys 0.029s
I20260709 13:05:51.675199 21191 tablet_bootstrap.cc:492] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa: Bootstrap starting.
I20260709 13:05:51.677675 21192 raft_consensus.cc:359] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.678579 21192 raft_consensus.cc:385] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.678962 21192 raft_consensus.cc:740] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.679908 21192 consensus_queue.cc:260] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.685111 21191 tablet_bootstrap.cc:654] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.686420 21192 ts_tablet_manager.cc:1434] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:51.687474 21192 tablet_bootstrap.cc:492] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22: Bootstrap starting.
I20260709 13:05:51.690289 21193 tablet_bootstrap.cc:492] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92: No bootstrap required, opened a new log
I20260709 13:05:51.690754 21193 ts_tablet_manager.cc:1403] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.015s
I20260709 13:05:51.692818 21193 raft_consensus.cc:359] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.693244 21193 raft_consensus.cc:385] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.693400 21193 raft_consensus.cc:740] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.695205 21193 consensus_queue.cc:260] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.697368 21191 tablet_bootstrap.cc:492] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa: No bootstrap required, opened a new log
I20260709 13:05:51.697839 21191 ts_tablet_manager.cc:1403] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:05:51.699148 21192 tablet_bootstrap.cc:654] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.700357 21191 raft_consensus.cc:359] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.701272 21191 raft_consensus.cc:385] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.701596 21191 raft_consensus.cc:740] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.702069 20900 catalog_manager.cc:5697] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 452db08a116b47c1a40c130129d326fa (127.19.231.131). New cstate: current_term: 1 leader_uuid: "452db08a116b47c1a40c130129d326fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.706755 21193 ts_tablet_manager.cc:1434] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.003s
I20260709 13:05:51.707882 21191 consensus_queue.cc:260] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.709296 21193 tablet_bootstrap.cc:492] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92: Bootstrap starting.
I20260709 13:05:51.711359 21192 tablet_bootstrap.cc:492] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22: No bootstrap required, opened a new log
I20260709 13:05:51.711881 21192 ts_tablet_manager.cc:1403] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 13:05:51.714556 21192 raft_consensus.cc:359] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.715435 21192 raft_consensus.cc:385] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.715867 21192 raft_consensus.cc:740] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.716719 21192 consensus_queue.cc:260] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.717399 21191 ts_tablet_manager.cc:1434] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:05:51.718487 21191 tablet_bootstrap.cc:492] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa: Bootstrap starting.
I20260709 13:05:51.719154 21192 ts_tablet_manager.cc:1434] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:51.720088 21192 tablet_bootstrap.cc:492] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22: Bootstrap starting.
I20260709 13:05:51.725009 21191 tablet_bootstrap.cc:654] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.715490 21193 tablet_bootstrap.cc:654] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.728356 21192 tablet_bootstrap.cc:654] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.736918 21193 tablet_bootstrap.cc:492] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92: No bootstrap required, opened a new log
I20260709 13:05:51.737479 21193 ts_tablet_manager.cc:1403] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 13:05:51.738143 21191 tablet_bootstrap.cc:492] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa: No bootstrap required, opened a new log
I20260709 13:05:51.738654 21191 ts_tablet_manager.cc:1403] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:05:51.740171 21193 raft_consensus.cc:359] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.740936 21192 tablet_bootstrap.cc:492] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22: No bootstrap required, opened a new log
I20260709 13:05:51.740861 21193 raft_consensus.cc:385] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.741459 21192 ts_tablet_manager.cc:1403] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.003s
I20260709 13:05:51.741557 21193 raft_consensus.cc:740] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.742132 21191 raft_consensus.cc:359] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.742865 21191 raft_consensus.cc:385] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.742529 21193 consensus_queue.cc:260] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.743225 21191 raft_consensus.cc:740] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.744114 21191 consensus_queue.cc:260] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.744982 21193 ts_tablet_manager.cc:1434] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:51.744582 21192 raft_consensus.cc:359] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.745435 21192 raft_consensus.cc:385] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.745777 21192 raft_consensus.cc:740] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.746858 21192 consensus_queue.cc:260] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.749336 21192 ts_tablet_manager.cc:1434] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:51.745895 21193 tablet_bootstrap.cc:492] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92: Bootstrap starting.
I20260709 13:05:51.750412 21192 tablet_bootstrap.cc:492] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22: Bootstrap starting.
I20260709 13:05:51.750576 21191 ts_tablet_manager.cc:1434] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:05:51.752072 21200 raft_consensus.cc:493] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.752568 21200 raft_consensus.cc:515] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.756378 21193 tablet_bootstrap.cc:654] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.757580 21192 tablet_bootstrap.cc:654] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.767534 21200 leader_election.cc:290] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.779513 21193 tablet_bootstrap.cc:492] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92: No bootstrap required, opened a new log
I20260709 13:05:51.779995 21193 ts_tablet_manager.cc:1403] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.009s
I20260709 13:05:51.781342 21192 tablet_bootstrap.cc:492] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22: No bootstrap required, opened a new log
I20260709 13:05:51.781862 21192 ts_tablet_manager.cc:1403] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.012s
I20260709 13:05:51.782699 21193 raft_consensus.cc:359] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.783450 21193 raft_consensus.cc:385] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.783743 21193 raft_consensus.cc:740] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.784305 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3376286300e4b479ce6a63d53a6ed7b" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa" is_pre_election: true
I20260709 13:05:51.784473 21193 consensus_queue.cc:260] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.785141 21150 raft_consensus.cc:2393] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5017ae1b74974cf0a8b6fea7131faa92 in current term 1: Already voted for candidate 8860dc5b4b2b421983b3e0121142dd22 in this term.
I20260709 13:05:51.784863 21192 raft_consensus.cc:359] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.785696 21192 raft_consensus.cc:385] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.786056 21192 raft_consensus.cc:740] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.786628 21193 ts_tablet_manager.cc:1434] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:05:51.786723 21192 consensus_queue.cc:260] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.787361 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3376286300e4b479ce6a63d53a6ed7b" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22" is_pre_election: true
I20260709 13:05:51.788985 21192 ts_tablet_manager.cc:1434] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:51.789115 21043 leader_election.cc:304] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92; no voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:51.789933 21200 raft_consensus.cc:3060] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.797267 21231 consensus_queue.cc:1048] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:51.798894 21200 raft_consensus.cc:2749] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.805011 21200 raft_consensus.cc:493] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.807127 21200 raft_consensus.cc:515] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.810616 21200 leader_election.cc:290] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.810561 21208 raft_consensus.cc:493] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.811270 21208 raft_consensus.cc:515] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.813339 21208 leader_election.cc:290] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:51.815989 21001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22" is_pre_election: true
I20260709 13:05:51.816529 21001 raft_consensus.cc:2468] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 0.
I20260709 13:05:51.817243 21196 consensus_queue.cc:1048] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.817574 21117 leader_election.cc:304] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:51.818676 21196 raft_consensus.cc:2804] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.819062 21196 raft_consensus.cc:493] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.819410 21196 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.819478 21001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a99a29e4e434e58ae6617b376ee53b2" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22" is_pre_election: true
I20260709 13:05:51.820112 21001 raft_consensus.cc:2468] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 0.
I20260709 13:05:51.821336 21043 leader_election.cc:304] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:51.823488 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92" is_pre_election: true
I20260709 13:05:51.824131 21077 raft_consensus.cc:2468] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 0.
I20260709 13:05:51.826742 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a99a29e4e434e58ae6617b376ee53b2" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa" is_pre_election: true
I20260709 13:05:51.827432 21150 raft_consensus.cc:2468] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 0.
I20260709 13:05:51.830984 21200 raft_consensus.cc:2804] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.831627 21200 raft_consensus.cc:493] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.832098 21200 raft_consensus.cc:3060] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.826414 21196 raft_consensus.cc:515] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.835003 21001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:51.835733 21001 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.837055 21196 leader_election.cc:290] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:51.835047 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:51.843088 21077 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.842692 21200 raft_consensus.cc:515] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.846707 21000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a99a29e4e434e58ae6617b376ee53b2" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:51.846972 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a99a29e4e434e58ae6617b376ee53b2" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:51.847517 21000 raft_consensus.cc:3060] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.847579 21150 raft_consensus.cc:3060] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.857925 21000 raft_consensus.cc:2468] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 1.
I20260709 13:05:51.859787 21077 raft_consensus.cc:2468] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 1.
I20260709 13:05:51.859609 21043 leader_election.cc:304] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:51.861495 21150 raft_consensus.cc:2468] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 1.
I20260709 13:05:51.863440 21001 raft_consensus.cc:2468] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 1.
I20260709 13:05:51.863724 21115 leader_election.cc:304] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:51.864563 21196 raft_consensus.cc:2804] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.847594 21200 leader_election.cc:290] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 1 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.865243 21196 raft_consensus.cc:697] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Becoming Leader. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:51.865660 21200 raft_consensus.cc:2804] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.866127 21200 raft_consensus.cc:697] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 LEADER]: Becoming Leader. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:51.866123 21196 consensus_queue.cc:237] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.867182 21200 consensus_queue.cc:237] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.875706 20899 catalog_manager.cc:5697] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 452db08a116b47c1a40c130129d326fa (127.19.231.131). New cstate: current_term: 1 leader_uuid: "452db08a116b47c1a40c130129d326fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.876886 20900 catalog_manager.cc:5697] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.882902 21215 consensus_queue.cc:1048] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.896098 21198 consensus_queue.cc:1048] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.897766 21221 consensus_queue.cc:1048] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.906289 21252 raft_consensus.cc:493] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.907121 21252 raft_consensus.cc:515] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.909961 21252 leader_election.cc:290] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.910064 21001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9bf42b6f742a5aa8507234d579e94" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22" is_pre_election: true
I20260709 13:05:51.910720 21001 raft_consensus.cc:2468] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 0.
I20260709 13:05:51.911764 21043 leader_election.cc:304] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:51.912326 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9bf42b6f742a5aa8507234d579e94" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa" is_pre_election: true
I20260709 13:05:51.912952 21150 raft_consensus.cc:2468] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 0.
I20260709 13:05:51.913816 21252 raft_consensus.cc:2804] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.914928 21252 raft_consensus.cc:493] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.915292 21252 raft_consensus.cc:3060] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.915897 21215 consensus_queue.cc:1048] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.924682 21252 raft_consensus.cc:515] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.927001 21252 leader_election.cc:290] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 1 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:51.927819 21001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9bf42b6f742a5aa8507234d579e94" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:51.928454 21001 raft_consensus.cc:3060] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.932103 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9bf42b6f742a5aa8507234d579e94" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:51.932643 21150 raft_consensus.cc:3060] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.933769 21001 raft_consensus.cc:2468] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 1.
I20260709 13:05:51.934778 21043 leader_election.cc:304] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:51.935515 21252 raft_consensus.cc:2804] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.936017 21252 raft_consensus.cc:697] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 LEADER]: Becoming Leader. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:51.937467 21252 consensus_queue.cc:237] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:51.938530 21150 raft_consensus.cc:2468] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 1.
I20260709 13:05:51.945948 20898 catalog_manager.cc:5697] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.998090 21196 raft_consensus.cc:493] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.998606 21196 raft_consensus.cc:515] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.000365 21196 leader_election.cc:290] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:52.001164 21001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22" is_pre_election: true
I20260709 13:05:52.001365 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92" is_pre_election: true
I20260709 13:05:52.001747 21001 raft_consensus.cc:2468] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 0.
I20260709 13:05:52.001956 21077 raft_consensus.cc:2468] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 0.
I20260709 13:05:52.002879 21117 leader_election.cc:304] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:52.003603 21196 raft_consensus.cc:2804] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.003933 21196 raft_consensus.cc:493] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.004175 21196 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.008992 21196 raft_consensus.cc:515] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.010629 21196 leader_election.cc:290] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:52.011592 21001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:52.011719 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:52.012145 21001 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.012281 21077 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.016938 21077 raft_consensus.cc:2468] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 1.
I20260709 13:05:52.018003 21115 leader_election.cc:304] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:52.018442 21001 raft_consensus.cc:2468] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 1.
I20260709 13:05:52.018714 21196 raft_consensus.cc:2804] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.019248 21196 raft_consensus.cc:697] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Becoming Leader. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:52.019975 21196 consensus_queue.cc:237] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.027436 20898 catalog_manager.cc:5697] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 452db08a116b47c1a40c130129d326fa (127.19.231.131). New cstate: current_term: 1 leader_uuid: "452db08a116b47c1a40c130129d326fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.045169 21215 raft_consensus.cc:493] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.045698 21215 raft_consensus.cc:515] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.047662 21215 leader_election.cc:290] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:52.048523 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92" is_pre_election: true
I20260709 13:05:52.048730 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452db08a116b47c1a40c130129d326fa" is_pre_election: true
I20260709 13:05:52.049245 21077 raft_consensus.cc:2393] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8860dc5b4b2b421983b3e0121142dd22 in current term 1: Already voted for candidate 452db08a116b47c1a40c130129d326fa in this term.
I20260709 13:05:52.050372 20966 leader_election.cc:304] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8860dc5b4b2b421983b3e0121142dd22; no voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92
I20260709 13:05:52.051079 21215 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.055672 21215 raft_consensus.cc:2749] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.087900 21196 consensus_queue.cc:1048] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.099306 21231 consensus_queue.cc:1048] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.160271 21231 consensus_queue.cc:1048] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.172009 21231 consensus_queue.cc:1048] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.211145 21215 consensus_queue.cc:1048] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.213400 21215 consensus_queue.cc:1048] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.260591 21252 consensus_queue.cc:1048] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.272149 21252 consensus_queue.cc:1048] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.306298 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
mode: GRACEFUL
new_leader_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:47410
I20260709 13:05:52.306892 21150 raft_consensus.cc:606] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Received request to transfer leadership to TS 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:52.312065 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bf856aa2eaf4795b609c291bd2fd69d"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
mode: GRACEFUL
new_leader_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:47410
I20260709 13:05:52.312598 21150 raft_consensus.cc:606] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Received request to transfer leadership to TS 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:52.317781 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "136da1143cc6484a815dd33c61922e19"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
mode: GRACEFUL
new_leader_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:47410
I20260709 13:05:52.318410 21150 raft_consensus.cc:606] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Received request to transfer leadership to TS 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:52.326951 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
mode: GRACEFUL
new_leader_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:47410
I20260709 13:05:52.327508 21150 raft_consensus.cc:606] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Received request to transfer leadership to TS 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:52.340749 21001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
mode: GRACEFUL
new_leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
 from {username='slave'} at 127.0.0.1:42878
I20260709 13:05:52.341431 21001 raft_consensus.cc:606] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Received request to transfer leadership to TS 5017ae1b74974cf0a8b6fea7131faa92
I20260709 13:05:52.347054 21001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
mode: GRACEFUL
new_leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
 from {username='slave'} at 127.0.0.1:42878
I20260709 13:05:52.347585 21001 raft_consensus.cc:606] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Received request to transfer leadership to TS 5017ae1b74974cf0a8b6fea7131faa92
I20260709 13:05:52.352370 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
mode: GRACEFUL
new_leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
 from {username='slave'} at 127.0.0.1:47410
I20260709 13:05:52.352910 21150 raft_consensus.cc:606] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Received request to transfer leadership to TS 5017ae1b74974cf0a8b6fea7131faa92
I20260709 13:05:52.369761 21077 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a99a29e4e434e58ae6617b376ee53b2"
dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
mode: GRACEFUL
new_leader_uuid: "452db08a116b47c1a40c130129d326fa"
 from {username='slave'} at 127.0.0.1:50804
I20260709 13:05:52.370402 21077 raft_consensus.cc:606] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 LEADER]: Received request to transfer leadership to TS 452db08a116b47c1a40c130129d326fa
I20260709 13:05:52.440104 21208 consensus_queue.cc:1048] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.445456 21269 consensus_queue.cc:1048] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.447245 21231 raft_consensus.cc:993] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa: : Instructing follower 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:52.447721 21231 raft_consensus.cc:1081] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Signalling peer 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:52.450057 21002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:42858
I20260709 13:05:52.450707 21002 raft_consensus.cc:493] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.451154 21002 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.456885 21231 consensus_queue.cc:1048] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.458714 21200 consensus_queue.cc:1048] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.460480 21002 raft_consensus.cc:515] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.463052 21001 raft_consensus.cc:1240] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Rejecting Update request from peer 452db08a116b47c1a40c130129d326fa for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.464730 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:52.467329 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:52.468148 21150 raft_consensus.cc:3055] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.468576 21150 raft_consensus.cc:740] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:52.469985 21150 consensus_queue.cc:260] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.471304 21150 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.473240 21002 leader_election.cc:290] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 2 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:52.483729 21150 raft_consensus.cc:2468] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 2.
I20260709 13:05:52.485065 20966 leader_election.cc:304] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 5017ae1b74974cf0a8b6fea7131faa92
I20260709 13:05:52.485939 21198 raft_consensus.cc:2804] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.486439 21198 raft_consensus.cc:697] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:52.487329 21198 consensus_queue.cc:237] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.495816 20900 catalog_manager.cc:5697] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 1 to 2, leader changed from 452db08a116b47c1a40c130129d326fa (127.19.231.131) to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.501713 21196 raft_consensus.cc:993] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa: : Instructing follower 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:52.502172 21231 raft_consensus.cc:1081] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Signalling peer 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:52.503829 21000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:42858
I20260709 13:05:52.504717 21000 raft_consensus.cc:493] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.505066 21000 raft_consensus.cc:3060] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.509696 21000 raft_consensus.cc:515] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:52.511477 21000 leader_election.cc:290] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 2 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:52.512428 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:52.512574 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:52.513042 21077 raft_consensus.cc:3060] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.513072 21150 raft_consensus.cc:3055] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.513821 21150 raft_consensus.cc:740] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:52.514542 21150 consensus_queue.cc:260] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:52.515558 21150 raft_consensus.cc:3060] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.518396 21077 raft_consensus.cc:2468] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 2.
I20260709 13:05:52.519484 20966 leader_election.cc:304] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:52.520169 21198 raft_consensus.cc:2804] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.520606 21198 raft_consensus.cc:697] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:52.520536 21150 raft_consensus.cc:2468] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 2.
I20260709 13:05:52.521430 21198 consensus_queue.cc:237] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:52.527582 20900 catalog_manager.cc:5697] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 1 to 2, leader changed from 452db08a116b47c1a40c130129d326fa (127.19.231.131) to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.543939 21231 consensus_queue.cc:1048] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.557827 21196 consensus_queue.cc:1048] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.567463 21231 raft_consensus.cc:993] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa: : Instructing follower 5017ae1b74974cf0a8b6fea7131faa92 to start an election
I20260709 13:05:52.567977 21196 raft_consensus.cc:1081] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Signalling peer 5017ae1b74974cf0a8b6fea7131faa92 to start an election
I20260709 13:05:52.569622 21077 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263"
dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
 from {username='slave'} at 127.0.0.1:50784
I20260709 13:05:52.570297 21077 raft_consensus.cc:493] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.570683 21077 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.576159 21077 raft_consensus.cc:515] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.578233 21077 leader_election.cc:290] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 2 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:52.579321 21000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:52.579614 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:52.579944 21000 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.580248 21150 raft_consensus.cc:3055] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.580600 21150 raft_consensus.cc:740] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:52.581439 21150 consensus_queue.cc:260] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.582758 21150 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.585747 21000 raft_consensus.cc:2468] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 2.
I20260709 13:05:52.587129 21043 leader_election.cc:304] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:52.587873 21269 raft_consensus.cc:2804] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.588405 21269 raft_consensus.cc:697] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Becoming Leader. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:52.588340 21150 raft_consensus.cc:2468] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 2.
I20260709 13:05:52.589367 21269 consensus_queue.cc:237] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.596083 20898 catalog_manager.cc:5697] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 reported cstate change: term changed from 1 to 2, leader changed from 452db08a116b47c1a40c130129d326fa (127.19.231.131) to 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.661911 21252 raft_consensus.cc:993] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92: : Instructing follower 452db08a116b47c1a40c130129d326fa to start an election
I20260709 13:05:52.662469 21269 raft_consensus.cc:1081] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 LEADER]: Signalling peer 452db08a116b47c1a40c130129d326fa to start an election
I20260709 13:05:52.664057 21150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a99a29e4e434e58ae6617b376ee53b2"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
 from {username='slave'} at 127.0.0.1:47406
I20260709 13:05:52.664520 21150 raft_consensus.cc:493] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.664773 21150 raft_consensus.cc:3060] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.669414 21150 raft_consensus.cc:515] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.671124 21150 leader_election.cc:290] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 2 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:52.672070 21000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a99a29e4e434e58ae6617b376ee53b2" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:52.672293 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a99a29e4e434e58ae6617b376ee53b2" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:52.672721 21000 raft_consensus.cc:3060] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.672859 21077 raft_consensus.cc:3055] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.673444 21077 raft_consensus.cc:740] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:52.674302 21077 consensus_queue.cc:260] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.675587 21077 raft_consensus.cc:3060] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.680311 21000 raft_consensus.cc:2468] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 2.
I20260709 13:05:52.681643 21117 leader_election.cc:304] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:52.682493 21208 raft_consensus.cc:2804] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.682659 21077 raft_consensus.cc:2468] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 2.
I20260709 13:05:52.683024 21208 raft_consensus.cc:697] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 2 LEADER]: Becoming Leader. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:52.683938 21208 consensus_queue.cc:237] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.690264 20898 catalog_manager.cc:5697] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa reported cstate change: term changed from 1 to 2, leader changed from 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130) to 452db08a116b47c1a40c130129d326fa (127.19.231.131). New cstate: current_term: 2 leader_uuid: "452db08a116b47c1a40c130129d326fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.704181 21215 raft_consensus.cc:993] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22: : Instructing follower 5017ae1b74974cf0a8b6fea7131faa92 to start an election
I20260709 13:05:52.704702 21215 raft_consensus.cc:1081] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Signalling peer 5017ae1b74974cf0a8b6fea7131faa92 to start an election
I20260709 13:05:52.706081 21196 raft_consensus.cc:993] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa: : Instructing follower 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:52.706151 21077 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0"
dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
 from {username='slave'} at 127.0.0.1:50800
I20260709 13:05:52.706641 21208 raft_consensus.cc:1081] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Signalling peer 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:52.706836 21077 raft_consensus.cc:493] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.707299 21077 raft_consensus.cc:3060] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.708647 21000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "136da1143cc6484a815dd33c61922e19"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:42858
I20260709 13:05:52.709152 21000 raft_consensus.cc:493] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.709448 21000 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.712216 21077 raft_consensus.cc:515] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.713914 21077 leader_election.cc:290] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 2 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:52.714367 21000 raft_consensus.cc:515] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.715006 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:52.715130 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:52.715669 21002 raft_consensus.cc:3055] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.715713 21150 raft_consensus.cc:3060] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.716030 21002 raft_consensus.cc:740] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:52.716514 21000 leader_election.cc:290] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 2 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:52.716925 21002 consensus_queue.cc:260] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.717836 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:52.718195 21002 raft_consensus.cc:3060] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.718372 21151 raft_consensus.cc:3055] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.718709 21151 raft_consensus.cc:740] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:52.719586 21151 consensus_queue.cc:260] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.720800 21151 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.721230 21150 raft_consensus.cc:2468] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 2.
I20260709 13:05:52.722612 21041 leader_election.cc:304] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:52.722630 21077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:52.723469 21077 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.723585 21269 raft_consensus.cc:2804] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.724081 21269 raft_consensus.cc:697] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Becoming Leader. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:52.725240 21002 raft_consensus.cc:2468] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 2.
I20260709 13:05:52.724959 21269 consensus_queue.cc:237] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.730043 21077 raft_consensus.cc:2468] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 2.
I20260709 13:05:52.728685 21151 raft_consensus.cc:2468] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 2.
I20260709 13:05:52.731400 20966 leader_election.cc:304] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:52.732228 21215 raft_consensus.cc:2804] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.732685 21215 raft_consensus.cc:697] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:52.733561 21215 consensus_queue.cc:237] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.733572 20898 catalog_manager.cc:5697] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 reported cstate change: term changed from 1 to 2, leader changed from 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129) to 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.740326 20900 catalog_manager.cc:5697] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 1 to 2, leader changed from 452db08a116b47c1a40c130129d326fa (127.19.231.131) to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.838470 21196 raft_consensus.cc:993] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa: : Instructing follower 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:52.839007 21208 raft_consensus.cc:1081] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Signalling peer 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:52.840334 21198 raft_consensus.cc:993] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22: : Instructing follower 5017ae1b74974cf0a8b6fea7131faa92 to start an election
I20260709 13:05:52.840708 21002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bf856aa2eaf4795b609c291bd2fd69d"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:42858
I20260709 13:05:52.840807 21215 raft_consensus.cc:1081] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Signalling peer 5017ae1b74974cf0a8b6fea7131faa92 to start an election
I20260709 13:05:52.841256 21002 raft_consensus.cc:493] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.841629 21002 raft_consensus.cc:3060] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.842593 21077 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae"
dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
 from {username='slave'} at 127.0.0.1:50800
I20260709 13:05:52.843176 21077 raft_consensus.cc:493] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.843498 21077 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.846640 21002 raft_consensus.cc:515] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.848546 21002 leader_election.cc:290] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 2 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:52.848321 21077 raft_consensus.cc:515] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.849848 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf856aa2eaf4795b609c291bd2fd69d" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:52.849888 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf856aa2eaf4795b609c291bd2fd69d" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:52.850456 21077 leader_election.cc:290] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 2 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:52.850548 21076 raft_consensus.cc:3060] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.850471 21151 raft_consensus.cc:3055] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.851235 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:52.851521 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:52.851926 21002 raft_consensus.cc:3055] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.852061 21150 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.852360 21002 raft_consensus.cc:740] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:52.852375 21151 raft_consensus.cc:740] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:52.853401 21002 consensus_queue.cc:260] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.853511 21151 consensus_queue.cc:260] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.854583 21002 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.854867 21151 raft_consensus.cc:3060] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.858487 21076 raft_consensus.cc:2468] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 2.
I20260709 13:05:52.859921 20966 leader_election.cc:304] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:52.860891 21215 raft_consensus.cc:2804] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.860913 21150 raft_consensus.cc:2468] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 2.
I20260709 13:05:52.861624 21215 raft_consensus.cc:697] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:52.861999 21002 raft_consensus.cc:2468] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 2.
I20260709 13:05:52.862277 21041 leader_election.cc:304] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:52.862941 21151 raft_consensus.cc:2468] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 2.
I20260709 13:05:52.863179 21269 raft_consensus.cc:2804] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.862636 21215 consensus_queue.cc:237] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.863694 21269 raft_consensus.cc:697] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Becoming Leader. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:52.864499 21269 consensus_queue.cc:237] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:52.871695 20900 catalog_manager.cc:5697] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 1 to 2, leader changed from 452db08a116b47c1a40c130129d326fa (127.19.231.131) to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.873373 20898 catalog_manager.cc:5697] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 reported cstate change: term changed from 1 to 2, leader changed from 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129) to 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.959925 21076 raft_consensus.cc:1275] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.961225 21215 consensus_queue.cc:1048] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.968802 21150 raft_consensus.cc:1275] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.970522 21283 consensus_queue.cc:1048] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:52.981235 21150 raft_consensus.cc:1275] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Refusing update from remote peer 5017ae1b74974cf0a8b6fea7131faa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.982529 21269 consensus_queue.cc:1048] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.988996 21076 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.990756 21002 raft_consensus.cc:1275] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Refusing update from remote peer 5017ae1b74974cf0a8b6fea7131faa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.992408 21252 consensus_queue.cc:1048] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.997812 21076 raft_consensus.cc:1275] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.999506 21283 consensus_queue.cc:1048] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.013810 21150 raft_consensus.cc:1275] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.018158 21221 consensus_queue.cc:1048] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:53.136660 21150 raft_consensus.cc:1275] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.137975 21221 consensus_queue.cc:1048] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.145613 21076 raft_consensus.cc:1275] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.146986 21215 consensus_queue.cc:1048] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.195304 21076 raft_consensus.cc:1275] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Refusing update from remote peer 452db08a116b47c1a40c130129d326fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.196740 21208 consensus_queue.cc:1048] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.204174 21002 raft_consensus.cc:1275] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Refusing update from remote peer 452db08a116b47c1a40c130129d326fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.205715 21196 consensus_queue.cc:1048] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.228324 21150 raft_consensus.cc:1275] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Refusing update from remote peer 5017ae1b74974cf0a8b6fea7131faa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.229519 21284 consensus_queue.cc:1048] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.238224 21002 raft_consensus.cc:1275] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Refusing update from remote peer 5017ae1b74974cf0a8b6fea7131faa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.239707 21269 consensus_queue.cc:1048] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:53.243659 21076 raft_consensus.cc:1275] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.245569 21215 consensus_queue.cc:1048] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.261487 21150 raft_consensus.cc:1275] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.262854 21221 consensus_queue.cc:1048] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.325871 21002 raft_consensus.cc:1275] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Refusing update from remote peer 5017ae1b74974cf0a8b6fea7131faa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.327186 21269 consensus_queue.cc:1048] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.335879 21150 raft_consensus.cc:1275] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Refusing update from remote peer 5017ae1b74974cf0a8b6fea7131faa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.337630 21284 consensus_queue.cc:1048] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:55.401772 20382 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:55.402698 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:55.420971 21002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
mode: GRACEFUL
new_leader_uuid: "452db08a116b47c1a40c130129d326fa"
 from {username='slave'} at 127.0.0.1:42892
I20260709 13:05:55.421502 21002 raft_consensus.cc:606] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Received request to transfer leadership to TS 452db08a116b47c1a40c130129d326fa
I20260709 13:05:55.424270 21002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "136da1143cc6484a815dd33c61922e19"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
mode: GRACEFUL
new_leader_uuid: "452db08a116b47c1a40c130129d326fa"
 from {username='slave'} at 127.0.0.1:42892
I20260709 13:05:55.424789 21002 raft_consensus.cc:606] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Received request to transfer leadership to TS 452db08a116b47c1a40c130129d326fa
I20260709 13:05:55.426036 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:55.426506 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:55.520220 21221 raft_consensus.cc:993] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22: : Instructing follower 452db08a116b47c1a40c130129d326fa to start an election
I20260709 13:05:55.520707 21221 raft_consensus.cc:1081] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Signalling peer 452db08a116b47c1a40c130129d326fa to start an election
I20260709 13:05:55.522169 21150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
 from {username='slave'} at 127.0.0.1:47394
I20260709 13:05:55.522661 21150 raft_consensus.cc:493] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:55.522965 21150 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.527036 21150 raft_consensus.cc:515] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:55.528446 21150 leader_election.cc:290] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 3 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:55.529814 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:55.529723 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:55.530500 21076 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.530479 21002 raft_consensus.cc:3055] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:55.531073 21002 raft_consensus.cc:740] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:55.531898 21002 consensus_queue.cc:260] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:55.533133 21002 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.537755 21076 raft_consensus.cc:2468] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 3.
I20260709 13:05:55.539193 21115 leader_election.cc:304] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:55.540205 21295 raft_consensus.cc:2804] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:55.540100 21002 raft_consensus.cc:2468] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 3.
I20260709 13:05:55.541565 21295 raft_consensus.cc:697] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Becoming Leader. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:55.542392 21295 consensus_queue.cc:237] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:55.549376 20900 catalog_manager.cc:5697] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa reported cstate change: term changed from 2 to 3, leader changed from 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129) to 452db08a116b47c1a40c130129d326fa (127.19.231.131). New cstate: current_term: 3 leader_uuid: "452db08a116b47c1a40c130129d326fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.742066 21298 raft_consensus.cc:993] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22: : Instructing follower 452db08a116b47c1a40c130129d326fa to start an election
I20260709 13:05:55.742543 21221 raft_consensus.cc:1081] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Signalling peer 452db08a116b47c1a40c130129d326fa to start an election
I20260709 13:05:55.744129 21150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "136da1143cc6484a815dd33c61922e19"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
 from {username='slave'} at 127.0.0.1:47394
I20260709 13:05:55.744675 21150 raft_consensus.cc:493] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:55.745049 21150 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.750453 21150 raft_consensus.cc:515] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:55.751869 21150 leader_election.cc:290] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 3 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:55.752950 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:55.752943 21002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:55.753616 21076 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.753705 21002 raft_consensus.cc:3055] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:55.754105 21002 raft_consensus.cc:740] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:55.754740 21002 consensus_queue.cc:260] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:55.755702 21002 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.759563 21076 raft_consensus.cc:2468] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 3.
I20260709 13:05:55.760749 21002 raft_consensus.cc:2468] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 3.
I20260709 13:05:55.760756 21115 leader_election.cc:304] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:55.761629 21295 raft_consensus.cc:2804] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:55.762131 21295 raft_consensus.cc:697] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Becoming Leader. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:55.762907 21295 consensus_queue.cc:237] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:55.772678 20900 catalog_manager.cc:5697] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa reported cstate change: term changed from 2 to 3, leader changed from 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129) to 452db08a116b47c1a40c130129d326fa (127.19.231.131). New cstate: current_term: 3 leader_uuid: "452db08a116b47c1a40c130129d326fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.066471 21000 raft_consensus.cc:1275] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Refusing update from remote peer 452db08a116b47c1a40c130129d326fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.067843 21295 consensus_queue.cc:1048] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.077231 21076 raft_consensus.cc:1275] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Refusing update from remote peer 452db08a116b47c1a40c130129d326fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.078536 21299 consensus_queue.cc:1048] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.152915 21076 raft_consensus.cc:1275] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Refusing update from remote peer 452db08a116b47c1a40c130129d326fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.154191 21309 consensus_queue.cc:1048] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.164813 21000 raft_consensus.cc:1275] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Refusing update from remote peer 452db08a116b47c1a40c130129d326fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.166128 21295 consensus_queue.cc:1048] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.427438 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:56.443023 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "136da1143cc6484a815dd33c61922e19"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
mode: GRACEFUL
new_leader_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:47410
I20260709 13:05:56.443629 21150 raft_consensus.cc:606] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Received request to transfer leadership to TS 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:56.451332 21150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
mode: GRACEFUL
new_leader_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:47410
I20260709 13:05:56.451819 21150 raft_consensus.cc:606] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Received request to transfer leadership to TS 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:56.456781 21076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0"
dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
mode: GRACEFUL
new_leader_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:50804
I20260709 13:05:56.457248 21076 raft_consensus.cc:606] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Received request to transfer leadership to TS 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:56.462119 21076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae"
dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
mode: GRACEFUL
new_leader_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:50804
I20260709 13:05:56.462596 21076 raft_consensus.cc:606] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Received request to transfer leadership to TS 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:56.467234 21076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263"
dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
mode: GRACEFUL
new_leader_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:50804
I20260709 13:05:56.467724 21076 raft_consensus.cc:606] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Received request to transfer leadership to TS 8860dc5b4b2b421983b3e0121142dd22
I20260709 13:05:56.603287 21299 raft_consensus.cc:993] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa: : Instructing follower 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:56.603751 21295 raft_consensus.cc:1081] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Signalling peer 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:56.605333 21000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:42858
I20260709 13:05:56.605814 21000 raft_consensus.cc:493] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.606074 21000 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.610653 21000 raft_consensus.cc:515] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.612331 21000 leader_election.cc:290] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 4 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:56.613091 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:56.613394 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fcb394546d4fd2a31add17c16a01d1" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:56.613660 21076 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.613919 21150 raft_consensus.cc:3055] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:56.614219 21150 raft_consensus.cc:740] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:56.614943 21150 consensus_queue.cc:260] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.615775 21150 raft_consensus.cc:3060] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.618971 21076 raft_consensus.cc:2468] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 4.
I20260709 13:05:56.620223 20966 leader_election.cc:304] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:56.620512 21150 raft_consensus.cc:2468] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 4.
I20260709 13:05:56.621060 21221 raft_consensus.cc:2804] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:56.622040 21221 raft_consensus.cc:697] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:56.622990 21221 consensus_queue.cc:237] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.629540 20899 catalog_manager.cc:5697] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 3 to 4, leader changed from 452db08a116b47c1a40c130129d326fa (127.19.231.131) to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 4 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.680493 21299 raft_consensus.cc:993] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa: : Instructing follower 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:56.680932 21295 raft_consensus.cc:1081] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Signalling peer 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:56.682561 21000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "136da1143cc6484a815dd33c61922e19"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:42858
I20260709 13:05:56.683135 21000 raft_consensus.cc:493] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.683495 21000 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.688050 21000 raft_consensus.cc:515] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.689621 21000 leader_election.cc:290] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 4 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:56.690614 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:56.690757 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136da1143cc6484a815dd33c61922e19" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:56.691303 21076 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.691373 21150 raft_consensus.cc:3055] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:56.691742 21150 raft_consensus.cc:740] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:56.692310 21150 consensus_queue.cc:260] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.693351 21150 raft_consensus.cc:3060] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.696714 21076 raft_consensus.cc:2468] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 4.
I20260709 13:05:56.697803 21150 raft_consensus.cc:2468] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 4.
I20260709 13:05:56.697940 20966 leader_election.cc:304] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5017ae1b74974cf0a8b6fea7131faa92, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:56.698747 21221 raft_consensus.cc:2804] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:56.699237 21221 raft_consensus.cc:697] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:56.699990 21221 consensus_queue.cc:237] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.705482 20899 catalog_manager.cc:5697] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 3 to 4, leader changed from 452db08a116b47c1a40c130129d326fa (127.19.231.131) to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 4 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.725091 21306 raft_consensus.cc:993] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92: : Instructing follower 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:56.725524 21306 raft_consensus.cc:1081] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Signalling peer 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:56.727005 21000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:42864
I20260709 13:05:56.727514 21000 raft_consensus.cc:493] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.727807 21000 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.732771 21000 raft_consensus.cc:515] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.734393 21000 leader_election.cc:290] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 3 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:56.735427 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:56.735553 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:56.735988 21076 raft_consensus.cc:3055] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:56.736044 21150 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.736263 21076 raft_consensus.cc:740] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:56.737025 21076 consensus_queue.cc:260] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.737934 21076 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.740724 21150 raft_consensus.cc:2468] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 3.
I20260709 13:05:56.741752 20966 leader_election.cc:304] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:56.741989 21076 raft_consensus.cc:2468] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 3.
I20260709 13:05:56.742543 21221 raft_consensus.cc:2804] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:56.743074 21221 raft_consensus.cc:697] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:56.743891 21221 consensus_queue.cc:237] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.750828 20899 catalog_manager.cc:5697] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 2 to 3, leader changed from 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130) to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.763773 21319 raft_consensus.cc:993] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92: : Instructing follower 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:56.764257 21306 raft_consensus.cc:1081] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Signalling peer 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:56.765699 21000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:42864
I20260709 13:05:56.766160 21000 raft_consensus.cc:493] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.766420 21000 raft_consensus.cc:3060] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.771203 21000 raft_consensus.cc:515] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.772706 21000 leader_election.cc:290] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 3 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:56.773627 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:56.773900 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b947e6221054903ba6b1a78eed46df0" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:56.774230 21076 raft_consensus.cc:3055] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:56.774350 21150 raft_consensus.cc:3060] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.774564 21076 raft_consensus.cc:740] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:56.775305 21076 consensus_queue.cc:260] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.776369 21076 raft_consensus.cc:3060] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.780602 21150 raft_consensus.cc:2468] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 3.
I20260709 13:05:56.781708 20966 leader_election.cc:304] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:56.782083 21076 raft_consensus.cc:2468] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 3.
I20260709 13:05:56.782404 21221 raft_consensus.cc:2804] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:56.782941 21221 raft_consensus.cc:697] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:56.783665 21221 consensus_queue.cc:237] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.790196 20899 catalog_manager.cc:5697] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 2 to 3, leader changed from 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130) to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.875906 21319 raft_consensus.cc:993] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92: : Instructing follower 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:56.876302 21306 raft_consensus.cc:1081] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Signalling peer 8860dc5b4b2b421983b3e0121142dd22 to start an election
I20260709 13:05:56.877830 21000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
 from {username='slave'} at 127.0.0.1:42864
I20260709 13:05:56.878336 21000 raft_consensus.cc:493] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.878652 21000 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.883214 21000 raft_consensus.cc:515] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.885231 21000 leader_election.cc:290] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 3 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:56.885855 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:56.886449 21076 raft_consensus.cc:3055] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:56.886449 21150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae" candidate_uuid: "8860dc5b4b2b421983b3e0121142dd22" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:56.886996 21076 raft_consensus.cc:740] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:56.887168 21150 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.887739 21076 consensus_queue.cc:260] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.888839 21076 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.893412 21150 raft_consensus.cc:2468] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 3.
I20260709 13:05:56.894620 20966 leader_election.cc:304] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 8860dc5b4b2b421983b3e0121142dd22; no voters: 
I20260709 13:05:56.894693 21076 raft_consensus.cc:2468] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8860dc5b4b2b421983b3e0121142dd22 in term 3.
I20260709 13:05:56.895453 21221 raft_consensus.cc:2804] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:56.895932 21221 raft_consensus.cc:697] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Becoming Leader. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:56.896652 21221 consensus_queue.cc:237] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:56.903595 20899 catalog_manager.cc:5697] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 reported cstate change: term changed from 2 to 3, leader changed from 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130) to 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "8860dc5b4b2b421983b3e0121142dd22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.053428 21076 raft_consensus.cc:1275] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:57.054847 21221 consensus_queue.cc:1048] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.067301 21150 raft_consensus.cc:1275] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:57.068852 21325 consensus_queue.cc:1048] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:57.212973 21150 raft_consensus.cc:1275] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.214136 21325 consensus_queue.cc:1048] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.224732 21076 raft_consensus.cc:1275] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.226186 21221 consensus_queue.cc:1048] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.233978 21151 raft_consensus.cc:1275] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.235316 21315 consensus_queue.cc:1048] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.244481 21076 raft_consensus.cc:1275] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.245673 21325 consensus_queue.cc:1048] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.255733 21151 raft_consensus.cc:1275] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:57.257028 21315 consensus_queue.cc:1048] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.266532 21076 raft_consensus.cc:1275] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:57.269357 21315 consensus_queue.cc:1048] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:57.326138 21077 raft_consensus.cc:1275] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.327381 21315 consensus_queue.cc:1048] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.335832 21151 raft_consensus.cc:1275] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Refusing update from remote peer 8860dc5b4b2b421983b3e0121142dd22: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.337613 21221 consensus_queue.cc:1048] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:59.475325 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:59.484504 21000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
mode: GRACEFUL
new_leader_uuid: "452db08a116b47c1a40c130129d326fa"
 from {username='slave'} at 127.0.0.1:42892
I20260709 13:05:59.485509 21000 raft_consensus.cc:606] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Received request to transfer leadership to TS 452db08a116b47c1a40c130129d326fa
I20260709 13:05:59.488515 21000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
mode: GRACEFUL
new_leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
 from {username='slave'} at 127.0.0.1:42892
I20260709 13:05:59.489030 21000 raft_consensus.cc:606] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Received request to transfer leadership to TS 5017ae1b74974cf0a8b6fea7131faa92
I20260709 13:05:59.491386 21000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
mode: GRACEFUL
new_leader_uuid: "452db08a116b47c1a40c130129d326fa"
 from {username='slave'} at 127.0.0.1:42892
I20260709 13:05:59.491906 21000 raft_consensus.cc:606] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Received request to transfer leadership to TS 452db08a116b47c1a40c130129d326fa
I20260709 13:05:59.494199 21000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3376286300e4b479ce6a63d53a6ed7b"
dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
mode: GRACEFUL
new_leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
 from {username='slave'} at 127.0.0.1:42892
I20260709 13:05:59.494712 21000 raft_consensus.cc:606] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Received request to transfer leadership to TS 5017ae1b74974cf0a8b6fea7131faa92
I20260709 13:05:59.495879 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:59.496353 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:59.659828 21337 raft_consensus.cc:993] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22: : Instructing follower 5017ae1b74974cf0a8b6fea7131faa92 to start an election
I20260709 13:05:59.660429 21341 raft_consensus.cc:1081] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Signalling peer 5017ae1b74974cf0a8b6fea7131faa92 to start an election
I20260709 13:05:59.662134 21076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263"
dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
 from {username='slave'} at 127.0.0.1:50800
I20260709 13:05:59.662647 21076 raft_consensus.cc:493] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.663049 21076 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.668318 21076 raft_consensus.cc:515] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:59.670241 21076 leader_election.cc:290] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 4 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:59.671123 21000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:59.671453 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfd26e12c0a4b6093b8362bb92bc263" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:59.671788 21000 raft_consensus.cc:3055] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:59.672129 21151 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.672144 21000 raft_consensus.cc:740] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:59.673223 21000 consensus_queue.cc:260] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:59.674327 21000 raft_consensus.cc:3060] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.678434 21151 raft_consensus.cc:2468] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 4.
I20260709 13:05:59.679253 21000 raft_consensus.cc:2468] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 4.
I20260709 13:05:59.679888 21041 leader_election.cc:304] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:59.680778 21340 raft_consensus.cc:2804] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:59.681582 21340 raft_consensus.cc:697] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 LEADER]: Becoming Leader. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:59.682322 21340 consensus_queue.cc:237] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:59.689023 20900 catalog_manager.cc:5697] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 reported cstate change: term changed from 3 to 4, leader changed from 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129) to 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130). New cstate: current_term: 4 leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.707906 21337 raft_consensus.cc:993] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22: : Instructing follower 452db08a116b47c1a40c130129d326fa to start an election
I20260709 13:05:59.708320 21341 raft_consensus.cc:1081] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Signalling peer 452db08a116b47c1a40c130129d326fa to start an election
I20260709 13:05:59.709693 21151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
 from {username='slave'} at 127.0.0.1:47394
I20260709 13:05:59.710173 21151 raft_consensus.cc:493] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.710484 21151 raft_consensus.cc:3060] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.715893 21151 raft_consensus.cc:515] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:59.717783 21151 leader_election.cc:290] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 3 election: Requested vote from peers 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143), 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395)
I20260709 13:05:59.718896 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:59.718969 21000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6465571f084d1585a86b2e14e68fba" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:59.719655 21000 raft_consensus.cc:3055] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:59.719622 21076 raft_consensus.cc:3060] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.720088 21000 raft_consensus.cc:740] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:59.720840 21000 consensus_queue.cc:260] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:59.722007 21000 raft_consensus.cc:3060] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.726271 21076 raft_consensus.cc:2468] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 3.
I20260709 13:05:59.727670 21115 leader_election.cc:304] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:59.727982 21000 raft_consensus.cc:2468] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 3.
I20260709 13:05:59.728525 21339 raft_consensus.cc:2804] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:59.729091 21339 raft_consensus.cc:697] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Becoming Leader. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:59.729933 21339 consensus_queue.cc:237] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } }
I20260709 13:05:59.737058 20900 catalog_manager.cc:5697] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa reported cstate change: term changed from 2 to 3, leader changed from 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129) to 452db08a116b47c1a40c130129d326fa (127.19.231.131). New cstate: current_term: 3 leader_uuid: "452db08a116b47c1a40c130129d326fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.751556 21337 raft_consensus.cc:993] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22: : Instructing follower 5017ae1b74974cf0a8b6fea7131faa92 to start an election
I20260709 13:05:59.751981 21341 raft_consensus.cc:1081] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Signalling peer 5017ae1b74974cf0a8b6fea7131faa92 to start an election
I20260709 13:05:59.753294 21076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3376286300e4b479ce6a63d53a6ed7b"
dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
 from {username='slave'} at 127.0.0.1:50800
I20260709 13:05:59.753731 21076 raft_consensus.cc:493] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.754020 21076 raft_consensus.cc:3060] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.758253 21076 raft_consensus.cc:515] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:59.759914 21076 leader_election.cc:290] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 2 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 452db08a116b47c1a40c130129d326fa (127.19.231.131:38747)
I20260709 13:05:59.760695 21000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3376286300e4b479ce6a63d53a6ed7b" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:59.761003 21151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3376286300e4b479ce6a63d53a6ed7b" candidate_uuid: "5017ae1b74974cf0a8b6fea7131faa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "452db08a116b47c1a40c130129d326fa"
I20260709 13:05:59.761220 21000 raft_consensus.cc:3055] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.761523 21000 raft_consensus.cc:740] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:59.761554 21151 raft_consensus.cc:3060] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.762351 21000 consensus_queue.cc:260] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:59.763216 21000 raft_consensus.cc:3060] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.766603 21151 raft_consensus.cc:2468] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 2.
I20260709 13:05:59.767446 21000 raft_consensus.cc:2468] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5017ae1b74974cf0a8b6fea7131faa92 in term 2.
I20260709 13:05:59.767665 21041 leader_election.cc:304] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:59.768525 21340 raft_consensus.cc:2804] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.768859 21340 raft_consensus.cc:697] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Becoming Leader. State: Replica: 5017ae1b74974cf0a8b6fea7131faa92, State: Running, Role: LEADER
I20260709 13:05:59.769632 21340 consensus_queue.cc:237] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:59.777053 20900 catalog_manager.cc:5697] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 reported cstate change: term changed from 1 to 2, leader changed from 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129) to 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5017ae1b74974cf0a8b6fea7131faa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.805529 21337 raft_consensus.cc:993] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22: : Instructing follower 452db08a116b47c1a40c130129d326fa to start an election
I20260709 13:05:59.805995 21337 raft_consensus.cc:1081] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Signalling peer 452db08a116b47c1a40c130129d326fa to start an election
I20260709 13:05:59.807389 21151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae"
dest_uuid: "452db08a116b47c1a40c130129d326fa"
 from {username='slave'} at 127.0.0.1:47394
I20260709 13:05:59.807871 21151 raft_consensus.cc:493] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.808169 21151 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.812752 21151 raft_consensus.cc:515] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:59.814519 21151 leader_election.cc:290] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 4 election: Requested vote from peers 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395), 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143)
I20260709 13:05:59.815347 21000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8860dc5b4b2b421983b3e0121142dd22"
I20260709 13:05:59.815510 21076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab132bf70d4f4a8995c3682717eff5ae" candidate_uuid: "452db08a116b47c1a40c130129d326fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5017ae1b74974cf0a8b6fea7131faa92"
I20260709 13:05:59.815919 21000 raft_consensus.cc:3055] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:59.815958 21076 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.816385 21000 raft_consensus.cc:740] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8860dc5b4b2b421983b3e0121142dd22, State: Running, Role: LEADER
I20260709 13:05:59.817250 21000 consensus_queue.cc:260] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:59.818410 21000 raft_consensus.cc:3060] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.822475 21076 raft_consensus.cc:2468] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 4.
I20260709 13:05:59.823563 21115 leader_election.cc:304] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452db08a116b47c1a40c130129d326fa, 5017ae1b74974cf0a8b6fea7131faa92; no voters: 
I20260709 13:05:59.824441 21339 raft_consensus.cc:2804] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:59.824761 21000 raft_consensus.cc:2468] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452db08a116b47c1a40c130129d326fa in term 4.
I20260709 13:05:59.824941 21339 raft_consensus.cc:697] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 4 LEADER]: Becoming Leader. State: Replica: 452db08a116b47c1a40c130129d326fa, State: Running, Role: LEADER
I20260709 13:05:59.825843 21339 consensus_queue.cc:237] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } }
I20260709 13:05:59.832931 20900 catalog_manager.cc:5697] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa reported cstate change: term changed from 3 to 4, leader changed from 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129) to 452db08a116b47c1a40c130129d326fa (127.19.231.131). New cstate: current_term: 4 leader_uuid: "452db08a116b47c1a40c130129d326fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.187189 21151 raft_consensus.cc:1275] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Refusing update from remote peer 5017ae1b74974cf0a8b6fea7131faa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.188608 21340 consensus_queue.cc:1048] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.198871 21000 raft_consensus.cc:1275] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Refusing update from remote peer 5017ae1b74974cf0a8b6fea7131faa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.200310 21340 consensus_queue.cc:1048] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.246949 21151 raft_consensus.cc:1275] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Refusing update from remote peer 5017ae1b74974cf0a8b6fea7131faa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:00.248355 21340 consensus_queue.cc:1048] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452db08a116b47c1a40c130129d326fa" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:00.257017 21000 raft_consensus.cc:1275] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Refusing update from remote peer 5017ae1b74974cf0a8b6fea7131faa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:00.258939 21340 consensus_queue.cc:1048] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:00.283250 21000 raft_consensus.cc:1275] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Refusing update from remote peer 452db08a116b47c1a40c130129d326fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.284417 21339 consensus_queue.cc:1048] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:00.290618 21000 raft_consensus.cc:1275] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Refusing update from remote peer 452db08a116b47c1a40c130129d326fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:00.293562 21076 raft_consensus.cc:1275] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Refusing update from remote peer 452db08a116b47c1a40c130129d326fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.293637 21338 consensus_queue.cc:1048] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8860dc5b4b2b421983b3e0121142dd22" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:00.295696 21360 consensus_queue.cc:1048] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:00.309051 21076 raft_consensus.cc:1275] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Refusing update from remote peer 452db08a116b47c1a40c130129d326fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:00.311498 21360 consensus_queue.cc:1048] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5017ae1b74974cf0a8b6fea7131faa92" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:00.497242 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:00.503327 20382 tablet_server.cc:179] TabletServer@127.19.231.129:0 shutting down...
I20260709 13:06:00.528316 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:00.529138 20382 tablet_replica.cc:333] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22: stopping tablet replica
I20260709 13:06:00.530128 20382 raft_consensus.cc:2243] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.531026 20382 raft_consensus.cc:2272] T 136da1143cc6484a815dd33c61922e19 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.532737 20382 tablet_replica.cc:333] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22: stopping tablet replica
I20260709 13:06:00.533354 20382 raft_consensus.cc:2243] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.533725 20382 raft_consensus.cc:2272] T 1b6465571f084d1585a86b2e14e68fba P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.535753 20382 tablet_replica.cc:333] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22: stopping tablet replica
I20260709 13:06:00.536268 20382 raft_consensus.cc:2243] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.536608 20382 raft_consensus.cc:2272] T 7a99a29e4e434e58ae6617b376ee53b2 P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.538300 20382 tablet_replica.cc:333] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22: stopping tablet replica
I20260709 13:06:00.538728 20382 raft_consensus.cc:2243] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.539182 20382 raft_consensus.cc:2272] T ab132bf70d4f4a8995c3682717eff5ae P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.541082 20382 tablet_replica.cc:333] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22: stopping tablet replica
I20260709 13:06:00.541570 20382 raft_consensus.cc:2243] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.542258 20382 raft_consensus.cc:2272] T 06fcb394546d4fd2a31add17c16a01d1 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.543905 20382 tablet_replica.cc:333] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22: stopping tablet replica
I20260709 13:06:00.544327 20382 raft_consensus.cc:2243] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.544682 20382 raft_consensus.cc:2272] T 02b9bf42b6f742a5aa8507234d579e94 P 8860dc5b4b2b421983b3e0121142dd22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.546281 20382 tablet_replica.cc:333] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22: stopping tablet replica
I20260709 13:06:00.546693 20382 raft_consensus.cc:2243] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.547492 20382 raft_consensus.cc:2272] T 3b947e6221054903ba6b1a78eed46df0 P 8860dc5b4b2b421983b3e0121142dd22 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.549229 20382 tablet_replica.cc:333] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22: stopping tablet replica
I20260709 13:06:00.549818 20382 raft_consensus.cc:2243] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.550396 20382 raft_consensus.cc:2272] T 4cfd26e12c0a4b6093b8362bb92bc263 P 8860dc5b4b2b421983b3e0121142dd22 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.552858 20382 tablet_replica.cc:333] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22: stopping tablet replica
I20260709 13:06:00.553369 20382 raft_consensus.cc:2243] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.554041 20382 raft_consensus.cc:2272] T 7bf856aa2eaf4795b609c291bd2fd69d P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.556033 20382 tablet_replica.cc:333] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22: stopping tablet replica
I20260709 13:06:00.556506 20382 raft_consensus.cc:2243] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.556833 20382 raft_consensus.cc:2272] T c3376286300e4b479ce6a63d53a6ed7b P 8860dc5b4b2b421983b3e0121142dd22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.587380 20382 tablet_server.cc:196] TabletServer@127.19.231.129:0 shutdown complete.
I20260709 13:06:00.607651 20382 tablet_server.cc:179] TabletServer@127.19.231.130:0 shutting down...
I20260709 13:06:00.630620 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:00.631469 20382 tablet_replica.cc:333] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92: stopping tablet replica
I20260709 13:06:00.632117 20382 raft_consensus.cc:2243] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.632967 20382 raft_consensus.cc:2272] T 02b9bf42b6f742a5aa8507234d579e94 P 5017ae1b74974cf0a8b6fea7131faa92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.634864 20382 tablet_replica.cc:333] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92: stopping tablet replica
I20260709 13:06:00.635428 20382 raft_consensus.cc:2243] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.635854 20382 raft_consensus.cc:2272] T 3b947e6221054903ba6b1a78eed46df0 P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.637531 20382 tablet_replica.cc:333] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92: stopping tablet replica
I20260709 13:06:00.638123 20382 raft_consensus.cc:2243] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.639219 20382 raft_consensus.cc:2272] T 4cfd26e12c0a4b6093b8362bb92bc263 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.641887 20382 tablet_replica.cc:333] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92: stopping tablet replica
I20260709 13:06:00.642362 20382 raft_consensus.cc:2243] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.642755 20382 raft_consensus.cc:2272] T 7bf856aa2eaf4795b609c291bd2fd69d P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.644593 20382 tablet_replica.cc:333] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92: stopping tablet replica
I20260709 13:06:00.645056 20382 raft_consensus.cc:2243] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.645742 20382 raft_consensus.cc:2272] T c3376286300e4b479ce6a63d53a6ed7b P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.647835 20382 tablet_replica.cc:333] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92: stopping tablet replica
I20260709 13:06:00.648384 20382 raft_consensus.cc:2243] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.648906 20382 raft_consensus.cc:2272] T 136da1143cc6484a815dd33c61922e19 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.650571 20382 tablet_replica.cc:333] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92: stopping tablet replica
I20260709 13:06:00.651118 20382 raft_consensus.cc:2243] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.651564 20382 raft_consensus.cc:2272] T 06fcb394546d4fd2a31add17c16a01d1 P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.653293 20382 tablet_replica.cc:333] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92: stopping tablet replica
I20260709 13:06:00.653759 20382 raft_consensus.cc:2243] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.654196 20382 raft_consensus.cc:2272] T 7a99a29e4e434e58ae6617b376ee53b2 P 5017ae1b74974cf0a8b6fea7131faa92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.655833 20382 tablet_replica.cc:333] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92: stopping tablet replica
I20260709 13:06:00.656289 20382 raft_consensus.cc:2243] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.656702 20382 raft_consensus.cc:2272] T ab132bf70d4f4a8995c3682717eff5ae P 5017ae1b74974cf0a8b6fea7131faa92 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.658926 20382 tablet_replica.cc:333] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92: stopping tablet replica
I20260709 13:06:00.659412 20382 raft_consensus.cc:2243] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.659843 20382 raft_consensus.cc:2272] T 1b6465571f084d1585a86b2e14e68fba P 5017ae1b74974cf0a8b6fea7131faa92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.689231 20382 tablet_server.cc:196] TabletServer@127.19.231.130:0 shutdown complete.
I20260709 13:06:00.709192 20382 tablet_server.cc:179] TabletServer@127.19.231.131:0 shutting down...
W20260709 13:06:00.712675 21115 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.130:43143: connect: Connection refused (error 111)
W20260709 13:06:00.718814 21115 consensus_peers.cc:597] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa -> Peer 5017ae1b74974cf0a8b6fea7131faa92 (127.19.231.130:43143): Couldn't send request to peer 5017ae1b74974cf0a8b6fea7131faa92. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:43143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:00.739319 21117 consensus_peers.cc:597] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa -> Peer 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395): Couldn't send request to peer 8860dc5b4b2b421983b3e0121142dd22. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.740200 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:00.740823 20382 tablet_replica.cc:333] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa: stopping tablet replica
I20260709 13:06:00.741385 20382 raft_consensus.cc:2243] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.741849 20382 raft_consensus.cc:2272] T 136da1143cc6484a815dd33c61922e19 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.743782 20382 tablet_replica.cc:333] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa: stopping tablet replica
I20260709 13:06:00.744313 20382 raft_consensus.cc:2243] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.744794 20382 raft_consensus.cc:2272] T 4cfd26e12c0a4b6093b8362bb92bc263 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.747455 20382 tablet_replica.cc:333] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa: stopping tablet replica
I20260709 13:06:00.748263 20382 raft_consensus.cc:2243] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.748788 20382 raft_consensus.cc:2272] T 7bf856aa2eaf4795b609c291bd2fd69d P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.751243 20382 tablet_replica.cc:333] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa: stopping tablet replica
W20260709 13:06:00.751230 21117 consensus_peers.cc:597] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa -> Peer 8860dc5b4b2b421983b3e0121142dd22 (127.19.231.129:36395): Couldn't send request to peer 8860dc5b4b2b421983b3e0121142dd22. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.752074 20382 raft_consensus.cc:2243] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.752485 20382 raft_consensus.cc:2272] T c3376286300e4b479ce6a63d53a6ed7b P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.755200 20382 tablet_replica.cc:333] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa: stopping tablet replica
I20260709 13:06:00.755676 20382 raft_consensus.cc:2243] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.756039 20382 raft_consensus.cc:2272] T 02b9bf42b6f742a5aa8507234d579e94 P 452db08a116b47c1a40c130129d326fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.757800 20382 tablet_replica.cc:333] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa: stopping tablet replica
I20260709 13:06:00.758273 20382 raft_consensus.cc:2243] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.758730 20382 raft_consensus.cc:2272] T 3b947e6221054903ba6b1a78eed46df0 P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.760689 20382 tablet_replica.cc:333] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa: stopping tablet replica
I20260709 13:06:00.761209 20382 raft_consensus.cc:2243] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.762063 20382 raft_consensus.cc:2272] T 7a99a29e4e434e58ae6617b376ee53b2 P 452db08a116b47c1a40c130129d326fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.763798 20382 tablet_replica.cc:333] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa: stopping tablet replica
I20260709 13:06:00.764300 20382 raft_consensus.cc:2243] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.764737 20382 raft_consensus.cc:2272] T 06fcb394546d4fd2a31add17c16a01d1 P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.766371 20382 tablet_replica.cc:333] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa: stopping tablet replica
I20260709 13:06:00.766909 20382 raft_consensus.cc:2243] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.767643 20382 raft_consensus.cc:2272] T ab132bf70d4f4a8995c3682717eff5ae P 452db08a116b47c1a40c130129d326fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.769912 20382 tablet_replica.cc:333] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa: stopping tablet replica
I20260709 13:06:00.770414 20382 raft_consensus.cc:2243] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.771236 20382 raft_consensus.cc:2272] T 1b6465571f084d1585a86b2e14e68fba P 452db08a116b47c1a40c130129d326fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.800031 20382 tablet_server.cc:196] TabletServer@127.19.231.131:0 shutdown complete.
I20260709 13:06:00.818301 20382 master.cc:562] Master@127.19.231.190:37807 shutting down...
I20260709 13:06:00.840827 20382 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.841378 20382 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.841715 20382 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8689a6498eda4ca08c8eab9a29a852b4: stopping tablet replica
I20260709 13:06:00.861475 20382 master.cc:584] Master@127.19.231.190:37807 shutdown complete.
452db08a116b47c1a40c130129d326fa  1
5017ae1b74974cf0a8b6fea7131faa92  4
8860dc5b4b2b421983b3e0121142dd22  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10671 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:06:00.902920 20382 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.231.190:34603
I20260709 13:06:00.904039 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:00.910543 21368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.910580 21367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.911167 21370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:00.911989 20382 server_base.cc:1061] running on GCE node
I20260709 13:06:00.912781 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:00.912971 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:00.913084 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602360913074 us; error 0 us; skew 500 ppm
I20260709 13:06:00.913537 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:00.915964 20382 webserver.cc:533] Webserver started at http://127.19.231.190:45801/ using document root <none> and password file <none>
I20260709 13:06:00.916406 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:00.916556 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:00.916779 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:00.917908 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/master-0-root/instance:
uuid: "8a31697310664f6da99c69fbc04b3926"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-1t6m"
I20260709 13:06:00.922469 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:06:00.925971 21375 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.926915 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:00.927251 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/master-0-root
uuid: "8a31697310664f6da99c69fbc04b3926"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-1t6m"
I20260709 13:06:00.927558 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:00.940490 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:00.941753 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:00.981137 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.190:34603
I20260709 13:06:00.981248 21426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.190:34603 every 8 connection(s)
I20260709 13:06:00.985350 21427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:00.996045 21427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Bootstrap starting.
I20260709 13:06:01.001137 21427 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.005609 21427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: No bootstrap required, opened a new log
I20260709 13:06:01.007934 21427 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a31697310664f6da99c69fbc04b3926" member_type: VOTER }
I20260709 13:06:01.008389 21427 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.008646 21427 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a31697310664f6da99c69fbc04b3926, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.009268 21427 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a31697310664f6da99c69fbc04b3926" member_type: VOTER }
I20260709 13:06:01.009758 21427 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:01.010012 21427 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:01.010330 21427 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.014983 21427 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a31697310664f6da99c69fbc04b3926" member_type: VOTER }
I20260709 13:06:01.015594 21427 leader_election.cc:304] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a31697310664f6da99c69fbc04b3926; no voters: 
I20260709 13:06:01.016767 21427 leader_election.cc:290] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:01.017088 21430 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:01.018613 21430 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 1 LEADER]: Becoming Leader. State: Replica: 8a31697310664f6da99c69fbc04b3926, State: Running, Role: LEADER
I20260709 13:06:01.019307 21430 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a31697310664f6da99c69fbc04b3926" member_type: VOTER }
I20260709 13:06:01.020298 21427 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:01.024466 21431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a31697310664f6da99c69fbc04b3926" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a31697310664f6da99c69fbc04b3926" member_type: VOTER } }
I20260709 13:06:01.025403 21432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a31697310664f6da99c69fbc04b3926. Latest consensus state: current_term: 1 leader_uuid: "8a31697310664f6da99c69fbc04b3926" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a31697310664f6da99c69fbc04b3926" member_type: VOTER } }
I20260709 13:06:01.025440 21431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:01.025997 21432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:01.027694 21436 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:01.033061 21436 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:01.038290 20382 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:01.042326 21436 catalog_manager.cc:1383] Generated new cluster ID: f5a890138c5946968c2b8e11f616d9ee
I20260709 13:06:01.042619 21436 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:01.067731 21436 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:01.069000 21436 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:01.084301 21436 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Generated new TSK 0
I20260709 13:06:01.084959 21436 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:01.105849 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:01.111931 21448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.112481 21449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.114542 21451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.115773 20382 server_base.cc:1061] running on GCE node
I20260709 13:06:01.116919 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:01.117100 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:01.117301 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602361117264 us; error 0 us; skew 500 ppm
I20260709 13:06:01.117852 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:01.120240 20382 webserver.cc:533] Webserver started at http://127.19.231.129:37419/ using document root <none> and password file <none>
I20260709 13:06:01.121233 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:01.121460 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.121850 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.123100 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/instance:
uuid: "5a34fd3290de493eb6bbe828dd742772"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-1t6m"
I20260709 13:06:01.127745 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:01.131142 21456 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.131953 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:01.132211 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root
uuid: "5a34fd3290de493eb6bbe828dd742772"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-1t6m"
I20260709 13:06:01.132457 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.144694 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.145915 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.147514 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:01.149889 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:01.150075 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.150390 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:01.150571 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.194626 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.129:46061
I20260709 13:06:01.194728 21518 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.129:46061 every 8 connection(s)
I20260709 13:06:01.199633 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:01.207408 21523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.210057 21524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.213106 21526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.213261 20382 server_base.cc:1061] running on GCE node
I20260709 13:06:01.214552 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:01.214742 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:01.214946 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602361214931 us; error 0 us; skew 500 ppm
I20260709 13:06:01.215405 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:01.217716 20382 webserver.cc:533] Webserver started at http://127.19.231.130:44921/ using document root <none> and password file <none>
I20260709 13:06:01.218146 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:01.218297 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.218501 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.219645 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/instance:
uuid: "5727b19579474da6a12f79730b924770"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-1t6m"
I20260709 13:06:01.224908 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:06:01.225889 21519 heartbeater.cc:344] Connected to a master server at 127.19.231.190:34603
I20260709 13:06:01.226300 21519 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:01.227285 21519 heartbeater.cc:507] Master 127.19.231.190:34603 requested a full tablet report, sending...
I20260709 13:06:01.229538 21531 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.230001 21392 ts_manager.cc:194] Registered new tserver with Master: 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:01.230561 20382 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:06:01.230926 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root
uuid: "5727b19579474da6a12f79730b924770"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-1t6m"
I20260709 13:06:01.231248 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.232228 21392 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40776
I20260709 13:06:01.255708 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.257071 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.258641 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:01.261080 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:01.261343 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.261605 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:01.261790 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.303594 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.130:41371
I20260709 13:06:01.303689 21593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.130:41371 every 8 connection(s)
I20260709 13:06:01.308904 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:01.316540 21597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.319200 21598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.320612 21600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.321355 20382 server_base.cc:1061] running on GCE node
I20260709 13:06:01.322351 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:01.322646 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:01.322849 21594 heartbeater.cc:344] Connected to a master server at 127.19.231.190:34603
I20260709 13:06:01.322906 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602361322883 us; error 0 us; skew 500 ppm
I20260709 13:06:01.323377 21594 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:01.323838 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:01.324299 21594 heartbeater.cc:507] Master 127.19.231.190:34603 requested a full tablet report, sending...
I20260709 13:06:01.326565 20382 webserver.cc:533] Webserver started at http://127.19.231.131:41013/ using document root <none> and password file <none>
I20260709 13:06:01.326920 21392 ts_manager.cc:194] Registered new tserver with Master: 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:01.327135 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:01.327450 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.327747 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.328532 21392 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40780
I20260709 13:06:01.328992 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/instance:
uuid: "a87bd86b86e74aa8bb61189215b73439"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-1t6m"
I20260709 13:06:01.334290 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:01.338217 21605 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.339136 20382 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:01.339504 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root
uuid: "a87bd86b86e74aa8bb61189215b73439"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-1t6m"
I20260709 13:06:01.339855 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.356431 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.357780 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.359440 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:01.361948 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:01.362211 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.362493 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:01.362707 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.404307 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.131:41367
I20260709 13:06:01.404402 21667 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.131:41367 every 8 connection(s)
I20260709 13:06:01.417728 21668 heartbeater.cc:344] Connected to a master server at 127.19.231.190:34603
I20260709 13:06:01.418169 21668 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:01.419037 21668 heartbeater.cc:507] Master 127.19.231.190:34603 requested a full tablet report, sending...
I20260709 13:06:01.421073 21392 ts_manager.cc:194] Registered new tserver with Master: a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:01.422140 20382 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014494649s
I20260709 13:06:01.422598 21392 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40790
I20260709 13:06:01.448518 21392 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40794:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:01.454530 21392 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:01.656111 21632 tablet_service.cc:1511] Processing CreateTablet for tablet 852aa9ec17544a9eb8f44e067743d0c6 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:01.658581 21632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852aa9ec17544a9eb8f44e067743d0c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.659829 21633 tablet_service.cc:1511] Processing CreateTablet for tablet eae01b9fdd5340dc9416e5834263a4d6 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:01.663707 21633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae01b9fdd5340dc9416e5834263a4d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.668933 21631 tablet_service.cc:1511] Processing CreateTablet for tablet 4e78f55a98514b6b95c6ea1b508ac13e (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:01.670496 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e78f55a98514b6b95c6ea1b508ac13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.670209 21559 tablet_service.cc:1511] Processing CreateTablet for tablet eae01b9fdd5340dc9416e5834263a4d6 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:01.671641 21559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae01b9fdd5340dc9416e5834263a4d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.672077 21480 tablet_service.cc:1511] Processing CreateTablet for tablet 1fbb59e66fd74778a9cbae5114efa101 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:01.673529 21480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fbb59e66fd74778a9cbae5114efa101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.673285 21479 tablet_service.cc:1511] Processing CreateTablet for tablet 1a421c4648b143d58ea851d133ca3863 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:01.674661 21479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a421c4648b143d58ea851d133ca3863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.675741 21481 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7e8b71ee674ed4b42ef0ba024cf600 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:01.676088 21558 tablet_service.cc:1511] Processing CreateTablet for tablet 852aa9ec17544a9eb8f44e067743d0c6 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:01.677165 21481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7e8b71ee674ed4b42ef0ba024cf600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.677459 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852aa9ec17544a9eb8f44e067743d0c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.672079 21630 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7e8b71ee674ed4b42ef0ba024cf600 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:01.680100 21557 tablet_service.cc:1511] Processing CreateTablet for tablet 4e78f55a98514b6b95c6ea1b508ac13e (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:01.681716 21557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e78f55a98514b6b95c6ea1b508ac13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.681412 21483 tablet_service.cc:1511] Processing CreateTablet for tablet 852aa9ec17544a9eb8f44e067743d0c6 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:01.683955 21484 tablet_service.cc:1511] Processing CreateTablet for tablet eae01b9fdd5340dc9416e5834263a4d6 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:01.684051 21556 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7e8b71ee674ed4b42ef0ba024cf600 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:01.685472 21556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7e8b71ee674ed4b42ef0ba024cf600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.686472 21629 tablet_service.cc:1511] Processing CreateTablet for tablet 1fbb59e66fd74778a9cbae5114efa101 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:01.687160 21630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7e8b71ee674ed4b42ef0ba024cf600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.687928 21629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fbb59e66fd74778a9cbae5114efa101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.688618 21555 tablet_service.cc:1511] Processing CreateTablet for tablet 1fbb59e66fd74778a9cbae5114efa101 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:01.680104 21482 tablet_service.cc:1511] Processing CreateTablet for tablet 4e78f55a98514b6b95c6ea1b508ac13e (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:01.692592 21483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852aa9ec17544a9eb8f44e067743d0c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.692584 21554 tablet_service.cc:1511] Processing CreateTablet for tablet 1a421c4648b143d58ea851d133ca3863 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:01.699016 21484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae01b9fdd5340dc9416e5834263a4d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.690560 21555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fbb59e66fd74778a9cbae5114efa101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.703295 21482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e78f55a98514b6b95c6ea1b508ac13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.707276 21554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a421c4648b143d58ea851d133ca3863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.727572 21628 tablet_service.cc:1511] Processing CreateTablet for tablet 1a421c4648b143d58ea851d133ca3863 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:01.729135 21628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a421c4648b143d58ea851d133ca3863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.796705 21683 tablet_bootstrap.cc:492] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:01.805428 21683 tablet_bootstrap.cc:654] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.813149 21630 tablet_service.cc:1511] Processing CreateTablet for tablet b773b0d389ce4ab991f6892abb4882e7 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:01.813019 21478 tablet_service.cc:1511] Processing CreateTablet for tablet b773b0d389ce4ab991f6892abb4882e7 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:01.816048 21553 tablet_service.cc:1511] Processing CreateTablet for tablet b773b0d389ce4ab991f6892abb4882e7 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:01.817701 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b773b0d389ce4ab991f6892abb4882e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.819996 21477 tablet_service.cc:1511] Processing CreateTablet for tablet 68080652a5d4450691efb2d8b5c1b187 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:01.827265 21478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b773b0d389ce4ab991f6892abb4882e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.828012 21477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68080652a5d4450691efb2d8b5c1b187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.841673 21552 tablet_service.cc:1511] Processing CreateTablet for tablet 68080652a5d4450691efb2d8b5c1b187 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:01.843492 21552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68080652a5d4450691efb2d8b5c1b187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.844467 21631 tablet_service.cc:1511] Processing CreateTablet for tablet 68080652a5d4450691efb2d8b5c1b187 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:01.845839 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68080652a5d4450691efb2d8b5c1b187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.861706 21476 tablet_service.cc:1511] Processing CreateTablet for tablet d6080cb4ff0f4e5aae18e38fa86b1fa1 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:01.863288 21476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6080cb4ff0f4e5aae18e38fa86b1fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.865679 21551 tablet_service.cc:1511] Processing CreateTablet for tablet d6080cb4ff0f4e5aae18e38fa86b1fa1 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:01.868177 21630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b773b0d389ce4ab991f6892abb4882e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.869096 21551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6080cb4ff0f4e5aae18e38fa86b1fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.871833 21632 tablet_service.cc:1511] Processing CreateTablet for tablet d6080cb4ff0f4e5aae18e38fa86b1fa1 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:01.873558 21632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6080cb4ff0f4e5aae18e38fa86b1fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.877568 21628 tablet_service.cc:1511] Processing CreateTablet for tablet d46f34ab738d4d38b09f9d1228d68c7d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:01.878397 21475 tablet_service.cc:1511] Processing CreateTablet for tablet d46f34ab738d4d38b09f9d1228d68c7d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:01.881191 21475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46f34ab738d4d38b09f9d1228d68c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.884783 21684 tablet_bootstrap.cc:492] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:01.889494 21479 tablet_service.cc:1511] Processing CreateTablet for tablet 06b5fb42c147456889a1843340b22720 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:01.892563 21557 tablet_service.cc:1511] Processing CreateTablet for tablet 22b45f3e8b8e428ea4709e7e9ee43868 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:01.894040 21557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b45f3e8b8e428ea4709e7e9ee43868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.894966 21627 tablet_service.cc:1511] Processing CreateTablet for tablet 06b5fb42c147456889a1843340b22720 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:01.898203 21628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46f34ab738d4d38b09f9d1228d68c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.900985 21558 tablet_service.cc:1511] Processing CreateTablet for tablet 06b5fb42c147456889a1843340b22720 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:01.902534 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b5fb42c147456889a1843340b22720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.907640 21556 tablet_service.cc:1511] Processing CreateTablet for tablet d46f34ab738d4d38b09f9d1228d68c7d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:01.911316 21626 tablet_service.cc:1511] Processing CreateTablet for tablet 22b45f3e8b8e428ea4709e7e9ee43868 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:01.913709 21627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b5fb42c147456889a1843340b22720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.913770 21483 tablet_service.cc:1511] Processing CreateTablet for tablet ac0b1311ffdd4c1293236cad678687e7 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:01.915215 21483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0b1311ffdd4c1293236cad678687e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.915383 21556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46f34ab738d4d38b09f9d1228d68c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.919770 21683 tablet_bootstrap.cc:492] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:01.920305 21683 ts_tablet_manager.cc:1403] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.124s	user 0.037s	sys 0.032s
I20260709 13:06:01.916363 21480 tablet_service.cc:1511] Processing CreateTablet for tablet 22b45f3e8b8e428ea4709e7e9ee43868 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:01.926744 21626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b45f3e8b8e428ea4709e7e9ee43868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.945941 21686 tablet_bootstrap.cc:492] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:01.947042 21684 tablet_bootstrap.cc:654] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.947729 21558 tablet_service.cc:1511] Processing CreateTablet for tablet ac0b1311ffdd4c1293236cad678687e7 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:01.949172 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0b1311ffdd4c1293236cad678687e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.958465 21479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b5fb42c147456889a1843340b22720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.961088 21480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b45f3e8b8e428ea4709e7e9ee43868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.966359 21683 raft_consensus.cc:359] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:01.967450 21683 raft_consensus.cc:385] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.967823 21683 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.968850 21683 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:01.994851 21629 tablet_service.cc:1511] Processing CreateTablet for tablet ac0b1311ffdd4c1293236cad678687e7 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:01.997164 21686 tablet_bootstrap.cc:654] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.998157 21629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0b1311ffdd4c1293236cad678687e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.018070 21475 tablet_service.cc:1511] Processing CreateTablet for tablet 401d63d1bf204db2a802876b9ddc8476 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:02.019690 21475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401d63d1bf204db2a802876b9ddc8476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.026382 21668 heartbeater.cc:499] Master 127.19.231.190:34603 was elected leader, sending a full tablet report...
I20260709 13:06:02.029968 21553 tablet_service.cc:1511] Processing CreateTablet for tablet 401d63d1bf204db2a802876b9ddc8476 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:02.040373 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401d63d1bf204db2a802876b9ddc8476. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:02.033093 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:02.049507 21683 ts_tablet_manager.cc:1434] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.019s
I20260709 13:06:02.050686 21683 tablet_bootstrap.cc:492] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:02.066576 21683 tablet_bootstrap.cc:654] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.067102 21684 tablet_bootstrap.cc:492] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:02.068111 21684 ts_tablet_manager.cc:1403] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.184s	user 0.024s	sys 0.031s
I20260709 13:06:02.073374 21684 raft_consensus.cc:359] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.079008 21684 raft_consensus.cc:385] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.082938 21684 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.091713 21684 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.100741 21479 tablet_service.cc:1511] Processing CreateTablet for tablet 300e225ec8c14d76921637fefe0d57eb (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:02.102625 21479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300e225ec8c14d76921637fefe0d57eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.113078 21686 tablet_bootstrap.cc:492] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:02.113600 21686 ts_tablet_manager.cc:1403] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.169s	user 0.050s	sys 0.084s
I20260709 13:06:02.114298 21631 tablet_service.cc:1511] Processing CreateTablet for tablet 300e225ec8c14d76921637fefe0d57eb (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:02.116166 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300e225ec8c14d76921637fefe0d57eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.116602 21686 raft_consensus.cc:359] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } }
I20260709 13:06:02.117380 21686 raft_consensus.cc:385] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.117709 21686 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.125409 21683 tablet_bootstrap.cc:492] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:02.125885 21683 ts_tablet_manager.cc:1403] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.022s
I20260709 13:06:02.131700 21483 tablet_service.cc:1511] Processing CreateTablet for tablet bd6859210b204263aedc975d7586330c (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:02.131970 21683 raft_consensus.cc:359] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.136147 21557 tablet_service.cc:1511] Processing CreateTablet for tablet bd6859210b204263aedc975d7586330c (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:02.149015 21557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6859210b204263aedc975d7586330c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.139297 21483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6859210b204263aedc975d7586330c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.130041 21633 tablet_service.cc:1511] Processing CreateTablet for tablet 401d63d1bf204db2a802876b9ddc8476 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:02.140086 21558 tablet_service.cc:1511] Processing CreateTablet for tablet 300e225ec8c14d76921637fefe0d57eb (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:02.118502 21686 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } }
I20260709 13:06:02.150504 21683 raft_consensus.cc:385] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.155064 21683 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.159075 21684 ts_tablet_manager.cc:1434] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.091s	user 0.025s	sys 0.036s
I20260709 13:06:02.159826 21519 heartbeater.cc:499] Master 127.19.231.190:34603 was elected leader, sending a full tablet report...
I20260709 13:06:02.159554 21683 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.160004 21477 tablet_service.cc:1511] Processing CreateTablet for tablet 377467a782f94dd2b6e76b88920dfb8b (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:02.161388 21477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377467a782f94dd2b6e76b88920dfb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.161895 21683 ts_tablet_manager.cc:1434] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.001s
I20260709 13:06:02.163025 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300e225ec8c14d76921637fefe0d57eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.160112 21684 tablet_bootstrap.cc:492] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:02.180255 21551 tablet_service.cc:1511] Processing CreateTablet for tablet 377467a782f94dd2b6e76b88920dfb8b (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:02.181617 21551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377467a782f94dd2b6e76b88920dfb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.184369 21629 tablet_service.cc:1511] Processing CreateTablet for tablet b4a9406eef59405b975ed9c99811d69a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:02.185091 21552 tablet_service.cc:1511] Processing CreateTablet for tablet b4a9406eef59405b975ed9c99811d69a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:02.185889 21630 tablet_service.cc:1511] Processing CreateTablet for tablet 377467a782f94dd2b6e76b88920dfb8b (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:02.186419 21552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a9406eef59405b975ed9c99811d69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.186666 21476 tablet_service.cc:1511] Processing CreateTablet for tablet b4a9406eef59405b975ed9c99811d69a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:02.187207 21478 tablet_service.cc:1511] Processing CreateTablet for tablet 05a0423f397042e3aed0ddbf0c111bd4 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:02.188037 21476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a9406eef59405b975ed9c99811d69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.188686 21478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a0423f397042e3aed0ddbf0c111bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.199285 21683 tablet_bootstrap.cc:492] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:02.202368 21686 ts_tablet_manager.cc:1434] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.088s	user 0.019s	sys 0.006s
I20260709 13:06:02.203248 21594 heartbeater.cc:499] Master 127.19.231.190:34603 was elected leader, sending a full tablet report...
I20260709 13:06:02.203599 21686 tablet_bootstrap.cc:492] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:02.178889 21633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401d63d1bf204db2a802876b9ddc8476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.224371 21481 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf7884717c9466486b7e5eb6b4626c5 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:02.225482 21553 tablet_service.cc:1511] Processing CreateTablet for tablet 05a0423f397042e3aed0ddbf0c111bd4 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:02.226178 21481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf7884717c9466486b7e5eb6b4626c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.226976 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a0423f397042e3aed0ddbf0c111bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.224612 21627 tablet_service.cc:1511] Processing CreateTablet for tablet 05a0423f397042e3aed0ddbf0c111bd4 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:02.233122 21686 tablet_bootstrap.cc:654] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.247262 21627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a0423f397042e3aed0ddbf0c111bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.251173 21630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377467a782f94dd2b6e76b88920dfb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.255190 21629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a9406eef59405b975ed9c99811d69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.247121 21691 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.266456 21691 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.223387 21628 tablet_service.cc:1511] Processing CreateTablet for tablet bd6859210b204263aedc975d7586330c (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:02.280886 21628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6859210b204263aedc975d7586330c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.302909 21691 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:02.316783 21631 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf7884717c9466486b7e5eb6b4626c5 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:02.318375 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf7884717c9466486b7e5eb6b4626c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.330621 21686 tablet_bootstrap.cc:492] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:02.331180 21686 ts_tablet_manager.cc:1403] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.128s	user 0.022s	sys 0.029s
I20260709 13:06:02.338666 21686 raft_consensus.cc:359] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.339473 21686 raft_consensus.cc:385] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.339783 21686 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.342936 21686 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.367466 21683 tablet_bootstrap.cc:654] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.371918 21684 tablet_bootstrap.cc:654] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.372711 21686 ts_tablet_manager.cc:1434] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:06:02.381606 21626 tablet_service.cc:1511] Processing CreateTablet for tablet 92e37e086e4a48aa8d09172d1b43518d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:02.383641 21626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e37e086e4a48aa8d09172d1b43518d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.408349 21479 tablet_service.cc:1511] Processing CreateTablet for tablet c7bfc9f63b5d484f83f58360423d19e3 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:02.418390 21479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bfc9f63b5d484f83f58360423d19e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.414685 21480 tablet_service.cc:1511] Processing CreateTablet for tablet 7d086ed254594401ae567a7d3681c987 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:02.422818 21480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d086ed254594401ae567a7d3681c987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.408609 21477 tablet_service.cc:1511] Processing CreateTablet for tablet 92e37e086e4a48aa8d09172d1b43518d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:02.425596 21477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e37e086e4a48aa8d09172d1b43518d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.407608 21632 tablet_service.cc:1511] Processing CreateTablet for tablet c7bfc9f63b5d484f83f58360423d19e3 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:02.428115 21632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bfc9f63b5d484f83f58360423d19e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.411995 21625 tablet_service.cc:1511] Processing CreateTablet for tablet c670f1ebdec3444e9e371f0fca10d38d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:02.432569 21625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c670f1ebdec3444e9e371f0fca10d38d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.408609 21476 tablet_service.cc:1511] Processing CreateTablet for tablet c670f1ebdec3444e9e371f0fca10d38d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:02.437011 21476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c670f1ebdec3444e9e371f0fca10d38d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.451002 21688 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.451578 21688 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.402120 21686 tablet_bootstrap.cc:492] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:02.483618 21475 tablet_service.cc:1511] Processing CreateTablet for tablet 47fdde72d59a41308bcdd5d0e303c5cb (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:02.485780 21475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fdde72d59a41308bcdd5d0e303c5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.490109 21558 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf7884717c9466486b7e5eb6b4626c5 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:02.491570 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf7884717c9466486b7e5eb6b4626c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:02.495157 21378 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 50245.2us
I20260709 13:06:02.497612 21624 tablet_service.cc:1511] Processing CreateTablet for tablet 7d086ed254594401ae567a7d3681c987 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:02.509953 21624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d086ed254594401ae567a7d3681c987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.511432 21688 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:02.512732 21478 tablet_service.cc:1511] Processing CreateTablet for tablet bbb07a26963247f383d1e9c7990b92ac (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:02.513592 21556 tablet_service.cc:1511] Processing CreateTablet for tablet 92e37e086e4a48aa8d09172d1b43518d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:02.514083 21478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb07a26963247f383d1e9c7990b92ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.514911 21556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e37e086e4a48aa8d09172d1b43518d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.516824 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:02.517584 21643 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:02.519101 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:02.519985 21691 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.520346 21691 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.520678 21691 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.523836 21483 tablet_service.cc:1511] Processing CreateTablet for tablet 8e067febbdfa48d7b1d4f20ec5e2337a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:02.525197 21483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e067febbdfa48d7b1d4f20ec5e2337a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.527855 21482 tablet_service.cc:1511] Processing CreateTablet for tablet 32891f0cc92c44afbc3bd39c2c408597 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:02.529192 21482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32891f0cc92c44afbc3bd39c2c408597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.532209 21683 tablet_bootstrap.cc:492] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:02.532823 21683 ts_tablet_manager.cc:1403] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.334s	user 0.062s	sys 0.046s
I20260709 13:06:02.542609 21683 raft_consensus.cc:359] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.543465 21683 raft_consensus.cc:385] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.543792 21683 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.546447 21475 tablet_service.cc:1511] Processing CreateTablet for tablet e2ba3136589046f7ada398d9210f305d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:02.546826 21484 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff1ef08407c4bed8b0670f8230f0a40 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:02.548053 21475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ba3136589046f7ada398d9210f305d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.549038 21481 tablet_service.cc:1511] Processing CreateTablet for tablet 18db3d7d8520484b9eb6da32f2bc86ed (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:02.550179 21683 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.552100 21691 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.552627 21683 ts_tablet_manager.cc:1434] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:06:02.554381 21691 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:02.555163 21692 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.553748 21481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18db3d7d8520484b9eb6da32f2bc86ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.555662 21692 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } }
I20260709 13:06:02.555678 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:02.558917 21643 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.563144 21484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff1ef08407c4bed8b0670f8230f0a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.564046 21478 tablet_service.cc:1511] Processing CreateTablet for tablet 4d0597072fba4deebec5c1ddaeff142f (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:02.565423 21478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0597072fba4deebec5c1ddaeff142f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.568846 21692 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:02.570289 21683 tablet_bootstrap.cc:492] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:02.572057 21551 tablet_service.cc:1511] Processing CreateTablet for tablet c7bfc9f63b5d484f83f58360423d19e3 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:02.573760 21551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bfc9f63b5d484f83f58360423d19e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.576274 21552 tablet_service.cc:1511] Processing CreateTablet for tablet c670f1ebdec3444e9e371f0fca10d38d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:02.578152 21552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c670f1ebdec3444e9e371f0fca10d38d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.608371 21557 tablet_service.cc:1511] Processing CreateTablet for tablet 7d086ed254594401ae567a7d3681c987 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:02.608702 21553 tablet_service.cc:1511] Processing CreateTablet for tablet 47fdde72d59a41308bcdd5d0e303c5cb (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:02.609766 21557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d086ed254594401ae567a7d3681c987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.610459 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fdde72d59a41308bcdd5d0e303c5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.613287 21684 tablet_bootstrap.cc:492] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:02.613912 21684 ts_tablet_manager.cc:1403] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.454s	user 0.015s	sys 0.007s
I20260709 13:06:02.616528 21683 tablet_bootstrap.cc:654] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.617164 21684 raft_consensus.cc:359] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.617995 21684 raft_consensus.cc:385] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:02.618188 21376 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44584.3us
I20260709 13:06:02.618417 21684 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.619346 21684 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.621738 21684 ts_tablet_manager.cc:1434] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:06:02.622834 21684 tablet_bootstrap.cc:492] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:02.629864 21625 tablet_service.cc:1511] Processing CreateTablet for tablet bbb07a26963247f383d1e9c7990b92ac (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:02.635725 21625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb07a26963247f383d1e9c7990b92ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.640158 21559 tablet_service.cc:1511] Processing CreateTablet for tablet bbb07a26963247f383d1e9c7990b92ac (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:02.641597 21559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb07a26963247f383d1e9c7990b92ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.644979 21554 tablet_service.cc:1511] Processing CreateTablet for tablet 8e067febbdfa48d7b1d4f20ec5e2337a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:02.649644 21554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e067febbdfa48d7b1d4f20ec5e2337a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.644778 21626 tablet_service.cc:1511] Processing CreateTablet for tablet 8e067febbdfa48d7b1d4f20ec5e2337a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:02.651655 21626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e067febbdfa48d7b1d4f20ec5e2337a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.657155 21555 tablet_service.cc:1511] Processing CreateTablet for tablet 32891f0cc92c44afbc3bd39c2c408597 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:02.658510 21555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32891f0cc92c44afbc3bd39c2c408597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.664516 21550 tablet_service.cc:1511] Processing CreateTablet for tablet 18db3d7d8520484b9eb6da32f2bc86ed (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:02.654440 21643 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:02.678545 21550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18db3d7d8520484b9eb6da32f2bc86ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.683485 21630 tablet_service.cc:1511] Processing CreateTablet for tablet 32891f0cc92c44afbc3bd39c2c408597 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:02.683820 21629 tablet_service.cc:1511] Processing CreateTablet for tablet 18db3d7d8520484b9eb6da32f2bc86ed (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:02.684994 21630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32891f0cc92c44afbc3bd39c2c408597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.685262 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:02.685070 21631 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff1ef08407c4bed8b0670f8230f0a40 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:02.686079 21691 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.686443 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff1ef08407c4bed8b0670f8230f0a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.686585 21691 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:02.687017 21633 tablet_service.cc:1511] Processing CreateTablet for tablet e2ba3136589046f7ada398d9210f305d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:02.687517 21691 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.688299 21633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ba3136589046f7ada398d9210f305d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.692085 21628 tablet_service.cc:1511] Processing CreateTablet for tablet 4d0597072fba4deebec5c1ddaeff142f (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:02.693461 21628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0597072fba4deebec5c1ddaeff142f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.695114 21629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18db3d7d8520484b9eb6da32f2bc86ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.698328 21686 tablet_bootstrap.cc:654] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.500458 21627 tablet_service.cc:1511] Processing CreateTablet for tablet 47fdde72d59a41308bcdd5d0e303c5cb (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:02.711694 21627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fdde72d59a41308bcdd5d0e303c5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.713575 21558 tablet_service.cc:1511] Processing CreateTablet for tablet e2ba3136589046f7ada398d9210f305d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:02.723605 21478 tablet_service.cc:1511] Processing CreateTablet for tablet a85b464a0e924904be2840142de89c0d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:02.723623 21481 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0b012cfcad4a71a65a1e83d453cfca (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:02.725170 21478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85b464a0e924904be2840142de89c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.725994 21481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0b012cfcad4a71a65a1e83d453cfca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.728747 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:02.729108 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:02.730610 21459 leader_election.cc:343] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:02.732126 21459 leader_election.cc:343] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.748389 21484 tablet_service.cc:1511] Processing CreateTablet for tablet 5057458c15c04db7a727b0b401a36bdc (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:02.749750 21484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5057458c15c04db7a727b0b401a36bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.746273 21624 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0b012cfcad4a71a65a1e83d453cfca (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:02.766840 21624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0b012cfcad4a71a65a1e83d453cfca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.764295 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ba3136589046f7ada398d9210f305d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.770602 21684 tablet_bootstrap.cc:654] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.775444 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:02.792570 21475 tablet_service.cc:1511] Processing CreateTablet for tablet 470cdc8938f2464c96c100ae314a56b7 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:02.795245 21551 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff1ef08407c4bed8b0670f8230f0a40 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:02.803511 21551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff1ef08407c4bed8b0670f8230f0a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.810011 21556 tablet_service.cc:1511] Processing CreateTablet for tablet a85b464a0e924904be2840142de89c0d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:02.811417 21556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85b464a0e924904be2840142de89c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.811576 21683 tablet_bootstrap.cc:492] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:02.812153 21683 ts_tablet_manager.cc:1403] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.242s	user 0.026s	sys 0.048s
I20260709 13:06:02.812515 21390 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.816380 21692 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.806210 21552 tablet_service.cc:1511] Processing CreateTablet for tablet 4d0597072fba4deebec5c1ddaeff142f (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:02.820485 21692 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.820989 21475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470cdc8938f2464c96c100ae314a56b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.823659 21692 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:02.829794 21632 tablet_service.cc:1511] Processing CreateTablet for tablet a85b464a0e924904be2840142de89c0d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:02.831279 21632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85b464a0e924904be2840142de89c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.806393 21553 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0b012cfcad4a71a65a1e83d453cfca (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:06:02.858536 21606 leader_election.cc:343] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:02.859122 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 60952.2us
I20260709 13:06:02.860083 21631 tablet_service.cc:1511] Processing CreateTablet for tablet 470cdc8938f2464c96c100ae314a56b7 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:02.860914 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:02.863086 21483 tablet_service.cc:1511] Processing CreateTablet for tablet 24789f7f25d44609b76928ec55894739 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:06:02.864019 21608 leader_election.cc:343] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.864463 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:02.864816 21483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24789f7f25d44609b76928ec55894739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.865528 21688 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.867336 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:02.867806 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:02.861136 21683 raft_consensus.cc:359] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.861766 21552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0597072fba4deebec5c1ddaeff142f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.872071 21683 raft_consensus.cc:385] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.884847 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470cdc8938f2464c96c100ae314a56b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.885046 21557 tablet_service.cc:1511] Processing CreateTablet for tablet 5057458c15c04db7a727b0b401a36bdc (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:02.885993 21481 tablet_service.cc:1511] Processing CreateTablet for tablet 6397e2c83e814a908887a9e44184de0a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:02.883036 21683 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
W20260709 13:06:02.893013 21532 leader_election.cc:343] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:02.893864 21532 leader_election.cc:343] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.896281 21481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6397e2c83e814a908887a9e44184de0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.898494 21478 tablet_service.cc:1511] Processing CreateTablet for tablet 18a391cd0b80409cb0308239137325f8 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:02.899901 21478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a391cd0b80409cb0308239137325f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.902201 21629 tablet_service.cc:1511] Processing CreateTablet for tablet 6397e2c83e814a908887a9e44184de0a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:02.904239 21629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6397e2c83e814a908887a9e44184de0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.906494 21625 tablet_service.cc:1511] Processing CreateTablet for tablet 24789f7f25d44609b76928ec55894739 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:02.908044 21625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24789f7f25d44609b76928ec55894739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.890386 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0b012cfcad4a71a65a1e83d453cfca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.911371 21557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5057458c15c04db7a727b0b401a36bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.912773 21558 tablet_service.cc:1511] Processing CreateTablet for tablet 470cdc8938f2464c96c100ae314a56b7 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:02.914184 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470cdc8938f2464c96c100ae314a56b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.921818 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:02.922315 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:02.923022 21493 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
W20260709 13:06:02.923511 21532 leader_election.cc:343] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.923966 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:02.924724 21692 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.925200 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:02.925976 21692 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.926334 21692 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.926704 21692 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.927230 21683 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.932741 21683 ts_tablet_manager.cc:1434] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.003s
I20260709 13:06:02.934051 21683 tablet_bootstrap.cc:492] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:02.934654 21692 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.936955 21692 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:02.937794 21557 tablet_service.cc:1511] Processing CreateTablet for tablet 24789f7f25d44609b76928ec55894739 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:02.938432 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:02.939141 21557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24789f7f25d44609b76928ec55894739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.940966 21684 tablet_bootstrap.cc:492] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:02.941480 21684 ts_tablet_manager.cc:1403] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.319s	user 0.010s	sys 0.014s
I20260709 13:06:02.943643 21630 tablet_service.cc:1511] Processing CreateTablet for tablet 5057458c15c04db7a727b0b401a36bdc (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 13:06:02.944003 21532 leader_election.cc:343] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.945024 21630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5057458c15c04db7a727b0b401a36bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.945494 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:02.946097 21494 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.949240 21688 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.949752 21688 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.952692 21550 tablet_service.cc:1511] Processing CreateTablet for tablet 6397e2c83e814a908887a9e44184de0a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:02.955365 21688 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:02.954125 21550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6397e2c83e814a908887a9e44184de0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.956823 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:02.958777 21606 leader_election.cc:343] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.958818 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:02.962775 21608 leader_election.cc:343] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.963256 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:02.964368 21688 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.989271 21684 raft_consensus.cc:359] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.990036 21684 raft_consensus.cc:385] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.990309 21684 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.991506 21684 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:02.997129 21551 tablet_service.cc:1511] Processing CreateTablet for tablet 18a391cd0b80409cb0308239137325f8 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:02.998507 21551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a391cd0b80409cb0308239137325f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.003844 21683 tablet_bootstrap.cc:654] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.013180 21475 tablet_service.cc:1511] Processing CreateTablet for tablet e214d67cdc8f4690b393c47800e8e3e6 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:03.014578 21475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e214d67cdc8f4690b393c47800e8e3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.016175 21494 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:03.016402 21554 tablet_service.cc:1511] Processing CreateTablet for tablet e214d67cdc8f4690b393c47800e8e3e6 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:03.017074 21625 tablet_service.cc:1511] Processing CreateTablet for tablet 18a391cd0b80409cb0308239137325f8 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:03.019081 21631 tablet_service.cc:1511] Processing CreateTablet for tablet b14a1dff9e774b09a93b9bf00960df20 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:03.023736 21632 tablet_service.cc:1511] Processing CreateTablet for tablet e214d67cdc8f4690b393c47800e8e3e6 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:03.027052 21555 tablet_service.cc:1511] Processing CreateTablet for tablet b14a1dff9e774b09a93b9bf00960df20 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:03.031410 21481 tablet_service.cc:1511] Processing CreateTablet for tablet 12f1cc6194a54e7d8fb8d72776638772 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:02.994041 21684 ts_tablet_manager.cc:1434] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:06:03.043711 21625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a391cd0b80409cb0308239137325f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.044382 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14a1dff9e774b09a93b9bf00960df20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.044167 21484 tablet_service.cc:1511] Processing CreateTablet for tablet b14a1dff9e774b09a93b9bf00960df20 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:06:03.045222 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:03.045498 21481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f1cc6194a54e7d8fb8d72776638772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.047392 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:03.048228 21629 tablet_service.cc:1511] Processing CreateTablet for tablet 12f1cc6194a54e7d8fb8d72776638772 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:03.049537 21554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e214d67cdc8f4690b393c47800e8e3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.049629 21629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f1cc6194a54e7d8fb8d72776638772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.052080 21692 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.050895 21550 tablet_service.cc:1511] Processing CreateTablet for tablet 6fad88e2e67d44f7adb559c0a8eb0af8 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:03.055385 21478 tablet_service.cc:1511] Processing CreateTablet for tablet 6fad88e2e67d44f7adb559c0a8eb0af8 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:03.060676 21558 tablet_service.cc:1511] Processing CreateTablet for tablet 12f1cc6194a54e7d8fb8d72776638772 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:03.059619 21484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14a1dff9e774b09a93b9bf00960df20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.072989 21686 tablet_bootstrap.cc:492] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:03.073499 21686 ts_tablet_manager.cc:1403] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.675s	user 0.028s	sys 0.018s
I20260709 13:06:03.074606 21683 tablet_bootstrap.cc:492] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:03.075131 21683 ts_tablet_manager.cc:1403] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.000s
I20260709 13:06:03.076596 21686 raft_consensus.cc:359] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.077364 21686 raft_consensus.cc:385] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.077682 21686 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.067514 21555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14a1dff9e774b09a93b9bf00960df20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.079082 21683 raft_consensus.cc:359] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.079842 21683 raft_consensus.cc:385] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.080152 21683 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.081044 21632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e214d67cdc8f4690b393c47800e8e3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.081075 21683 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.091053 21686 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.093773 21478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fad88e2e67d44f7adb559c0a8eb0af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.099124 21482 tablet_service.cc:1511] Processing CreateTablet for tablet 545ee5e8315344d387b7e32a6fe5984b (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:03.100523 21482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 545ee5e8315344d387b7e32a6fe5984b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.102931 21550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fad88e2e67d44f7adb559c0a8eb0af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.103992 21625 tablet_service.cc:1511] Processing CreateTablet for tablet 6fad88e2e67d44f7adb559c0a8eb0af8 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:03.105552 21625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fad88e2e67d44f7adb559c0a8eb0af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.086411 21684 tablet_bootstrap.cc:492] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:03.087530 21683 ts_tablet_manager.cc:1434] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:06:03.115294 21552 tablet_service.cc:1511] Processing CreateTablet for tablet 545ee5e8315344d387b7e32a6fe5984b (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:03.115562 21630 tablet_service.cc:1511] Processing CreateTablet for tablet 545ee5e8315344d387b7e32a6fe5984b (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:03.116981 21630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 545ee5e8315344d387b7e32a6fe5984b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.117928 21624 tablet_service.cc:1511] Processing CreateTablet for tablet 5b18ad2e6f014e20be78478bc402f892 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:03.119264 21624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b18ad2e6f014e20be78478bc402f892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.120491 21480 tablet_service.cc:1511] Processing CreateTablet for tablet 5b18ad2e6f014e20be78478bc402f892 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:03.121894 21480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b18ad2e6f014e20be78478bc402f892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.127806 21559 tablet_service.cc:1511] Processing CreateTablet for tablet 5b18ad2e6f014e20be78478bc402f892 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:03.113505 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f1cc6194a54e7d8fb8d72776638772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.133193 21559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b18ad2e6f014e20be78478bc402f892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.133268 21683 tablet_bootstrap.cc:492] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:03.134809 21552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 545ee5e8315344d387b7e32a6fe5984b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.144181 21475 tablet_service.cc:1511] Processing CreateTablet for tablet 4d6d6e481fd941658a227093848691fa (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:03.145780 21475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d6d6e481fd941658a227093848691fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.111430 21692 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:03.147519 21692 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.151057 21553 tablet_service.cc:1511] Processing CreateTablet for tablet 4d6d6e481fd941658a227093848691fa (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:03.152536 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d6d6e481fd941658a227093848691fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.157723 21628 tablet_service.cc:1511] Processing CreateTablet for tablet 4d6d6e481fd941658a227093848691fa (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:03.159127 21628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d6d6e481fd941658a227093848691fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.140131 21686 ts_tablet_manager.cc:1434] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.006s
I20260709 13:06:03.163794 21686 tablet_bootstrap.cc:492] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:03.180888 21684 tablet_bootstrap.cc:654] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.184314 21683 tablet_bootstrap.cc:654] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.187144 21483 tablet_service.cc:1511] Processing CreateTablet for tablet 05ff2c5405fa4d388804a95695e2b592 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:03.188710 21483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ff2c5405fa4d388804a95695e2b592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.192461 21553 tablet_service.cc:1511] Processing CreateTablet for tablet 05ff2c5405fa4d388804a95695e2b592 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:03.201112 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ff2c5405fa4d388804a95695e2b592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.203883 21629 tablet_service.cc:1511] Processing CreateTablet for tablet 05ff2c5405fa4d388804a95695e2b592 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:03.189087 21686 tablet_bootstrap.cc:654] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.214372 21691 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.205292 21629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ff2c5405fa4d388804a95695e2b592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.227018 21481 tablet_service.cc:1511] Processing CreateTablet for tablet 1f372659e8e14c5d86dae03fcd58b963 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:03.228418 21481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f372659e8e14c5d86dae03fcd58b963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.241115 21624 tablet_service.cc:1511] Processing CreateTablet for tablet 1f372659e8e14c5d86dae03fcd58b963 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:03.249389 21553 tablet_service.cc:1511] Processing CreateTablet for tablet 1f372659e8e14c5d86dae03fcd58b963 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:03.251085 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f372659e8e14c5d86dae03fcd58b963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.254055 21688 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.254587 21688 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.256596 21624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f372659e8e14c5d86dae03fcd58b963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.256714 21688 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:03.257844 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:03.258642 21494 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 1: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:03.258298 21484 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2e35d97e8c4c319144e4d36af40d14 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:03.259606 21484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2e35d97e8c4c319144e4d36af40d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.260281 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:03.262805 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:03.264034 21688 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.308010 21481 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce0a50f2fc84191b1ad3c1fde5847ce (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:03.308884 21684 tablet_bootstrap.cc:492] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:03.309432 21684 ts_tablet_manager.cc:1403] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.255s	user 0.031s	sys 0.012s
W20260709 13:06:03.309746 21459 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:03.311911 21631 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2e35d97e8c4c319144e4d36af40d14 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:03.313210 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2e35d97e8c4c319144e4d36af40d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.302623 21688 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.315289 21688 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.315058 21553 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2e35d97e8c4c319144e4d36af40d14 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:03.315730 21688 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.316200 21625 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce0a50f2fc84191b1ad3c1fde5847ce (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:03.318526 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2e35d97e8c4c319144e4d36af40d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.318450 21558 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce0a50f2fc84191b1ad3c1fde5847ce (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:03.319344 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce0a50f2fc84191b1ad3c1fde5847ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.325138 21554 tablet_service.cc:1511] Processing CreateTablet for tablet cc9f5258ae3f4790a9bc1813d73ec987 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:03.326771 21554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9f5258ae3f4790a9bc1813d73ec987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.317498 21625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce0a50f2fc84191b1ad3c1fde5847ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.336301 21691 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.336844 21691 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.309427 21481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce0a50f2fc84191b1ad3c1fde5847ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.344225 21684 raft_consensus.cc:359] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } }
I20260709 13:06:03.345022 21684 raft_consensus.cc:385] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.345330 21684 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.346352 21684 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } }
I20260709 13:06:03.350893 21632 tablet_service.cc:1511] Processing CreateTablet for tablet cc9f5258ae3f4790a9bc1813d73ec987 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:03.352598 21632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9f5258ae3f4790a9bc1813d73ec987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.353713 21683 tablet_bootstrap.cc:492] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:03.354231 21683 ts_tablet_manager.cc:1403] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.221s	user 0.017s	sys 0.017s
I20260709 13:06:03.354921 21691 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:03.350908 21478 tablet_service.cc:1511] Processing CreateTablet for tablet cc9f5258ae3f4790a9bc1813d73ec987 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:03.332872 21390 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.359474 21478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9f5258ae3f4790a9bc1813d73ec987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.362411 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:03.363119 21688 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:03.364017 21459 leader_election.cc:343] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.366080 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:03.370549 21608 leader_election.cc:343] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.365556 21552 tablet_service.cc:1511] Processing CreateTablet for tablet 630b1c2cf4484981883df8266fc20ac4 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:03.372403 21552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630b1c2cf4484981883df8266fc20ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.358445 21683 raft_consensus.cc:359] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.379042 21683 raft_consensus.cc:385] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.379701 21683 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.412955 21686 tablet_bootstrap.cc:492] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:03.413514 21686 ts_tablet_manager.cc:1403] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.250s	user 0.025s	sys 0.037s
I20260709 13:06:03.414147 21631 tablet_service.cc:1511] Processing CreateTablet for tablet 630b1c2cf4484981883df8266fc20ac4 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:03.415383 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630b1c2cf4484981883df8266fc20ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.416345 21686 raft_consensus.cc:359] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.417172 21686 raft_consensus.cc:385] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.417526 21686 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.418407 21686 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.405894 21683 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.428397 21686 ts_tablet_manager.cc:1434] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
W20260709 13:06:03.433409 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82064.5us
I20260709 13:06:03.453014 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:03.453694 21643 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:03.453608 21558 tablet_service.cc:1511] Processing CreateTablet for tablet cae2bb9c133344078cc4f963e7188776 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:03.454912 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae2bb9c133344078cc4f963e7188776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.455730 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:03.454912 21553 tablet_service.cc:1511] Processing CreateTablet for tablet 67538f399a3e491e97d3a4c5585bf44a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:03.461253 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67538f399a3e491e97d3a4c5585bf44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.461886 21684 ts_tablet_manager.cc:1434] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.152s	user 0.007s	sys 0.020s
I20260709 13:06:03.462563 21683 ts_tablet_manager.cc:1434] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.001s
I20260709 13:06:03.471907 21683 tablet_bootstrap.cc:492] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:03.461319 21631 tablet_service.cc:1511] Processing CreateTablet for tablet cae2bb9c133344078cc4f963e7188776 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:03.476056 21686 tablet_bootstrap.cc:492] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:03.483889 21481 tablet_service.cc:1511] Processing CreateTablet for tablet 630b1c2cf4484981883df8266fc20ac4 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:03.484184 21478 tablet_service.cc:1511] Processing CreateTablet for tablet cae2bb9c133344078cc4f963e7188776 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:03.485152 21481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630b1c2cf4484981883df8266fc20ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.484792 21483 tablet_service.cc:1511] Processing CreateTablet for tablet 67538f399a3e491e97d3a4c5585bf44a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:03.487820 21475 tablet_service.cc:1511] Processing CreateTablet for tablet ca05d89c0a6b4f8ca791df1da0bad1f1 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:06:03.488927 21606 leader_election.cc:343] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.484895 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:03.489378 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:03.490592 21722 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.490860 21724 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.491245 21724 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.491602 21724 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.491984 21483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67538f399a3e491e97d3a4c5585bf44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.494472 21475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca05d89c0a6b4f8ca791df1da0bad1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.498268 21550 tablet_service.cc:1511] Processing CreateTablet for tablet e0950a4a64c4484ba4b753d544c7f1eb (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:03.498765 21724 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.477222 21630 tablet_service.cc:1511] Processing CreateTablet for tablet 67538f399a3e491e97d3a4c5585bf44a (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:03.502213 21559 tablet_service.cc:1511] Processing CreateTablet for tablet 35e6cfe6efc04bc98ae2183731b5ae40 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:03.499122 21478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae2bb9c133344078cc4f963e7188776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.506906 21484 tablet_service.cc:1511] Processing CreateTablet for tablet e0950a4a64c4484ba4b753d544c7f1eb (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:03.508175 21484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0950a4a64c4484ba4b753d544c7f1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.509194 21480 tablet_service.cc:1511] Processing CreateTablet for tablet 35e6cfe6efc04bc98ae2183731b5ae40 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:03.510411 21480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e6cfe6efc04bc98ae2183731b5ae40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.499652 21550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0950a4a64c4484ba4b753d544c7f1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.516323 21555 tablet_service.cc:1511] Processing CreateTablet for tablet 13befc0ae0be496ea458eb0ed6662d3d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:03.517673 21555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13befc0ae0be496ea458eb0ed6662d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.518050 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:03.476913 21684 tablet_bootstrap.cc:492] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:03.519091 21559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e6cfe6efc04bc98ae2183731b5ae40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:03.519511 21459 leader_election.cc:343] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.521634 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:03.522267 21642 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.522984 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae2bb9c133344078cc4f963e7188776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.524785 21624 tablet_service.cc:1511] Processing CreateTablet for tablet 35e6cfe6efc04bc98ae2183731b5ae40 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:03.528163 21624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e6cfe6efc04bc98ae2183731b5ae40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.527930 21625 tablet_service.cc:1511] Processing CreateTablet for tablet e0950a4a64c4484ba4b753d544c7f1eb (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:03.529215 21625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0950a4a64c4484ba4b753d544c7f1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.530337 21642 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:03.531064 21630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67538f399a3e491e97d3a4c5585bf44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.531705 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:03.532724 21725 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.533232 21725 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:03.523132 21482 tablet_service.cc:1511] Processing CreateTablet for tablet 13befc0ae0be496ea458eb0ed6662d3d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:03.534582 21482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13befc0ae0be496ea458eb0ed6662d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.534119 21725 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.539064 21724 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:03.540254 21686 tablet_bootstrap.cc:654] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.542745 21684 tablet_bootstrap.cc:654] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.547025 21692 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.547560 21692 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.549611 21692 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:03.551610 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:03.552495 21628 tablet_service.cc:1511] Processing CreateTablet for tablet 13befc0ae0be496ea458eb0ed6662d3d (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 13:06:03.553697 21532 leader_election.cc:343] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.553721 21628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13befc0ae0be496ea458eb0ed6662d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.501062 21629 tablet_service.cc:1511] Processing CreateTablet for tablet ca05d89c0a6b4f8ca791df1da0bad1f1 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:03.555488 21481 tablet_service.cc:1511] Processing CreateTablet for tablet 2002b234371248e3aaaecd1014e30086 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:03.556113 21629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca05d89c0a6b4f8ca791df1da0bad1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.556583 21481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2002b234371248e3aaaecd1014e30086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.477743 21558 tablet_service.cc:1511] Processing CreateTablet for tablet ca05d89c0a6b4f8ca791df1da0bad1f1 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:03.559943 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca05d89c0a6b4f8ca791df1da0bad1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.586058 21686 tablet_bootstrap.cc:492] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:03.586601 21686 ts_tablet_manager.cc:1403] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.006s
I20260709 13:06:03.589558 21686 raft_consensus.cc:359] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.579409 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:03.598649 21632 tablet_service.cc:1511] Processing CreateTablet for tablet 2002b234371248e3aaaecd1014e30086 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:03.604082 21686 raft_consensus.cc:385] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.604259 21642 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:03.604588 21686 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.601181 21692 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.604857 21632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2002b234371248e3aaaecd1014e30086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.605515 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:03.609566 21692 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.609948 21692 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.610282 21692 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.610467 21392 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.612375 21684 tablet_bootstrap.cc:492] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:03.612886 21684 ts_tablet_manager.cc:1403] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.136s	user 0.019s	sys 0.016s
I20260709 13:06:03.616210 21684 raft_consensus.cc:359] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.599468 21552 tablet_service.cc:1511] Processing CreateTablet for tablet 2002b234371248e3aaaecd1014e30086 (DEFAULT_TABLE table=test-workload [id=4d35304567724c40bebbf345e7e61b0b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:03.618548 21684 raft_consensus.cc:385] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.620719 21724 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.620774 21684 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.621297 21724 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } }
I20260709 13:06:03.621877 21684 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.623466 21724 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:03.625289 21552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2002b234371248e3aaaecd1014e30086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.625113 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:03.625433 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:03.625471 21684 ts_tablet_manager.cc:1434] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:06:03.626025 21569 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
W20260709 13:06:03.626588 21457 leader_election.cc:343] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.629961 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:03.631601 21724 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.605548 21686 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.632162 21724 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.632676 21724 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.634477 21686 ts_tablet_manager.cc:1434] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.002s
I20260709 13:06:03.636831 21686 tablet_bootstrap.cc:492] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:03.644640 21686 tablet_bootstrap.cc:654] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.646236 21724 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } }
I20260709 13:06:03.656076 21724 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:03.655963 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:03.655989 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:03.657672 21569 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.660276 21683 tablet_bootstrap.cc:654] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:03.665156 21457 leader_election.cc:343] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.667868 21684 tablet_bootstrap.cc:492] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:03.669589 21722 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.670230 21722 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.672477 21722 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:03.674687 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:03.677698 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:03.679165 21606 leader_election.cc:343] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:03.680745 21608 leader_election.cc:343] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.685274 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:03.686298 21722 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.680356 21692 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.700484 21692 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:03.701371 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:03.702984 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:03.703552 21642 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:03.704017 21532 leader_election.cc:343] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.704770 21686 tablet_bootstrap.cc:492] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:03.705418 21686 ts_tablet_manager.cc:1403] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.000s
I20260709 13:06:03.701838 21724 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.708842 21724 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.713650 21642 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:03.715500 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:03.716029 21724 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:03.716233 21686 raft_consensus.cc:359] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.716966 21686 raft_consensus.cc:385] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.717249 21686 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.717841 21569 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:03.718998 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:03.719612 21642 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:03.721014 21714 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.721074 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:03.718158 21686 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.722329 21724 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.723794 21724 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.725612 21684 tablet_bootstrap.cc:654] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.726665 21683 tablet_bootstrap.cc:492] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:03.727254 21683 ts_tablet_manager.cc:1403] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.256s	user 0.018s	sys 0.003s
I20260709 13:06:03.724336 21724 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.736650 21714 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:03.738205 21686 ts_tablet_manager.cc:1434] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:06:03.739254 21686 tablet_bootstrap.cc:492] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:03.738747 21714 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.739748 21683 raft_consensus.cc:359] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.740667 21683 raft_consensus.cc:385] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.742977 21735 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.742749 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:03.743517 21735 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.744117 21725 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.744015 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:03.744728 21725 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:03.744983 21569 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:03.741668 21683 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.745594 21725 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } }
I20260709 13:06:03.746656 21683 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.749166 21683 ts_tablet_manager.cc:1434] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.006s
I20260709 13:06:03.749774 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:03.750036 21735 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:03.750589 21683 tablet_bootstrap.cc:492] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:03.730965 21734 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:06:03.751833 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:03.750699 21735 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.757854 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:03.762276 21734 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.758869 21735 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.773159 21724 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.775192 21683 tablet_bootstrap.cc:654] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.778988 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:03.780179 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:03.780589 21735 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:03.780771 21569 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.783435 21724 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:03.784245 21686 tablet_bootstrap.cc:654] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.784574 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:03.785184 21642 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.787350 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:03.788283 21641 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 1: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:03.789625 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:03.790827 21692 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.791343 21569 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:03.791833 21642 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:03.792764 21459 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:03.794051 21724 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.794556 21724 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:03.795464 21724 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.798971 21692 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.803301 21392 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.815817 21684 tablet_bootstrap.cc:492] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:03.816390 21684 ts_tablet_manager.cc:1403] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.149s	user 0.016s	sys 0.014s
I20260709 13:06:03.816520 21390 catalog_manager.cc:5697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.819561 21684 raft_consensus.cc:359] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.820313 21684 raft_consensus.cc:385] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.820638 21684 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.822675 21684 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.824404 21683 tablet_bootstrap.cc:492] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:03.824874 21683 ts_tablet_manager.cc:1403] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.009s
I20260709 13:06:03.825327 21684 ts_tablet_manager.cc:1434] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:03.826386 21684 tablet_bootstrap.cc:492] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:03.827736 21683 raft_consensus.cc:359] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.828500 21683 raft_consensus.cc:385] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.828822 21683 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.829711 21683 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.831930 21683 ts_tablet_manager.cc:1434] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:06:03.834116 21686 tablet_bootstrap.cc:492] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:03.834736 21686 ts_tablet_manager.cc:1403] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.096s	user 0.018s	sys 0.000s
I20260709 13:06:03.835006 21683 tablet_bootstrap.cc:492] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:03.835760 21684 tablet_bootstrap.cc:654] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.837916 21686 raft_consensus.cc:359] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.838930 21686 raft_consensus.cc:385] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.839422 21686 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.840468 21686 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.840533 21391 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.842682 21683 tablet_bootstrap.cc:654] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.843921 21686 ts_tablet_manager.cc:1434] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:06:03.845427 21686 tablet_bootstrap.cc:492] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:03.855160 21686 tablet_bootstrap.cc:654] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.860371 21725 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.861102 21725 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.865372 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:03.867491 21725 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:03.867311 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:03.868783 21686 tablet_bootstrap.cc:492] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:03.869287 21686 ts_tablet_manager.cc:1403] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.015s
I20260709 13:06:03.869314 21643 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:03.871008 21457 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:03.872014 21686 raft_consensus.cc:359] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.872686 21686 raft_consensus.cc:385] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.872967 21686 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.873616 21686 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.874009 21725 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.880077 21686 ts_tablet_manager.cc:1434] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:06:03.880993 21686 tablet_bootstrap.cc:492] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:03.886029 21684 tablet_bootstrap.cc:492] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:03.886612 21686 tablet_bootstrap.cc:654] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.886662 21684 ts_tablet_manager.cc:1403] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.061s	user 0.031s	sys 0.013s
I20260709 13:06:03.881588 21725 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.890486 21684 raft_consensus.cc:359] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.892117 21684 raft_consensus.cc:385] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.892522 21684 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.893272 21683 tablet_bootstrap.cc:492] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:03.893332 21686 tablet_bootstrap.cc:492] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:03.893863 21683 ts_tablet_manager.cc:1403] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.006s
I20260709 13:06:03.893975 21686 ts_tablet_manager.cc:1403] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:06:03.893436 21684 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.896387 21684 ts_tablet_manager.cc:1434] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:03.896685 21686 raft_consensus.cc:359] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.896873 21683 raft_consensus.cc:359] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.897467 21686 raft_consensus.cc:385] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.897534 21683 raft_consensus.cc:385] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.897662 21684 tablet_bootstrap.cc:492] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:03.897924 21683 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.897866 21686 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.898875 21683 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.899034 21686 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.900995 21686 ts_tablet_manager.cc:1434] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:06:03.902451 21683 ts_tablet_manager.cc:1434] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:03.903450 21683 tablet_bootstrap.cc:492] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:03.905270 21684 tablet_bootstrap.cc:654] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.907634 21686 tablet_bootstrap.cc:492] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:03.908962 21683 tablet_bootstrap.cc:654] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.915606 21686 tablet_bootstrap.cc:654] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.916715 21684 tablet_bootstrap.cc:492] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:03.917253 21684 ts_tablet_manager.cc:1403] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:06:03.924993 21684 raft_consensus.cc:359] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.926254 21684 raft_consensus.cc:385] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.927605 21684 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.928385 21684 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.929384 21683 tablet_bootstrap.cc:492] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:03.929607 21686 tablet_bootstrap.cc:492] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:03.929838 21683 ts_tablet_manager.cc:1403] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.007s
I20260709 13:06:03.930052 21686 ts_tablet_manager.cc:1403] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:06:03.930425 21684 ts_tablet_manager.cc:1434] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:06:03.931664 21684 tablet_bootstrap.cc:492] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:03.932595 21683 raft_consensus.cc:359] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } }
I20260709 13:06:03.932861 21686 raft_consensus.cc:359] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.933387 21683 raft_consensus.cc:385] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.933673 21686 raft_consensus.cc:385] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.933795 21683 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.934021 21686 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.934677 21683 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } }
I20260709 13:06:03.934876 21686 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.937229 21686 ts_tablet_manager.cc:1434] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:03.939950 21683 ts_tablet_manager.cc:1434] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:06:03.940908 21683 tablet_bootstrap.cc:492] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:03.941713 21684 tablet_bootstrap.cc:654] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.947796 21686 tablet_bootstrap.cc:492] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:03.952078 21683 tablet_bootstrap.cc:654] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.957465 21684 tablet_bootstrap.cc:492] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:03.958149 21684 ts_tablet_manager.cc:1403] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 13:06:03.959565 21686 tablet_bootstrap.cc:654] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.961719 21684 raft_consensus.cc:359] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.962684 21684 raft_consensus.cc:385] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.963059 21684 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.963917 21684 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.969610 21684 ts_tablet_manager.cc:1434] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:06:03.970532 21684 tablet_bootstrap.cc:492] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:03.971715 21686 tablet_bootstrap.cc:492] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:03.972354 21686 ts_tablet_manager.cc:1403] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.005s
I20260709 13:06:03.975014 21722 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.975520 21722 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.975919 21686 raft_consensus.cc:359] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.976586 21686 raft_consensus.cc:385] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.976876 21686 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.977072 21725 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.977674 21722 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:03.977555 21686 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.976329 21684 tablet_bootstrap.cc:654] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.979600 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:03.979717 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:03.980394 21569 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:03.981773 21686 ts_tablet_manager.cc:1434] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:03.981642 21608 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:03.982496 21722 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.982897 21722 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.983343 21722 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:03.988962 21606 leader_election.cc:343] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.992949 21714 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.993678 21714 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:03.996646 21714 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:03.999714 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:03.998064 21722 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.001680 21642 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:04.003623 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:04.004057 21757 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.004525 21734 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.004889 21734 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.005223 21734 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.005417 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:04.006736 21686 tablet_bootstrap.cc:492] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
W20260709 13:06:04.007488 21606 leader_election.cc:343] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.008824 21722 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.013836 21684 tablet_bootstrap.cc:492] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:04.014333 21684 ts_tablet_manager.cc:1403] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.026s
I20260709 13:06:04.016935 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:04.017061 21684 raft_consensus.cc:359] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.017613 21569 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.017768 21686 tablet_bootstrap.cc:654] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.017817 21684 raft_consensus.cc:385] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.018251 21684 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.018939 21684 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.020874 21684 ts_tablet_manager.cc:1434] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:04.024729 21684 tablet_bootstrap.cc:492] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:04.030566 21684 tablet_bootstrap.cc:654] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.033013 21724 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:04.000339 21683 tablet_bootstrap.cc:492] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.054667 21683 ts_tablet_manager.cc:1403] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.114s	user 0.018s	sys 0.012s
I20260709 13:06:04.000696 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:04.056383 21494 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
W20260709 13:06:04.071492 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:04.075229 21725 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.076308 21725 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.076607 21683 raft_consensus.cc:359] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.077615 21683 raft_consensus.cc:385] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.078029 21683 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.079006 21683 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.081315 21724 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.081884 21683 ts_tablet_manager.cc:1434] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:06:04.081775 21724 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.087983 21683 tablet_bootstrap.cc:492] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.088193 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:04.089824 21457 leader_election.cc:343] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.080904 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:04.091604 21568 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:04.092931 21459 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:04.090965 21724 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.094462 21683 tablet_bootstrap.cc:654] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.095315 21724 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.096124 21724 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.097002 21724 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.086705 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:04.102413 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:04.004544 21757 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.104094 21714 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.104583 21714 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.106712 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:04.108095 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:04.108242 21606 leader_election.cc:343] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.109229 21714 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:04.109891 21532 leader_election.cc:343] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:04.110495 21457 leader_election.cc:343] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.111644 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:04.112661 21643 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:04.113951 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:04.114749 21567 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:04.116384 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:06:04.116515 21459 leader_election.cc:343] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.117276 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:04.118114 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:04.119359 21758 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.119465 21757 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.119861 21758 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.120154 21725 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.120369 21758 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.075237 21569 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:04.119490 21568 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.119360 21714 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.119846 21764 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.074491 21734 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.123430 21608 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:04.127614 21714 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.130358 21714 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.140709 21757 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.141564 21757 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:04.142594 21757 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.151814 21686 tablet_bootstrap.cc:492] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:04.151638 21692 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.152326 21686 ts_tablet_manager.cc:1403] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.146s	user 0.025s	sys 0.042s
I20260709 13:06:04.153002 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:04.153591 21493 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.153638 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:04.154346 21643 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.156188 21764 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.156629 21683 tablet_bootstrap.cc:492] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.158058 21683 ts_tablet_manager.cc:1403] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.004s
I20260709 13:06:04.163072 21686 raft_consensus.cc:359] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.164136 21686 raft_consensus.cc:385] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.164513 21686 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.166361 21722 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.166937 21722 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.159147 21734 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.168174 21686 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.172170 21722 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.174144 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:04.174705 21686 ts_tablet_manager.cc:1434] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
W20260709 13:06:04.177157 21606 leader_election.cc:343] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.177558 21493 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:04.178097 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:04.178925 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:04.179037 21569 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:04.179914 21734 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.180464 21734 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:04.180897 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:04.182333 21722 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.182677 21722 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.183061 21722 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.182765 21734 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.183497 21684 tablet_bootstrap.cc:492] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:04.184022 21684 ts_tablet_manager.cc:1403] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.159s	user 0.045s	sys 0.072s
I20260709 13:06:04.186081 21643 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:04.186936 21686 tablet_bootstrap.cc:492] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:04.149276 21724 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.162434 21758 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.197276 21683 raft_consensus.cc:359] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.199673 21683 raft_consensus.cc:385] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.200117 21683 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.201046 21683 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.207309 21692 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.210911 21692 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.213903 21692 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.215060 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:04.215590 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:04.216004 21493 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:04.216012 21764 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:04.216507 21641 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:04.220826 21684 raft_consensus.cc:359] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.223743 21684 raft_consensus.cc:385] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.223199 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:04.221791 21722 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.225600 21758 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.224210 21684 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.226642 21734 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.227277 21734 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.227699 21734 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.228073 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:04.225658 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:04.233867 21724 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.234504 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:04.235162 21566 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.230872 21684 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.239574 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:04.240638 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:04.242239 21606 leader_election.cc:343] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.240700 21641 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.243043 21684 ts_tablet_manager.cc:1434] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.059s	user 0.012s	sys 0.000s
I20260709 13:06:04.241758 21722 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.246603 21566 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:04.246923 21493 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.248452 21459 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:04.249965 21725 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.250499 21725 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:04.251888 21686 tablet_bootstrap.cc:654] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.251564 21725 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.257177 21643 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.264624 21684 tablet_bootstrap.cc:492] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:04.277397 21692 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:04.279825 21714 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.281762 21568 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 1: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:04.299153 21641 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:04.300783 21714 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.307528 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:04.301693 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:04.311950 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:04.312811 21641 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:04.313165 21725 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:04.313359 21567 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.316428 21683 ts_tablet_manager.cc:1434] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.158s	user 0.041s	sys 0.035s
I20260709 13:06:04.317972 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:04.318823 21683 tablet_bootstrap.cc:492] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.318841 21714 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.335664 21391 catalog_manager.cc:5697] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.344422 21683 tablet_bootstrap.cc:654] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.344489 21686 tablet_bootstrap.cc:492] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:04.346769 21686 ts_tablet_manager.cc:1403] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.160s	user 0.032s	sys 0.006s
I20260709 13:06:04.347518 21725 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.354116 21686 raft_consensus.cc:359] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.354951 21686 raft_consensus.cc:385] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.355289 21686 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.351970 21389 catalog_manager.cc:5697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.363813 21686 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.366055 21686 ts_tablet_manager.cc:1434] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:06:04.367010 21686 tablet_bootstrap.cc:492] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:04.376633 21493 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:04.384029 21684 tablet_bootstrap.cc:654] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.391731 21606 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:04.395394 21771 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.396275 21771 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:04.397619 21683 tablet_bootstrap.cc:492] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.397164 21771 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.398103 21683 ts_tablet_manager.cc:1403] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.006s
I20260709 13:06:04.386562 21734 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.400134 21686 tablet_bootstrap.cc:654] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.401196 21734 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.403383 21567 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:04.402917 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:04.403964 21641 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.401974 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:04.405759 21494 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.411046 21641 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:04.412366 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:04.413744 21734 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.414249 21494 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:04.414517 21734 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:04.413861 21392 catalog_manager.cc:5697] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.415448 21734 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.417572 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:04.420038 21757 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.420900 21757 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:04.424208 21683 raft_consensus.cc:359] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.424912 21683 raft_consensus.cc:385] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.425174 21683 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.422132 21757 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.426540 21683 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.428537 21683 ts_tablet_manager.cc:1434] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:06:04.429826 21683 tablet_bootstrap.cc:492] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.432096 21684 tablet_bootstrap.cc:492] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:04.432561 21684 ts_tablet_manager.cc:1403] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.172s	user 0.009s	sys 0.007s
I20260709 13:06:04.437099 21686 tablet_bootstrap.cc:492] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:04.437625 21686 ts_tablet_manager.cc:1403] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.006s
I20260709 13:06:04.444379 21684 raft_consensus.cc:359] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.444844 21683 tablet_bootstrap.cc:654] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.452478 21683 tablet_bootstrap.cc:492] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.448855 21686 raft_consensus.cc:359] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.453491 21683 ts_tablet_manager.cc:1403] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.007s
I20260709 13:06:04.453714 21686 raft_consensus.cc:385] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.454063 21686 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.453892 21391 catalog_manager.cc:5697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.445123 21684 raft_consensus.cc:385] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.454936 21686 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.455377 21684 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.456454 21684 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.456961 21686 ts_tablet_manager.cc:1434] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 13:06:04.456830 21683 raft_consensus.cc:359] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.457674 21683 raft_consensus.cc:385] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.457978 21686 tablet_bootstrap.cc:492] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:04.458012 21683 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.459446 21683 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.462399 21683 ts_tablet_manager.cc:1434] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:04.463419 21683 tablet_bootstrap.cc:492] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.466671 21686 tablet_bootstrap.cc:654] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.469671 21683 tablet_bootstrap.cc:654] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.475040 21684 ts_tablet_manager.cc:1434] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:06:04.476197 21684 tablet_bootstrap.cc:492] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:04.475287 21391 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.477851 21683 tablet_bootstrap.cc:492] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.477284 21391 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.478119 21686 tablet_bootstrap.cc:492] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:04.478313 21683 ts_tablet_manager.cc:1403] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 13:06:04.478672 21686 ts_tablet_manager.cc:1403] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.007s
I20260709 13:06:04.481649 21683 raft_consensus.cc:359] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.481848 21686 raft_consensus.cc:359] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.482337 21683 raft_consensus.cc:385] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.482733 21686 raft_consensus.cc:385] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.482741 21683 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.483282 21686 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.483719 21683 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.484429 21686 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.486063 21683 ts_tablet_manager.cc:1434] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:04.486027 21714 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.486645 21686 ts_tablet_manager.cc:1434] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:04.486584 21714 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.487154 21683 tablet_bootstrap.cc:492] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.487792 21686 tablet_bootstrap.cc:492] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:04.488754 21714 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.491357 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:04.492944 21532 leader_election.cc:343] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.493563 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:04.494956 21686 tablet_bootstrap.cc:654] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.496304 21684 tablet_bootstrap.cc:654] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.498567 21683 tablet_bootstrap.cc:654] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.505717 21684 tablet_bootstrap.cc:492] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
W20260709 13:06:04.506109 21532 leader_election.cc:343] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.506331 21684 ts_tablet_manager.cc:1403] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 13:06:04.506887 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:04.507983 21734 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.512019 21684 raft_consensus.cc:359] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.515445 21684 raft_consensus.cc:385] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.516795 21684 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.517046 21686 tablet_bootstrap.cc:492] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:04.517539 21686 ts_tablet_manager.cc:1403] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.011s
I20260709 13:06:04.518069 21683 tablet_bootstrap.cc:492] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.517789 21684 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.518532 21683 ts_tablet_manager.cc:1403] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.003s
I20260709 13:06:04.520485 21686 raft_consensus.cc:359] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.521205 21686 raft_consensus.cc:385] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.521548 21686 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.521160 21683 raft_consensus.cc:359] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.522208 21683 raft_consensus.cc:385] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.522534 21683 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.522346 21686 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.523356 21683 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.524688 21684 ts_tablet_manager.cc:1434] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:06:04.525610 21684 tablet_bootstrap.cc:492] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:04.525910 21683 ts_tablet_manager.cc:1434] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:04.526820 21683 tablet_bootstrap.cc:492] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.531898 21684 tablet_bootstrap.cc:654] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.532701 21683 tablet_bootstrap.cc:654] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.533397 21686 ts_tablet_manager.cc:1434] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:06:04.534446 21686 tablet_bootstrap.cc:492] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:04.540366 21686 tablet_bootstrap.cc:654] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.542523 21683 tablet_bootstrap.cc:492] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.543232 21683 ts_tablet_manager.cc:1403] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:06:04.547752 21683 raft_consensus.cc:359] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.548470 21683 raft_consensus.cc:385] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.548768 21683 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.549578 21683 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.551018 21686 tablet_bootstrap.cc:492] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:04.551461 21686 ts_tablet_manager.cc:1403] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.003s
I20260709 13:06:04.552006 21683 ts_tablet_manager.cc:1434] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:04.552925 21683 tablet_bootstrap.cc:492] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.554611 21686 raft_consensus.cc:359] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.555523 21686 raft_consensus.cc:385] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.555728 21684 tablet_bootstrap.cc:492] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:04.555883 21686 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.556456 21684 ts_tablet_manager.cc:1403] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.015s
I20260709 13:06:04.556843 21686 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.558928 21683 tablet_bootstrap.cc:654] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.559008 21686 ts_tablet_manager.cc:1434] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:04.559202 21684 raft_consensus.cc:359] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.559978 21684 raft_consensus.cc:385] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.560297 21684 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.560405 21686 tablet_bootstrap.cc:492] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:04.561146 21684 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.567021 21686 tablet_bootstrap.cc:654] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.570926 21683 tablet_bootstrap.cc:492] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.571803 21683 ts_tablet_manager.cc:1403] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:06:04.574131 21761 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.574466 21683 raft_consensus.cc:359] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.574640 21761 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.575194 21683 raft_consensus.cc:385] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.575490 21683 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.576136 21683 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.576886 21761 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.578562 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:04.579231 21683 ts_tablet_manager.cc:1434] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:04.580271 21683 tablet_bootstrap.cc:492] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.580149 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:04.581594 21457 leader_election.cc:343] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.586611 21683 tablet_bootstrap.cc:654] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:04.591410 21606 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.594285 21684 ts_tablet_manager.cc:1434] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:06:04.595633 21684 tablet_bootstrap.cc:492] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:04.579221 21567 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:04.600718 21459 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:04.602300 21761 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.602819 21761 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.603250 21761 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.615629 21761 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.622371 21761 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.623845 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:04.625767 21683 tablet_bootstrap.cc:492] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.626237 21683 ts_tablet_manager.cc:1403] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.011s
I20260709 13:06:04.626521 21686 tablet_bootstrap.cc:492] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
W20260709 13:06:04.626945 21457 leader_election.cc:343] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.627043 21686 ts_tablet_manager.cc:1403] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.019s
I20260709 13:06:04.627030 21734 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.627736 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:04.627650 21734 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.628310 21567 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.628973 21683 raft_consensus.cc:359] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.629607 21683 raft_consensus.cc:385] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.629762 21734 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.629974 21683 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.629946 21686 raft_consensus.cc:359] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.636933 21686 raft_consensus.cc:385] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.637296 21686 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.637058 21683 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.637532 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:04.638022 21686 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.639353 21567 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:04.639628 21686 ts_tablet_manager.cc:1434] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 13:06:04.640616 21459 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:04.641121 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:04.640715 21532 leader_election.cc:343] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.642017 21761 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:04.642686 21532 leader_election.cc:343] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.643190 21761 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:04.643148 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:04.643735 21683 ts_tablet_manager.cc:1434] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:06:04.644361 21734 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.644156 21761 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.645561 21684 tablet_bootstrap.cc:654] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.644699 21683 tablet_bootstrap.cc:492] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.648417 21757 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.648900 21757 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.650254 21686 tablet_bootstrap.cc:492] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:04.652130 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:04.653756 21606 leader_election.cc:343] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.654524 21757 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.656876 21686 tablet_bootstrap.cc:654] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.655067 21683 tablet_bootstrap.cc:654] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.667954 21683 tablet_bootstrap.cc:492] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.668613 21683 ts_tablet_manager.cc:1403] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.006s
I20260709 13:06:04.668800 21686 tablet_bootstrap.cc:492] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:04.669348 21686 ts_tablet_manager.cc:1403] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.006s
I20260709 13:06:04.672399 21686 raft_consensus.cc:359] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.672444 21683 raft_consensus.cc:359] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.673223 21686 raft_consensus.cc:385] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.673426 21683 raft_consensus.cc:385] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.673633 21686 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.673904 21683 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.674484 21686 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.674945 21683 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.677439 21686 ts_tablet_manager.cc:1434] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:04.679636 21686 tablet_bootstrap.cc:492] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:04.685953 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:04.686798 21569 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:04.688520 21683 ts_tablet_manager.cc:1434] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 13:06:04.689895 21683 tablet_bootstrap.cc:492] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.692332 21686 tablet_bootstrap.cc:654] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.692857 21757 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.693420 21757 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.697808 21757 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.698374 21683 tablet_bootstrap.cc:654] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.699010 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:04.701310 21606 leader_election.cc:343] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.702626 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:04.704360 21757 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.704871 21686 tablet_bootstrap.cc:492] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:04.705385 21686 ts_tablet_manager.cc:1403] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:06:04.704916 21757 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.706243 21757 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.708338 21686 raft_consensus.cc:359] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.709174 21686 raft_consensus.cc:385] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.709513 21686 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.714102 21686 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.717846 21686 ts_tablet_manager.cc:1434] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:06:04.717886 21714 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:04.722172 21686 tablet_bootstrap.cc:492] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:04.724035 21714 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.724751 21714 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.729621 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:04.730614 21569 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:04.732769 21714 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.732975 21724 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.749714 21771 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.750067 21608 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:04.750434 21771 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.751371 21722 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.751858 21722 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.752236 21722 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.755462 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:04.755898 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:04.759588 21492 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:04.754009 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:04.762590 21493 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:04.769395 21683 tablet_bootstrap.cc:492] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:04.770216 21683 ts_tablet_manager.cc:1403] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.006s
I20260709 13:06:04.748602 21757 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.753266 21771 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.772174 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:04.775700 21771 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.776100 21771 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.777014 21771 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.788074 21757 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.788839 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:04.790779 21606 leader_election.cc:343] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.791617 21686 tablet_bootstrap.cc:654] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.776584 21722 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.795614 21761 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.796661 21722 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.798038 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:04.798717 21567 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:04.798834 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:06:04.799763 21532 leader_election.cc:343] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.800734 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:04.802197 21606 leader_election.cc:343] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.802445 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:04.803071 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:04.803438 21566 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.803721 21567 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.804762 21389 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.806970 21722 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.802595 21714 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.811411 21683 raft_consensus.cc:359] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.812073 21683 raft_consensus.cc:385] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.812433 21683 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.810845 21714 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.813172 21683 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.814203 21714 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.816490 21734 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.820420 21684 tablet_bootstrap.cc:492] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:04.820924 21684 ts_tablet_manager.cc:1403] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.226s	user 0.057s	sys 0.074s
I20260709 13:06:04.822729 21771 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.823756 21684 raft_consensus.cc:359] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.824405 21684 raft_consensus.cc:385] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.824661 21684 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.825423 21757 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.825311 21684 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.825896 21757 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.827344 21684 ts_tablet_manager.cc:1434] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:06:04.828019 21566 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:04.828245 21684 tablet_bootstrap.cc:492] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:04.829164 21771 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.829460 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:04.831426 21493 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.832031 21567 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:04.834678 21683 ts_tablet_manager.cc:1434] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 13:06:04.834987 21722 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.835533 21757 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.839860 21683 tablet_bootstrap.cc:492] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:04.854089 21493 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:04.857472 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:04.835543 21722 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.858758 21757 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.860052 21771 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.865579 21771 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.867667 21771 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.868767 21757 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:04.869123 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:04.869642 21757 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.862325 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:04.869196 21722 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.881461 21724 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.883139 21608 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:04.883276 21724 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.884843 21722 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.885506 21722 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:04.886179 21724 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.887035 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:04.868794 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:04.887776 21567 raft_consensus.cc:2393] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:04.887712 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:04.886492 21722 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:04.870558 21606 leader_election.cc:343] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:04.893052 21606 leader_election.cc:343] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.896822 21459 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:04.907840 21686 tablet_bootstrap.cc:492] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:04.908527 21686 ts_tablet_manager.cc:1403] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.187s	user 0.024s	sys 0.015s
I20260709 13:06:04.911063 21714 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.912261 21686 raft_consensus.cc:359] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.913190 21686 raft_consensus.cc:385] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.913506 21686 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.914443 21686 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.926321 21686 ts_tablet_manager.cc:1434] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:06:04.927732 21686 tablet_bootstrap.cc:492] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Bootstrap starting.
W20260709 13:06:04.914767 21606 leader_election.cc:343] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.916247 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:04.915813 21724 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.935510 21771 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.946393 21764 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.949035 21764 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.950656 21714 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.951169 21764 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:04.933784 21809 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.948961 21722 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.983227 21684 tablet_bootstrap.cc:654] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.982153 21722 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:04.986857 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:04.990995 21722 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:04.979472 21809 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.001893 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.003849 21567 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:05.004290 21722 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.004848 21722 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.014374 21459 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:05.019359 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:05.016940 21812 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:06:05.027253 21764 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.020782 21809 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:05.036429 21683 tablet_bootstrap.cc:654] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.039862 21722 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:05.041769 21809 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.054955 21764 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.056460 21807 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.057034 21807 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.059298 21807 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:05.065603 21686 tablet_bootstrap.cc:654] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.032781 21771 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:05.062721 21392 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.068331 21392 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:05.066630 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 50735.3us
I20260709 13:06:05.074532 21771 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.075194 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:05.076841 21569 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:05.087034 21606 leader_election.cc:343] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.088199 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.088865 21568 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:05.090914 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.091315 21724 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.093495 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.094238 21684 tablet_bootstrap.cc:492] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:05.094714 21684 ts_tablet_manager.cc:1403] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.267s	user 0.010s	sys 0.010s
I20260709 13:06:05.095177 21764 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.096149 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.096787 21567 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:05.097343 21684 raft_consensus.cc:359] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.098039 21684 raft_consensus.cc:385] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.098317 21684 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.098929 21684 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.099975 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:05.100572 21493 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:05.100967 21684 ts_tablet_manager.cc:1434] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:05.103067 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:05.103129 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.103880 21568 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:05.106761 21684 tablet_bootstrap.cc:492] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:05.106320 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:05.108356 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.108592 21757 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.108958 21757 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.109297 21757 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.113507 21684 tablet_bootstrap.cc:654] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.114969 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:05.115576 21494 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.117326 21809 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.119419 21569 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:05.145586 21684 tablet_bootstrap.cc:492] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:05.146195 21684 ts_tablet_manager.cc:1403] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.023s
I20260709 13:06:05.124019 21494 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:05.128369 21757 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.150892 21757 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:05.131484 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:05.149904 21684 raft_consensus.cc:359] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.138311 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:05.138299 21389 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.141759 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:05.142457 21683 tablet_bootstrap.cc:492] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:05.153474 21683 ts_tablet_manager.cc:1403] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.314s	user 0.016s	sys 0.006s
I20260709 13:06:05.153383 21641 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:05.142961 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.151852 21684 raft_consensus.cc:385] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.154665 21684 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
W20260709 13:06:05.155616 21608 leader_election.cc:343] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.155419 21684 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.156064 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.156247 21683 raft_consensus.cc:359] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.156955 21683 raft_consensus.cc:385] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.157220 21683 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
W20260709 13:06:05.157255 21608 leader_election.cc:343] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.157596 21684 ts_tablet_manager.cc:1434] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:06:05.157724 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.158587 21684 tablet_bootstrap.cc:492] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:05.159524 21757 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.159910 21757 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.160223 21757 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.163159 21809 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.163770 21809 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.162921 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.167915 21817 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.168301 21817 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.168635 21817 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.174944 21683 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.181558 21684 tablet_bootstrap.cc:654] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.187104 21683 ts_tablet_manager.cc:1434] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:06:05.188422 21683 tablet_bootstrap.cc:492] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:05.190994 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:05.191875 21494 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.185488 21608 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.195439 21771 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.196224 21722 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.200381 21757 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.202461 21757 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:05.203317 21817 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.203869 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:05.196499 21771 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:06:05.207381 21686 tablet_bootstrap.cc:492] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
W20260709 13:06:05.205857 21606 leader_election.cc:343] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.207952 21686 ts_tablet_manager.cc:1403] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.280s	user 0.019s	sys 0.023s
I20260709 13:06:05.212467 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:05.212882 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:06:05.214278 21606 leader_election.cc:343] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.214608 21817 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:05.216291 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:05.216881 21567 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.217494 21641 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.223228 21683 tablet_bootstrap.cc:654] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.225279 21494 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:05.228111 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:05.228744 21565 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.229409 21686 raft_consensus.cc:359] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.230129 21686 raft_consensus.cc:385] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.217501 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:05.230432 21686 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.235026 21686 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.235581 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:05.237215 21686 ts_tablet_manager.cc:1434] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.000s
I20260709 13:06:05.237607 21568 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.239215 21686 tablet_bootstrap.cc:492] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:05.238535 21817 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.243562 21817 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:05.246534 21817 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.250104 21725 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
I20260709 13:06:05.251571 21565 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:05.286877 21761 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.326668 21761 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.329815 21761 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:05.329741 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.238186 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:05.331652 21807 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.332135 21807 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:05.332964 21807 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.286877 21568 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:05.339614 21684 tablet_bootstrap.cc:492] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:05.340091 21684 ts_tablet_manager.cc:1403] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.182s	user 0.010s	sys 0.002s
I20260709 13:06:05.344019 21683 tablet_bootstrap.cc:492] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:05.344491 21683 ts_tablet_manager.cc:1403] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.156s	user 0.016s	sys 0.005s
I20260709 13:06:05.251714 21567 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:05.345180 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:05.345451 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 108067us
I20260709 13:06:05.345953 21391 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.347174 21683 raft_consensus.cc:359] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.347869 21683 raft_consensus.cc:385] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.348151 21683 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
W20260709 13:06:05.348259 21532 leader_election.cc:343] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.349308 21684 raft_consensus.cc:359] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.350044 21684 raft_consensus.cc:385] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.350311 21684 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.351135 21683 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.352249 21684 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.354476 21684 ts_tablet_manager.cc:1434] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:06:05.355187 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:05.356916 21683 ts_tablet_manager.cc:1434] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:06:05.357890 21683 tablet_bootstrap.cc:492] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:05.359232 21686 tablet_bootstrap.cc:654] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.360816 21764 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.360997 21684 tablet_bootstrap.cc:492] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:05.366196 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.370067 21817 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.372576 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.374563 21818 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.375123 21818 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:05.375953 21818 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.376253 21757 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.387655 21683 tablet_bootstrap.cc:654] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.383809 21817 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:06:05.391077 21532 leader_election.cc:343] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.391181 21807 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.393356 21807 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.393661 21817 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.378594 21389 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.396780 21813 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.399602 21807 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:05.396757 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.405853 21807 raft_consensus.cc:2764] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:06:05.414453 21684 tablet_bootstrap.cc:654] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.426230 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:05.428455 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:05.434340 21819 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.436043 21683 tablet_bootstrap.cc:492] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:05.435797 21818 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.438129 21813 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.438752 21813 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.440645 21813 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:05.441668 21813 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:05.442343 21532 leader_election.cc:343] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.443970 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:05.444160 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:05.444726 21643 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:05.436558 21683 ts_tablet_manager.cc:1403] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.005s
I20260709 13:06:05.449671 21683 raft_consensus.cc:359] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.450379 21683 raft_consensus.cc:385] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.450722 21683 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.451447 21683 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.452914 21686 tablet_bootstrap.cc:492] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:05.453442 21686 ts_tablet_manager.cc:1403] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.214s	user 0.026s	sys 0.008s
I20260709 13:06:05.453509 21683 ts_tablet_manager.cc:1434] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:05.454468 21683 tablet_bootstrap.cc:492] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:05.456154 21686 raft_consensus.cc:359] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.456815 21686 raft_consensus.cc:385] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.457090 21686 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.457896 21686 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.460227 21686 ts_tablet_manager.cc:1434] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:05.460453 21817 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.461501 21686 tablet_bootstrap.cc:492] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
W20260709 13:06:05.466058 21532 leader_election.cc:343] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.467775 21684 tablet_bootstrap.cc:492] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:05.468225 21684 ts_tablet_manager.cc:1403] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.107s	user 0.008s	sys 0.004s
I20260709 13:06:05.468536 21686 tablet_bootstrap.cc:654] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.466612 21532 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:05.474771 21813 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.477510 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:05.480708 21805 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.481129 21805 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.481482 21805 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.485219 21391 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.487439 21391 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:05.491961 21532 leader_election.cc:343] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.495605 21684 raft_consensus.cc:359] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.496347 21684 raft_consensus.cc:385] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.496622 21684 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.497347 21684 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.512079 21722 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.519258 21684 ts_tablet_manager.cc:1434] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:06:05.520589 21684 tablet_bootstrap.cc:492] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:05.526062 21492 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.528123 21683 tablet_bootstrap.cc:654] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.531169 21805 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.532373 21686 tablet_bootstrap.cc:492] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:05.532828 21686 ts_tablet_manager.cc:1403] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.009s
I20260709 13:06:05.534108 21684 tablet_bootstrap.cc:654] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.535522 21805 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:05.536181 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:05.539443 21722 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.537712 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:05.539940 21722 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.540388 21641 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.543051 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:05.543823 21493 raft_consensus.cc:2393] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 1: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:05.546070 21722 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:05.546857 21532 leader_election.cc:343] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.547159 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.548919 21608 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.550086 21684 tablet_bootstrap.cc:492] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:05.550235 21722 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.550623 21684 ts_tablet_manager.cc:1403] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:06:05.553197 21684 raft_consensus.cc:359] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.553880 21684 raft_consensus.cc:385] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.554145 21684 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.554831 21684 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.556075 21641 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:05.538682 21686 raft_consensus.cc:359] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.557122 21686 raft_consensus.cc:385] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.557493 21686 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.558678 21686 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.559419 21683 tablet_bootstrap.cc:492] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:05.559887 21683 ts_tablet_manager.cc:1403] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.106s	user 0.005s	sys 0.009s
I20260709 13:06:05.560917 21686 ts_tablet_manager.cc:1434] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:06:05.562260 21683 raft_consensus.cc:359] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.562952 21683 raft_consensus.cc:385] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.563210 21683 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.563903 21764 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.563795 21683 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.564327 21764 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.564788 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.566112 21683 ts_tablet_manager.cc:1434] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:06:05.566314 21813 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.566555 21764 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:05.566973 21683 tablet_bootstrap.cc:492] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:05.569509 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:05.556847 21684 ts_tablet_manager.cc:1434] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:05.570008 21813 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:05.570952 21684 tablet_bootstrap.cc:492] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:05.570919 21813 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.573709 21764 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.574196 21764 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.575201 21683 tablet_bootstrap.cc:654] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.576298 21764 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:05.577948 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.578804 21565 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:05.580295 21686 tablet_bootstrap.cc:492] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:05.580120 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.581689 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:05.583194 21761 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.582020 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:05.585428 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:05.585748 21494 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.586642 21764 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.591958 21686 tablet_bootstrap.cc:654] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.555650 21722 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.613327 21771 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.632858 21724 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.637714 21686 tablet_bootstrap.cc:492] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:05.638214 21686 ts_tablet_manager.cc:1403] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.012s
I20260709 13:06:05.641016 21686 raft_consensus.cc:359] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.635102 21724 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.659089 21686 raft_consensus.cc:385] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.659714 21686 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.650609 21391 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.633929 21764 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.663044 21686 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.676632 21724 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:05.681877 21771 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.682425 21771 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.683377 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:05.684676 21771 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:05.686940 21818 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.690979 21818 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.691442 21683 tablet_bootstrap.cc:492] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:05.691918 21683 ts_tablet_manager.cc:1403] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.125s	user 0.022s	sys 0.013s
I20260709 13:06:05.694118 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.695421 21567 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:05.695345 21683 raft_consensus.cc:359] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.696208 21683 raft_consensus.cc:385] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.696501 21683 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.696975 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:05.697440 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.697736 21686 ts_tablet_manager.cc:1434] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:06:05.698001 21683 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.698503 21565 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:05.699076 21686 tablet_bootstrap.cc:492] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:05.699302 21722 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.699682 21722 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.700055 21722 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.700387 21683 ts_tablet_manager.cc:1434] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:06:05.701342 21683 tablet_bootstrap.cc:492] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:05.707463 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:05.712137 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:05.713965 21764 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.719360 21684 tablet_bootstrap.cc:654] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.720614 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:05.721669 21683 tablet_bootstrap.cc:654] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:05.724423 21606 leader_election.cc:343] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:05.725579 21606 leader_election.cc:343] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.714095 21722 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.751412 21818 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:05.752527 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:05.754179 21683 tablet_bootstrap.cc:492] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:05.754669 21683 ts_tablet_manager.cc:1403] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.006s
I20260709 13:06:05.755184 21764 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:05.756726 21606 leader_election.cc:343] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.757893 21734 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.759362 21686 tablet_bootstrap.cc:654] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.757220 21722 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:05.761123 21771 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.766673 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:05.793275 21566 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.796339 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:05.798484 21608 leader_election.cc:343] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.799165 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.800778 21771 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.817495 21818 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.847159 21684 tablet_bootstrap.cc:492] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:05.847787 21684 ts_tablet_manager.cc:1403] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.277s	user 0.068s	sys 0.061s
I20260709 13:06:05.853209 21566 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:05.854290 21818 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.854923 21722 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.855154 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.856673 21683 raft_consensus.cc:359] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.855175 21818 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.857569 21757 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.858160 21757 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:05.858989 21757 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.859266 21818 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:05.859995 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:05.861456 21606 leader_election.cc:343] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.863291 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:05.857596 21683 raft_consensus.cc:385] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.865367 21683 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.866550 21683 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.867729 21566 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:05.891553 21608 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:05.892228 21813 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.893079 21722 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.892905 21813 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.895743 21813 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:05.893498 21722 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.896561 21722 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.897545 21684 raft_consensus.cc:359] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.898600 21684 raft_consensus.cc:385] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.898972 21684 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.900045 21684 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.903635 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:05.902410 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:05.900671 21683 ts_tablet_manager.cc:1434] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.144s	user 0.033s	sys 0.056s
I20260709 13:06:05.904912 21492 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:05.905841 21683 tablet_bootstrap.cc:492] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:05.908643 21684 ts_tablet_manager.cc:1434] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 13:06:05.911084 21684 tablet_bootstrap.cc:492] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:05.915771 21391 catalog_manager.cc:5697] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:05.926926 21532 leader_election.cc:343] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.928167 21734 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.929293 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:05.931090 21813 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.931582 21813 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.932053 21813 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.941687 21686 tablet_bootstrap.cc:492] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:05.943503 21686 ts_tablet_manager.cc:1403] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.245s	user 0.036s	sys 0.030s
I20260709 13:06:05.926421 21722 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.954846 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:05.957515 21606 leader_election.cc:343] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.961717 21813 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.977082 21686 raft_consensus.cc:359] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.977834 21686 raft_consensus.cc:385] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.978127 21686 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.980396 21813 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:05.981537 21686 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:05.990059 21722 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:05.991036 21734 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.998806 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:05.999743 21567 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.007040 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:06.007735 21494 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.023511 21684 tablet_bootstrap.cc:654] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.992942 21734 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.027786 21771 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.028432 21734 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.110150 21567 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:06.112933 21494 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:06.116627 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.117640 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:06.132006 21641 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:06.118134 21683 tablet_bootstrap.cc:654] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.132521 21734 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:06.118415 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 81814.5us
W20260709 13:06:06.133620 21532 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.135042 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:06.136620 21734 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.121088 21686 ts_tablet_manager.cc:1434] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.177s	user 0.023s	sys 0.071s
I20260709 13:06:06.116627 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:06.137140 21734 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:06.123652 21817 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.126623 21757 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.129089 21684 tablet_bootstrap.cc:492] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:06.138393 21684 ts_tablet_manager.cc:1403] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.228s	user 0.020s	sys 0.006s
I20260709 13:06:06.138238 21757 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.138995 21686 tablet_bootstrap.cc:492] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Bootstrap starting.
W20260709 13:06:06.139343 21532 leader_election.cc:343] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.140312 21757 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:06.141005 21684 raft_consensus.cc:359] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.141782 21684 raft_consensus.cc:385] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.142055 21684 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.138077 21734 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.142645 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:06.143458 21813 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.143069 21684 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.143836 21813 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.144323 21813 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.162405 21684 ts_tablet_manager.cc:1434] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
W20260709 13:06:06.163380 21532 leader_election.cc:343] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.163754 21684 tablet_bootstrap.cc:492] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:06.162237 21813 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.147262 21686 tablet_bootstrap.cc:654] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.201360 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.202526 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:06.203948 21532 leader_election.cc:343] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.207993 21813 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.209231 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:06.210068 21642 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.212757 21683 tablet_bootstrap.cc:492] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:06.213351 21686 tablet_bootstrap.cc:492] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:06.213800 21686 ts_tablet_manager.cc:1403] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.075s	user 0.004s	sys 0.012s
I20260709 13:06:06.216288 21686 raft_consensus.cc:359] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.216944 21686 raft_consensus.cc:385] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.217260 21686 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.217911 21686 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.220242 21686 ts_tablet_manager.cc:1434] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:06:06.219642 21392 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.221182 21686 tablet_bootstrap.cc:492] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:06.213303 21683 ts_tablet_manager.cc:1403] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.308s	user 0.029s	sys 0.042s
I20260709 13:06:06.190821 21684 tablet_bootstrap.cc:654] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.176246 21608 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:06:06.222757 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46659.5us
I20260709 13:06:06.223670 21757 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.224185 21757 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:06.225175 21757 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.226202 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:06.228243 21608 leader_election.cc:343] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.228868 21686 tablet_bootstrap.cc:654] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.229331 21683 raft_consensus.cc:359] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.234616 21683 raft_consensus.cc:385] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.235075 21683 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.235973 21683 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.238682 21683 ts_tablet_manager.cc:1434] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:06:06.239732 21683 tablet_bootstrap.cc:492] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:06.221395 21642 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:06.248895 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:06.247345 21857 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.250110 21813 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.250653 21813 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:06.250344 21857 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.251586 21813 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.252887 21857 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:06.255266 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:06.260569 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:06.261976 21459 leader_election.cc:343] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.271612 21684 tablet_bootstrap.cc:492] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:06.272094 21684 ts_tablet_manager.cc:1403] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.000s
I20260709 13:06:06.274403 21819 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:06.276227 21686 tablet_bootstrap.cc:492] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:06.276705 21686 ts_tablet_manager.cc:1403] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.005s
W20260709 13:06:06.276847 21606 leader_election.cc:343] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.277346 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:06.278594 21817 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.279158 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:06.279822 21640 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:06.281487 21686 raft_consensus.cc:359] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.284297 21683 tablet_bootstrap.cc:654] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.282567 21684 raft_consensus.cc:359] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.284755 21684 raft_consensus.cc:385] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.285070 21684 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.283690 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:06.284363 21686 raft_consensus.cc:385] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.285970 21686 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.286201 21857 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.287569 21857 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.288060 21857 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.286739 21684 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.287683 21686 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.292421 21686 ts_tablet_manager.cc:1434] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:06:06.293313 21722 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.289934 21684 ts_tablet_manager.cc:1434] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:06:06.293918 21722 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.294035 21390 catalog_manager.cc:5697] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.295008 21684 tablet_bootstrap.cc:492] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:06.296267 21722 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:06.296720 21686 tablet_bootstrap.cc:492] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:06.299505 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.301793 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.302435 21569 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:06.303599 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:06.304427 21819 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.304819 21819 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.305156 21819 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.310849 21684 tablet_bootstrap.cc:654] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.315546 21857 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:06.311441 21606 leader_election.cc:343] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.314679 21686 tablet_bootstrap.cc:654] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.319648 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:06.321559 21459 leader_election.cc:343] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.322702 21734 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.323392 21734 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.326122 21734 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.329383 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.330608 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:06.332665 21532 leader_election.cc:343] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:06.335036 21532 leader_election.cc:343] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.335450 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:06.336530 21734 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.334877 21391 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.338869 21819 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.339293 21684 tablet_bootstrap.cc:492] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:06.340059 21684 ts_tablet_manager.cc:1403] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.004s
I20260709 13:06:06.342079 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:06.344388 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:06.349637 21569 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.347103 21819 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:06.349020 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:06.351161 21642 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.355623 21683 tablet_bootstrap.cc:492] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:06.356161 21683 ts_tablet_manager.cc:1403] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.117s	user 0.025s	sys 0.042s
I20260709 13:06:06.363368 21683 raft_consensus.cc:359] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.365092 21683 raft_consensus.cc:385] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.365401 21683 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.366004 21683 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.368026 21683 ts_tablet_manager.cc:1434] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:06.368984 21683 tablet_bootstrap.cc:492] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:06.369936 21569 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:06.368103 21684 raft_consensus.cc:359] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.372040 21684 raft_consensus.cc:385] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.372310 21684 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.375423 21684 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.375960 21686 tablet_bootstrap.cc:492] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:06.376542 21686 ts_tablet_manager.cc:1403] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.008s
W20260709 13:06:06.345705 21606 leader_election.cc:343] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.384006 21683 tablet_bootstrap.cc:654] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.383412 21684 ts_tablet_manager.cc:1434] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:06:06.387430 21684 tablet_bootstrap.cc:492] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:06.392719 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:06.393612 21722 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.394181 21722 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:06.385133 21857 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.395913 21686 raft_consensus.cc:359] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.396245 21757 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.396662 21686 raft_consensus.cc:385] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.397053 21686 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.396533 21722 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.397830 21857 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.397047 21757 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.397756 21686 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.398512 21857 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.400985 21818 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.403697 21857 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.404520 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.405189 21684 tablet_bootstrap.cc:654] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.405719 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:06.404515 21493 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.408247 21686 ts_tablet_manager.cc:1434] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.002s
I20260709 13:06:06.410641 21686 tablet_bootstrap.cc:492] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:06.415220 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:06.416528 21686 tablet_bootstrap.cc:654] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.424384 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.431469 21757 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:06.432430 21606 leader_election.cc:343] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.434403 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.436311 21642 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:06.437520 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:06.438408 21764 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:06.438423 21608 leader_election.cc:343] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.439049 21764 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:06.439018 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:06.439986 21764 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.440464 21819 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.444703 21683 tablet_bootstrap.cc:492] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:06.445277 21683 ts_tablet_manager.cc:1403] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.005s
I20260709 13:06:06.448014 21683 raft_consensus.cc:359] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.448727 21683 raft_consensus.cc:385] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.449011 21683 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.449708 21683 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:06.452003 21606 consensus_peers.cc:597] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.452513 21683 ts_tablet_manager.cc:1434] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:06.453640 21683 tablet_bootstrap.cc:492] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:06.461627 21684 tablet_bootstrap.cc:492] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:06.462276 21684 ts_tablet_manager.cc:1403] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.004s
I20260709 13:06:06.465732 21684 raft_consensus.cc:359] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.468390 21686 tablet_bootstrap.cc:492] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:06.469058 21686 ts_tablet_manager.cc:1403] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.006s
I20260709 13:06:06.472576 21686 raft_consensus.cc:359] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.473484 21686 raft_consensus.cc:385] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.473834 21686 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.466699 21684 raft_consensus.cc:385] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.475069 21684 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.475755 21684 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.477898 21684 ts_tablet_manager.cc:1434] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:06:06.479844 21683 tablet_bootstrap.cc:654] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.480170 21857 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.483402 21684 tablet_bootstrap.cc:492] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:06.474620 21686 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.489204 21686 ts_tablet_manager.cc:1434] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:06:06.491389 21686 tablet_bootstrap.cc:492] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:06.523118 21392 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:06.542963 21532 consensus_peers.cc:597] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.544206 21686 tablet_bootstrap.cc:654] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.544577 21684 tablet_bootstrap.cc:654] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.548126 21683 tablet_bootstrap.cc:492] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:06.548720 21683 ts_tablet_manager.cc:1403] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.095s	user 0.020s	sys 0.020s
I20260709 13:06:06.559778 21684 tablet_bootstrap.cc:492] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:06.559717 21683 raft_consensus.cc:359] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.560341 21684 ts_tablet_manager.cc:1403] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.006s
I20260709 13:06:06.560508 21683 raft_consensus.cc:385] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.560847 21683 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.561054 21391 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.561501 21683 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.562727 21684 raft_consensus.cc:359] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.563380 21684 raft_consensus.cc:385] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.563620 21684 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.564213 21684 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.565092 21683 ts_tablet_manager.cc:1434] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:06.565864 21683 tablet_bootstrap.cc:492] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:06.566228 21684 ts_tablet_manager.cc:1434] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:06.569295 21686 tablet_bootstrap.cc:492] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:06.569761 21686 ts_tablet_manager.cc:1403] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.004s
I20260709 13:06:06.571117 21684 tablet_bootstrap.cc:492] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:06.571125 21683 tablet_bootstrap.cc:654] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.572286 21686 raft_consensus.cc:359] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.572957 21686 raft_consensus.cc:385] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.573529 21686 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.574311 21686 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.576725 21686 ts_tablet_manager.cc:1434] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:06.577732 21686 tablet_bootstrap.cc:492] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:06.577759 21684 tablet_bootstrap.cc:654] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.586566 21683 tablet_bootstrap.cc:492] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:06.587108 21683 ts_tablet_manager.cc:1403] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:06:06.592217 21683 raft_consensus.cc:359] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.592902 21683 raft_consensus.cc:385] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.593179 21683 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.593799 21683 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.594360 21686 tablet_bootstrap.cc:654] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.595942 21683 ts_tablet_manager.cc:1434] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:06:06.596976 21683 tablet_bootstrap.cc:492] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:06.602820 21683 tablet_bootstrap.cc:654] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.604561 21684 tablet_bootstrap.cc:492] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:06.605197 21684 ts_tablet_manager.cc:1403] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.038s	user 0.002s	sys 0.010s
I20260709 13:06:06.608750 21684 raft_consensus.cc:359] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.609611 21684 raft_consensus.cc:385] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.609876 21684 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.611117 21764 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.611613 21764 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.613682 21764 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.615995 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.617558 21813 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.619593 21683 tablet_bootstrap.cc:492] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:06.620013 21683 ts_tablet_manager.cc:1403] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 13:06:06.622048 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:06.622874 21642 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:06.622766 21683 raft_consensus.cc:359] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.623540 21683 raft_consensus.cc:385] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.623785 21683 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.624418 21683 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.625319 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:06.610699 21684 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.627307 21857 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.631093 21683 ts_tablet_manager.cc:1434] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:06:06.632004 21683 tablet_bootstrap.cc:492] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:06.636220 21857 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.637696 21683 tablet_bootstrap.cc:654] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.640180 21686 tablet_bootstrap.cc:492] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:06.640646 21686 ts_tablet_manager.cc:1403] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.017s
I20260709 13:06:06.641359 21684 ts_tablet_manager.cc:1434] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:06:06.642817 21684 tablet_bootstrap.cc:492] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:06.643281 21686 raft_consensus.cc:359] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.643989 21686 raft_consensus.cc:385] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.644246 21686 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.644891 21686 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.648957 21686 ts_tablet_manager.cc:1434] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:06:06.649535 21684 tablet_bootstrap.cc:654] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.649933 21686 tablet_bootstrap.cc:492] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:06.656857 21686 tablet_bootstrap.cc:654] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.667846 21684 tablet_bootstrap.cc:492] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:06.668473 21684 ts_tablet_manager.cc:1403] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.002s
I20260709 13:06:06.671941 21684 raft_consensus.cc:359] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.672683 21684 raft_consensus.cc:385] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.673002 21684 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.673699 21684 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.676654 21683 tablet_bootstrap.cc:492] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:06.676340 21734 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.677244 21683 ts_tablet_manager.cc:1403] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.045s	user 0.003s	sys 0.013s
I20260709 13:06:06.680088 21734 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.680620 21683 raft_consensus.cc:359] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.680647 21734 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.681279 21684 ts_tablet_manager.cc:1434] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:06:06.681497 21683 raft_consensus.cc:385] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.681910 21683 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.682618 21684 tablet_bootstrap.cc:492] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:06.682570 21683 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.684201 21722 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.684662 21722 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.684973 21683 ts_tablet_manager.cc:1434] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:06.685026 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.686025 21683 tablet_bootstrap.cc:492] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:06.686064 21714 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.686587 21714 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.688689 21714 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.690239 21684 tablet_bootstrap.cc:654] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.692725 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.693094 21683 tablet_bootstrap.cc:654] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.693463 21569 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:06.695217 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.696696 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:06.700997 21532 leader_election.cc:343] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:06.702270 21532 leader_election.cc:343] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.703101 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:06.704000 21818 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.704375 21818 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.704698 21818 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.705088 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:06.706990 21606 leader_election.cc:343] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.704696 21683 tablet_bootstrap.cc:492] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:06.711294 21683 ts_tablet_manager.cc:1403] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:06:06.712428 21734 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.686831 21722 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:06.713938 21683 raft_consensus.cc:359] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:06.714350 21532 leader_election.cc:343] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.714771 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:06.715579 21818 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.716610 21819 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.717096 21819 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.718509 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:06.719621 21819 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:06.720350 21818 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:06.714648 21683 raft_consensus.cc:385] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.720992 21683 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
W20260709 13:06:06.721024 21606 leader_election.cc:343] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.722295 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.722982 21494 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:06.723140 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:06.723820 21642 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:06.721778 21683 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.726075 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:06.726363 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.726727 21565 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.728044 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:06.728797 21714 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.729138 21734 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.730213 21872 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.730363 21734 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.730580 21872 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.747212 21683 ts_tablet_manager.cc:1434] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:06:06.727535 21722 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.724236 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:06.755196 21608 leader_election.cc:343] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.754895 21722 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.748036 21872 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.758998 21757 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.759460 21757 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.759213 21683 tablet_bootstrap.cc:492] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:06.759908 21757 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.763499 21686 tablet_bootstrap.cc:492] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:06.794327 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.796133 21857 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.796820 21857 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:06.797235 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 69245.7us
I20260709 13:06:06.797899 21686 ts_tablet_manager.cc:1403] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.009s
I20260709 13:06:06.797405 21819 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.799897 21714 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.805114 21714 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.806838 21565 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:06.807257 21714 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.810431 21734 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.801079 21722 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:06.803658 21819 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.813776 21857 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.814522 21819 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:06.815567 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:06.818485 21686 raft_consensus.cc:359] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.819238 21686 raft_consensus.cc:385] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.819525 21686 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.815925 21683 tablet_bootstrap.cc:654] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.810222 21872 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.823098 21757 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.825055 21872 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.826048 21757 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:06.829813 21684 tablet_bootstrap.cc:492] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:06.829903 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.830559 21684 ts_tablet_manager.cc:1403] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.148s	user 0.026s	sys 0.058s
I20260709 13:06:06.831736 21459 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:06.833189 21857 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.833822 21684 raft_consensus.cc:359] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.834575 21684 raft_consensus.cc:385] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.834932 21684 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.835608 21684 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.837715 21684 ts_tablet_manager.cc:1434] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:06:06.840540 21684 tablet_bootstrap.cc:492] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:06.847223 21684 tablet_bootstrap.cc:654] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.847914 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.831527 21686 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.851480 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:06.853917 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:06.849555 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:06.854610 21640 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:06.852654 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:06.856523 21722 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.857131 21722 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:06.858248 21722 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.862175 21857 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.862718 21857 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.865758 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.866582 21569 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:06.866854 21857 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.866348 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:06.868057 21684 tablet_bootstrap.cc:492] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:06.868961 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:06.869350 21684 ts_tablet_manager.cc:1403] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.006s
I20260709 13:06:06.871368 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:06.871850 21764 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.874222 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:06.874861 21640 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.876255 21684 raft_consensus.cc:359] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:06.877640 21606 leader_election.cc:343] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.880861 21684 raft_consensus.cc:385] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.881300 21684 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.881577 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:06.882021 21532 leader_election.cc:343] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.882648 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:06.869376 21686 ts_tablet_manager.cc:1434] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.001s
I20260709 13:06:06.882500 21684 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.886278 21684 ts_tablet_manager.cc:1434] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.005s
I20260709 13:06:06.886127 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:06.886862 21494 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.893261 21493 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.894614 21686 tablet_bootstrap.cc:492] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:06.896114 21391 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.898103 21494 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:06.899649 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:06.900128 21714 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.900537 21714 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.900940 21714 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.901053 21905 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.901669 21905 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:06.902458 21905 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.903729 21764 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.904733 21684 tablet_bootstrap.cc:492] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:06.908347 21714 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:06.916152 21532 leader_election.cc:343] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:06.917028 21532 leader_election.cc:343] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.917388 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:06.918748 21714 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.921654 21872 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.926677 21764 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:06.927151 21532 leader_election.cc:343] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.927223 21764 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.927407 21757 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.929267 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.930088 21569 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 1: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:06.930953 21683 tablet_bootstrap.cc:492] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:06.931427 21683 ts_tablet_manager.cc:1403] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.181s	user 0.021s	sys 0.017s
I20260709 13:06:06.942222 21764 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:06.934716 21640 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:06.946681 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:06.949451 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:06.936391 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.931625 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.953490 21569 raft_consensus.cc:2393] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:06.939782 21684 tablet_bootstrap.cc:654] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.954963 21459 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:06.956233 21764 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.936034 21686 tablet_bootstrap.cc:654] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.953439 21683 raft_consensus.cc:359] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.968834 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:06.969954 21565 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.972266 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:06.972944 21640 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.979262 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:06.978750 21391 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.980244 21905 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.981379 21857 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:06.981587 21608 leader_election.cc:343] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.983613 21642 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.983577 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:06.961251 21683 raft_consensus.cc:385] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.985345 21683 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.986279 21683 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:06.982995 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:06.989295 21817 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.990535 21640 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:06.995689 21684 tablet_bootstrap.cc:492] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:06.996037 21764 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.996212 21684 ts_tablet_manager.cc:1403] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.004s
I20260709 13:06:06.998135 21683 ts_tablet_manager.cc:1434] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:06:06.999503 21683 tablet_bootstrap.cc:492] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:06.999930 21714 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.000459 21714 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:07.001253 21714 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.003469 21725 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.003553 21873 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.003194 21734 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.004055 21725 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.004745 21734 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.006174 21725 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.006716 21734 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.007143 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:06.983744 21905 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:07.008821 21459 leader_election.cc:343] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.010437 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:07.011091 21684 raft_consensus.cc:359] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.012089 21684 raft_consensus.cc:385] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.012454 21684 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.015962 21684 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:07.024870 21532 leader_election.cc:343] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.014339 21734 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.034025 21391 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.041330 21684 ts_tablet_manager.cc:1434] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:06:07.032132 21817 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.042287 21817 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.042687 21684 tablet_bootstrap.cc:492] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:07.036511 21734 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:07.043713 21734 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.044517 21817 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:07.035329 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:07.031508 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:07.052752 21764 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.068001 21686 tablet_bootstrap.cc:492] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:07.067773 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:07.068459 21686 ts_tablet_manager.cc:1403] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.174s	user 0.013s	sys 0.006s
I20260709 13:06:07.063448 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:07.062400 21640 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:07.067408 21764 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.075852 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:07.099433 21643 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:07.100685 21686 raft_consensus.cc:359] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.101999 21686 raft_consensus.cc:385] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:07.102175 21606 leader_election.cc:343] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.102347 21686 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.103220 21686 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.105016 21686 ts_tablet_manager.cc:1434] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:06:07.105975 21686 tablet_bootstrap.cc:492] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:07.118090 21683 tablet_bootstrap.cc:654] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.133072 21919 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.170611 21872 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.177089 21872 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.188621 21722 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.190517 21872 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.236370 21818 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.178735 21608 leader_election.cc:343] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.239523 21818 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.248612 21764 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.250226 21818 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:07.260620 21764 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.245611 21608 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:07.261166 21764 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:07.261857 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 84210.1us
I20260709 13:06:07.263046 21919 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.264642 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:07.266063 21606 leader_election.cc:343] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.266921 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:07.268147 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:07.268577 21764 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.268800 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:07.269070 21857 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.270474 21714 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:07.272298 21714 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:07.272707 21714 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.274364 21684 tablet_bootstrap.cc:654] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.270615 21857 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.280462 21683 tablet_bootstrap.cc:492] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:07.280396 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:07.281209 21683 ts_tablet_manager.cc:1403] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.282s	user 0.022s	sys 0.007s
I20260709 13:06:07.281195 21640 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
W20260709 13:06:07.282441 21532 leader_election.cc:343] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.282168 21857 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.306775 21714 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.302852 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:07.322769 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:07.329325 21566 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:07.333590 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:07.331872 21931 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:07.334535 21568 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.373432 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:07.386404 21459 leader_election.cc:343] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.387040 21569 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:07.383241 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:07.388025 21872 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.340252 21714 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.388392 21872 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.388918 21872 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.389205 21686 tablet_bootstrap.cc:654] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.389133 21683 raft_consensus.cc:359] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.390079 21683 raft_consensus.cc:385] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.390377 21683 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.391032 21683 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.390889 21684 tablet_bootstrap.cc:492] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:07.395571 21684 ts_tablet_manager.cc:1403] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.353s	user 0.020s	sys 0.028s
I20260709 13:06:07.324942 21641 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:07.339090 21391 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.399197 21923 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:07.401609 21683 ts_tablet_manager.cc:1434] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.008s
I20260709 13:06:07.402343 21683 tablet_bootstrap.cc:492] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:07.400630 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:07.403175 21905 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.403544 21905 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.403884 21905 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.404002 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:07.344014 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:07.401104 21928 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:06:07.406347 21764 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.409457 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:07.410640 21764 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:07.411296 21643 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.411921 21764 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.413014 21764 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:07.406610 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 88121.6us
I20260709 13:06:07.423383 21494 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.417929 21872 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.419380 21643 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:07.427234 21917 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:07.437965 21857 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.438840 21684 raft_consensus.cc:359] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.440989 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:07.448552 21684 raft_consensus.cc:385] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.448887 21684 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.441392 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:07.449774 21714 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.449563 21684 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.450516 21714 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:07.451798 21684 ts_tablet_manager.cc:1434] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:06:07.451460 21714 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.451857 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:07.441795 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:07.452517 21565 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.452737 21494 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.429944 21905 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:07.442879 21608 consensus_peers.cc:597] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.437165 21872 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.454531 21857 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.446444 21683 tablet_bootstrap.cc:654] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.464463 21905 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:07.446571 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:07.454769 21722 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.469789 21722 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.472090 21722 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:07.473268 21643 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.462347 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:07.454882 21684 tablet_bootstrap.cc:492] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:07.468360 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:07.475683 21568 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.476938 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:07.478108 21494 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:07.478657 21764 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.479111 21764 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.479446 21764 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.484809 21608 leader_election.cc:343] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.484891 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:07.487025 21457 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:07.489100 21714 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.490283 21714 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:07.492786 21857 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.495560 21391 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.489117 21568 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
W20260709 13:06:07.489225 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 56877.9us
I20260709 13:06:07.507390 21684 tablet_bootstrap.cc:654] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.499842 21643 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:07.500747 21764 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.508102 21919 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.508626 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:07.509970 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:07.501682 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:07.509970 21764 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.510819 21919 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.511179 21641 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.511600 21686 tablet_bootstrap.cc:492] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:07.512075 21686 ts_tablet_manager.cc:1403] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.406s	user 0.012s	sys 0.020s
I20260709 13:06:07.507474 21683 tablet_bootstrap.cc:492] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:07.511477 21919 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:07.514638 21686 raft_consensus.cc:359] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.515674 21919 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.516345 21686 raft_consensus.cc:385] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.516620 21686 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.517292 21686 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.502245 21714 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.519420 21686 ts_tablet_manager.cc:1434] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:07.492755 21565 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:07.520606 21686 tablet_bootstrap.cc:492] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:07.521587 21459 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:07.522477 21764 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.523010 21764 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:07.523648 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:07.523875 21764 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.527735 21686 tablet_bootstrap.cc:654] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.528298 21683 ts_tablet_manager.cc:1403] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.001s
I20260709 13:06:07.528460 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:07.529137 21568 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.532498 21606 leader_election.cc:343] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.518673 21641 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:07.536793 21683 raft_consensus.cc:359] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:07.536015 21606 leader_election.cc:343] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.543771 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:07.546123 21818 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.547071 21818 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:07.539346 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:07.550825 21641 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.552582 21532 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.560719 21568 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:07.562011 21459 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:07.563202 21857 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.563921 21857 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:07.565214 21857 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.570823 21683 raft_consensus.cc:385] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.571334 21683 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.572213 21683 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.581533 21641 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:07.586618 21683 ts_tablet_manager.cc:1434] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:06:07.572595 21391 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.586999 21714 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:07.590572 21532 consensus_peers.cc:597] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.604744 21683 tablet_bootstrap.cc:492] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:07.591064 21686 tablet_bootstrap.cc:492] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:07.608165 21686 ts_tablet_manager.cc:1403] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.037s
I20260709 13:06:07.611073 21686 raft_consensus.cc:359] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.611750 21686 raft_consensus.cc:385] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.611838 21919 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.612063 21686 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.612480 21919 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.612756 21686 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.615015 21390 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.616386 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:07.617344 21565 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:07.619779 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:07.620069 21683 tablet_bootstrap.cc:654] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.621626 21905 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.622015 21905 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.622356 21905 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.624771 21919 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:07.611511 21684 tablet_bootstrap.cc:492] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:07.626098 21684 ts_tablet_manager.cc:1403] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.171s	user 0.007s	sys 0.010s
I20260709 13:06:07.628119 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:07.630252 21606 leader_election.cc:343] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.629930 21684 raft_consensus.cc:359] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.631680 21684 raft_consensus.cc:385] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.632177 21684 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.632346 21392 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.633019 21684 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.635895 21684 ts_tablet_manager.cc:1434] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:07.636873 21684 tablet_bootstrap.cc:492] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:07.643780 21932 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.656975 21932 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.659209 21932 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.660916 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:07.661729 21568 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:07.661476 21813 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.667701 21389 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.668897 21684 tablet_bootstrap.cc:654] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.639216 21905 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.675755 21905 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:07.650508 21686 ts_tablet_manager.cc:1434] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.001s
I20260709 13:06:07.677920 21686 tablet_bootstrap.cc:492] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:07.681473 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:07.683061 21606 leader_election.cc:343] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.683951 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:07.684600 21568 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.685771 21686 tablet_bootstrap.cc:654] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.643980 21683 tablet_bootstrap.cc:492] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:07.688982 21683 ts_tablet_manager.cc:1403] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.010s
I20260709 13:06:07.676553 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:07.695595 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:07.697094 21932 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.704274 21683 raft_consensus.cc:359] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.705058 21683 raft_consensus.cc:385] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.705341 21683 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.706023 21683 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.707073 21932 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.708173 21683 ts_tablet_manager.cc:1434] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 13:06:07.708959 21683 tablet_bootstrap.cc:492] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:07.706974 21568 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:07.711608 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:07.712957 21905 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.713757 21905 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:07.714707 21905 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.721462 21686 tablet_bootstrap.cc:492] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:07.721957 21686 ts_tablet_manager.cc:1403] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 13:06:07.724503 21683 tablet_bootstrap.cc:654] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.724923 21686 raft_consensus.cc:359] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.725617 21686 raft_consensus.cc:385] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.725886 21686 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.726630 21686 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.729254 21684 tablet_bootstrap.cc:492] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:07.729744 21684 ts_tablet_manager.cc:1403] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.022s
I20260709 13:06:07.732666 21686 ts_tablet_manager.cc:1434] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:07.732398 21684 raft_consensus.cc:359] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.733057 21684 raft_consensus.cc:385] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.733325 21684 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.733613 21686 tablet_bootstrap.cc:492] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:07.733968 21684 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.736300 21684 ts_tablet_manager.cc:1434] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:07.737432 21684 tablet_bootstrap.cc:492] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:07.739601 21686 tablet_bootstrap.cc:654] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.745045 21684 tablet_bootstrap.cc:654] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.739100 21683 tablet_bootstrap.cc:492] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:07.745697 21683 ts_tablet_manager.cc:1403] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.003s
I20260709 13:06:07.748327 21683 raft_consensus.cc:359] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.749063 21683 raft_consensus.cc:385] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.749390 21683 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.750123 21683 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.752275 21683 ts_tablet_manager.cc:1434] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:07.753032 21683 tablet_bootstrap.cc:492] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:07.758427 21683 tablet_bootstrap.cc:654] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.734639 21391 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.771517 21686 tablet_bootstrap.cc:492] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:07.772001 21686 ts_tablet_manager.cc:1403] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.012s
I20260709 13:06:07.772387 21683 tablet_bootstrap.cc:492] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:07.772418 21684 tablet_bootstrap.cc:492] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:07.772913 21683 ts_tablet_manager.cc:1403] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.001s
I20260709 13:06:07.773247 21684 ts_tablet_manager.cc:1403] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.006s
I20260709 13:06:07.775951 21684 raft_consensus.cc:359] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.776688 21684 raft_consensus.cc:385] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.776995 21684 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.777243 21683 raft_consensus.cc:359] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.778015 21683 raft_consensus.cc:385] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.777691 21684 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.778290 21683 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.781770 21684 ts_tablet_manager.cc:1434] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:06:07.779340 21686 raft_consensus.cc:359] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.779179 21683 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.786477 21686 raft_consensus.cc:385] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.786816 21686 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.787158 21684 tablet_bootstrap.cc:492] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:07.787504 21686 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.788498 21683 ts_tablet_manager.cc:1434] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:06:07.789429 21683 tablet_bootstrap.cc:492] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:07.789884 21686 ts_tablet_manager.cc:1434] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 13:06:07.793462 21684 tablet_bootstrap.cc:654] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.795105 21683 tablet_bootstrap.cc:654] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.801878 21932 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.802399 21932 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.805124 21932 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.807333 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:07.807462 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:07.808034 21643 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:07.809491 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:07.810336 21932 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.810773 21932 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.811211 21932 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.812634 21686 tablet_bootstrap.cc:492] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:07.818460 21932 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.819103 21686 tablet_bootstrap.cc:654] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.822381 21932 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.823626 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:07.825958 21643 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.826381 21459 leader_election.cc:343] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.827975 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:07.829782 21683 tablet_bootstrap.cc:492] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:07.830235 21683 ts_tablet_manager.cc:1403] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.016s
I20260709 13:06:07.830660 21684 tablet_bootstrap.cc:492] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:07.831274 21684 ts_tablet_manager.cc:1403] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.009s
I20260709 13:06:07.834580 21818 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.835109 21818 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.836402 21684 raft_consensus.cc:359] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.837078 21684 raft_consensus.cc:385] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.837339 21684 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.838249 21818 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:07.838007 21684 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.836428 21683 raft_consensus.cc:359] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.839944 21683 raft_consensus.cc:385] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.840222 21684 ts_tablet_manager.cc:1434] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:06:07.883430 21714 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.841125 21643 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:07.886960 21714 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.841291 21684 tablet_bootstrap.cc:492] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:07.840209 21683 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.893328 21857 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.841089 21686 tablet_bootstrap.cc:492] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:07.909615 21714 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.901151 21857 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.914259 21857 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:07.919631 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:07.920428 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:07.925423 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:07.926262 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:07.928222 21683 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:07.878429 21459 leader_election.cc:343] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:07.933009 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55088.9us
I20260709 13:06:07.937027 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:07.938174 21565 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
W20260709 13:06:07.939396 21606 leader_election.cc:343] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.947026 21683 ts_tablet_manager.cc:1434] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.117s	user 0.009s	sys 0.006s
I20260709 13:06:07.951781 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:07.958215 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:07.959371 21683 tablet_bootstrap.cc:492] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
W20260709 13:06:07.957064 21608 leader_election.cc:343] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.956295 21642 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:07.961290 21857 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.962255 21857 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:07.962877 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:07.963615 21857 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:07.964187 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:07.964891 21818 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.971033 21959 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.966002 21459 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:07.975612 21686 ts_tablet_manager.cc:1403] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.008s
I20260709 13:06:07.976612 21932 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.977038 21932 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.977375 21932 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.988332 21933 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.001544 21686 raft_consensus.cc:359] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.002700 21686 raft_consensus.cc:385] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.003125 21686 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.004038 21686 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.005841 21686 ts_tablet_manager.cc:1434] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:06:08.021178 21684 tablet_bootstrap.cc:654] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.033820 21683 tablet_bootstrap.cc:654] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:08.039584 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46460.7us
I20260709 13:06:08.056948 21686 tablet_bootstrap.cc:492] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:08.056974 21642 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.069058 21964 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.069931 21961 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.086755 21569 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.073717 21959 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:06:08.086741 21492 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.095314 21932 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.095938 21390 catalog_manager.cc:5697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.105840 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:08.106065 21734 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.106604 21638 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.113277 21684 tablet_bootstrap.cc:492] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:08.113785 21683 tablet_bootstrap.cc:492] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:08.114184 21683 ts_tablet_manager.cc:1403] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.155s	user 0.015s	sys 0.016s
I20260709 13:06:08.118598 21764 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.120211 21764 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.120301 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:08.121348 21568 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.122093 21684 ts_tablet_manager.cc:1403] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.281s	user 0.018s	sys 0.010s
I20260709 13:06:08.104180 21932 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:08.111346 21734 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.145428 21817 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.160066 21817 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.236325 21686 tablet_bootstrap.cc:654] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.210659 21568 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
W20260709 13:06:08.256094 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 55543.4us
I20260709 13:06:08.247454 21684 raft_consensus.cc:359] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.260671 21684 raft_consensus.cc:385] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.261066 21684 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.200603 21734 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.252079 21817 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:08.276945 21684 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.276360 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:08.292203 21683 raft_consensus.cc:359] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.295096 21683 raft_consensus.cc:385] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.295531 21683 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.287457 21817 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.274714 21959 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:06:08.304816 21683 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.317293 21976 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:06:08.304430 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:08.322224 21683 ts_tablet_manager.cc:1434] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.208s	user 0.012s	sys 0.002s
I20260709 13:06:08.330685 21734 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:08.331058 21683 tablet_bootstrap.cc:492] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:08.307916 21817 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.341053 21488 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.377449 21684 ts_tablet_manager.cc:1434] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.255s	user 0.013s	sys 0.016s
I20260709 13:06:08.382326 21872 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.388521 21872 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:08.389654 21608 leader_election.cc:343] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.413600 21817 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:08.390724 21872 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:08.419284 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:08.466913 21944 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:06:08.480962 21686 tablet_bootstrap.cc:492] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:08.481722 21686 ts_tablet_manager.cc:1403] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.425s	user 0.010s	sys 0.010s
I20260709 13:06:08.423219 21974 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:06:08.503775 21684 tablet_bootstrap.cc:492] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
W20260709 13:06:08.512466 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 55789us
I20260709 13:06:08.506400 21638 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:08.501538 21642 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:08.527482 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:08.531836 21637 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 1: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:08.531651 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:08.529541 21981 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.552552 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:08.561848 21683 tablet_bootstrap.cc:654] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.573539 21981 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:08.583698 21608 leader_election.cc:343] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.604351 21981 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:08.605886 21686 raft_consensus.cc:359] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.606567 21686 raft_consensus.cc:385] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.606791 21686 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.612345 21686 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.622359 21686 ts_tablet_manager.cc:1434] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.140s	user 0.013s	sys 0.000s
I20260709 13:06:08.644366 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:08.656569 21684 tablet_bootstrap.cc:654] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.669142 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:08.686225 21964 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:08.687852 21964 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:08.691447 21606 leader_election.cc:343] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.691964 21606 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:08.696123 21817 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.694626 21981 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.688342 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:08.714457 21683 tablet_bootstrap.cc:492] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
W20260709 13:06:08.714679 21606 leader_election.cc:343] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.716687 21683 ts_tablet_manager.cc:1403] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.386s	user 0.016s	sys 0.025s
I20260709 13:06:08.717783 21684 tablet_bootstrap.cc:492] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
W20260709 13:06:08.717088 21606 leader_election.cc:343] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.718279 21684 ts_tablet_manager.cc:1403] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.297s	user 0.010s	sys 0.014s
I20260709 13:06:08.718490 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:08.720742 21683 raft_consensus.cc:359] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.721076 21684 raft_consensus.cc:359] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:08.738654 21608 leader_election.cc:343] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.738929 21684 raft_consensus.cc:385] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.722158 21683 raft_consensus.cc:385] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.722419 21997 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.739251 21608 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:08.739251 21684 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.740010 21981 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.740478 21684 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.739369 21683 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.742297 21683 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.743611 21684 ts_tablet_manager.cc:1434] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 13:06:08.744815 21684 tablet_bootstrap.cc:492] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:08.744867 21683 ts_tablet_manager.cc:1434] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.003s
I20260709 13:06:08.746416 21683 tablet_bootstrap.cc:492] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:08.754251 21683 tablet_bootstrap.cc:654] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.754251 21684 tablet_bootstrap.cc:654] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:08.756803 21606 consensus_peers.cc:597] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.761555 21683 tablet_bootstrap.cc:492] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:08.762354 21683 ts_tablet_manager.cc:1403] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:06:08.769492 21683 raft_consensus.cc:359] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.770625 21683 raft_consensus.cc:385] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.771085 21683 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.772477 21683 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.778311 21683 ts_tablet_manager.cc:1434] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:06:08.779706 21683 tablet_bootstrap.cc:492] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:08.784818 21686 tablet_bootstrap.cc:492] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:08.788256 21683 tablet_bootstrap.cc:654] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.798028 21684 tablet_bootstrap.cc:492] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:08.798885 21684 ts_tablet_manager.cc:1403] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.028s
I20260709 13:06:08.803151 21684 raft_consensus.cc:359] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.804282 21684 raft_consensus.cc:385] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.804755 21684 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.805709 21684 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.808614 21684 ts_tablet_manager.cc:1434] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:08.809849 21684 tablet_bootstrap.cc:492] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:08.811867 21683 tablet_bootstrap.cc:492] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:08.812330 21683 ts_tablet_manager.cc:1403] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.009s
I20260709 13:06:08.815083 21683 raft_consensus.cc:359] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.815712 21684 tablet_bootstrap.cc:654] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.815884 21683 raft_consensus.cc:385] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.816290 21683 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.817030 21683 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.819283 21683 ts_tablet_manager.cc:1434] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:06:08.819589 21686 tablet_bootstrap.cc:654] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.820334 21683 tablet_bootstrap.cc:492] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:08.828544 21683 tablet_bootstrap.cc:654] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.829242 21684 tablet_bootstrap.cc:492] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:08.829986 21684 ts_tablet_manager.cc:1403] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:06:08.833639 21459 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:08.833575 21684 raft_consensus.cc:359] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.834893 21684 raft_consensus.cc:385] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.835361 21684 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.836640 21684 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.840946 21683 tablet_bootstrap.cc:492] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:08.844374 21974 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.841488 21764 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.843353 21684 ts_tablet_manager.cc:1434] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:06:08.844894 21683 ts_tablet_manager.cc:1403] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.005s
I20260709 13:06:08.844924 21974 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.852245 21683 raft_consensus.cc:359] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.853358 21683 raft_consensus.cc:385] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.853806 21683 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.855108 21974 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:08.847612 21764 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:08.848111 21684 tablet_bootstrap.cc:492] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:08.856312 21764 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.865011 21684 tablet_bootstrap.cc:654] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.854737 21683 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.867898 21964 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:08.869962 21683 ts_tablet_manager.cc:1434] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:06:08.873342 21683 tablet_bootstrap.cc:492] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:08.886591 21683 tablet_bootstrap.cc:654] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.898967 21684 tablet_bootstrap.cc:492] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:08.899521 21684 ts_tablet_manager.cc:1403] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.007s
I20260709 13:06:08.903436 21684 raft_consensus.cc:359] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.904409 21684 raft_consensus.cc:385] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.904752 21684 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.905864 21684 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.909194 21684 ts_tablet_manager.cc:1434] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:08.909614 21683 tablet_bootstrap.cc:492] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:08.910348 21683 ts_tablet_manager.cc:1403] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.002s
I20260709 13:06:08.915176 21683 raft_consensus.cc:359] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.916357 21683 raft_consensus.cc:385] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.916813 21683 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.910432 21684 tablet_bootstrap.cc:492] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:08.930863 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:08.955546 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:08.991607 21979 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.979750 21857 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.992164 21979 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:08.992267 21857 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:08.980568 22005 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.270s	user 0.001s	sys 0.003s
I20260709 13:06:08.994531 21857 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:08.995334 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:08.995982 21494 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:08.997225 21684 tablet_bootstrap.cc:654] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.999727 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.000379 21562 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:09.000970 21979 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.002226 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.002265 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:09.003875 21979 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.004240 21979 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.004603 21979 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.006683 21457 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:09.008144 21857 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.009467 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.014428 21979 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.014933 21684 tablet_bootstrap.cc:492] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:09.015484 21684 ts_tablet_manager.cc:1403] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.005s
I20260709 13:06:09.017238 21979 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.017370 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:09.017992 21638 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.018266 21684 raft_consensus.cc:359] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.019052 21684 raft_consensus.cc:385] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.019323 21684 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.020232 21684 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.022559 21684 ts_tablet_manager.cc:1434] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:09.022516 21979 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:09.023836 21684 tablet_bootstrap.cc:492] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:09.025524 21638 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:09.027165 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.029973 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:09.030586 21562 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.031304 21684 tablet_bootstrap.cc:654] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.029126 21979 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.032539 21979 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:09.033461 21979 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.040932 21562 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:09.047616 21684 tablet_bootstrap.cc:492] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:09.048161 21684 ts_tablet_manager.cc:1403] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 13:06:09.048157 21686 tablet_bootstrap.cc:492] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:09.049077 21686 ts_tablet_manager.cc:1403] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.265s	user 0.013s	sys 0.004s
I20260709 13:06:09.051136 21684 raft_consensus.cc:359] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.051910 21684 raft_consensus.cc:385] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.052182 21684 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.052996 21684 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.059342 21987 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.059998 21987 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:09.064670 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 305013us
I20260709 13:06:09.065837 21684 ts_tablet_manager.cc:1434] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:06:09.067065 21684 tablet_bootstrap.cc:492] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:09.074080 21684 tablet_bootstrap.cc:654] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.082928 21684 tablet_bootstrap.cc:492] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:09.083433 21684 ts_tablet_manager.cc:1403] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.005s
I20260709 13:06:09.086229 21684 raft_consensus.cc:359] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.086977 21684 raft_consensus.cc:385] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.087378 21684 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.088202 21684 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.090940 21684 ts_tablet_manager.cc:1434] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:09.091970 21684 tablet_bootstrap.cc:492] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:09.101059 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.101572 21684 tablet_bootstrap.cc:654] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.101926 21635 raft_consensus.cc:2376] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1. Re-sending same reply.
I20260709 13:06:09.107124 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.107993 21684 tablet_bootstrap.cc:492] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:09.108619 21684 ts_tablet_manager.cc:1403] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:06:09.108909 21457 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:09.109656 21857 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.112056 21684 raft_consensus.cc:359] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.112776 21684 raft_consensus.cc:385] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.113049 21684 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.113972 21684 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.121203 21684 ts_tablet_manager.cc:1434] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:09.122491 21684 tablet_bootstrap.cc:492] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:09.129168 21684 tablet_bootstrap.cc:654] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:09.136701 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:09.141106 21684 tablet_bootstrap.cc:492] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:09.141695 21684 ts_tablet_manager.cc:1403] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.002s
I20260709 13:06:09.143754 21686 raft_consensus.cc:359] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.144547 21686 raft_consensus.cc:385] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.144343 21684 raft_consensus.cc:359] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.145272 21684 raft_consensus.cc:385] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.145608 21684 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.146347 21684 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.147611 21984 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.148177 21984 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.148929 21684 ts_tablet_manager.cc:1434] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:09.149755 21984 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.150138 21684 tablet_bootstrap.cc:492] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
W20260709 13:06:09.150527 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 85107.8us
I20260709 13:06:09.152700 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:09.155140 21567 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.144904 21686 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.160507 21686 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.156100 21961 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.170080 21961 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.177930 21961 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.178654 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.181890 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.184262 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:09.187220 21961 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.187282 21988 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:09.204345 21683 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.207989 21683 ts_tablet_manager.cc:1434] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.297s	user 0.011s	sys 0.002s
I20260709 13:06:09.210767 21764 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.211520 21764 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.212875 21987 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:09.214089 21764 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.215071 21683 tablet_bootstrap.cc:492] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:09.219163 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:09.219880 21488 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:09.222167 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.222858 21637 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:09.224341 21905 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.226881 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.224862 21905 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.237039 21985 raft_consensus.cc:2764] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:06:09.238168 21764 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.241628 21764 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.241815 21905 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:09.242167 21764 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.259953 21964 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.260520 21964 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.263068 21964 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.265019 21686 ts_tablet_manager.cc:1434] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.213s	user 0.006s	sys 0.000s
W20260709 13:06:09.266950 21606 leader_election.cc:343] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.267015 21764 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.274349 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.280889 21764 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.286584 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:09.274842 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.288707 21686 tablet_bootstrap.cc:492] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:09.291486 21486 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:09.294628 21606 leader_election.cc:343] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.279978 21905 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.305357 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.306353 21637 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:09.313230 21996 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:09.313997 21996 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.304491 21905 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.324482 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:09.319244 21905 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.334123 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.319872 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:09.321043 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.335533 21964 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.339115 21634 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.339520 21964 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.339769 21959 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.336071 21764 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.341472 21764 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.341828 21764 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:09.342480 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 188847us
I20260709 13:06:09.340446 21959 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.353036 21684 tablet_bootstrap.cc:654] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:09.355963 21459 leader_election.cc:343] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:09.356923 21459 leader_election.cc:343] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.360255 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.360931 21637 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:09.364192 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.364487 21683 tablet_bootstrap.cc:654] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.363219 21857 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.367458 21961 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.367391 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.367277 21857 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.367978 21961 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.368333 21961 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.371150 21959 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.372507 21764 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.359440 21964 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:09.374807 21459 leader_election.cc:343] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.375021 21764 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.375270 21996 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.376583 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:09.378652 21857 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.379570 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:09.379673 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.380326 21642 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.380667 21638 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:09.382063 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.382412 21857 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:09.382844 21988 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.383414 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.385630 21977 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.386145 21977 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.385317 21988 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.387362 21988 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.389376 21686 tablet_bootstrap.cc:654] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.392135 21905 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:09.671989 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 99842us
I20260709 13:06:09.673072 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:09.673731 21764 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.459118 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:09.676505 21492 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.676384 21764 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.678570 21764 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.631139 21997 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:09.435199 21973 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.679839 21684 tablet_bootstrap.cc:492] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:09.679636 21997 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.680364 21684 ts_tablet_manager.cc:1403] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.531s	user 0.011s	sys 0.030s
I20260709 13:06:09.680115 21973 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.682947 21973 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:09.542521 21977 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.541877 21634 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:09.685210 21988 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.686347 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:09.575846 21996 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:09.456779 21905 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:09.687300 21996 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.688303 21977 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.689553 21996 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:09.436058 21459 leader_election.cc:343] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.651898 21989 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:09.539768 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.687445 21684 raft_consensus.cc:359] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.704772 21684 raft_consensus.cc:385] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.705076 21684 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.706122 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:09.715648 21683 tablet_bootstrap.cc:492] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:09.716171 21683 ts_tablet_manager.cc:1403] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.501s	user 0.012s	sys 0.024s
I20260709 13:06:09.683529 21997 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:09.718459 21684 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.720033 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:09.523314 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.704161 21977 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:09.637549 21642 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:09.582360 21961 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.411274 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.724534 21734 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.732851 21684 ts_tablet_manager.cc:1434] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.002s
I20260709 13:06:09.714329 21561 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
W20260709 13:06:09.718201 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 283565us
I20260709 13:06:09.736761 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.719950 21992 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:09.740185 21764 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.740710 21764 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:09.741515 21764 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:09.729645 22030 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.215s	user 0.005s	sys 0.013s
I20260709 13:06:09.731988 21988 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.747165 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.747356 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:09.743752 21608 leader_election.cc:343] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.748855 21608 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:09.733361 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:09.750238 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.750334 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:09.756877 21608 leader_election.cc:343] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.757515 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:09.758634 21967 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.759019 21967 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.759315 21967 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.760352 21987 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.751183 21637 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:09.764326 21686 tablet_bootstrap.cc:492] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:09.765575 21686 ts_tablet_manager.cc:1403] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.477s	user 0.031s	sys 0.022s
I20260709 13:06:09.768450 21967 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.765410 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:06:09.771808 21606 leader_election.cc:343] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.752111 21992 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.775741 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.776479 21563 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:09.777302 21992 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:09.777392 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:09.772315 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:09.754244 21683 raft_consensus.cc:359] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.779577 21683 raft_consensus.cc:385] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.779906 21683 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.769215 21686 raft_consensus.cc:359] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.711766 21989 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.780550 21686 raft_consensus.cc:385] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.780900 21686 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.781564 21684 tablet_bootstrap.cc:492] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:09.782452 21818 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.769714 21997 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.770030 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.780457 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:09.788005 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.788690 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.790045 21492 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:09.800098 21635 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:09.786193 21989 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:09.803665 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.805174 21634 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:09.806291 21967 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:09.793807 21977 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.809353 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.822537 21686 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.825443 21686 ts_tablet_manager.cc:1434] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:06:09.810477 21961 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:09.826702 21459 leader_election.cc:343] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.830716 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:09.831349 21638 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.833580 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:09.834913 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:09.836054 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:09.836796 21491 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.833626 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:09.839025 21488 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:09.842499 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.821525 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:09.845468 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:09.850924 21606 leader_election.cc:343] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.848176 21818 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.855377 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:09.856027 21637 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.855391 21818 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:09.859050 21818 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.865228 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:09.866902 21961 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:09.862769 21459 leader_election.cc:343] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.868355 21683 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.869757 21642 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:09.871310 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.872551 21683 ts_tablet_manager.cc:1434] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.156s	user 0.003s	sys 0.008s
I20260709 13:06:09.863397 21638 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
W20260709 13:06:09.879241 21608 leader_election.cc:343] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:09.881080 21608 leader_election.cc:343] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:09.881399 21532 leader_election.cc:343] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.885583 21684 tablet_bootstrap.cc:654] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.885447 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:09.886453 21569 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.891958 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:09.893823 22035 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.894260 22035 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.894588 22035 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.894729 21992 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.900439 21686 tablet_bootstrap.cc:492] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:09.901202 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:09.911907 21683 tablet_bootstrap.cc:492] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:09.912815 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:09.914925 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.915640 21764 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.916064 21764 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:09.916967 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:09.918176 21569 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:09.918291 21764 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.926144 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:09.909935 22035 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:09.922403 21984 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.935081 21996 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.943953 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:09.966722 21423 debug-util.cc:398] Leaking SignalData structure 0x7b080003b8e0 after lost signal to thread 20385
W20260709 13:06:09.945966 21459 leader_election.cc:343] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.948062 21984 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.974946 21984 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.953559 21872 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.973469 21391 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.992491 21813 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.994716 21391 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:10.018410 22041 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:06:10.021224 22035 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:10.022152 22038 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.998986 21872 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.054553 22038 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.086360 22038 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.104167 21637 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:10.095712 22035 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.119131 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 184650us
I20260709 13:06:10.119699 21686 tablet_bootstrap.cc:654] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:10.119901 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 183612us
I20260709 13:06:10.122538 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:10.109447 22035 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:10.129999 21459 leader_election.cc:343] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.140681 22035 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:10.124598 21959 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:10.131515 21423 debug-util.cc:398] Leaking SignalData structure 0x7b080003bfc0 after lost signal to thread 21426
I20260709 13:06:10.179868 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:10.183218 21532 leader_election.cc:343] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.184732 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:10.188184 21764 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.188932 21764 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:10.190393 21764 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.186833 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:06:10.200554 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:06:10.196528 21423 debug-util.cc:398] Leaking SignalData structure 0x7b0800244480 after lost signal to thread 21518
I20260709 13:06:10.185254 22049 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
W20260709 13:06:10.238761 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48214.6us
I20260709 13:06:10.217512 21973 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:10.245278 21684 tablet_bootstrap.cc:492] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:10.245775 21684 ts_tablet_manager.cc:1403] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.492s	user 0.026s	sys 0.021s
W20260709 13:06:10.252900 21423 debug-util.cc:398] Leaking SignalData structure 0x7b080024d700 after lost signal to thread 21593
I20260709 13:06:10.256143 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:10.256763 21637 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:10.257248 22048 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:10.255359 22047 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
W20260709 13:06:10.256840 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4ea0 after lost signal to thread 21667
I20260709 13:06:10.249950 21976 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.274722 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 75397.6us
I20260709 13:06:10.351761 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:10.201036 22038 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:10.338342 22050 log.cc:927] Time spent T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:10.340721 21984 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.345954 21683 tablet_bootstrap.cc:654] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.272511 21976 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.392254 21976 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:10.386077 21684 raft_consensus.cc:359] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.402184 22054 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.397171 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:10.410053 21643 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:10.406414 21684 raft_consensus.cc:385] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.408828 21686 tablet_bootstrap.cc:492] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:10.412151 21684 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.412533 21686 ts_tablet_manager.cc:1403] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.512s	user 0.040s	sys 0.075s
I20260709 13:06:10.414225 22054 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:10.418018 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:10.417745 21684 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.418764 21764 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:10.419129 21764 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.419438 21764 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.415215 22054 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.424507 21984 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:10.430249 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:10.430683 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:10.431537 21563 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:10.433588 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:10.426362 22038 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:10.439615 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:10.440635 21684 ts_tablet_manager.cc:1434] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.195s	user 0.008s	sys 0.016s
I20260709 13:06:10.450284 21872 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:10.460568 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:10.466769 21977 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:06:10.479168 21764 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:10.480564 21520 tablet.cc:2406] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:10.481662 21764 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:10.481910 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:10.494065 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:10.486934 21637 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:10.513418 21532 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:10.600963 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 103642us
I20260709 13:06:10.602242 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:10.603060 21857 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.603276 21684 tablet_bootstrap.cc:492] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
W20260709 13:06:10.603695 21459 leader_election.cc:343] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.604121 21857 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:06:10.604630 21459 leader_election.cc:343] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.605010 21857 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.607254 21683 tablet_bootstrap.cc:492] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:10.607805 21683 ts_tablet_manager.cc:1403] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.710s	user 0.020s	sys 0.030s
W20260709 13:06:10.610172 21459 leader_election.cc:343] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:10.610499 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:10.612124 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:10.614600 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 98632.3us
W20260709 13:06:10.615458 21532 leader_election.cc:343] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:10.618283 21459 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:10.632131 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:10.623844 21686 raft_consensus.cc:359] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.634496 21686 raft_consensus.cc:385] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.634826 21686 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
W20260709 13:06:10.634938 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 122891us
W20260709 13:06:10.631402 21459 leader_election.cc:343] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:10.640888 21459 consensus_peers.cc:597] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:10.641013 22060 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:10.641806 21459 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:10.631716 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:10.647145 22049 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:10.631390 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:10.649396 21639 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 1: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:10.650463 21683 raft_consensus.cc:359] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.651170 21683 raft_consensus.cc:385] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.651500 21683 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.653046 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:10.654250 21683 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.657750 21686 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.647846 21637 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.663058 21684 tablet_bootstrap.cc:654] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.665647 22038 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.667924 22038 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.669941 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:10.670169 22038 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:10.659977 21976 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.670658 21634 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.675094 21683 ts_tablet_manager.cc:1434] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 13:06:10.681752 21683 tablet_bootstrap.cc:492] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:10.693542 21686 ts_tablet_manager.cc:1434] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.281s	user 0.010s	sys 0.002s
I20260709 13:06:10.704599 21637 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:10.705673 21984 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:10.705816 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:10.695128 21634 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:10.706666 21563 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:06:10.731323 21459 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:10.751291 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:10.758526 21857 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.754674 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:10.757501 21999 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:06:10.775218 21857 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:10.776152 21857 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.757529 21977 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:06:10.806828 21683 tablet_bootstrap.cc:654] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.822117 21686 tablet_bootstrap.cc:492] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:10.835026 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:06:10.838017 21608 consensus_peers.cc:597] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:10.842806 21560 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.844991 21857 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:10.848174 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:10.847172 21977 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:06:10.856240 21684 tablet_bootstrap.cc:492] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:10.856710 21684 ts_tablet_manager.cc:1403] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.262s	user 0.026s	sys 0.007s
I20260709 13:06:10.861024 22049 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.882131 22049 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.891098 21684 raft_consensus.cc:359] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.895565 21684 raft_consensus.cc:385] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.896117 21684 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.898586 21684 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.857337 21857 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:10.909597 21684 ts_tablet_manager.cc:1434] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.001s
I20260709 13:06:10.911839 21390 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 89) took 1108 ms. Trace:
I20260709 13:06:10.915647 21987 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:06:10.948261 21684 tablet_bootstrap.cc:492] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:10.928092 21390 rpcz_store.cc:276] 0709 13:06:09.800076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.800251 (+   175us) service_pool.cc:224] Handling call
0709 13:06:10.908528 (+1108277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2848,"reported_tablets":2}
I20260709 13:06:10.943446 21857 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:10.988616 21391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 84) took 1663 ms. Trace:
I20260709 13:06:11.001200 21686 tablet_bootstrap.cc:654] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.010480 22054 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:11.017169 21389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 84) took 1564 ms. Trace:
I20260709 13:06:11.017666 21389 rpcz_store.cc:276] 0709 13:06:09.453052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.456424 (+  3372us) service_pool.cc:224] Handling call
0709 13:06:11.016974 (+1560550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44583,"reported_tablets":9}
I20260709 13:06:11.024899 21683 tablet_bootstrap.cc:492] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:11.025446 21683 ts_tablet_manager.cc:1403] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.345s	user 0.022s	sys 0.014s
I20260709 13:06:11.030107 21390 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:06:11.031750 21390 catalog_manager.cc:5697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:11.033968 21390 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:06:11.035343 21390 catalog_manager.cc:5697] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:06:10.988936 21391 rpcz_store.cc:276] 0709 13:06:09.325537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.325717 (+   180us) service_pool.cc:224] Handling call
0709 13:06:10.988565 (+1662848us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:10.334487 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:10.335074 (+   587us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:10.335110 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:06:10.335127 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:10.335506 (+   379us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:10.335594 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:10.335620 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:10.381769 (+ 46149us) tablet.cc:701] Row locks acquired
0709 13:06:10.382979 (+  1210us) write_op.cc:260] PREPARE: finished
0709 13:06:10.406091 (+ 23112us) write_op.cc:270] Start()
0709 13:06:10.417287 (+ 11196us) write_op.cc:276] Timestamp: P: 1783602370406016 usec, L: 0
0709 13:06:10.420973 (+  3686us) op_driver.cc:348] REPLICATION: starting
0709 13:06:10.491184 (+ 70211us) log.cc:844] Serialized 934 byte log entry
0709 13:06:10.812797 (+321613us) op_driver.cc:464] REPLICATION: finished
0709 13:06:10.829539 (+ 16742us) write_op.cc:301] APPLY: starting
0709 13:06:10.829697 (+   158us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:10.829848 (+   151us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:10.847170 (+ 17322us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:10.851286 (+  4116us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:10.851506 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:10.851579 (+    73us) write_op.cc:312] APPLY: finished
0709 13:06:10.851812 (+   233us) log.cc:844] Serialized 28 byte log entry
0709 13:06:10.851993 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:10.852072 (+    79us) write_op.cc:454] Released schema lock
0709 13:06:10.852105 (+    33us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:10.852442 (+   337us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:10.852484 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53694,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":16445,"apply.run_cpu_time_us":2564,"apply.run_wall_time_us":22889,"num_ops":2,"prepare.queue_time_us":228946,"prepare.run_cpu_time_us":20904,"prepare.run_wall_time_us":319624,"raft.queue_time_us":118869,"raft.run_cpu_time_us":2974,"raft.run_wall_time_us":7238,"replication_time_us":391673,"thread_start_us":366019,"threads_started":4,"wal-append.queue_time_us":199597}]]}
I20260709 13:06:11.042990 21683 raft_consensus.cc:359] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.052337 21683 raft_consensus.cc:385] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.052704 21683 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.054378 21683 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.059135 21684 tablet_bootstrap.cc:654] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.037165 21390 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:11.062088 21390 catalog_manager.cc:5697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:06:11.062852 21686 tablet_bootstrap.cc:492] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:11.063316 21686 ts_tablet_manager.cc:1403] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.241s	user 0.009s	sys 0.011s
I20260709 13:06:11.062872 21683 ts_tablet_manager.cc:1434] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:06:11.067095 21683 tablet_bootstrap.cc:492] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:11.068866 21686 raft_consensus.cc:359] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.069659 21686 raft_consensus.cc:385] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.069977 21686 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.070639 21686 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.096588 21961 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.115298 21686 ts_tablet_manager.cc:1434] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:06:11.117442 21686 tablet_bootstrap.cc:492] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:11.121228 21987 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.121752 21987 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.123803 21987 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:11.129329 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:11.131712 21608 leader_election.cc:343] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.132198 22049 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:11.134505 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:11.142956 21857 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.143502 21857 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.145743 21857 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:11.147450 21684 tablet_bootstrap.cc:492] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
W20260709 13:06:11.143646 21606 leader_election.cc:343] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.147938 21684 ts_tablet_manager.cc:1403] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.009s
I20260709 13:06:11.148248 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:11.149585 21683 tablet_bootstrap.cc:654] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.151470 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:11.152171 21642 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:11.155402 22054 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:11.156647 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:11.157428 21560 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:11.158644 21389 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.161595 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:11.161546 21389 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.162482 21961 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:11.163133 21389 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.166177 21961 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.166600 21961 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.167431 21684 raft_consensus.cc:359] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.168156 21684 raft_consensus.cc:385] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.168432 21684 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.196280 21684 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.199191 21684 ts_tablet_manager.cc:1434] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.002s
I20260709 13:06:11.200264 21684 tablet_bootstrap.cc:492] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:11.209847 21961 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.213822 21686 tablet_bootstrap.cc:654] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:11.257669 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:11.229512 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:11.260674 21569 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.262924 21961 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:11.220717 21684 tablet_bootstrap.cc:654] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.277540 21569 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:11.279327 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:11.280404 21683 tablet_bootstrap.cc:492] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:11.280862 21683 ts_tablet_manager.cc:1403] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.214s	user 0.015s	sys 0.000s
I20260709 13:06:11.281947 21857 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:11.283655 21857 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:11.288146 21683 raft_consensus.cc:359] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.288899 21683 raft_consensus.cc:385] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.289217 21683 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.287418 21857 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.289963 21683 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:11.296785 21459 consensus_peers.cc:597] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:11.302313 21683 ts_tablet_manager.cc:1434] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:06:11.303416 21683 tablet_bootstrap.cc:492] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:11.303565 21961 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.306367 21961 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.303438 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:11.315845 21639 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.332296 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:11.331634 21961 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:11.333036 21686 tablet_bootstrap.cc:492] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:11.333492 21686 ts_tablet_manager.cc:1403] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.216s	user 0.010s	sys 0.019s
W20260709 13:06:11.333711 21459 leader_election.cc:343] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.336267 21686 raft_consensus.cc:359] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.336995 21686 raft_consensus.cc:385] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.337297 21686 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.338076 21686 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.348575 21961 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.355480 21686 ts_tablet_manager.cc:1434] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:06:11.356380 21686 tablet_bootstrap.cc:492] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:11.357306 21683 tablet_bootstrap.cc:654] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.367964 21389 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.362262 21639 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:11.383122 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:11.392103 21634 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:11.396286 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:11.397046 21857 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:11.397428 21857 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.397786 21857 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.404597 22060 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.405166 22060 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.413466 21684 tablet_bootstrap.cc:492] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:11.413992 21684 ts_tablet_manager.cc:1403] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.214s	user 0.015s	sys 0.026s
I20260709 13:06:11.415427 21561 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.408309 21857 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.428988 22060 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:11.429536 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:11.430087 21684 raft_consensus.cc:359] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.430807 21684 raft_consensus.cc:385] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.431099 21684 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.431910 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:11.432760 21639 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 1: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:11.434015 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:11.434249 21857 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:11.435325 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:11.435357 21459 leader_election.cc:343] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.431746 21684 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.436451 22060 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.439343 21684 ts_tablet_manager.cc:1434] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:06:11.440268 21684 tablet_bootstrap.cc:492] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:11.445302 21683 tablet_bootstrap.cc:492] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:11.445845 21683 ts_tablet_manager.cc:1403] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.002s
I20260709 13:06:11.448060 22060 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:11.448582 21683 raft_consensus.cc:359] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.451851 21686 tablet_bootstrap.cc:654] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.454416 21684 tablet_bootstrap.cc:654] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.449261 21683 raft_consensus.cc:385] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.455039 21683 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.455742 21683 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.456647 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:11.457171 21642 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.457854 21683 ts_tablet_manager.cc:1434] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:06:11.458876 21683 tablet_bootstrap.cc:492] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:11.462827 21764 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.464578 21683 tablet_bootstrap.cc:654] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.471743 21684 tablet_bootstrap.cc:492] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:11.472235 21684 ts_tablet_manager.cc:1403] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 13:06:11.476173 21684 raft_consensus.cc:359] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.476856 21684 raft_consensus.cc:385] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.477109 21684 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.477670 21684 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.479941 21684 ts_tablet_manager.cc:1434] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:11.482654 21686 tablet_bootstrap.cc:492] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:11.483367 21686 ts_tablet_manager.cc:1403] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.000s
I20260709 13:06:11.486470 21686 raft_consensus.cc:359] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.487272 21686 raft_consensus.cc:385] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.487565 21686 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.482640 21684 tablet_bootstrap.cc:492] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:11.493103 21642 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:11.493335 21686 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.494306 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:11.495553 21857 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:11.496017 21857 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:11.495580 22049 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:11.496976 21686 ts_tablet_manager.cc:1434] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:06:11.496845 21857 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.500240 21686 tablet_bootstrap.cc:492] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:11.514739 21684 tablet_bootstrap.cc:654] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.522457 21683 tablet_bootstrap.cc:492] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:11.523175 21683 ts_tablet_manager.cc:1403] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.015s
I20260709 13:06:11.524857 21989 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.525365 21989 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.529425 21683 raft_consensus.cc:359] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.530220 22060 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.530447 21683 raft_consensus.cc:385] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.530743 22060 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.530928 21683 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.532755 22060 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:11.532389 21683 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.536265 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:11.544018 21683 ts_tablet_manager.cc:1434] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:06:11.532763 21989 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:11.550081 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:11.549162 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:11.549018 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:11.557399 21608 leader_election.cc:343] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.557871 21488 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:11.560474 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:11.562669 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:11.563601 21981 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:11.563993 22060 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:11.564020 21981 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.564636 21981 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.565529 22053 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.566071 22053 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.566938 21683 tablet_bootstrap.cc:492] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:11.568503 22053 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:11.569342 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:11.569036 21390 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.575346 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:11.575639 21606 leader_election.cc:343] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:11.576925 21608 leader_election.cc:343] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.577450 21608 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:11.578925 21686 tablet_bootstrap.cc:654] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.580251 21987 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:11.581537 21683 tablet_bootstrap.cc:654] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.606720 21981 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.608973 21684 tablet_bootstrap.cc:492] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:11.609472 21684 ts_tablet_manager.cc:1403] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.020s
I20260709 13:06:11.609683 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:11.610342 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:11.610467 21493 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:11.612017 21608 leader_election.cc:343] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.612680 21981 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:11.613802 21684 raft_consensus.cc:359] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.614473 21684 raft_consensus.cc:385] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.614706 21684 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.621045 21684 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.624311 21684 ts_tablet_manager.cc:1434] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:06:11.627367 21493 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:11.629083 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:11.630525 21981 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:11.631203 21981 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:11.632145 21981 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.636981 21683 tablet_bootstrap.cc:492] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:11.637419 21683 ts_tablet_manager.cc:1403] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.019s
I20260709 13:06:11.639602 21683 raft_consensus.cc:359] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.640273 21683 raft_consensus.cc:385] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.640534 21683 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.641129 21686 tablet_bootstrap.cc:492] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:11.641295 21683 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.642916 21684 tablet_bootstrap.cc:492] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:11.644678 21686 ts_tablet_manager.cc:1403] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.144s	user 0.007s	sys 0.012s
I20260709 13:06:11.650066 21390 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:11.652597 21683 ts_tablet_manager.cc:1434] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:06:11.652776 21686 raft_consensus.cc:359] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.653601 21686 raft_consensus.cc:385] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.653733 21683 tablet_bootstrap.cc:492] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:11.654006 21686 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.654739 21686 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.659068 21684 tablet_bootstrap.cc:654] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.660136 21686 ts_tablet_manager.cc:1434] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:06:11.667304 21683 tablet_bootstrap.cc:654] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.671514 21686 tablet_bootstrap.cc:492] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:11.678314 21686 tablet_bootstrap.cc:654] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.703647 21684 tablet_bootstrap.cc:492] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:11.704150 21684 ts_tablet_manager.cc:1403] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.006s
I20260709 13:06:11.707258 21683 tablet_bootstrap.cc:492] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:11.707769 21683 ts_tablet_manager.cc:1403] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.014s
I20260709 13:06:11.707932 21684 raft_consensus.cc:359] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.708650 21684 raft_consensus.cc:385] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.708915 21684 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.710429 21683 raft_consensus.cc:359] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.710739 21684 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.711158 21683 raft_consensus.cc:385] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.711642 21683 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.712320 21683 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.714421 21683 ts_tablet_manager.cc:1434] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:11.716110 21684 ts_tablet_manager.cc:1434] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:06:11.717155 21683 tablet_bootstrap.cc:492] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:11.722757 21684 tablet_bootstrap.cc:492] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:11.736397 21561 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.738384 22049 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.746505 21684 tablet_bootstrap.cc:654] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.747031 21686 tablet_bootstrap.cc:492] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:11.747545 21686 ts_tablet_manager.cc:1403] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.001s
I20260709 13:06:11.750908 21683 tablet_bootstrap.cc:654] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.757730 21686 raft_consensus.cc:359] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.758709 21686 raft_consensus.cc:385] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.759090 21686 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.759898 21686 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.780658 21683 tablet_bootstrap.cc:492] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:11.781210 21683 ts_tablet_manager.cc:1403] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.005s
I20260709 13:06:11.810961 21686 ts_tablet_manager.cc:1434] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:06:11.811359 22049 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.814615 21683 raft_consensus.cc:359] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.815618 21684 tablet_bootstrap.cc:492] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:11.816202 21684 ts_tablet_manager.cc:1403] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.094s	user 0.028s	sys 0.004s
I20260709 13:06:11.816710 21683 raft_consensus.cc:385] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.817037 21683 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.817816 21686 tablet_bootstrap.cc:492] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:11.818300 21683 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.822302 21684 raft_consensus.cc:359] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.823109 21684 raft_consensus.cc:385] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.823414 21684 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.824084 21684 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.827951 21684 ts_tablet_manager.cc:1434] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:06:11.832384 21683 ts_tablet_manager.cc:1434] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.051s	user 0.015s	sys 0.000s
I20260709 13:06:11.833424 21683 tablet_bootstrap.cc:492] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:11.840969 21684 tablet_bootstrap.cc:492] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:11.846709 21686 tablet_bootstrap.cc:654] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.857582 21684 tablet_bootstrap.cc:654] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.865289 21683 tablet_bootstrap.cc:654] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.868013 22054 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.868659 22054 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.872998 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:11.873679 21488 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
I20260709 13:06:11.874887 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:11.876890 21683 tablet_bootstrap.cc:492] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:11.879616 21683 ts_tablet_manager.cc:1403] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.001s
I20260709 13:06:11.878911 21569 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.881683 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:11.883533 21608 leader_election.cc:343] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.876343 21981 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:11.884912 21981 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.885254 21981 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.880576 22054 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:11.894200 21686 tablet_bootstrap.cc:492] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:11.893891 21683 raft_consensus.cc:359] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.894663 21686 ts_tablet_manager.cc:1403] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.003s
I20260709 13:06:11.894827 21683 raft_consensus.cc:385] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.895234 21683 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.897321 21686 raft_consensus.cc:359] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.898610 21992 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.902374 21992 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.903018 21686 raft_consensus.cc:385] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:11.903533 21686 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:11.904431 21992 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:11.904184 21686 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.906728 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:11.901826 22054 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.913106 22054 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.918306 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:11.920588 21608 leader_election.cc:343] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.921576 22054 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:11.896885 21683 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.923246 21683 ts_tablet_manager.cc:1434] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:06:11.924091 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:11.926074 22049 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.930395 22049 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.928745 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:11.934607 21606 leader_election.cc:343] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.935046 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:11.937273 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:11.940127 22053 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:11.941359 22053 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.941888 21992 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:11.941851 22053 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.940361 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:11.944074 21459 leader_election.cc:343] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.944306 22053 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:11.946375 21686 ts_tablet_manager.cc:1434] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 13:06:11.946694 22049 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:11.947888 21686 tablet_bootstrap.cc:492] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:11.948261 21683 tablet_bootstrap.cc:492] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Bootstrap starting.
I20260709 13:06:11.950852 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:11.905140 21981 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.952451 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:11.953179 21634 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
W20260709 13:06:11.952494 21608 leader_election.cc:343] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.956179 21981 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:11.956411 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:11.957811 21608 leader_election.cc:343] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:11.961458 21683 tablet_bootstrap.cc:654] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.968012 21686 tablet_bootstrap.cc:654] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:11.973644 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:11.974675 21493 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:11.980497 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:11.985729 21493 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:11.987193 21686 tablet_bootstrap.cc:492] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:11.997231 21686 ts_tablet_manager.cc:1403] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 13:06:11.999801 21686 raft_consensus.cc:359] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:11.996707 21684 tablet_bootstrap.cc:492] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:12.000802 21684 ts_tablet_manager.cc:1403] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.161s	user 0.016s	sys 0.010s
I20260709 13:06:12.003032 21683 tablet_bootstrap.cc:492] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: No bootstrap required, opened a new log
I20260709 13:06:11.980525 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:12.003667 21683 ts_tablet_manager.cc:1403] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.003s
I20260709 13:06:12.003633 21684 raft_consensus.cc:359] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.004616 21684 raft_consensus.cc:385] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.004951 21684 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
W20260709 13:06:12.005812 21606 leader_election.cc:343] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.006349 21606 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:12.005599 21684 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.006340 21686 raft_consensus.cc:385] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.008247 22043 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:12.006455 21683 raft_consensus.cc:359] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.036223 21686 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.036598 21683 raft_consensus.cc:385] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.009509 21684 ts_tablet_manager.cc:1434] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:06:12.036938 21683 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.037081 21686 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.037734 21684 tablet_bootstrap.cc:492] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:12.037621 21683 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.018823 21961 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:06:12.039573 21683 ts_tablet_manager.cc:1434] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:06:12.036370 22043 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.039991 22043 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.018963 21976 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.041721 21976 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.007741 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:12.043841 21976 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:12.044152 22053 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:12.044615 22053 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:12.045483 22053 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.007948 21981 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:12.039199 21686 ts_tablet_manager.cc:1434] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:06:12.049149 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:12.049701 21686 tablet_bootstrap.cc:492] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:12.051410 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:12.053452 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:12.054225 21992 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.054944 21976 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:12.054746 21992 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.057230 21992 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:12.051589 22043 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.064531 21686 tablet_bootstrap.cc:654] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.066684 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:12.067353 21569 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:12.070255 21459 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.058480 21684 tablet_bootstrap.cc:654] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.059125 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:12.059794 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:12.075224 21642 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 0.
I20260709 13:06:12.075531 21493 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 1: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:12.076793 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:12.085170 21569 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:12.085878 21992 raft_consensus.cc:2764] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:06:12.088728 22043 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:12.090197 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:12.091243 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:12.091665 22043 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:12.092015 21642 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.092368 22043 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:12.093256 22043 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.099442 21642 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:12.099630 21684 tablet_bootstrap.cc:492] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:12.101323 21684 ts_tablet_manager.cc:1403] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.003s
I20260709 13:06:12.103549 21686 tablet_bootstrap.cc:492] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:12.104035 21686 ts_tablet_manager.cc:1403] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 13:06:12.104802 21684 raft_consensus.cc:359] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.105635 21684 raft_consensus.cc:385] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.105976 21684 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.106513 21686 raft_consensus.cc:359] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.107213 21686 raft_consensus.cc:385] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.106819 21684 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.104857 21390 catalog_manager.cc:5697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 1, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.111485 22054 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.112177 22054 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.113452 21857 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.113911 21857 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.115855 21857 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:12.118013 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:12.119596 21459 leader_election.cc:343] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.121106 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:12.121425 21684 ts_tablet_manager.cc:1434] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:06:12.121790 21634 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:12.122804 21684 tablet_bootstrap.cc:492] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:12.123085 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:12.107497 21686 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.124101 21857 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:12.124469 21857 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.124812 21857 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.124202 21686 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.131374 21857 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.134970 21686 ts_tablet_manager.cc:1434] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:06:12.136238 21686 tablet_bootstrap.cc:492] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:12.141362 21684 tablet_bootstrap.cc:654] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.142172 22054 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:12.144843 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:12.146057 21608 leader_election.cc:343] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.150170 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:12.151422 21606 leader_election.cc:343] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.151844 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:12.153844 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:12.155171 21459 leader_election.cc:343] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.155395 22054 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:12.157625 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:12.158150 21634 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.159682 21686 tablet_bootstrap.cc:654] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.160571 21684 tablet_bootstrap.cc:492] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:12.163288 21567 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.163337 21684 ts_tablet_manager.cc:1403] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.003s
W20260709 13:06:12.166811 21608 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.170707 21561 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.174437 22053 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:12.186646 21857 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:12.184192 21390 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.188822 21634 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:12.190013 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:12.191462 21961 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:12.191582 21764 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.192245 21764 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.206678 21857 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.207937 21857 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.210956 21684 raft_consensus.cc:359] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.211673 21684 raft_consensus.cc:385] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.211920 21684 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.213039 21857 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:12.213671 21764 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:12.215018 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:12.219337 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:12.220204 21642 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
W20260709 13:06:12.221140 21459 leader_election.cc:343] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.223451 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:12.218575 21684 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.228082 21764 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:12.228578 21764 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.229000 21764 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.236964 21684 ts_tablet_manager.cc:1434] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:06:12.241247 21764 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.250772 21684 tablet_bootstrap.cc:492] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Bootstrap starting.
I20260709 13:06:12.250849 21764 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:12.227577 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:12.257414 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:12.258230 21642 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.230355 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:12.263352 21961 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:12.266089 21634 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:12.292722 21987 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:12.299585 21459 leader_election.cc:343] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.299839 21686 tablet_bootstrap.cc:492] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:12.300292 21686 ts_tablet_manager.cc:1403] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.164s	user 0.022s	sys 0.011s
I20260709 13:06:12.301097 21642 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:12.299204 21987 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.322883 21987 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:12.323501 21961 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.307789 21976 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.350366 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:12.359261 21686 raft_consensus.cc:359] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.370343 21764 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:12.376091 21686 raft_consensus.cc:385] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.325892 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:12.376164 21764 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.379925 21764 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.371722 22130 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.377631 21686 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
W20260709 13:06:12.381822 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 74991.1us
I20260709 13:06:12.385712 21686 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:12.380915 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 72667.8us
I20260709 13:06:12.348325 22049 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.395110 22049 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.397817 22049 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:12.348367 21976 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.383421 22130 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:12.457267 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 83457.4us
I20260709 13:06:12.460937 21764 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:12.451305 22134 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:06:12.470343 21764 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:12.470872 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 120604us
I20260709 13:06:12.479815 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:12.483673 21459 leader_election.cc:343] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.488754 21976 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:12.489923 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:12.490368 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:12.492353 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:12.494072 21569 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.499131 21686 ts_tablet_manager.cc:1434] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.199s	user 0.015s	sys 0.014s
I20260709 13:06:12.510434 21684 tablet_bootstrap.cc:654] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:12.522169 21459 leader_election.cc:343] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.526711 21686 tablet_bootstrap.cc:492] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:12.559875 21569 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
W20260709 13:06:12.564124 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 165142us
I20260709 13:06:12.530494 22129 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:12.605118 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82565.6us
W20260709 13:06:12.609977 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 86761.5us
I20260709 13:06:12.612278 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:12.596048 22129 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:12.612951 22130 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:12.626415 21459 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:12.629781 21857 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:12.630244 21857 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:12.631048 21857 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.677780 21684 tablet_bootstrap.cc:492] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: No bootstrap required, opened a new log
I20260709 13:06:12.678305 21684 ts_tablet_manager.cc:1403] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Time spent bootstrapping tablet: real 0.428s	user 0.018s	sys 0.043s
I20260709 13:06:12.681008 21686 tablet_bootstrap.cc:654] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.683481 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:12.694592 21684 raft_consensus.cc:359] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.695679 21684 raft_consensus.cc:385] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.696053 21684 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.696902 21684 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:12.706221 21608 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.711102 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:12.712369 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:12.712971 21642 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:12.715173 21684 ts_tablet_manager.cc:1434] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.003s
W20260709 13:06:12.723278 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 96946.2us
W20260709 13:06:12.728580 21459 leader_election.cc:343] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.727676 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:12.679116 22129 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:12.754293 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:12.756219 21566 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.752602 21641 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.772145 22049 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:12.774786 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:12.855957 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:12.893971 21641 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:12.800403 21491 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 0.
W20260709 13:06:12.963686 21608 leader_election.cc:343] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.995273 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:12.996032 21639 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:12.997483 21686 tablet_bootstrap.cc:492] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:12.998127 21686 ts_tablet_manager.cc:1403] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.485s	user 0.044s	sys 0.031s
I20260709 13:06:13.001330 21686 raft_consensus.cc:359] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.001972 21686 raft_consensus.cc:385] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.002210 21686 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.003175 21686 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.004662 21686 ts_tablet_manager.cc:1434] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:06:13.005510 21686 tablet_bootstrap.cc:492] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:13.019520 21561 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.023274 22157 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.025512 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:13.027580 21981 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:13.028149 21981 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.028581 21981 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.035693 21390 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.037722 21390 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.039762 21390 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.040827 21981 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.043488 21981 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:13.054358 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:06:13.059255 21459 consensus_peers.cc:597] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.060935 22043 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:13.061465 22043 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.061614 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:13.061970 22043 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.064706 22156 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:13.065147 22156 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.065483 22156 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.070902 22151 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:13.073978 22156 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.076165 22156 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:13.080291 22138 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.089582 21686 tablet_bootstrap.cc:654] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.093148 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:13.093788 21642 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.100342 21992 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.103722 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:13.105079 21459 leader_election.cc:343] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.106611 22043 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.125401 22043 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:13.108048 21642 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:13.116261 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:13.126000 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:13.126600 21486 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 1: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:06:13.127516 21459 leader_election.cc:343] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.138024 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:13.139015 22151 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:13.139667 22151 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:13.140815 22151 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.155292 22155 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:13.155896 22155 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.157099 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:13.158110 21642 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:13.165518 22155 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:13.174546 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:13.180127 22138 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.191066 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:13.198334 22043 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:13.200489 22171 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:06:13.231693 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:13.232136 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:13.240378 21608 leader_election.cc:343] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.240811 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:13.242524 22157 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.252018 21686 tablet_bootstrap.cc:492] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:13.267620 21686 ts_tablet_manager.cc:1403] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.262s	user 0.007s	sys 0.007s
I20260709 13:06:13.257072 22156 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:06:13.265895 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:13.271003 22155 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.281850 21686 raft_consensus.cc:359] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.282588 21686 raft_consensus.cc:385] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.282920 21686 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.283560 21686 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.285113 21686 ts_tablet_manager.cc:1434] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:06:13.286006 21686 tablet_bootstrap.cc:492] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:13.288672 21390 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.325760 22043 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.326289 22043 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.329420 22043 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:13.330155 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:13.330866 21635 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 0.
I20260709 13:06:13.330771 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:13.332047 21457 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:13.333005 21459 leader_election.cc:343] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.332945 21686 tablet_bootstrap.cc:654] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.334865 22043 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:13.335317 22043 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.335659 22043 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.342847 22043 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.345490 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:13.348393 21459 leader_election.cc:343] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:13.350159 22043 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:13.350390 21686 tablet_bootstrap.cc:492] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:13.351580 21686 ts_tablet_manager.cc:1403] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.006s
I20260709 13:06:13.352722 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:13.353368 21635 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.354699 21686 raft_consensus.cc:359] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.355540 21686 raft_consensus.cc:385] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.355865 21686 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.356617 21686 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.359300 21686 ts_tablet_manager.cc:1434] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:13.360296 21635 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:13.361112 21686 tablet_bootstrap.cc:492] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:13.361481 21457 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:13.368801 22043 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:13.369316 22043 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:13.370121 22043 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.377676 21686 tablet_bootstrap.cc:654] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.404312 21686 tablet_bootstrap.cc:492] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:13.404903 21686 ts_tablet_manager.cc:1403] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.003s
I20260709 13:06:13.404840 21390 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.410568 21686 raft_consensus.cc:359] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.411330 21686 raft_consensus.cc:385] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.411612 21686 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.412356 21686 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.414659 21686 ts_tablet_manager.cc:1434] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:06:13.419991 21686 tablet_bootstrap.cc:492] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:13.430158 22155 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.430701 22155 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.439028 22155 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:13.443121 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:13.443604 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:13.444001 21635 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 1: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:13.445534 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:13.446905 22155 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.447127 21686 tablet_bootstrap.cc:654] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.448316 22043 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.456408 21686 tablet_bootstrap.cc:492] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:13.456935 21686 ts_tablet_manager.cc:1403] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.006s
I20260709 13:06:13.459828 21686 raft_consensus.cc:359] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.460601 21686 raft_consensus.cc:385] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.460880 21686 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.462536 22155 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.463164 21686 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.465643 21686 ts_tablet_manager.cc:1434] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:06:13.467579 21686 tablet_bootstrap.cc:492] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:13.469841 21561 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.485800 21686 tablet_bootstrap.cc:654] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.486824 22043 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:13.528501 21686 tablet_bootstrap.cc:492] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:13.529044 21686 ts_tablet_manager.cc:1403] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.023s
I20260709 13:06:13.532377 21686 raft_consensus.cc:359] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.533102 21686 raft_consensus.cc:385] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.533429 21686 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.540340 21686 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.542577 21686 ts_tablet_manager.cc:1434] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:06:13.543732 21686 tablet_bootstrap.cc:492] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Bootstrap starting.
I20260709 13:06:13.585157 22153 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.585700 22153 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.587922 22153 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:13.592186 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:13.593163 21686 tablet_bootstrap.cc:654] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.606963 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:13.649343 22043 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:13.654925 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:13.679894 21563 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.680214 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:13.689226 21686 tablet_bootstrap.cc:492] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: No bootstrap required, opened a new log
I20260709 13:06:13.689894 21686 ts_tablet_manager.cc:1403] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Time spent bootstrapping tablet: real 0.146s	user 0.027s	sys 0.023s
I20260709 13:06:13.699357 22155 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.700014 22155 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.702366 22155 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:13.702961 22155 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.703485 22155 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.705844 22155 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:13.708051 21686 raft_consensus.cc:359] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.709522 21686 raft_consensus.cc:385] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.709942 21686 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.728832 21566 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.713752 21686 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.732594 21686 ts_tablet_manager.cc:1434] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:06:13.748039 21566 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.750694 22188 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.747773 22151 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.755708 22188 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:13.765661 22188 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:13.773046 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 75305.3us
I20260709 13:06:13.777945 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:13.778946 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:13.785980 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:13.787254 21487 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 1: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:13.787477 22156 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.795635 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:13.798707 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:13.803265 22153 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.815477 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:13.816514 21635 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 1: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:13.824091 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:13.824923 22153 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.825430 21532 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:13.826146 22153 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.829542 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:13.830201 21992 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.839226 21992 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.848013 22156 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:14.701692 21440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:14.753407 22154 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.753964 22154 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:14.756376 22154 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:14.757459 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:14.758144 21565 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:14.756994 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:14.759039 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:14.759200 21487 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:14.759876 22154 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.760294 22154 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.760679 22154 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.765955 22154 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:14.768646 22154 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:14.770853 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:14.771540 21565 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.776860 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:14.777629 21487 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.783070 21565 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:14.784359 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:14.785156 22154 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:14.785738 22154 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:14.786624 22154 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:14.788324 21487 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:14.800508 21392 catalog_manager.cc:5697] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 0 to 2, leader changed from <none> to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 2 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.988775 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:15.029086 22201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:15.031273 22204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:15.035254 20382 server_base.cc:1061] running on GCE node
W20260709 13:06:15.036279 22202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:15.038942 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:15.039323 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:15.039619 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602375039600 us; error 0 us; skew 500 ppm
I20260709 13:06:15.040423 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:15.067940 20382 webserver.cc:533] Webserver started at http://127.19.231.132:41593/ using document root <none> and password file <none>
I20260709 13:06:15.068701 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:15.069021 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:15.069394 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:15.070662 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-3-root/instance:
uuid: "549b31ac31b6428994b45938abc223a7"
format_stamp: "Formatted at 2026-07-09 13:06:15 on dist-test-slave-1t6m"
I20260709 13:06:15.076459 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:15.091601 22209 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:15.093086 20382 fs_manager.cc:730] Time spent opening block manager: real 0.014s	user 0.001s	sys 0.008s
I20260709 13:06:15.093617 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-3-root
uuid: "549b31ac31b6428994b45938abc223a7"
format_stamp: "Formatted at 2026-07-09 13:06:15 on dist-test-slave-1t6m"
I20260709 13:06:15.094089 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:15.122486 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:15.124642 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:15.127101 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:15.131033 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:15.131357 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:15.131692 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:15.131958 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:15.209026 21493 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:15.213179 22154 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:15.251556 21565 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:15.252960 22257 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:15.347805 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.132:40323
I20260709 13:06:15.347916 22277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.132:40323 every 8 connection(s)
I20260709 13:06:15.375257 20382 auto_leader_rebalancer-test.cc:384] add a tserver: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:15.394711 22278 heartbeater.cc:344] Connected to a master server at 127.19.231.190:34603
I20260709 13:06:15.395237 22278 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:15.396126 22278 heartbeater.cc:507] Master 127.19.231.190:34603 requested a full tablet report, sending...
I20260709 13:06:15.399407 21392 ts_manager.cc:194] Registered new tserver with Master: 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:15.401247 21392 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52850
I20260709 13:06:15.847220 21487 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:15.855126 21565 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.857223 22200 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:15.867663 21641 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.873745 22147 raft_consensus.cc:2955] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:15.875387 21566 raft_consensus.cc:2955] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:15.885766 21764 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.894920 21493 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:06:15.903182 21457 consensus_peers.cc:597] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cae2bb9c133344078cc4f963e7188776. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.904575 21392 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:15.918694 21638 raft_consensus.cc:2955] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:15.939924 21566 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.940879 21641 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.942970 21764 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:15.947103 21457 consensus_peers.cc:597] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f372659e8e14c5d86dae03fcd58b963. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.947705 21764 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.024204 21764 raft_consensus.cc:2955] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:16.024834 21565 raft_consensus.cc:2955] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:06:16.033691 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 64604.9us
W20260709 13:06:16.034946 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 78955.5us
I20260709 13:06:16.066300 21391 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:16.087091 21641 raft_consensus.cc:2955] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:16.113216 21561 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:16.218393 21638 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.224750 21493 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.243018 22302 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:16.245042 22188 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:16.252872 21532 consensus_peers.cc:597] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6397e2c83e814a908887a9e44184de0a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.255650 22194 raft_consensus.cc:2955] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:16.261224 21487 raft_consensus.cc:2955] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:16.270010 21638 raft_consensus.cc:2955] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:16.274509 21493 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:16.277251 21390 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:16.306067 21457 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b773b0d389ce4ab991f6892abb4882e7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.310463 21641 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.313352 21569 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.315274 22200 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.317493 22200 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:16.350029 22200 raft_consensus.cc:2955] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:16.355415 21638 raft_consensus.cc:2955] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:16.378005 21569 raft_consensus.cc:2955] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:16.391700 21390 catalog_manager.cc:5697] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:16.404150 22278 heartbeater.cc:499] Master 127.19.231.190:34603 was elected leader, sending a full tablet report...
I20260709 13:06:16.443436 22310 ts_tablet_manager.cc:933] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:16.455070 22310 tablet_copy_client.cc:323] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:16.542943 21504 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet cae2bb9c133344078cc4f963e7188776 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:16.543650 21504 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet cae2bb9c133344078cc4f963e7188776 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-cae2bb9c133344078cc4f963e7188776
I20260709 13:06:16.585106 21504 tablet_copy_source_session.cc:215] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.597572 22314 ts_tablet_manager.cc:933] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:16.603762 22310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae2bb9c133344078cc4f963e7188776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.606101 22314 tablet_copy_client.cc:323] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:16.626266 21504 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet 1f372659e8e14c5d86dae03fcd58b963 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:16.626884 21504 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet 1f372659e8e14c5d86dae03fcd58b963 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-1f372659e8e14c5d86dae03fcd58b963
I20260709 13:06:16.636019 21504 tablet_copy_source_session.cc:215] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.636082 22316 ts_tablet_manager.cc:933] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:16.649863 22310 tablet_copy_client.cc:806] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.650337 22314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f372659e8e14c5d86dae03fcd58b963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.650579 22310 tablet_copy_client.cc:670] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.661458 22316 tablet_copy_client.cc:323] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.130:41371
I20260709 13:06:16.662544 22310 tablet_copy_client.cc:538] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.686403 22314 tablet_copy_client.cc:806] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.687614 22314 tablet_copy_client.cc:670] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.691778 22314 tablet_copy_client.cc:538] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.696349 21579 tablet_copy_service.cc:140] P 5727b19579474da6a12f79730b924770: Received BeginTabletCopySession request for tablet 6397e2c83e814a908887a9e44184de0a from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36572)
I20260709 13:06:16.696996 21579 tablet_copy_service.cc:161] P 5727b19579474da6a12f79730b924770: Beginning new tablet copy session on tablet 6397e2c83e814a908887a9e44184de0a from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36572: session id = 549b31ac31b6428994b45938abc223a7-6397e2c83e814a908887a9e44184de0a
I20260709 13:06:16.704782 21579 tablet_copy_source_session.cc:215] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.708686 22316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6397e2c83e814a908887a9e44184de0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.713953 22314 tablet_bootstrap.cc:492] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:16.719130 22310 tablet_bootstrap.cc:492] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:16.746336 22316 tablet_copy_client.cc:806] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.746987 22316 tablet_copy_client.cc:670] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.751153 22316 tablet_copy_client.cc:538] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.771675 22316 tablet_bootstrap.cc:492] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:16.797765 22310 tablet_bootstrap.cc:492] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.798756 22310 tablet_bootstrap.cc:492] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:16.799564 22310 ts_tablet_manager.cc:1403] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.006s
I20260709 13:06:16.802513 22310 raft_consensus.cc:359] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:16.803411 22310 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:16.804060 22310 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:16.820109 22314 tablet_bootstrap.cc:492] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.821081 22314 tablet_bootstrap.cc:492] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:16.821774 22314 ts_tablet_manager.cc:1403] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.013s
I20260709 13:06:16.847936 22310 ts_tablet_manager.cc:1434] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:06:16.858984 21504 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-cae2bb9c133344078cc4f963e7188776 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:16.859496 21504 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-cae2bb9c133344078cc4f963e7188776 on tablet cae2bb9c133344078cc4f963e7188776 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:16.867024 22310 ts_tablet_manager.cc:933] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:16.873839 22316 tablet_bootstrap.cc:492] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.874992 22316 tablet_bootstrap.cc:492] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:16.867270 22314 raft_consensus.cc:359] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:16.875663 22314 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:16.875887 22316 ts_tablet_manager.cc:1403] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.031s
I20260709 13:06:16.876451 22314 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:16.879436 22316 raft_consensus.cc:359] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:16.881470 22316 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:16.882261 22316 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:16.884262 22316 ts_tablet_manager.cc:1434] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:16.886298 21579 tablet_copy_service.cc:342] P 5727b19579474da6a12f79730b924770: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-6397e2c83e814a908887a9e44184de0a received from {username='slave'} at 127.0.0.1:36572
I20260709 13:06:16.886778 21579 tablet_copy_service.cc:434] P 5727b19579474da6a12f79730b924770: ending tablet copy session 549b31ac31b6428994b45938abc223a7-6397e2c83e814a908887a9e44184de0a on tablet 6397e2c83e814a908887a9e44184de0a with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:16.890344 22310 tablet_copy_client.cc:323] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:16.892184 21504 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet b773b0d389ce4ab991f6892abb4882e7 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:16.892452 22314 ts_tablet_manager.cc:1434] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.003s
I20260709 13:06:16.892794 21504 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet b773b0d389ce4ab991f6892abb4882e7 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-b773b0d389ce4ab991f6892abb4882e7
I20260709 13:06:16.895483 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-1f372659e8e14c5d86dae03fcd58b963 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:16.895936 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-1f372659e8e14c5d86dae03fcd58b963 on tablet 1f372659e8e14c5d86dae03fcd58b963 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:16.903992 21504 tablet_copy_source_session.cc:215] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.908612 22310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b773b0d389ce4ab991f6892abb4882e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.926334 22310 tablet_copy_client.cc:806] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.926977 22310 tablet_copy_client.cc:670] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.930709 22310 tablet_copy_client.cc:538] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.940553 22310 tablet_bootstrap.cc:492] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:16.966161 22310 tablet_bootstrap.cc:492] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.967222 22310 tablet_bootstrap.cc:492] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:16.968283 22310 ts_tablet_manager.cc:1403] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.007s
I20260709 13:06:16.970479 22247 raft_consensus.cc:1217] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.971499 22310 raft_consensus.cc:359] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:16.972419 22310 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:16.973595 22310 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:16.976071 22310 ts_tablet_manager.cc:1434] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:16.978261 21504 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-b773b0d389ce4ab991f6892abb4882e7 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:16.978672 21504 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-b773b0d389ce4ab991f6892abb4882e7 on tablet b773b0d389ce4ab991f6892abb4882e7 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:17.096771 22247 raft_consensus.cc:1217] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.189666 22247 raft_consensus.cc:1217] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.301173 22247 raft_consensus.cc:1217] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.530138 22147 raft_consensus.cc:1064] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:17.533447 22147 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:17.543817 22247 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.546940 21641 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.547338 22327 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.548710 21561 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.554316 21764 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.557746 22297 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.608537 22200 raft_consensus.cc:2955] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:17.636773 22297 raft_consensus.cc:1064] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:17.639758 22297 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:17.652361 22247 raft_consensus.cc:2955] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:17.667830 22302 raft_consensus.cc:1064] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:17.697181 22302 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:17.714025 21390 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:17.735229 22247 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.739689 21486 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.765491 21642 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.766968 22302 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.768940 22326 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.776080 22337 raft_consensus.cc:1064] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:17.780053 21569 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.784466 22247 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.784291 22327 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.778692 22337 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:17.796959 21638 raft_consensus.cc:2955] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:17.801651 21641 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.810734 21569 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.814079 21565 raft_consensus.cc:2955] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:17.824126 22337 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.843031 22326 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.844736 21764 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.846495 22246 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:17.884711 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 80812.9us
I20260709 13:06:17.889165 21641 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:17.902947 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52465.8us
I20260709 13:06:17.905575 22200 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.906697 22147 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.912729 21486 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:17.918074 22302 raft_consensus.cc:2955] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:17.920262 22200 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.926944 22246 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.928855 22200 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:17.947842 22327 raft_consensus.cc:2955] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:17.970093 22245 raft_consensus.cc:2955] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:17.970155 22337 raft_consensus.cc:2955] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:17.991883 21390 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.996942 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cae2bb9c133344078cc4f963e7188776 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.992120 22244 raft_consensus.cc:2955] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.007215 21561 raft_consensus.cc:2955] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.010546 21391 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.046417 21635 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.105410 21392 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.148087 22244 raft_consensus.cc:2955] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.170528 21493 raft_consensus.cc:2955] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:06:18.204875 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 94471.2us
I20260709 13:06:18.216218 22353 raft_consensus.cc:2955] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.243394 21552 tablet_service.cc:1558] Processing DeleteTablet for tablet cae2bb9c133344078cc4f963e7188776 with delete_type TABLET_DATA_TOMBSTONED (TS 5727b19579474da6a12f79730b924770 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40984
I20260709 13:06:18.278054 22352 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:06:18.281848 21569 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:18.288432 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 63792.2us
I20260709 13:06:18.294364 22357 tablet_replica.cc:333] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:06:18.301187 22244 raft_consensus.cc:2955] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.320207 21637 raft_consensus.cc:2955] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.323778 21639 raft_consensus.cc:2955] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.329754 21561 raft_consensus.cc:2955] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.337978 21486 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:18.348963 21566 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.348728 21637 raft_consensus.cc:2955] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.350771 22327 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:18.353513 21635 raft_consensus.cc:2955] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.359218 22246 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.347018 22244 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.379343 22357 raft_consensus.cc:2243] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.388619 21764 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:18.394001 22357 raft_consensus.cc:2272] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.380955 21392 catalog_manager.cc:5697] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.438045 22357 ts_tablet_manager.cc:1916] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.439422 22356 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:18.438482 21764 raft_consensus.cc:2955] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:06:18.446833 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 71406us
I20260709 13:06:18.457602 21569 raft_consensus.cc:2955] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.461697 22244 raft_consensus.cc:2955] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.465099 21636 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.472903 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f372659e8e14c5d86dae03fcd58b963 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:18.481931 21486 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:18.509472 22302 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:18.514554 22326 raft_consensus.cc:2955] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.522253 22246 raft_consensus.cc:2955] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.528551 22245 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.534211 21392 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.546583 21632 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f372659e8e14c5d86dae03fcd58b963 with delete_type TABLET_DATA_TOMBSTONED (TS a87bd86b86e74aa8bb61189215b73439 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58370
I20260709 13:06:18.580369 22360 tablet_replica.cc:333] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:06:18.581763 22360 raft_consensus.cc:2243] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.587556 22297 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:06:18.605729 21639 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.605347 21392 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.582762 22360 raft_consensus.cc:2272] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.595772 21378 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6397e2c83e814a908887a9e44184de0a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:18.615051 22297 raft_consensus.cc:2955] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.617030 22244 raft_consensus.cc:2955] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.592332 22357 ts_tablet_manager.cc:1929] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.622224 22357 log.cc:1199] T cae2bb9c133344078cc4f963e7188776 P 5727b19579474da6a12f79730b924770: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/wals/cae2bb9c133344078cc4f963e7188776
I20260709 13:06:18.624361 21482 tablet_service.cc:1558] Processing DeleteTablet for tablet 6397e2c83e814a908887a9e44184de0a with delete_type TABLET_DATA_TOMBSTONED (TS 5a34fd3290de493eb6bbe828dd742772 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41276
I20260709 13:06:18.637141 21378 catalog_manager.cc:5028] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): tablet cae2bb9c133344078cc4f963e7188776 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:18.639941 22360 ts_tablet_manager.cc:1916] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.651921 22337 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:18.669539 21391 catalog_manager.cc:5697] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.670825 22361 tablet_replica.cc:333] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:06:18.672122 22361 raft_consensus.cc:2243] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.672794 22361 raft_consensus.cc:2272] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.675477 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b773b0d389ce4ab991f6892abb4882e7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:18.677206 21636 raft_consensus.cc:2955] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.692919 21552 tablet_service.cc:1558] Processing DeleteTablet for tablet b773b0d389ce4ab991f6892abb4882e7 with delete_type TABLET_DATA_TOMBSTONED (TS 5727b19579474da6a12f79730b924770 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40984
I20260709 13:06:18.694003 22357 tablet_replica.cc:333] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:06:18.691474 21639 raft_consensus.cc:2955] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:18.695101 22357 raft_consensus.cc:2243] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.696030 22357 raft_consensus.cc:2272] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.702158 22361 ts_tablet_manager.cc:1916] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.702957 22357 ts_tablet_manager.cc:1916] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.718647 22360 ts_tablet_manager.cc:1929] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.719197 22360 log.cc:1199] T 1f372659e8e14c5d86dae03fcd58b963 P a87bd86b86e74aa8bb61189215b73439: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/wals/1f372659e8e14c5d86dae03fcd58b963
I20260709 13:06:18.722106 21376 catalog_manager.cc:5028] TS a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): tablet 1f372659e8e14c5d86dae03fcd58b963 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:18.739177 22357 ts_tablet_manager.cc:1929] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.739663 22357 log.cc:1199] T b773b0d389ce4ab991f6892abb4882e7 P 5727b19579474da6a12f79730b924770: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/wals/b773b0d389ce4ab991f6892abb4882e7
I20260709 13:06:18.743126 21378 catalog_manager.cc:5028] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): tablet b773b0d389ce4ab991f6892abb4882e7 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:18.750699 22361 ts_tablet_manager.cc:1929] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.751312 22361 log.cc:1199] T 6397e2c83e814a908887a9e44184de0a P 5a34fd3290de493eb6bbe828dd742772: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/wals/6397e2c83e814a908887a9e44184de0a
I20260709 13:06:18.753149 21376 catalog_manager.cc:5028] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): tablet 6397e2c83e814a908887a9e44184de0a (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:19.824846 21486 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:19.831063 21636 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.832551 22147 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.832834 21565 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:19.833531 21457 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e214d67cdc8f4690b393c47800e8e3e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.835328 22327 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:19.851265 22297 raft_consensus.cc:2955] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:19.852360 21560 raft_consensus.cc:2955] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:19.877599 21392 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.890746 21639 raft_consensus.cc:2955] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:20.098680 21636 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:20.151634 21565 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:20.152957 22376 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.164827 21490 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:20.166666 22376 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:20.175175 22375 raft_consensus.cc:2955] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:06:20.188346 21606 consensus_peers.cc:597] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18db3d7d8520484b9eb6da32f2bc86ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.193975 21569 raft_consensus.cc:2955] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:20.197063 21565 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:20.198758 21390 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.203557 21493 raft_consensus.cc:2955] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:06:20.260545 21532 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd6859210b204263aedc975d7586330c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.260624 21635 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:20.262135 21493 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:20.264127 22326 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:20.265172 22371 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.282575 22371 raft_consensus.cc:2955] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:20.288040 21493 raft_consensus.cc:2955] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:20.313944 21635 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:20.315356 21636 raft_consensus.cc:2955] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:20.310115 21390 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:06:20.335181 21606 consensus_peers.cc:597] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d086ed254594401ae567a7d3681c987. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.336272 21561 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:20.338217 22358 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.359154 21493 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:20.363951 22358 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.369356 22389 ts_tablet_manager.cc:933] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:20.388351 22375 raft_consensus.cc:2955] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:20.398995 22389 tablet_copy_client.cc:323] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:20.401136 21504 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet e214d67cdc8f4690b393c47800e8e3e6 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:20.401746 21504 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet e214d67cdc8f4690b393c47800e8e3e6 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-e214d67cdc8f4690b393c47800e8e3e6
I20260709 13:06:20.411566 21560 raft_consensus.cc:2955] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:20.423300 21493 raft_consensus.cc:2955] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:20.443888 21504 tablet_copy_source_session.cc:215] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.447947 22389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e214d67cdc8f4690b393c47800e8e3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.446695 21390 catalog_manager.cc:5697] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:20.476832 22389 tablet_copy_client.cc:806] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.477470 22389 tablet_copy_client.cc:670] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.481487 22389 tablet_copy_client.cc:538] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.490739 22389 tablet_bootstrap.cc:492] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:20.520121 22389 tablet_bootstrap.cc:492] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.521126 22389 tablet_bootstrap.cc:492] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:20.521896 22389 ts_tablet_manager.cc:1403] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.021s
I20260709 13:06:20.525028 22389 raft_consensus.cc:359] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:20.528005 22389 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:20.529332 22389 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:20.555613 22389 ts_tablet_manager.cc:1434] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.033s	user 0.012s	sys 0.015s
I20260709 13:06:20.557996 21504 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-e214d67cdc8f4690b393c47800e8e3e6 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:20.558477 21504 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-e214d67cdc8f4690b393c47800e8e3e6 on tablet e214d67cdc8f4690b393c47800e8e3e6 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:20.657892 22389 ts_tablet_manager.cc:933] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:20.677801 22389 tablet_copy_client.cc:323] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.131:41367
I20260709 13:06:20.745016 21653 tablet_copy_service.cc:140] P a87bd86b86e74aa8bb61189215b73439: Received BeginTabletCopySession request for tablet 18db3d7d8520484b9eb6da32f2bc86ed from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36050)
I20260709 13:06:20.745601 21653 tablet_copy_service.cc:161] P a87bd86b86e74aa8bb61189215b73439: Beginning new tablet copy session on tablet 18db3d7d8520484b9eb6da32f2bc86ed from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36050: session id = 549b31ac31b6428994b45938abc223a7-18db3d7d8520484b9eb6da32f2bc86ed
I20260709 13:06:20.753532 21653 tablet_copy_source_session.cc:215] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.756877 22389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18db3d7d8520484b9eb6da32f2bc86ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.778014 22397 ts_tablet_manager.cc:933] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:20.780725 22398 ts_tablet_manager.cc:933] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:20.781117 22389 tablet_copy_client.cc:806] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.782680 22389 tablet_copy_client.cc:670] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.786502 22389 tablet_copy_client.cc:538] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.794441 22398 tablet_copy_client.cc:323] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.130:41371
I20260709 13:06:20.797801 21579 tablet_copy_service.cc:140] P 5727b19579474da6a12f79730b924770: Received BeginTabletCopySession request for tablet bd6859210b204263aedc975d7586330c from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36572)
I20260709 13:06:20.798385 21579 tablet_copy_service.cc:161] P 5727b19579474da6a12f79730b924770: Beginning new tablet copy session on tablet bd6859210b204263aedc975d7586330c from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36572: session id = 549b31ac31b6428994b45938abc223a7-bd6859210b204263aedc975d7586330c
I20260709 13:06:20.807801 21579 tablet_copy_source_session.cc:215] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.812671 22398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6859210b204263aedc975d7586330c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.820359 22389 tablet_bootstrap.cc:492] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:20.827644 22397 tablet_copy_client.cc:323] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.131:41367
I20260709 13:06:20.829810 21653 tablet_copy_service.cc:140] P a87bd86b86e74aa8bb61189215b73439: Received BeginTabletCopySession request for tablet 7d086ed254594401ae567a7d3681c987 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36050)
I20260709 13:06:20.830361 21653 tablet_copy_service.cc:161] P a87bd86b86e74aa8bb61189215b73439: Beginning new tablet copy session on tablet 7d086ed254594401ae567a7d3681c987 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36050: session id = 549b31ac31b6428994b45938abc223a7-7d086ed254594401ae567a7d3681c987
I20260709 13:06:20.838846 21653 tablet_copy_source_session.cc:215] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.842962 22397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d086ed254594401ae567a7d3681c987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.864982 22398 tablet_copy_client.cc:806] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.866322 22398 tablet_copy_client.cc:670] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.874006 22397 tablet_copy_client.cc:806] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.874523 22398 tablet_copy_client.cc:538] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.874670 22397 tablet_copy_client.cc:670] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.885829 22398 tablet_bootstrap.cc:492] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:20.889724 22397 tablet_copy_client.cc:538] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.899434 22397 tablet_bootstrap.cc:492] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:20.927321 22389 tablet_bootstrap.cc:492] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.928369 22389 tablet_bootstrap.cc:492] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:20.929064 22389 ts_tablet_manager.cc:1403] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.109s	user 0.030s	sys 0.004s
I20260709 13:06:20.939450 22389 raft_consensus.cc:359] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:20.942267 22389 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:20.943037 22389 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:20.950165 22389 ts_tablet_manager.cc:1434] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:06:20.952239 21653 tablet_copy_service.cc:342] P a87bd86b86e74aa8bb61189215b73439: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-18db3d7d8520484b9eb6da32f2bc86ed received from {username='slave'} at 127.0.0.1:36050
I20260709 13:06:20.952733 21653 tablet_copy_service.cc:434] P a87bd86b86e74aa8bb61189215b73439: ending tablet copy session 549b31ac31b6428994b45938abc223a7-18db3d7d8520484b9eb6da32f2bc86ed on tablet 18db3d7d8520484b9eb6da32f2bc86ed with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:20.952783 22246 raft_consensus.cc:1217] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:20.972200 22398 tablet_bootstrap.cc:492] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.973227 22398 tablet_bootstrap.cc:492] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:20.974995 22398 ts_tablet_manager.cc:1403] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.089s	user 0.027s	sys 0.013s
I20260709 13:06:20.977957 22398 raft_consensus.cc:359] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:20.978812 22398 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:20.979458 22398 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:20.981563 22398 ts_tablet_manager.cc:1434] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:20.983726 21579 tablet_copy_service.cc:342] P 5727b19579474da6a12f79730b924770: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-bd6859210b204263aedc975d7586330c received from {username='slave'} at 127.0.0.1:36572
I20260709 13:06:20.984182 21579 tablet_copy_service.cc:434] P 5727b19579474da6a12f79730b924770: ending tablet copy session 549b31ac31b6428994b45938abc223a7-bd6859210b204263aedc975d7586330c on tablet bd6859210b204263aedc975d7586330c with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:20.998813 22397 tablet_bootstrap.cc:492] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:21.000633 22397 tablet_bootstrap.cc:492] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:21.001368 22397 ts_tablet_manager.cc:1403] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.027s
I20260709 13:06:21.005102 22397 raft_consensus.cc:359] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:21.005980 22397 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:21.006637 22397 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:21.009285 22397 ts_tablet_manager.cc:1434] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:21.010939 21653 tablet_copy_service.cc:342] P a87bd86b86e74aa8bb61189215b73439: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-7d086ed254594401ae567a7d3681c987 received from {username='slave'} at 127.0.0.1:36050
I20260709 13:06:21.011350 21653 tablet_copy_service.cc:434] P a87bd86b86e74aa8bb61189215b73439: ending tablet copy session 549b31ac31b6428994b45938abc223a7-7d086ed254594401ae567a7d3681c987 on tablet 7d086ed254594401ae567a7d3681c987 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:21.043495 22246 raft_consensus.cc:1217] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:21.117519 22246 raft_consensus.cc:1217] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:21.322129 22246 raft_consensus.cc:1217] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:21.431308 22368 raft_consensus.cc:1064] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:21.433279 22368 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:21.440848 22406 raft_consensus.cc:1064] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:21.442842 22246 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.443517 22406 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:21.444963 22401 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.442842 21635 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.447556 22401 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.456807 21560 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.458942 22401 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.473155 22246 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.474589 22376 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.480471 21486 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.482077 22375 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.486357 21560 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.488804 22401 raft_consensus.cc:2955] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.490936 21635 raft_consensus.cc:2955] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.488281 22375 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:06:21.514235 22246 raft_consensus.cc:2955] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.521652 21569 raft_consensus.cc:2955] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:06:21.532680 22408 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:21.537679 21392 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.556097 22376 raft_consensus.cc:2955] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.560273 21560 raft_consensus.cc:2955] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.585474 22406 raft_consensus.cc:1064] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:21.591006 22406 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:21.611490 22244 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.605428 22246 raft_consensus.cc:2955] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.619769 22355 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:21.631117 21493 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.635283 22406 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.645269 21390 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.649339 21486 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:21.664220 22245 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.666453 22401 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.670284 21560 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.672065 22401 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:21.676167 21486 raft_consensus.cc:2955] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.683465 22368 raft_consensus.cc:2955] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.688099 21569 raft_consensus.cc:2955] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:06:21.691254 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 84147.3us
I20260709 13:06:21.693044 21560 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.697788 22245 raft_consensus.cc:2955] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.702128 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e214d67cdc8f4690b393c47800e8e3e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.703567 22375 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.710381 21638 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:21.734084 22247 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.735236 21390 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.751933 21632 tablet_service.cc:1558] Processing DeleteTablet for tablet e214d67cdc8f4690b393c47800e8e3e6 with delete_type TABLET_DATA_TOMBSTONED (TS a87bd86b86e74aa8bb61189215b73439 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58370
I20260709 13:06:21.758867 22425 tablet_replica.cc:333] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:06:21.760051 22425 raft_consensus.cc:2243] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.761485 22425 raft_consensus.cc:2272] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.781868 22355 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:21.791357 22244 raft_consensus.cc:2955] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.789207 22355 raft_consensus.cc:2955] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.794483 22375 raft_consensus.cc:2955] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.806685 21391 catalog_manager.cc:5697] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.815512 22247 raft_consensus.cc:2955] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.828203 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18db3d7d8520484b9eb6da32f2bc86ed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.835944 22425 ts_tablet_manager.cc:1916] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.849241 21493 raft_consensus.cc:2955] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.866320 21391 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.874536 22425 ts_tablet_manager.cc:1929] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.875145 22425 log.cc:1199] T e214d67cdc8f4690b393c47800e8e3e6 P a87bd86b86e74aa8bb61189215b73439: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/wals/e214d67cdc8f4690b393c47800e8e3e6
I20260709 13:06:21.877338 21376 catalog_manager.cc:5028] TS a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): tablet e214d67cdc8f4690b393c47800e8e3e6 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:21.879949 21482 tablet_service.cc:1558] Processing DeleteTablet for tablet 18db3d7d8520484b9eb6da32f2bc86ed with delete_type TABLET_DATA_TOMBSTONED (TS 5a34fd3290de493eb6bbe828dd742772 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41276
I20260709 13:06:21.890208 22426 tablet_replica.cc:333] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:06:21.891611 22426 raft_consensus.cc:2243] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.892336 22426 raft_consensus.cc:2272] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.894313 22405 raft_consensus.cc:1064] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:21.896595 22405 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:21.904929 22426 ts_tablet_manager.cc:1916] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.908279 21561 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.925629 22355 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.928817 22247 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.931488 21638 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.932381 21486 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.938673 22371 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:21.939663 22426 ts_tablet_manager.cc:1929] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.941648 22371 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.942028 21638 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:21.944762 21562 raft_consensus.cc:2955] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.946568 22427 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:21.949633 22426 log.cc:1199] T 18db3d7d8520484b9eb6da32f2bc86ed P 5a34fd3290de493eb6bbe828dd742772: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/wals/18db3d7d8520484b9eb6da32f2bc86ed
I20260709 13:06:21.948344 21569 raft_consensus.cc:2955] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.950686 22247 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.952060 21376 catalog_manager.cc:5028] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): tablet 18db3d7d8520484b9eb6da32f2bc86ed (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:21.953384 22421 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:21.961165 22406 raft_consensus.cc:2955] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.962987 22247 raft_consensus.cc:2955] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:21.982563 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d086ed254594401ae567a7d3681c987 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.996598 21569 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:22.003810 21391 catalog_manager.cc:5697] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:22.010519 22406 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:22.017333 22427 raft_consensus.cc:2955] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:22.031771 21482 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d086ed254594401ae567a7d3681c987 with delete_type TABLET_DATA_TOMBSTONED (TS 5a34fd3290de493eb6bbe828dd742772 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41276
I20260709 13:06:22.029445 22245 raft_consensus.cc:2955] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:22.032938 22426 tablet_replica.cc:333] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:06:22.034129 22426 raft_consensus.cc:2243] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:22.039672 21569 raft_consensus.cc:2955] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:22.046284 21490 raft_consensus.cc:2955] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:22.046718 21635 raft_consensus.cc:2955] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:22.048501 22426 raft_consensus.cc:2272] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:22.062280 22426 ts_tablet_manager.cc:1916] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:22.071419 21391 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.097958 21569 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:22.101295 22426 ts_tablet_manager.cc:1929] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:22.102012 22426 log.cc:1199] T 7d086ed254594401ae567a7d3681c987 P 5a34fd3290de493eb6bbe828dd742772: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/wals/7d086ed254594401ae567a7d3681c987
I20260709 13:06:22.107285 21376 catalog_manager.cc:5028] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): tablet 7d086ed254594401ae567a7d3681c987 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:22.109854 21490 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:22.111682 22428 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:22.112110 22245 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:22.114547 22428 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:22.122100 22427 raft_consensus.cc:2955] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:22.124783 21490 raft_consensus.cc:2955] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:22.127628 22245 raft_consensus.cc:2955] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:22.136804 21378 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd6859210b204263aedc975d7586330c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:22.151749 21391 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.188802 21632 tablet_service.cc:1558] Processing DeleteTablet for tablet bd6859210b204263aedc975d7586330c with delete_type TABLET_DATA_TOMBSTONED (TS a87bd86b86e74aa8bb61189215b73439 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58370
I20260709 13:06:22.189886 22425 tablet_replica.cc:333] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:06:22.190959 22425 raft_consensus.cc:2243] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:22.191671 22425 raft_consensus.cc:2272] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:22.195533 22425 ts_tablet_manager.cc:1916] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:22.211067 22425 ts_tablet_manager.cc:1929] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:22.211547 22425 log.cc:1199] T bd6859210b204263aedc975d7586330c P a87bd86b86e74aa8bb61189215b73439: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/wals/bd6859210b204263aedc975d7586330c
I20260709 13:06:22.213037 21376 catalog_manager.cc:5028] TS a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): tablet bd6859210b204263aedc975d7586330c (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:23.255276 21490 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:23.262583 21638 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:23.263700 21457 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f7e8b71ee674ed4b42ef0ba024cf600. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.264626 22384 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.265086 21567 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.266522 22435 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.273420 22384 raft_consensus.cc:2955] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.275573 21636 raft_consensus.cc:2955] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.277611 21569 raft_consensus.cc:2955] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.291808 21567 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:23.298491 21390 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:06:23.315354 21532 consensus_peers.cc:597] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68080652a5d4450691efb2d8b5c1b187. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.315876 21636 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.317761 21490 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.317438 22427 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:23.319252 22405 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:23.340508 22405 raft_consensus.cc:2955] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.344244 21486 raft_consensus.cc:2955] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.358034 21636 raft_consensus.cc:2955] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.378384 21391 catalog_manager.cc:5697] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.388546 21561 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:06:23.398422 21532 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbb07a26963247f383d1e9c7990b92ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.398487 21638 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:23.399195 21486 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:23.400101 22447 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.401497 22427 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.410995 22447 raft_consensus.cc:2955] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.413635 21486 raft_consensus.cc:2955] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.431588 21636 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:23.431795 21389 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 3, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.439013 21561 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:23.439343 21606 consensus_peers.cc:597] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7bfc9f63b5d484f83f58360423d19e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.440299 21638 raft_consensus.cc:2955] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.441583 21490 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.442359 22434 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.443778 22355 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.470654 22355 raft_consensus.cc:2955] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.472105 21567 raft_consensus.cc:2955] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.496045 21490 raft_consensus.cc:2955] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.510685 21390 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:23.668382 22455 ts_tablet_manager.cc:933] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:23.671659 22455 tablet_copy_client.cc:323] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:23.673540 21504 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet 7f7e8b71ee674ed4b42ef0ba024cf600 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:23.674015 21504 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet 7f7e8b71ee674ed4b42ef0ba024cf600 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-7f7e8b71ee674ed4b42ef0ba024cf600
I20260709 13:06:23.679178 21504 tablet_copy_source_session.cc:215] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.681780 22455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7e8b71ee674ed4b42ef0ba024cf600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.693768 22455 tablet_copy_client.cc:806] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.694305 22455 tablet_copy_client.cc:670] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.697942 22455 tablet_copy_client.cc:538] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.705966 22455 tablet_bootstrap.cc:492] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:23.724995 22455 tablet_bootstrap.cc:492] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.725919 22455 tablet_bootstrap.cc:492] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:23.726545 22455 ts_tablet_manager.cc:1403] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:06:23.729439 22455 raft_consensus.cc:359] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:23.730260 22455 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:23.730971 22455 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:23.739753 22455 ts_tablet_manager.cc:1434] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:06:23.746307 21504 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-7f7e8b71ee674ed4b42ef0ba024cf600 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:23.746757 21504 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-7f7e8b71ee674ed4b42ef0ba024cf600 on tablet 7f7e8b71ee674ed4b42ef0ba024cf600 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:23.855616 22455 ts_tablet_manager.cc:933] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:23.857383 22455 tablet_copy_client.cc:323] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.130:41371
I20260709 13:06:23.859092 21579 tablet_copy_service.cc:140] P 5727b19579474da6a12f79730b924770: Received BeginTabletCopySession request for tablet 68080652a5d4450691efb2d8b5c1b187 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36572)
I20260709 13:06:23.859665 21579 tablet_copy_service.cc:161] P 5727b19579474da6a12f79730b924770: Beginning new tablet copy session on tablet 68080652a5d4450691efb2d8b5c1b187 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36572: session id = 549b31ac31b6428994b45938abc223a7-68080652a5d4450691efb2d8b5c1b187
I20260709 13:06:23.866194 21579 tablet_copy_source_session.cc:215] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.870038 22455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68080652a5d4450691efb2d8b5c1b187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.886942 22455 tablet_copy_client.cc:806] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.887521 22455 tablet_copy_client.cc:670] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.891116 22455 tablet_copy_client.cc:538] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.901728 22455 tablet_bootstrap.cc:492] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:23.911078 22460 ts_tablet_manager.cc:933] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:23.919404 22460 tablet_copy_client.cc:323] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.131:41367
I20260709 13:06:23.922569 21653 tablet_copy_service.cc:140] P a87bd86b86e74aa8bb61189215b73439: Received BeginTabletCopySession request for tablet c7bfc9f63b5d484f83f58360423d19e3 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36050)
I20260709 13:06:23.923158 21653 tablet_copy_service.cc:161] P a87bd86b86e74aa8bb61189215b73439: Beginning new tablet copy session on tablet c7bfc9f63b5d484f83f58360423d19e3 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36050: session id = 549b31ac31b6428994b45938abc223a7-c7bfc9f63b5d484f83f58360423d19e3
I20260709 13:06:23.937422 21653 tablet_copy_source_session.cc:215] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.942951 22455 tablet_bootstrap.cc:492] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.943938 22455 tablet_bootstrap.cc:492] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:23.944621 22455 ts_tablet_manager.cc:1403] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.008s
I20260709 13:06:23.946400 22460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bfc9f63b5d484f83f58360423d19e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.953856 22455 raft_consensus.cc:359] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:23.955724 22455 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:23.956393 22455 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:23.958895 22455 ts_tablet_manager.cc:1434] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:06:23.938462 22463 ts_tablet_manager.cc:933] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:23.976348 21579 tablet_copy_service.cc:342] P 5727b19579474da6a12f79730b924770: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-68080652a5d4450691efb2d8b5c1b187 received from {username='slave'} at 127.0.0.1:36572
I20260709 13:06:23.977010 21579 tablet_copy_service.cc:434] P 5727b19579474da6a12f79730b924770: ending tablet copy session 549b31ac31b6428994b45938abc223a7-68080652a5d4450691efb2d8b5c1b187 on tablet 68080652a5d4450691efb2d8b5c1b187 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:23.997120 22460 tablet_copy_client.cc:806] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.997795 22460 tablet_copy_client.cc:670] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.999188 22463 tablet_copy_client.cc:323] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.130:41371
I20260709 13:06:24.001834 21579 tablet_copy_service.cc:140] P 5727b19579474da6a12f79730b924770: Received BeginTabletCopySession request for tablet bbb07a26963247f383d1e9c7990b92ac from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36572)
I20260709 13:06:24.002417 21579 tablet_copy_service.cc:161] P 5727b19579474da6a12f79730b924770: Beginning new tablet copy session on tablet bbb07a26963247f383d1e9c7990b92ac from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36572: session id = 549b31ac31b6428994b45938abc223a7-bbb07a26963247f383d1e9c7990b92ac
I20260709 13:06:24.009927 21579 tablet_copy_source_session.cc:215] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:24.001705 22460 tablet_copy_client.cc:538] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:24.013427 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb07a26963247f383d1e9c7990b92ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.022270 22460 tablet_bootstrap.cc:492] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:24.033082 22463 tablet_copy_client.cc:806] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:24.033715 22463 tablet_copy_client.cc:670] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:24.037673 22463 tablet_copy_client.cc:538] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:24.046990 22463 tablet_bootstrap.cc:492] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:24.061520 22460 tablet_bootstrap.cc:492] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:24.062451 22460 tablet_bootstrap.cc:492] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:24.063167 22460 ts_tablet_manager.cc:1403] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.007s
I20260709 13:06:24.066229 22460 raft_consensus.cc:359] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:24.067142 22460 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:24.067842 22460 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:24.074266 22460 ts_tablet_manager.cc:1434] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:24.077580 21653 tablet_copy_service.cc:342] P a87bd86b86e74aa8bb61189215b73439: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-c7bfc9f63b5d484f83f58360423d19e3 received from {username='slave'} at 127.0.0.1:36050
I20260709 13:06:24.078040 21653 tablet_copy_service.cc:434] P a87bd86b86e74aa8bb61189215b73439: ending tablet copy session 549b31ac31b6428994b45938abc223a7-c7bfc9f63b5d484f83f58360423d19e3 on tablet c7bfc9f63b5d484f83f58360423d19e3 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:24.080780 22463 tablet_bootstrap.cc:492] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:24.081744 22463 tablet_bootstrap.cc:492] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:24.082406 22463 ts_tablet_manager.cc:1403] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.036s	user 0.028s	sys 0.002s
I20260709 13:06:24.085319 22463 raft_consensus.cc:359] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:24.086135 22463 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:24.086772 22463 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:24.089138 22463 ts_tablet_manager.cc:1434] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:06:24.090718 21579 tablet_copy_service.cc:342] P 5727b19579474da6a12f79730b924770: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-bbb07a26963247f383d1e9c7990b92ac received from {username='slave'} at 127.0.0.1:36572
I20260709 13:06:24.091188 21579 tablet_copy_service.cc:434] P 5727b19579474da6a12f79730b924770: ending tablet copy session 549b31ac31b6428994b45938abc223a7-bbb07a26963247f383d1e9c7990b92ac on tablet bbb07a26963247f383d1e9c7990b92ac with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:24.253322 22247 raft_consensus.cc:1217] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:24.266462 22247 raft_consensus.cc:1217] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:24.447755 22247 raft_consensus.cc:1217] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:24.462903 22247 raft_consensus.cc:1217] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:24.658488 22384 raft_consensus.cc:1064] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:24.660363 22384 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:24.667052 22247 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.667052 21636 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.669067 21561 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.671060 22435 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.671963 22439 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.681495 22384 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:24.693156 22469 raft_consensus.cc:2955] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.699415 21636 raft_consensus.cc:2955] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.711705 22247 raft_consensus.cc:2955] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.726586 21391 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.734331 21561 raft_consensus.cc:2955] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.776492 21486 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:24.785585 21638 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.785668 22247 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.787664 22469 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.788621 22384 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.798535 22435 raft_consensus.cc:2955] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.799782 21638 raft_consensus.cc:2955] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.800943 22247 raft_consensus.cc:2955] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.835152 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f7e8b71ee674ed4b42ef0ba024cf600 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:24.842096 21389 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.846763 22355 raft_consensus.cc:1064] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:24.849424 22355 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:24.859970 22448 raft_consensus.cc:1064] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:24.867189 22448 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:24.876253 21486 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.876544 21552 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7e8b71ee674ed4b42ef0ba024cf600 with delete_type TABLET_DATA_TOMBSTONED (TS 5727b19579474da6a12f79730b924770 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40984
I20260709 13:06:24.878067 22355 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.883919 22247 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.885391 22355 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.901428 21561 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.916208 22406 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:24.931846 22479 tablet_replica.cc:333] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:06:24.933525 22479 raft_consensus.cc:2243] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.934378 22479 raft_consensus.cc:2272] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.941171 22245 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.942905 21490 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.943178 21638 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.950418 22447 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:24.952690 22467 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:24.955005 22447 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:24.952621 22406 raft_consensus.cc:2955] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.968089 22479 ts_tablet_manager.cc:1916] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:24.971397 22247 raft_consensus.cc:2955] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.978401 21561 raft_consensus.cc:2955] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:24.986191 22467 raft_consensus.cc:2955] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.000689 21390 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.998449 21490 raft_consensus.cc:2955] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.009495 22247 raft_consensus.cc:2955] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.017479 21486 raft_consensus.cc:2955] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.026335 21638 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:25.045931 21390 catalog_manager.cc:5697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.050477 22245 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:25.052209 22406 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.053284 21486 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:25.073876 22479 ts_tablet_manager.cc:1929] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:25.074425 22479 log.cc:1199] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5727b19579474da6a12f79730b924770: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/wals/7f7e8b71ee674ed4b42ef0ba024cf600
I20260709 13:06:25.074607 22355 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:25.088685 21378 catalog_manager.cc:5028] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): tablet 7f7e8b71ee674ed4b42ef0ba024cf600 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:25.091318 21569 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:25.102939 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 63943.2us
I20260709 13:06:25.109978 22406 raft_consensus.cc:2955] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.113598 22448 raft_consensus.cc:1064] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:25.115558 22244 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:25.114931 21638 raft_consensus.cc:2955] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.112052 21486 raft_consensus.cc:2955] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.124519 22448 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:25.130654 22488 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:25.136639 22244 raft_consensus.cc:2955] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.169687 21636 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:25.170208 22488 raft_consensus.cc:2955] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.174073 22467 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.178171 22245 raft_consensus.cc:2955] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.180734 21390 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.190349 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c7bfc9f63b5d484f83f58360423d19e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:25.198890 21636 raft_consensus.cc:2955] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.203063 21378 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68080652a5d4450691efb2d8b5c1b187 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:25.210063 21486 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:25.210004 21637 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:25.212528 22467 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:25.218693 22488 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.211635 22244 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:25.223598 22467 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.228065 21552 tablet_service.cc:1558] Processing DeleteTablet for tablet c7bfc9f63b5d484f83f58360423d19e3 with delete_type TABLET_DATA_TOMBSTONED (TS 5727b19579474da6a12f79730b924770 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40984
I20260709 13:06:25.229190 22479 tablet_replica.cc:333] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:06:25.230268 22479 raft_consensus.cc:2243] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.231182 22479 raft_consensus.cc:2272] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.234951 21392 catalog_manager.cc:5697] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.238004 22479 ts_tablet_manager.cc:1916] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.248260 21482 tablet_service.cc:1558] Processing DeleteTablet for tablet 68080652a5d4450691efb2d8b5c1b187 with delete_type TABLET_DATA_TOMBSTONED (TS 5a34fd3290de493eb6bbe828dd742772 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41276
I20260709 13:06:25.288362 22495 tablet_replica.cc:333] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:06:25.290007 22495 raft_consensus.cc:2243] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.295020 22495 raft_consensus.cc:2272] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.294624 22488 raft_consensus.cc:2955] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.302069 21641 raft_consensus.cc:2955] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.307677 22495 ts_tablet_manager.cc:1916] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.309921 22479 ts_tablet_manager.cc:1929] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:25.298420 22244 raft_consensus.cc:2955] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.317662 21486 raft_consensus.cc:2955] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.323334 22479 log.cc:1199] T c7bfc9f63b5d484f83f58360423d19e3 P 5727b19579474da6a12f79730b924770: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/wals/c7bfc9f63b5d484f83f58360423d19e3
I20260709 13:06:25.325345 21378 catalog_manager.cc:5028] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): tablet c7bfc9f63b5d484f83f58360423d19e3 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:25.331300 21391 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 3 to 4, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.357106 22495 ts_tablet_manager.cc:1929] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:25.357719 22495 log.cc:1199] T 68080652a5d4450691efb2d8b5c1b187 P 5a34fd3290de493eb6bbe828dd742772: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/wals/68080652a5d4450691efb2d8b5c1b187
I20260709 13:06:25.362063 21563 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:25.363380 21376 catalog_manager.cc:5028] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): tablet 68080652a5d4450691efb2d8b5c1b187 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:25.368712 22244 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.369429 21486 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.370833 22488 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:25.371832 22448 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:25.379967 22487 raft_consensus.cc:2955] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.384647 21486 raft_consensus.cc:2955] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.387670 22244 raft_consensus.cc:2955] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:25.391887 21378 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bbb07a26963247f383d1e9c7990b92ac with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:25.402972 21391 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 4 to 5, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.420486 21632 tablet_service.cc:1558] Processing DeleteTablet for tablet bbb07a26963247f383d1e9c7990b92ac with delete_type TABLET_DATA_TOMBSTONED (TS a87bd86b86e74aa8bb61189215b73439 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:58370
I20260709 13:06:25.422827 22497 tablet_replica.cc:333] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:06:25.423943 22497 raft_consensus.cc:2243] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.424715 22497 raft_consensus.cc:2272] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.428933 22497 ts_tablet_manager.cc:1916] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.447211 22497 ts_tablet_manager.cc:1929] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:25.447597 22497 log.cc:1199] T bbb07a26963247f383d1e9c7990b92ac P a87bd86b86e74aa8bb61189215b73439: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/wals/bbb07a26963247f383d1e9c7990b92ac
I20260709 13:06:25.449394 21376 catalog_manager.cc:5028] TS a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): tablet bbb07a26963247f383d1e9c7990b92ac (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:26.485556 21638 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:06:26.492923 21606 consensus_peers.cc:597] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac0b1311ffdd4c1293236cad678687e7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.493767 21562 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.496102 21490 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.495231 22406 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:26.498323 22406 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.511234 22406 raft_consensus.cc:2955] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.513144 21562 raft_consensus.cc:2955] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.515254 21490 raft_consensus.cc:2955] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.523955 21486 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:26.528157 21391 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.533670 21638 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.534092 21562 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:26.535424 21457 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12f1cc6194a54e7d8fb8d72776638772. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.539494 22439 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:26.558380 22506 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.565322 22384 raft_consensus.cc:2955] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.568949 21638 raft_consensus.cc:2955] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.582893 21562 raft_consensus.cc:2955] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.594192 21486 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:26.608860 21638 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.609097 21562 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.610424 22504 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.606600 21390 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.611356 22506 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:26.614324 21457 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35e6cfe6efc04bc98ae2183731b5ae40. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.630389 22506 raft_consensus.cc:2955] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.642834 21562 raft_consensus.cc:2955] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.642261 21638 raft_consensus.cc:2955] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.649976 21486 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:26.655496 21389 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.662977 21561 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.664974 22504 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.667796 21641 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:26.668248 21457 consensus_peers.cc:597] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d0b012cfcad4a71a65a1e83d453cfca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.669211 22504 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.680075 22504 raft_consensus.cc:2955] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.682008 21561 raft_consensus.cc:2955] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.720827 21641 raft_consensus.cc:2955] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.723533 21390 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:26.933619 22517 ts_tablet_manager.cc:933] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:26.935593 22517 tablet_copy_client.cc:323] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:26.937251 21504 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet 12f1cc6194a54e7d8fb8d72776638772 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:26.937752 21504 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet 12f1cc6194a54e7d8fb8d72776638772 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-12f1cc6194a54e7d8fb8d72776638772
I20260709 13:06:26.943527 21504 tablet_copy_source_session.cc:215] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:26.946697 22517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f1cc6194a54e7d8fb8d72776638772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:26.964445 22517 tablet_copy_client.cc:806] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:26.965117 22517 tablet_copy_client.cc:670] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:26.972361 22517 tablet_copy_client.cc:538] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:26.982311 22519 ts_tablet_manager.cc:933] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:26.984421 22519 tablet_copy_client.cc:323] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.131:41367
I20260709 13:06:26.986147 21653 tablet_copy_service.cc:140] P a87bd86b86e74aa8bb61189215b73439: Received BeginTabletCopySession request for tablet ac0b1311ffdd4c1293236cad678687e7 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36050)
I20260709 13:06:26.986821 22517 tablet_bootstrap.cc:492] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:26.986703 21653 tablet_copy_service.cc:161] P a87bd86b86e74aa8bb61189215b73439: Beginning new tablet copy session on tablet ac0b1311ffdd4c1293236cad678687e7 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36050: session id = 549b31ac31b6428994b45938abc223a7-ac0b1311ffdd4c1293236cad678687e7
I20260709 13:06:26.996183 21653 tablet_copy_source_session.cc:215] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:26.999702 22519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0b1311ffdd4c1293236cad678687e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:27.010509 22522 ts_tablet_manager.cc:933] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:27.026744 22522 tablet_copy_client.cc:323] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:27.034981 21504 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet 35e6cfe6efc04bc98ae2183731b5ae40 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:27.035543 21504 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet 35e6cfe6efc04bc98ae2183731b5ae40 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-35e6cfe6efc04bc98ae2183731b5ae40
I20260709 13:06:27.043552 21504 tablet_copy_source_session.cc:215] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:27.047771 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e6cfe6efc04bc98ae2183731b5ae40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:27.054069 22517 tablet_bootstrap.cc:492] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.055109 22517 tablet_bootstrap.cc:492] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:27.055819 22517 ts_tablet_manager.cc:1403] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.069s	user 0.040s	sys 0.014s
I20260709 13:06:27.059334 22517 raft_consensus.cc:359] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:27.060168 22517 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:27.060825 22517 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:27.067425 22519 tablet_copy_client.cc:806] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.068315 22519 tablet_copy_client.cc:670] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.099458 22524 ts_tablet_manager.cc:933] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:27.100066 22519 tablet_copy_client.cc:538] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.101579 22517 ts_tablet_manager.cc:1434] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.033s
I20260709 13:06:27.117425 22522 tablet_copy_client.cc:806] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.120760 22522 tablet_copy_client.cc:670] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.125824 21504 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-12f1cc6194a54e7d8fb8d72776638772 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:27.126264 21504 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-12f1cc6194a54e7d8fb8d72776638772 on tablet 12f1cc6194a54e7d8fb8d72776638772 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:27.128932 22522 tablet_copy_client.cc:538] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.148882 22519 tablet_bootstrap.cc:492] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:27.168295 22522 tablet_bootstrap.cc:492] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:27.203646 22524 tablet_copy_client.cc:323] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:27.206580 21503 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet 3d0b012cfcad4a71a65a1e83d453cfca from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:27.207145 21503 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet 3d0b012cfcad4a71a65a1e83d453cfca from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-3d0b012cfcad4a71a65a1e83d453cfca
I20260709 13:06:27.209200 22519 tablet_bootstrap.cc:492] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.217641 22522 tablet_bootstrap.cc:492] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.218748 22519 tablet_bootstrap.cc:492] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:27.219372 21503 tablet_copy_source_session.cc:215] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:27.219537 22519 ts_tablet_manager.cc:1403] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.013s
I20260709 13:06:27.222556 22519 raft_consensus.cc:359] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:27.223402 22519 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:27.224063 22519 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:27.225421 22522 tablet_bootstrap.cc:492] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:27.226177 22522 ts_tablet_manager.cc:1403] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.008s
I20260709 13:06:27.227574 22524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0b012cfcad4a71a65a1e83d453cfca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:27.239319 22519 ts_tablet_manager.cc:1434] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:06:27.241060 22522 raft_consensus.cc:359] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:27.241941 22522 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:27.251219 21653 tablet_copy_service.cc:342] P a87bd86b86e74aa8bb61189215b73439: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-ac0b1311ffdd4c1293236cad678687e7 received from {username='slave'} at 127.0.0.1:36050
I20260709 13:06:27.250593 22522 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:27.251693 21653 tablet_copy_service.cc:434] P a87bd86b86e74aa8bb61189215b73439: ending tablet copy session 549b31ac31b6428994b45938abc223a7-ac0b1311ffdd4c1293236cad678687e7 on tablet ac0b1311ffdd4c1293236cad678687e7 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:27.254122 22522 ts_tablet_manager.cc:1434] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:06:27.256752 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-35e6cfe6efc04bc98ae2183731b5ae40 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:27.257227 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-35e6cfe6efc04bc98ae2183731b5ae40 on tablet 35e6cfe6efc04bc98ae2183731b5ae40 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:27.277263 22524 tablet_copy_client.cc:806] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.277872 22524 tablet_copy_client.cc:670] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.281042 22524 tablet_copy_client.cc:538] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.290571 22524 tablet_bootstrap.cc:492] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:27.313691 22524 tablet_bootstrap.cc:492] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.314617 22524 tablet_bootstrap.cc:492] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:27.315323 22524 ts_tablet_manager.cc:1403] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.010s
I20260709 13:06:27.318279 22524 raft_consensus.cc:359] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:27.319154 22524 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:27.319810 22524 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:27.322415 22524 ts_tablet_manager.cc:1434] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:06:27.324807 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-3d0b012cfcad4a71a65a1e83d453cfca received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:27.325225 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-3d0b012cfcad4a71a65a1e83d453cfca on tablet 3d0b012cfcad4a71a65a1e83d453cfca with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:27.399304 22244 raft_consensus.cc:1217] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.474205 22244 raft_consensus.cc:1217] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.543337 22244 raft_consensus.cc:1217] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.602635 22244 raft_consensus.cc:1217] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.820470 22504 raft_consensus.cc:1064] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:27.823103 22504 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:27.839883 21641 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.839900 22244 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.842283 21562 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.843880 22506 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.845028 22384 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.845840 22530 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.859541 21641 raft_consensus.cc:2955] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:27.864805 21562 raft_consensus.cc:2955] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:27.874516 22478 raft_consensus.cc:1064] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:27.883520 21389 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:27.879108 22478 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:27.858723 22506 raft_consensus.cc:2955] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:27.901252 22244 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.903980 22499 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.907223 22244 raft_consensus.cc:2955] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:27.932669 21486 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.936061 22478 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.940469 21562 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.942857 22499 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.959020 22499 raft_consensus.cc:2955] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:27.975826 21561 raft_consensus.cc:2955] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:27.981539 21486 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:27.991320 21486 raft_consensus.cc:2955] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:27.992861 22244 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:27.995168 22530 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.004918 22244 raft_consensus.cc:2955] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.005370 22384 raft_consensus.cc:2955] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.007725 22506 raft_consensus.cc:1064] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:28.017011 22506 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:28.016227 21389 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.007225 22247 raft_consensus.cc:2955] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.012320 21641 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.039662 22530 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.051357 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35e6cfe6efc04bc98ae2183731b5ae40 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.050945 21641 raft_consensus.cc:2955] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.064342 22504 raft_consensus.cc:1064] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:28.064795 22247 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.067730 22504 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:28.069465 21392 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.070360 22384 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.072965 21636 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.077455 22506 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.078518 21641 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:28.082737 21561 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.085125 22506 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.088949 22245 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.090662 21552 tablet_service.cc:1558] Processing DeleteTablet for tablet 35e6cfe6efc04bc98ae2183731b5ae40 with delete_type TABLET_DATA_TOMBSTONED (TS 5727b19579474da6a12f79730b924770 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40984
I20260709 13:06:28.109450 22550 tablet_replica.cc:333] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:06:28.112915 22550 raft_consensus.cc:2243] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.116132 22478 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.116748 22245 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.118523 21567 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.129431 21569 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.138073 22478 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.137715 22530 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:28.142372 22544 raft_consensus.cc:2955] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.142942 22506 raft_consensus.cc:2955] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.133561 21636 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.145684 22550 raft_consensus.cc:2272] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.150476 22550 ts_tablet_manager.cc:1916] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:28.150698 22245 raft_consensus.cc:2955] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.157212 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac0b1311ffdd4c1293236cad678687e7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.158619 21561 raft_consensus.cc:2955] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.154410 21569 raft_consensus.cc:2955] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.171350 22550 ts_tablet_manager.cc:1929] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:28.171921 22550 log.cc:1199] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5727b19579474da6a12f79730b924770: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/wals/35e6cfe6efc04bc98ae2183731b5ae40
I20260709 13:06:28.185103 21378 catalog_manager.cc:5028] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): tablet 35e6cfe6efc04bc98ae2183731b5ae40 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
W20260709 13:06:28.186534 22549 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:28.188755 22506 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.190670 22506 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.200989 21392 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.208690 21636 raft_consensus.cc:2955] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.221321 21389 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.222250 22506 raft_consensus.cc:2955] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.230069 21641 raft_consensus.cc:2955] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.241065 22245 raft_consensus.cc:2955] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.254688 21482 tablet_service.cc:1558] Processing DeleteTablet for tablet ac0b1311ffdd4c1293236cad678687e7 with delete_type TABLET_DATA_TOMBSTONED (TS 5a34fd3290de493eb6bbe828dd742772 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41276
I20260709 13:06:28.271999 22559 tablet_replica.cc:333] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:06:28.273000 21561 raft_consensus.cc:2955] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.347193 21392 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.403394 22559 raft_consensus.cc:2243] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.405246 22559 raft_consensus.cc:2272] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.387409 22247 raft_consensus.cc:2955] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.413529 22559 ts_tablet_manager.cc:1916] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:28.435425 21487 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:28.469627 22244 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.474375 22561 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:28.502432 21561 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.517582 22560 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:28.498930 21488 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:28.532161 22244 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.533159 21641 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.530751 22559 ts_tablet_manager.cc:1929] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:28.542104 22560 raft_consensus.cc:2955] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.544512 21561 raft_consensus.cc:2955] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.538676 22559 log.cc:1199] T ac0b1311ffdd4c1293236cad678687e7 P 5a34fd3290de493eb6bbe828dd742772: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/wals/ac0b1311ffdd4c1293236cad678687e7
I20260709 13:06:28.560292 22563 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:28.565769 22244 raft_consensus.cc:2955] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.567323 21376 catalog_manager.cc:5028] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): tablet ac0b1311ffdd4c1293236cad678687e7 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:28.568861 21390 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.571833 22561 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.578586 22506 raft_consensus.cc:2955] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.586771 21632 tablet_service.cc:1558] Processing DeleteTablet for tablet 12f1cc6194a54e7d8fb8d72776638772 with delete_type TABLET_DATA_TOMBSTONED (TS a87bd86b86e74aa8bb61189215b73439 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58370
I20260709 13:06:28.595196 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d0b012cfcad4a71a65a1e83d453cfca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.597178 21641 raft_consensus.cc:2955] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.606607 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12f1cc6194a54e7d8fb8d72776638772 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.606985 22564 tablet_replica.cc:333] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:06:28.606868 21390 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.596798 22245 raft_consensus.cc:2955] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:28.610580 22564 raft_consensus.cc:2243] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.611644 22564 raft_consensus.cc:2272] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.622051 21552 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d0b012cfcad4a71a65a1e83d453cfca with delete_type TABLET_DATA_TOMBSTONED (TS 5727b19579474da6a12f79730b924770 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40984
I20260709 13:06:28.623700 22550 tablet_replica.cc:333] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:06:28.625265 22550 raft_consensus.cc:2243] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.627624 22550 raft_consensus.cc:2272] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.631978 22550 ts_tablet_manager.cc:1916] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:28.635142 22564 ts_tablet_manager.cc:1916] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:28.650338 22564 ts_tablet_manager.cc:1929] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:28.650818 22550 ts_tablet_manager.cc:1929] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:28.650962 22564 log.cc:1199] T 12f1cc6194a54e7d8fb8d72776638772 P a87bd86b86e74aa8bb61189215b73439: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/wals/12f1cc6194a54e7d8fb8d72776638772
I20260709 13:06:28.651450 22550 log.cc:1199] T 3d0b012cfcad4a71a65a1e83d453cfca P 5727b19579474da6a12f79730b924770: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/wals/3d0b012cfcad4a71a65a1e83d453cfca
I20260709 13:06:28.653499 21378 catalog_manager.cc:5028] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): tablet 3d0b012cfcad4a71a65a1e83d453cfca (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:28.654417 21376 catalog_manager.cc:5028] TS a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): tablet 12f1cc6194a54e7d8fb8d72776638772 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:29.699203 21488 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:29.709196 21561 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.710469 22566 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.713311 21638 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.715323 22561 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:29.721088 21457 consensus_peers.cc:597] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67538f399a3e491e97d3a4c5585bf44a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:29.720829 22566 raft_consensus.cc:2955] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:29.723546 21561 raft_consensus.cc:2955] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:29.762219 21641 raft_consensus.cc:2955] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:29.766609 21638 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:29.760972 21390 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:06:29.783557 21606 consensus_peers.cc:597] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 401d63d1bf204db2a802876b9ddc8476. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:29.786269 21561 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.786338 21487 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.787920 22565 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:29.789309 22478 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.802616 22543 raft_consensus.cc:2955] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:29.804293 21569 raft_consensus.cc:2955] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:29.814972 21488 raft_consensus.cc:2955] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:29.819290 21487 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:29.831737 21392 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:06:29.837431 21457 consensus_peers.cc:597] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca05d89c0a6b4f8ca791df1da0bad1f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:29.838618 21569 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.839027 21641 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.840842 22561 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.841715 22571 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.853669 22561 raft_consensus.cc:2955] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:29.855945 21569 raft_consensus.cc:2955] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:29.869534 21638 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:29.872067 21641 raft_consensus.cc:2955] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:06:29.880781 21606 consensus_peers.cc:597] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 24789f7f25d44609b76928ec55894739. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:29.882437 21569 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.881804 21389 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.883893 21487 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:29.884119 22565 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.887384 22565 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:06:29.900532 22478 raft_consensus.cc:2955] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:29.910667 21569 raft_consensus.cc:2955] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:29.923272 21389 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.931378 21487 raft_consensus.cc:2955] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:30.126464 22587 ts_tablet_manager.cc:933] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:30.129514 22587 tablet_copy_client.cc:323] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:30.131500 21503 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet 67538f399a3e491e97d3a4c5585bf44a from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:30.132090 21503 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet 67538f399a3e491e97d3a4c5585bf44a from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-67538f399a3e491e97d3a4c5585bf44a
I20260709 13:06:30.142814 21503 tablet_copy_source_session.cc:215] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:30.147257 22587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67538f399a3e491e97d3a4c5585bf44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.178203 22587 tablet_copy_client.cc:806] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:30.178943 22587 tablet_copy_client.cc:670] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:30.183866 22587 tablet_copy_client.cc:538] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:30.196204 22587 tablet_bootstrap.cc:492] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:30.219708 22587 tablet_bootstrap.cc:492] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:30.220793 22587 tablet_bootstrap.cc:492] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:30.221562 22587 ts_tablet_manager.cc:1403] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.026s	user 0.023s	sys 0.000s
I20260709 13:06:30.225127 22587 raft_consensus.cc:359] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:30.226140 22587 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:30.226915 22587 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:30.230643 22587 ts_tablet_manager.cc:1434] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:06:30.232874 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-67538f399a3e491e97d3a4c5585bf44a received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:30.233405 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-67538f399a3e491e97d3a4c5585bf44a on tablet 67538f399a3e491e97d3a4c5585bf44a with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:30.249030 22587 ts_tablet_manager.cc:933] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:30.251716 22587 tablet_copy_client.cc:323] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.131:41367
I20260709 13:06:30.253983 21653 tablet_copy_service.cc:140] P a87bd86b86e74aa8bb61189215b73439: Received BeginTabletCopySession request for tablet 401d63d1bf204db2a802876b9ddc8476 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36050)
I20260709 13:06:30.254550 21653 tablet_copy_service.cc:161] P a87bd86b86e74aa8bb61189215b73439: Beginning new tablet copy session on tablet 401d63d1bf204db2a802876b9ddc8476 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36050: session id = 549b31ac31b6428994b45938abc223a7-401d63d1bf204db2a802876b9ddc8476
I20260709 13:06:30.262774 21653 tablet_copy_source_session.cc:215] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:30.266259 22587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401d63d1bf204db2a802876b9ddc8476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.285290 22587 tablet_copy_client.cc:806] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:30.285923 22587 tablet_copy_client.cc:670] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:30.295598 22587 tablet_copy_client.cc:538] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:30.305347 22587 tablet_bootstrap.cc:492] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:30.333489 22587 tablet_bootstrap.cc:492] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:30.334522 22587 tablet_bootstrap.cc:492] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:30.335268 22587 ts_tablet_manager.cc:1403] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.030s	user 0.030s	sys 0.000s
I20260709 13:06:30.338965 22587 raft_consensus.cc:359] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:30.339973 22587 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:30.340721 22587 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:30.344031 22587 ts_tablet_manager.cc:1434] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.007s
I20260709 13:06:30.360798 21653 tablet_copy_service.cc:342] P a87bd86b86e74aa8bb61189215b73439: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-401d63d1bf204db2a802876b9ddc8476 received from {username='slave'} at 127.0.0.1:36050
I20260709 13:06:30.361346 21653 tablet_copy_service.cc:434] P a87bd86b86e74aa8bb61189215b73439: ending tablet copy session 549b31ac31b6428994b45938abc223a7-401d63d1bf204db2a802876b9ddc8476 on tablet 401d63d1bf204db2a802876b9ddc8476 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:30.403950 22587 ts_tablet_manager.cc:933] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:30.409901 22587 tablet_copy_client.cc:323] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:30.413527 21503 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet ca05d89c0a6b4f8ca791df1da0bad1f1 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:30.414116 21503 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet ca05d89c0a6b4f8ca791df1da0bad1f1 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-ca05d89c0a6b4f8ca791df1da0bad1f1
I20260709 13:06:30.422557 21503 tablet_copy_source_session.cc:215] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:30.426083 22587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca05d89c0a6b4f8ca791df1da0bad1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.440683 22587 tablet_copy_client.cc:806] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:30.441231 22587 tablet_copy_client.cc:670] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:30.444942 22587 tablet_copy_client.cc:538] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:30.453292 22587 tablet_bootstrap.cc:492] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:30.464409 22594 ts_tablet_manager.cc:933] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:30.466645 22594 tablet_copy_client.cc:323] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.131:41367
I20260709 13:06:30.469553 21653 tablet_copy_service.cc:140] P a87bd86b86e74aa8bb61189215b73439: Received BeginTabletCopySession request for tablet 24789f7f25d44609b76928ec55894739 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36050)
I20260709 13:06:30.470151 21653 tablet_copy_service.cc:161] P a87bd86b86e74aa8bb61189215b73439: Beginning new tablet copy session on tablet 24789f7f25d44609b76928ec55894739 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36050: session id = 549b31ac31b6428994b45938abc223a7-24789f7f25d44609b76928ec55894739
I20260709 13:06:30.471551 22587 tablet_bootstrap.cc:492] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:30.472337 22587 tablet_bootstrap.cc:492] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:30.472906 22587 ts_tablet_manager.cc:1403] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:06:30.475374 22587 raft_consensus.cc:359] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:30.476148 22587 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:30.476759 22587 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:30.478837 21653 tablet_copy_source_session.cc:215] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:30.481375 22587 ts_tablet_manager.cc:1434] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:30.482568 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24789f7f25d44609b76928ec55894739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.483624 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-ca05d89c0a6b4f8ca791df1da0bad1f1 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:30.484258 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-ca05d89c0a6b4f8ca791df1da0bad1f1 on tablet ca05d89c0a6b4f8ca791df1da0bad1f1 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:30.505142 22594 tablet_copy_client.cc:806] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:30.505832 22594 tablet_copy_client.cc:670] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:30.510581 22594 tablet_copy_client.cc:538] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:30.523103 22594 tablet_bootstrap.cc:492] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:30.539383 22244 raft_consensus.cc:1217] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:30.565831 22594 tablet_bootstrap.cc:492] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:30.566769 22594 tablet_bootstrap.cc:492] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:30.567564 22594 ts_tablet_manager.cc:1403] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.006s
I20260709 13:06:30.570487 22594 raft_consensus.cc:359] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:30.571337 22594 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:30.572021 22594 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:30.574494 22594 ts_tablet_manager.cc:1434] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:06:30.577354 21653 tablet_copy_service.cc:342] P a87bd86b86e74aa8bb61189215b73439: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-24789f7f25d44609b76928ec55894739 received from {username='slave'} at 127.0.0.1:36050
I20260709 13:06:30.577798 21653 tablet_copy_service.cc:434] P a87bd86b86e74aa8bb61189215b73439: ending tablet copy session 549b31ac31b6428994b45938abc223a7-24789f7f25d44609b76928ec55894739 on tablet 24789f7f25d44609b76928ec55894739 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:30.784509 22244 raft_consensus.cc:1217] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:31.004580 22244 raft_consensus.cc:1217] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:31.021391 22571 raft_consensus.cc:1064] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:31.024139 22571 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:31.025902 22244 raft_consensus.cc:1217] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:31.039642 22244 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.041714 21569 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.043283 22571 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.046765 22570 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.047708 21638 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.050487 22561 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.085850 22571 raft_consensus.cc:2955] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.093806 22244 raft_consensus.cc:2955] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.098361 21638 raft_consensus.cc:2955] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.103950 21569 raft_consensus.cc:2955] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.109687 21390 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.148541 21490 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:31.154210 22244 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.154685 21569 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.155653 22571 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.157544 22571 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.165927 22561 raft_consensus.cc:2955] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.167135 21567 raft_consensus.cc:2955] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.174712 22247 raft_consensus.cc:2955] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.200596 21391 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.213560 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67538f399a3e491e97d3a4c5585bf44a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.222841 21632 tablet_service.cc:1558] Processing DeleteTablet for tablet 67538f399a3e491e97d3a4c5585bf44a with delete_type TABLET_DATA_TOMBSTONED (TS a87bd86b86e74aa8bb61189215b73439 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58370
I20260709 13:06:31.226975 22609 tablet_replica.cc:333] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:06:31.228156 22609 raft_consensus.cc:2243] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.228978 22609 raft_consensus.cc:2272] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.232669 22609 ts_tablet_manager.cc:1916] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.248009 22609 ts_tablet_manager.cc:1929] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.248421 22609 log.cc:1199] T 67538f399a3e491e97d3a4c5585bf44a P a87bd86b86e74aa8bb61189215b73439: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/wals/67538f399a3e491e97d3a4c5585bf44a
I20260709 13:06:31.250027 21376 catalog_manager.cc:5028] TS a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): tablet 67538f399a3e491e97d3a4c5585bf44a (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:31.364502 22478 raft_consensus.cc:1064] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:31.366250 22478 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:31.372895 21561 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.373436 22247 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.373853 21488 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.374594 22478 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:31.375643 22580 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.376479 22543 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.400192 22598 raft_consensus.cc:2955] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.405052 21490 raft_consensus.cc:2955] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.412078 21561 raft_consensus.cc:2955] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.418629 22247 raft_consensus.cc:2955] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.429558 21392 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.460292 21641 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:31.466602 22247 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.467077 21567 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.468545 22598 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.469831 22580 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:31.471349 22601 raft_consensus.cc:1064] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:31.474009 22601 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:31.487197 22580 raft_consensus.cc:2955] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.488824 21567 raft_consensus.cc:2955] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.493095 22247 raft_consensus.cc:2955] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.513135 21389 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.519089 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 401d63d1bf204db2a802876b9ddc8476 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.520964 21567 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.522001 21641 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.522462 22601 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.523370 22247 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.524406 22571 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.530208 22571 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.546769 21482 tablet_service.cc:1558] Processing DeleteTablet for tablet 401d63d1bf204db2a802876b9ddc8476 with delete_type TABLET_DATA_TOMBSTONED (TS 5a34fd3290de493eb6bbe828dd742772 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41276
I20260709 13:06:31.554518 22618 tablet_replica.cc:333] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:06:31.555698 22618 raft_consensus.cc:2243] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.556450 22618 raft_consensus.cc:2272] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.561347 22247 raft_consensus.cc:2955] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.562024 22561 raft_consensus.cc:2955] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.562050 21641 raft_consensus.cc:2955] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.580454 21390 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.580675 21567 raft_consensus.cc:2955] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.596235 22618 ts_tablet_manager.cc:1916] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.602118 22598 raft_consensus.cc:1064] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:31.604991 22598 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:31.614081 22618 ts_tablet_manager.cc:1929] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.615440 22618 log.cc:1199] T 401d63d1bf204db2a802876b9ddc8476 P 5a34fd3290de493eb6bbe828dd742772: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/wals/401d63d1bf204db2a802876b9ddc8476
I20260709 13:06:31.622252 22247 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.623205 21376 catalog_manager.cc:5028] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): tablet 401d63d1bf204db2a802876b9ddc8476 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:31.626724 22580 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:31.632062 21567 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.638020 22598 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.638705 21488 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:31.645301 21490 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.650521 21561 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.652004 22601 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:31.654001 22543 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.654685 22244 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.657699 22571 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.675048 22570 raft_consensus.cc:2955] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.687609 21567 raft_consensus.cc:2955] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.754951 21391 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.758596 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca05d89c0a6b4f8ca791df1da0bad1f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.759732 22543 raft_consensus.cc:2955] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.771672 21561 raft_consensus.cc:2955] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.772341 22244 raft_consensus.cc:2955] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.779888 21490 raft_consensus.cc:2955] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.781436 21632 tablet_service.cc:1558] Processing DeleteTablet for tablet ca05d89c0a6b4f8ca791df1da0bad1f1 with delete_type TABLET_DATA_TOMBSTONED (TS a87bd86b86e74aa8bb61189215b73439 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58370
I20260709 13:06:31.783981 22247 raft_consensus.cc:2955] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.801935 21391 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.830367 21641 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:31.841212 22624 tablet_replica.cc:333] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:06:31.851542 22624 raft_consensus.cc:2243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.846731 21567 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.846674 22247 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.857977 22543 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.860656 22624 raft_consensus.cc:2272] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.861733 22598 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.867592 22478 raft_consensus.cc:2955] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.869185 21561 raft_consensus.cc:2955] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.880751 22624 ts_tablet_manager.cc:1916] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.886718 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 24789f7f25d44609b76928ec55894739 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.896898 22247 raft_consensus.cc:2955] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:31.897238 21391 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.913432 21482 tablet_service.cc:1558] Processing DeleteTablet for tablet 24789f7f25d44609b76928ec55894739 with delete_type TABLET_DATA_TOMBSTONED (TS 5a34fd3290de493eb6bbe828dd742772 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41276
I20260709 13:06:31.913492 22624 ts_tablet_manager.cc:1929] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.914386 22624 log.cc:1199] T ca05d89c0a6b4f8ca791df1da0bad1f1 P a87bd86b86e74aa8bb61189215b73439: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/wals/ca05d89c0a6b4f8ca791df1da0bad1f1
I20260709 13:06:31.914537 22618 tablet_replica.cc:333] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:06:31.915618 22618 raft_consensus.cc:2243] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.916198 21376 catalog_manager.cc:5028] TS a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): tablet ca05d89c0a6b4f8ca791df1da0bad1f1 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:31.916262 22618 raft_consensus.cc:2272] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.919438 22618 ts_tablet_manager.cc:1916] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.934533 22618 ts_tablet_manager.cc:1929] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:31.934908 22618 log.cc:1199] T 24789f7f25d44609b76928ec55894739 P 5a34fd3290de493eb6bbe828dd742772: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/wals/24789f7f25d44609b76928ec55894739
I20260709 13:06:31.936175 21376 catalog_manager.cc:5028] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): tablet 24789f7f25d44609b76928ec55894739 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:32.994050 21641 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:32.999440 21561 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:33.001479 21487 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:33.001789 21606 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05a0423f397042e3aed0ddbf0c111bd4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:33.001825 22543 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:33.005434 22478 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.011126 22626 raft_consensus.cc:2955] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.012862 21562 raft_consensus.cc:2955] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.014508 21487 raft_consensus.cc:2955] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.032186 21391 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.036032 21561 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.049405 21641 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:33.050837 21487 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:33.052531 21532 consensus_peers.cc:597] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e78f55a98514b6b95c6ea1b508ac13e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:33.054256 22556 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.055742 22619 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.074641 22619 raft_consensus.cc:2955] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.079371 21487 raft_consensus.cc:2955] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.077706 21635 raft_consensus.cc:2955] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.093267 21490 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.096004 21389 catalog_manager.cc:5697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:33.107035 21457 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4a9406eef59405b975ed9c99811d69a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:33.108909 21635 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:33.110625 22638 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.120427 21562 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:33.119668 22570 raft_consensus.cc:2955] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.123324 22601 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.128273 21635 raft_consensus.cc:2955] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.128986 21561 raft_consensus.cc:2955] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.137482 21490 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.138666 21390 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.168772 21641 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:33.170382 21562 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:33.171705 22561 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.173484 22638 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:33.175391 21457 consensus_peers.cc:597] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b18ad2e6f014e20be78478bc402f892. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:33.184088 22570 raft_consensus.cc:2955] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.186614 21641 raft_consensus.cc:2955] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.186594 21561 raft_consensus.cc:2955] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:33.210304 21389 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.418974 22644 ts_tablet_manager.cc:933] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:33.424671 22644 tablet_copy_client.cc:323] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.131:41367
I20260709 13:06:33.426676 21653 tablet_copy_service.cc:140] P a87bd86b86e74aa8bb61189215b73439: Received BeginTabletCopySession request for tablet 05a0423f397042e3aed0ddbf0c111bd4 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36050)
I20260709 13:06:33.427263 21653 tablet_copy_service.cc:161] P a87bd86b86e74aa8bb61189215b73439: Beginning new tablet copy session on tablet 05a0423f397042e3aed0ddbf0c111bd4 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36050: session id = 549b31ac31b6428994b45938abc223a7-05a0423f397042e3aed0ddbf0c111bd4
I20260709 13:06:33.434950 21653 tablet_copy_source_session.cc:215] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.438200 22644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a0423f397042e3aed0ddbf0c111bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.454808 22644 tablet_copy_client.cc:806] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.455458 22644 tablet_copy_client.cc:670] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.459072 22644 tablet_copy_client.cc:538] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.469973 22644 tablet_bootstrap.cc:492] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:33.513034 22644 tablet_bootstrap.cc:492] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:33.514021 22644 tablet_bootstrap.cc:492] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:33.514850 22644 ts_tablet_manager.cc:1403] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.007s
I20260709 13:06:33.517855 22644 raft_consensus.cc:359] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.518754 22644 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:33.519524 22644 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.528932 22647 ts_tablet_manager.cc:933] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:33.535416 22644 ts_tablet_manager.cc:1434] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.013s
I20260709 13:06:33.542521 21653 tablet_copy_service.cc:342] P a87bd86b86e74aa8bb61189215b73439: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-05a0423f397042e3aed0ddbf0c111bd4 received from {username='slave'} at 127.0.0.1:36050
I20260709 13:06:33.543011 21653 tablet_copy_service.cc:434] P a87bd86b86e74aa8bb61189215b73439: ending tablet copy session 549b31ac31b6428994b45938abc223a7-05a0423f397042e3aed0ddbf0c111bd4 on tablet 05a0423f397042e3aed0ddbf0c111bd4 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:33.548272 22644 ts_tablet_manager.cc:933] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:33.555721 22647 tablet_copy_client.cc:323] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:33.557614 22644 tablet_copy_client.cc:323] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.130:41371
I20260709 13:06:33.558048 21503 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet b4a9406eef59405b975ed9c99811d69a from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:33.558620 21503 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet b4a9406eef59405b975ed9c99811d69a from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-b4a9406eef59405b975ed9c99811d69a
I20260709 13:06:33.560405 21579 tablet_copy_service.cc:140] P 5727b19579474da6a12f79730b924770: Received BeginTabletCopySession request for tablet 4e78f55a98514b6b95c6ea1b508ac13e from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36572)
I20260709 13:06:33.560946 21579 tablet_copy_service.cc:161] P 5727b19579474da6a12f79730b924770: Beginning new tablet copy session on tablet 4e78f55a98514b6b95c6ea1b508ac13e from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36572: session id = 549b31ac31b6428994b45938abc223a7-4e78f55a98514b6b95c6ea1b508ac13e
I20260709 13:06:33.567262 21579 tablet_copy_source_session.cc:215] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.567495 21503 tablet_copy_source_session.cc:215] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.570614 22644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e78f55a98514b6b95c6ea1b508ac13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.579216 22647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a9406eef59405b975ed9c99811d69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.596336 22647 tablet_copy_client.cc:806] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.596961 22647 tablet_copy_client.cc:670] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.597564 22644 tablet_copy_client.cc:806] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.598122 22644 tablet_copy_client.cc:670] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.603791 22644 tablet_copy_client.cc:538] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.605225 22647 tablet_copy_client.cc:538] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.613478 22644 tablet_bootstrap.cc:492] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:33.621584 22647 tablet_bootstrap.cc:492] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:33.645202 22647 tablet_bootstrap.cc:492] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:33.646119 22647 tablet_bootstrap.cc:492] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:33.646152 22644 tablet_bootstrap.cc:492] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:33.646878 22647 ts_tablet_manager.cc:1403] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.001s
I20260709 13:06:33.647149 22644 tablet_bootstrap.cc:492] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:33.647943 22644 ts_tablet_manager.cc:1403] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.012s
I20260709 13:06:33.650905 22649 ts_tablet_manager.cc:933] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:33.650874 22644 raft_consensus.cc:359] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.651794 22644 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:33.652467 22644 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.654318 22644 ts_tablet_manager.cc:1434] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:06:33.655536 22649 tablet_copy_client.cc:323] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:33.653584 22647 raft_consensus.cc:359] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.657308 21503 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet 5b18ad2e6f014e20be78478bc402f892 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:33.657496 22647 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:33.657891 21503 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet 5b18ad2e6f014e20be78478bc402f892 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-5b18ad2e6f014e20be78478bc402f892
I20260709 13:06:33.659747 21579 tablet_copy_service.cc:342] P 5727b19579474da6a12f79730b924770: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-4e78f55a98514b6b95c6ea1b508ac13e received from {username='slave'} at 127.0.0.1:36572
I20260709 13:06:33.660212 21579 tablet_copy_service.cc:434] P 5727b19579474da6a12f79730b924770: ending tablet copy session 549b31ac31b6428994b45938abc223a7-4e78f55a98514b6b95c6ea1b508ac13e on tablet 4e78f55a98514b6b95c6ea1b508ac13e with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:33.658397 22647 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.663029 22647 ts_tablet_manager.cc:1434] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:33.665763 21503 tablet_copy_source_session.cc:215] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:33.668524 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-b4a9406eef59405b975ed9c99811d69a received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:33.668999 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-b4a9406eef59405b975ed9c99811d69a on tablet b4a9406eef59405b975ed9c99811d69a with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:33.675249 22649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b18ad2e6f014e20be78478bc402f892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.696029 22649 tablet_copy_client.cc:806] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:33.696693 22649 tablet_copy_client.cc:670] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:33.701036 22649 tablet_copy_client.cc:538] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.709236 22649 tablet_bootstrap.cc:492] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:33.727772 22649 tablet_bootstrap.cc:492] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:33.728497 22649 tablet_bootstrap.cc:492] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:33.729074 22649 ts_tablet_manager.cc:1403] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.001s
I20260709 13:06:33.731489 22649 raft_consensus.cc:359] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.732208 22649 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:33.732719 22649 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:33.734839 22649 ts_tablet_manager.cc:1434] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:33.741407 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-5b18ad2e6f014e20be78478bc402f892 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:33.741835 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-5b18ad2e6f014e20be78478bc402f892 on tablet 5b18ad2e6f014e20be78478bc402f892 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:33.965890 22245 raft_consensus.cc:1217] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:34.033722 22245 raft_consensus.cc:1217] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:34.085839 22245 raft_consensus.cc:1217] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:34.093240 22245 raft_consensus.cc:1217] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:34.381757 22638 raft_consensus.cc:1064] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:34.384591 22638 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:34.391160 22245 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.392732 21562 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.394115 22638 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.395824 22656 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.396733 21641 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.401775 22656 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.417191 22561 raft_consensus.cc:2955] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.419901 22245 raft_consensus.cc:2955] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.426709 21635 raft_consensus.cc:2955] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.429608 21562 raft_consensus.cc:2955] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.438264 21391 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.474679 21490 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:34.484328 21638 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.484926 22245 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.486451 22561 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.492599 22561 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.495302 22638 raft_consensus.cc:2955] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.497079 22247 raft_consensus.cc:2955] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.499703 21638 raft_consensus.cc:2955] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.501899 22556 raft_consensus.cc:1064] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:34.510862 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b4a9406eef59405b975ed9c99811d69a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:34.520256 22556 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:34.520119 21392 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.541934 22247 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.544315 21552 tablet_service.cc:1558] Processing DeleteTablet for tablet b4a9406eef59405b975ed9c99811d69a with delete_type TABLET_DATA_TOMBSTONED (TS 5727b19579474da6a12f79730b924770 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40984
I20260709 13:06:34.545123 22619 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.549863 21635 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.551239 21490 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.552228 22619 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.556951 22556 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.562302 22570 raft_consensus.cc:1064] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:34.564787 22570 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:34.572470 22669 tablet_replica.cc:333] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:06:34.576646 22669 raft_consensus.cc:2243] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:34.577509 22669 raft_consensus.cc:2272] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:34.578998 21567 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.581298 22247 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.583592 21638 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.591454 22656 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.597783 22669 ts_tablet_manager.cc:1916] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:34.616616 22570 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.587977 22619 raft_consensus.cc:2955] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.618360 22656 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.618091 21638 raft_consensus.cc:2955] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.623353 21487 raft_consensus.cc:2955] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.632656 22657 raft_consensus.cc:1064] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:34.632899 22245 raft_consensus.cc:2955] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.635458 22657 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:34.658656 21390 catalog_manager.cc:5697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.670680 22669 ts_tablet_manager.cc:1929] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:34.681931 22669 log.cc:1199] T b4a9406eef59405b975ed9c99811d69a P 5727b19579474da6a12f79730b924770: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/wals/b4a9406eef59405b975ed9c99811d69a
I20260709 13:06:34.686065 21378 catalog_manager.cc:5028] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): tablet b4a9406eef59405b975ed9c99811d69a (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:34.689270 22674 raft_consensus.cc:2955] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.710554 21562 raft_consensus.cc:2955] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.715548 22247 raft_consensus.cc:2955] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.715417 21635 raft_consensus.cc:2955] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.707902 21567 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:34.742455 22245 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.743669 21635 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.726614 21390 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.744532 22676 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.746955 22678 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:34.748526 22247 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.749877 22543 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.760998 22556 raft_consensus.cc:2955] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.768392 21638 raft_consensus.cc:2955] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.770669 21562 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.775275 22657 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.779975 21378 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4e78f55a98514b6b95c6ea1b508ac13e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:34.786948 21487 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:34.791632 22247 raft_consensus.cc:2955] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.815034 22543 raft_consensus.cc:2955] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.819351 22658 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.805738 21389 catalog_manager.cc:5697] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 3 to 4, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 1 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.822364 21561 raft_consensus.cc:2955] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.822939 21490 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:34.827441 22245 raft_consensus.cc:2955] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.829309 21567 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.830987 22674 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.838584 22244 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:34.843068 22674 raft_consensus.cc:2955] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.857182 21391 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.863955 21482 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e78f55a98514b6b95c6ea1b508ac13e with delete_type TABLET_DATA_TOMBSTONED (TS 5a34fd3290de493eb6bbe828dd742772 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41276
I20260709 13:06:34.864061 22570 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:34.846563 21561 raft_consensus.cc:2955] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.888350 21388 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.893913 22247 raft_consensus.cc:2955] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.898983 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b18ad2e6f014e20be78478bc402f892 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:34.908838 21632 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b18ad2e6f014e20be78478bc402f892 with delete_type TABLET_DATA_TOMBSTONED (TS a87bd86b86e74aa8bb61189215b73439 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58370
I20260709 13:06:34.912957 22685 tablet_replica.cc:333] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:06:34.914145 22685 raft_consensus.cc:2243] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:34.914948 22685 raft_consensus.cc:2272] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:34.919881 22685 ts_tablet_manager.cc:1916] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:34.907891 21488 raft_consensus.cc:2955] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:34.942955 22686 tablet_replica.cc:333] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:06:34.948908 22686 raft_consensus.cc:2243] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:34.949780 22686 raft_consensus.cc:2272] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:34.954739 22686 ts_tablet_manager.cc:1916] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:34.975538 22686 ts_tablet_manager.cc:1929] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:34.975997 22686 log.cc:1199] T 5b18ad2e6f014e20be78478bc402f892 P a87bd86b86e74aa8bb61189215b73439: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/wals/5b18ad2e6f014e20be78478bc402f892
I20260709 13:06:34.977519 21376 catalog_manager.cc:5028] TS a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): tablet 5b18ad2e6f014e20be78478bc402f892 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:34.980572 22685 ts_tablet_manager.cc:1929] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:34.981040 22685 log.cc:1199] T 4e78f55a98514b6b95c6ea1b508ac13e P 5a34fd3290de493eb6bbe828dd742772: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/wals/4e78f55a98514b6b95c6ea1b508ac13e
I20260709 13:06:34.982828 21376 catalog_manager.cc:5028] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): tablet 4e78f55a98514b6b95c6ea1b508ac13e (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:35.349629 21635 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.354446 21488 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:35.354736 22247 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:35.355665 22543 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.356822 22657 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.363523 22657 raft_consensus.cc:2955] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:35.376806 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:35.377837 22247 raft_consensus.cc:2955] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:35.402812 21490 raft_consensus.cc:2955] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:06:35.420763 21391 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 3 to 4, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:06:35.456138 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 69448.1us
I20260709 13:06:35.457144 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05a0423f397042e3aed0ddbf0c111bd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:35.467279 21552 tablet_service.cc:1558] Processing DeleteTablet for tablet 05a0423f397042e3aed0ddbf0c111bd4 with delete_type TABLET_DATA_TOMBSTONED (TS 5727b19579474da6a12f79730b924770 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40984
I20260709 13:06:35.469439 22692 tablet_replica.cc:333] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:06:35.470235 22692 raft_consensus.cc:2243] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.470995 22692 raft_consensus.cc:2272] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.474625 22692 ts_tablet_manager.cc:1916] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:35.494155 22692 ts_tablet_manager.cc:1929] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:35.494684 22692 log.cc:1199] T 05a0423f397042e3aed0ddbf0c111bd4 P 5727b19579474da6a12f79730b924770: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/wals/05a0423f397042e3aed0ddbf0c111bd4
I20260709 13:06:35.496654 21378 catalog_manager.cc:5028] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): tablet 05a0423f397042e3aed0ddbf0c111bd4 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:06:35.519675 21490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:35.520390 21490 raft_consensus.cc:606] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:06:35.523624 21490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:35.524099 21490 raft_consensus.cc:606] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:06:35.535611 21635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:52666
I20260709 13:06:35.536113 21635 raft_consensus.cc:606] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:06:35.538483 21490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:35.538985 21490 raft_consensus.cc:606] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:06:35.541281 21490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:35.541767 21490 raft_consensus.cc:606] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:06:35.544426 21488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:35.544989 21488 raft_consensus.cc:606] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:06:35.546135 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:35.547271 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:35.591842 22570 raft_consensus.cc:993] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 549b31ac31b6428994b45938abc223a7 to start an election
I20260709 13:06:35.592358 22570 raft_consensus.cc:1081] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Signalling peer 549b31ac31b6428994b45938abc223a7 to start an election
I20260709 13:06:35.596521 22247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60044
I20260709 13:06:35.597229 22247 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.597676 22247 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.603259 22247 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.605014 22247 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:35.605897 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:35.606207 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:35.606617 21488 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.606696 21635 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.607007 21488 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:35.607754 21488 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.608933 21488 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.613279 21635 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:35.614734 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:35.615535 22648 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.616679 22648 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:35.616693 21488 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:35.617619 22648 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.627178 21391 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 2 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.678035 22570 raft_consensus.cc:993] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 549b31ac31b6428994b45938abc223a7 to start an election
I20260709 13:06:35.678521 22656 raft_consensus.cc:1081] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Signalling peer 549b31ac31b6428994b45938abc223a7 to start an election
I20260709 13:06:35.679905 22247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60044
I20260709 13:06:35.680347 22247 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.680641 22247 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.686401 22247 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.689323 22247 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:35.689378 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:35.690138 21488 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.690465 21488 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:35.690466 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:35.691246 21567 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.691502 21488 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.692606 21488 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.697360 21488 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:35.698546 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:35.698544 21567 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:35.699534 22648 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.700068 22648 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:35.700856 22648 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.708478 21391 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 2 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.766687 22570 raft_consensus.cc:993] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:06:35.767200 22656 raft_consensus.cc:1081] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:06:35.768726 21567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:40994
I20260709 13:06:35.769222 21567 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.769603 21567 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.774462 21567 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:35.775856 21567 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:35.776674 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:35.776984 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:35.777274 21490 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.777513 21635 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.777608 21490 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:35.778568 21490 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:35.779740 21490 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.784006 21635 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:35.785140 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:35.785941 22556 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.786230 21490 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:35.786365 22556 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:35.787233 22556 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:35.796969 21391 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.857431 22656 raft_consensus.cc:993] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 549b31ac31b6428994b45938abc223a7 to start an election
I20260709 13:06:35.857903 22570 raft_consensus.cc:1081] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Signalling peer 549b31ac31b6428994b45938abc223a7 to start an election
I20260709 13:06:35.859299 22247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60044
I20260709 13:06:35.859737 22247 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.860098 22247 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.865746 22247 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.867576 22247 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:35.869037 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:35.869019 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:35.869768 21567 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.869840 21490 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.870321 21490 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:35.871140 21490 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.872316 21490 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.876955 21567 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:35.878720 21490 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:35.879578 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:35.880512 22648 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.880990 22648 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:35.881822 22648 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.884953 22674 raft_consensus.cc:993] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 549b31ac31b6428994b45938abc223a7 to start an election
I20260709 13:06:35.885556 22638 raft_consensus.cc:1081] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Signalling peer 549b31ac31b6428994b45938abc223a7 to start an election
I20260709 13:06:35.887217 22247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60044
I20260709 13:06:35.887751 22247 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.888139 22247 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.894101 22247 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.897172 22247 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:35.898579 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:35.899197 21490 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.899482 21490 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:35.899948 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:35.900171 21490 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.900592 21567 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.901362 21490 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.901222 21391 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 2 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.907238 21490 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:35.908349 22210 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:35.909080 21567 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:35.909353 22648 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.909950 22648 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:35.910825 22648 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:35.917768 22688 raft_consensus.cc:993] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:06:35.918381 22658 raft_consensus.cc:1081] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:06:35.919901 21567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:41010
I20260709 13:06:35.920359 21567 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.920660 21567 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.923709 21391 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 2 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.926242 21567 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:35.928361 21567 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:35.933404 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:35.934059 21635 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.934342 21635 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:35.935113 21635 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:35.936342 21635 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.936306 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:35.937074 21488 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.943046 21635 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:35.944350 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:35.944370 21488 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:35.945248 22678 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.946132 22678 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:35.946974 22678 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:35.955936 21391 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.062419 21635 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:36.063791 22648 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.079324 21488 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:36.080613 22696 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.099596 21490 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:36.101886 22648 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.112002 21567 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:36.114089 22648 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.253031 21638 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:36.254180 22556 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.266834 21487 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:36.269176 22715 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.273198 21567 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:36.275056 22648 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.284560 21490 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:36.286275 22648 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:36.355983 21487 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:36.358704 22648 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.368059 21562 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:36.370097 22706 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.373317 21638 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:36.376929 22556 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.392913 21487 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:36.396446 22714 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.531684 21487 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:36.538594 21638 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:36.538765 21567 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:36.540215 22674 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:36.539733 21457 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eae01b9fdd5340dc9416e5834263a4d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.541517 22570 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.548180 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:36.550185 22638 raft_consensus.cc:2955] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:36.552187 21635 raft_consensus.cc:2955] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:36.557649 21567 raft_consensus.cc:2955] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:36.563915 21562 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:36.583215 21389 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:36.591984 21532 consensus_peers.cc:597] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 377467a782f94dd2b6e76b88920dfb8b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.594511 21487 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:36.595742 21635 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:36.598266 22714 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:36.599378 22556 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:36.610841 22556 raft_consensus.cc:2955] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:36.612159 21490 raft_consensus.cc:2955] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:36.624402 21635 raft_consensus.cc:2955] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:37.670352 22730 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:37.671312 22730 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:37.674356 22730 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:37.820562 22730 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:37.821767 22656 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:37.822548 22656 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:37.825103 22656 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:37.821437 22730 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:37.828402 22730 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.051157 22731 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.051919 22731 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.052959 22674 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:38.053606 22674 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.054431 22731 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.182005 22731 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.201074 22735 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.202076 22735 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.204921 22735 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.056129 22674 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.111593 22730 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.581080 22730 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.583370 22656 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.583925 22730 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.182917 22731 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:38.229630 22739 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.230602 22740 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.233763 22736 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.230737 22733 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.223150 22734 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.230930 22735 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.330317 22729 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.325911 22742 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.349726 22747 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.350515 22732 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.352900 22738 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.356792 22749 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.370574 22748 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.379031 22743 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.379205 22751 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.379298 22756 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.383692 22754 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.380267 22746 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.382290 22745 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.447809 22758 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.448573 22750 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.519690 22737 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.520256 22741 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.520845 22755 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:38.449908 22753 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.517192 22744 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.536667 22760 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.554037 22764 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.556212 22759 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.554498 22766 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.555076 22757 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.555116 22762 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.557040 22763 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.554363 22765 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.557595 22752 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.584216 22656 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.599048 22747 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.599483 22757 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.601279 22747 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.598524 22765 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.601775 22757 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:38.601961 22755 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.602449 22759 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.603796 22765 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.604595 22759 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.605279 22759 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.604875 22733 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.605198 22750 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.605792 22759 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.606984 22737 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.607154 22751 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.607842 22733 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.609169 22751 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.609529 22729 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.609357 22736 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.610687 22763 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.611860 22729 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.612510 22741 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.612967 22763 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.609386 22743 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.613677 22760 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.614982 22744 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.609855 22762 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.615870 22743 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:38.619196 22748 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.604667 22755 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.619014 22764 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.615963 22760 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.621791 22735 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.614694 22741 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.609191 22737 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.617390 22744 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.637038 22750 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.627072 22754 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.631881 22752 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.644469 22744 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.598683 22749 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.606995 22746 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.598524 22738 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.630049 22753 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.623805 22740 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.657765 22754 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.627097 22766 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.627223 22758 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.622310 22742 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.622154 22745 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.633766 22756 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.619027 22739 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.647872 22762 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.677882 22742 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.682997 22766 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.687685 22758 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.691493 22746 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.675863 22762 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.671762 22739 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.673640 22753 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.654317 22744 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.695374 22764 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.684342 22752 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.701196 22740 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:38.175678 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1243) took 1298 ms. Trace:
W20260709 13:06:38.334992 21533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.006s	sys 0.002s
I20260709 13:06:38.706489 22745 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:38.690282 22748 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.703688 22749 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.704612 22756 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.863642 22745 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.707279 22759 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.608577 22733 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.763827 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.869633 22745 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.869696 21490 rpcz_store.cc:276] 0709 13:06:36.876804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.174757 (+1297953us) service_pool.cc:224] Handling call
0709 13:06:38.175149 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.175341 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.175364 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.175414 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:38.175444 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.175498 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.175617 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:38.871049 21493 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:38.871224 22733 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:38.780531 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.872218 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.873101 22745 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.874234 22733 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:38.620559 22734 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.785422 22752 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.785604 22754 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.788841 22741 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.789738 22760 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.790691 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.790923 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.791054 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.791764 22742 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.792956 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.793215 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.793705 22737 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:38.794327 22750 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.811290 22738 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:38.812070 22758 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.622267 22732 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.838406 22766 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.840298 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.841204 22739 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.780498 22777 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.811304 22736 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.620234 22656 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.699975 22762 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.901002 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:38.902052 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:38.902175 22758 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.902755 22243 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:38.837424 22753 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.861292 22771 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:38.862491 21533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.400s	user 0.006s	sys 0.002s
I20260709 13:06:38.863552 22731 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.867091 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:38.878719 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.882979 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.883682 22742 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.893378 22734 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:38.896624 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.893824 22737 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.904006 21487 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:38.915162 22768 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.899608 22760 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.910847 21562 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:38.910640 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:38.917726 21488 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:38.917889 22744 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.891778 22741 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.914060 21491 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:38.920543 21388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 229) took 2327 ms. Trace:
I20260709 13:06:38.917661 22768 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.915683 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:38.926366 22749 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.928176 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:38.882999 22752 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.892123 22754 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.933881 22767 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.931419 21569 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:38.923768 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:38.945070 22758 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.921890 21388 rpcz_store.cc:276] 0709 13:06:36.593449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.594884 (+  1435us) service_pool.cc:224] Handling call
0709 13:06:38.920359 (+2325475us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:06:38.939052 22776 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.935735 22748 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.939478 22762 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:38.929814 22760 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.940151 21391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 131) took 2281 ms. Trace:
I20260709 13:06:38.943151 22656 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:38.944836 21492 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:38.958504 22755 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:38.922245 22753 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.964998 22773 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.965178 22748 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.930052 22766 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.963253 22735 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.988816 22738 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:38.945761 22774 ts_tablet_manager.cc:933] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:38.918421 22771 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:38.963681 21391 rpcz_store.cc:276] 0709 13:06:36.624982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.625128 (+   146us) service_pool.cc:224] Handling call
0709 13:06:38.892633 (+2267505us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4c090 00007f98a9feaf3a 00007f98afda11cc 00007f98afe9f37e 00007f98ae3602a4 00007f98ae360232 00007f98ae360161 00007f98ae3600dc 00007f98ae35f392 00007f98a831d48c 00007f98a831c8c6
0709 13:06:38.906747 (+ 14114us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0,"spinlock_wait_cycles":3364125056}
I20260709 13:06:38.983283 22656 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.983481 22778 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:38.984468 22734 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:39.009171 22764 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.010141 22764 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.928598 22749 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.959631 22776 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.926693 22739 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:38.989897 22744 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:39.020663 22773 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.027256 22656 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:38.936476 22750 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.027720 21489 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.030607 22755 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.031442 22732 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.033180 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.034343 22246 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.025202 22762 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.035871 22762 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.037045 22772 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:39.036420 22739 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.027777 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.046103 22754 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:38.938508 22777 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.047489 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.028957 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.012226 22767 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.033257 22755 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.037787 22772 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.059803 21493 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.054710 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.067763 22765 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:39.068434 22734 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:39.058387 22656 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.073887 22776 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.071482 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.080402 22752 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.097527 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.099818 22741 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.099993 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.100304 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.100488 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.062558 22762 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.040416 22738 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.044852 22744 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.111667 22779 ts_tablet_manager.cc:933] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.078945 22743 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.112252 21565 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:39.119225 22656 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.048154 22778 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.119854 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:39.124270 21664 debug-util.cc:398] Leaking SignalData structure 0x7b080009ea60 after lost signal to thread 20385
I20260709 13:06:39.120414 22246 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.119779 22768 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.141474 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.105298 22736 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.141920 22738 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.150457 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.116056 22742 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.158838 21568 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:39.137904 22766 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.159219 22753 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.125663 22767 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.166090 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.141968 22772 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.175029 21487 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:39.160555 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.163434 22764 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.281620 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.171288 22748 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.206924 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.287284 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.293074 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.285768 22771 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.206679 22656 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.295009 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.209075 22775 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.284677 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.287145 21492 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:39.208106 22770 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:39.290506 22772 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:39.171881 22743 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.211249 22765 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.304034 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.303452 22738 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:39.304870 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55906us
I20260709 13:06:39.305132 22750 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.305444 22738 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.305794 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:39.306214 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:39.306633 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.307878 22738 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.308498 22777 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.309731 22778 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.305636 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.297387 22749 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.318097 22772 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.304893 22757 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.316654 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.319046 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.319231 22757 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.300714 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.320442 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.321460 22757 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.321689 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.321776 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.321862 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.231891 22736 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.330319 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.330435 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.331115 21491 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.326957 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.331341 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.331972 21569 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:39.331940 22736 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.331930 21568 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:39.334312 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.334926 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:39.327867 22781 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.335923 21568 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:39.335832 22781 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.336987 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.337750 21568 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:39.337926 21390 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 223) took 2730 ms. Trace:
I20260709 13:06:39.327870 22745 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.338267 21390 rpcz_store.cc:276] 0709 13:06:36.607040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.607193 (+   153us) service_pool.cc:224] Handling call
0709 13:06:39.337736 (+2730543us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23124,"reported_tablets":1}
I20260709 13:06:39.338856 22745 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.339455 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.339962 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.340740 21564 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:39.341322 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 359) took 1009 ms. Trace:
I20260709 13:06:39.341677 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.341728 22247 rpcz_store.cc:276] 0709 13:06:38.331635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.333705 (+  2070us) service_pool.cc:224] Handling call
0709 13:06:38.334033 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.866321 (+532288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.866385 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.866441 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:38.866535 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.340909 (+474374us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54006dc754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:39.340957 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.341131 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987872128}
I20260709 13:06:39.339479 22745 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.328100 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.329394 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.329587 22740 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.346534 22740 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.346691 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.347020 22740 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.347549 22241 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:39.347735 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.304867 22734 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.348456 21562 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:39.350111 22738 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.338758 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.350332 22736 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.356849 22736 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.357438 22736 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.352144 22770 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.360443 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.342476 21564 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:39.350145 21488 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.364341 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.353693 22738 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.365602 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.365742 22780 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.372576 22780 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.373376 22734 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.374020 22734 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.366448 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.374996 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.375553 21487 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.384862 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:39.385780 22749 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.386345 22749 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.386746 22749 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.387122 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.387682 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.389801 22782 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.389827 22743 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.390620 22782 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.392323 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.391319 22743 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:39.393703 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.388919 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.405824 21487 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.395372 22746 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.395921 22782 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.396394 22738 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.396329 22775 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.397743 22779 tablet_copy_client.cc:323] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.130:41371
I20260709 13:06:39.398423 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.422415 22241 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.399866 22212 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:39.424110 22762 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.424511 22762 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.424978 22762 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:39.400581 21664 debug-util.cc:398] Leaking SignalData structure 0x7b0800120900 after lost signal to thread 21426
I20260709 13:06:39.400779 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.400872 22778 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.431473 22765 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.432106 22765 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:39.431785 22778 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.432729 22765 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.401372 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:39.396415 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 67330.2us
I20260709 13:06:39.402220 22757 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:39.408033 22743 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.408172 22746 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.413034 22781 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.416666 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.418308 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.420243 22738 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:39.420660 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.420962 22782 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.421813 22775 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.399996 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.427778 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.435832 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:39.443617 22774 tablet_copy_client.cc:323] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:06:39.445631 21488 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.444100 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:39.443806 22782 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.438632 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:39.444689 21664 debug-util.cc:398] Leaking SignalData structure 0x7b0800322e80 after lost signal to thread 21518
I20260709 13:06:39.440140 22778 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.443622 22738 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.464331 22743 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.464793 22738 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.465728 22782 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.441308 22765 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.471876 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.470038 22749 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.472810 22771 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.473397 22771 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.473908 22771 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.425144 21635 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:39.478891 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:06:39.481216 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56438.1us
I20260709 13:06:39.469998 21390 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index -1 to 3, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:39.440968 22757 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.482707 22766 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.486460 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:39.503217 22737 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.503865 22744 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.505395 22744 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.506120 22782 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.506716 22782 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.507400 22780 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.508152 21579 tablet_copy_service.cc:140] P 5727b19579474da6a12f79730b924770: Received BeginTabletCopySession request for tablet 377467a782f94dd2b6e76b88920dfb8b from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36572)
I20260709 13:06:39.508919 21579 tablet_copy_service.cc:161] P 5727b19579474da6a12f79730b924770: Beginning new tablet copy session on tablet 377467a782f94dd2b6e76b88920dfb8b from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36572: session id = 549b31ac31b6428994b45938abc223a7-377467a782f94dd2b6e76b88920dfb8b
I20260709 13:06:39.509248 22782 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.486295 22777 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.510553 22772 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.510972 22777 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.511399 22777 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.496150 22766 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.512128 22766 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.513492 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.518137 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:39.495620 22773 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.524107 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:06:39.525828 21457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.131:41367 timed out after 1.586s (SENT) [suppressed 2 similar messages]
I20260709 13:06:39.529111 22750 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.529405 21579 tablet_copy_source_session.cc:215] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:39.529770 22750 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.531466 22746 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.487569 22743 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:39.531454 21664 debug-util.cc:398] Leaking SignalData structure 0x7b0800345540 after lost signal to thread 21593
I20260709 13:06:39.539234 22734 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.540715 22757 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.534578 22750 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.522715 22770 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.536106 22732 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.553098 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:06:39.556330 21664 debug-util.cc:398] Leaking SignalData structure 0x7b080031a780 after lost signal to thread 21667
W20260709 13:06:39.560675 21664 debug-util.cc:398] Leaking SignalData structure 0x7b08002753c0 after lost signal to thread 22277
I20260709 13:06:39.559142 22732 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.570990 22748 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.576913 22736 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.580438 22762 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.582927 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:39.583848 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:39.584265 22749 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.584812 22777 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.584002 22779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377467a782f94dd2b6e76b88920dfb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.590251 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:39.575513 22732 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.592339 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:39.582648 22748 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.607326 22748 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.595367 22776 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.597323 22769 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.610368 22769 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.610823 22769 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.605816 22766 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.593729 22656 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.586771 22743 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.587016 22762 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.609964 22776 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.612680 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:39.618968 22656 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.625167 22776 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.625228 22656 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.625700 22743 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.632093 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:39.588904 22740 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.613425 22750 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.639078 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:39.644173 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.636158 22753 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.636900 22736 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.645927 22753 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.646322 22753 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.646687 22753 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.654650 22748 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.668987 22745 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.691690 22748 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.699973 22740 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.676627 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.705628 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:39.709760 22777 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.716167 22771 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.717737 22245 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.720023 22750 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.728180 22776 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.706727 22745 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.733426 22245 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.734769 22769 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.739917 22766 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.742193 22771 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.744195 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.730990 22776 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.748733 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.749822 22247 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.751111 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.760059 22753 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.763161 22753 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.764570 22656 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.767180 22656 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.776692 22732 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.784158 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.801580 22769 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.799762 22732 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:06:39.811163 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 237465us
W20260709 13:06:39.820948 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 146480us
I20260709 13:06:39.821736 21459 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:39.823621 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:39.823805 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:39.824465 22795 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.824884 22795 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.825256 22795 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.825670 22777 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.826093 22777 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.826495 22777 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.828292 22769 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.830329 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:39.829089 22769 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:39.832049 22769 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.830078 22746 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:39.833705 22746 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:39.836191 22746 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:39.838090 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:39.847247 22753 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:39.845846 22777 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.847911 22753 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.850234 22753 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.856027 22777 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.860859 22779 tablet_copy_client.cc:806] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:39.862752 22779 tablet_copy_client.cc:670] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:39.867235 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:39.873715 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:39.874161 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:39.873474 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:39.876667 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 358217us
I20260709 13:06:39.877645 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.873209 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:39.872810 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 346140us
I20260709 13:06:39.881858 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.884168 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.884536 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:39.885217 22750 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:39.885890 22750 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.889664 22750 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:39.891911 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:39.892370 21489 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.892747 22797 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:06:39.896023 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.898221 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.897775 22797 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.895538 22777 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.900084 21503 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet eae01b9fdd5340dc9416e5834263a4d6 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:06:39.900666 21503 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet eae01b9fdd5340dc9416e5834263a4d6 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-eae01b9fdd5340dc9416e5834263a4d6
I20260709 13:06:39.900723 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.901847 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:39.902426 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:39.903182 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:39.904071 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 75015.9us
I20260709 13:06:39.905622 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.906037 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.907070 22769 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.907516 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.908039 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:39.908143 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:39.910336 21491 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.910475 21487 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:39.912814 22795 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:39.913940 21488 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.908895 21486 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.916447 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.917124 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.917709 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.918368 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.921900 21503 tablet_copy_source_session.cc:215] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:39.916451 22795 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.894979 22779 tablet_copy_client.cc:538] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:39.923269 22797 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.923430 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:39.924834 22746 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:39.926132 22796 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:39.926227 21491 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:39.926570 22796 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:39.927136 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.927847 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:39.934945 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:39.936430 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:39.938678 22762 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.938862 22777 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.962548 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:39.962590 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.963917 22788 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.964131 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.964389 22796 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.966331 22796 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.968782 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.972484 22769 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:39.978420 22779 tablet_bootstrap.cc:492] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:39.937453 22757 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:39.979957 22757 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:39.980365 22757 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:39.981314 22757 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:39.986093 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:39.987361 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:39.988361 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:39.988986 21639 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:39.996491 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:39.996546 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.996831 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:39.982551 22757 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.000347 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.000844 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.003723 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.006064 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.007839 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.010190 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:40.010995 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48511us
I20260709 13:06:40.012130 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.013242 22732 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.015616 22732 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.016239 22732 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.019412 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.019836 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.020390 21637 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.021601 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.023309 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.008656 22777 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.029207 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.030815 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.030449 22785 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:40.033520 22785 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.034041 22785 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.035622 22785 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.037653 22785 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.040578 22777 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.041894 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.042061 22777 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.042874 21639 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.042981 22777 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.045426 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.050355 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.051437 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:06:40.054589 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 72832.3us
W20260709 13:06:40.056411 21606 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22b45f3e8b8e428ea4709e7e9ee43868. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.057561 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.057880 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:40.058008 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.059495 22768 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.060274 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:40.060813 22768 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.059190 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.061244 22768 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.053839 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.063169 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.058562 22788 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.061386 22774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae01b9fdd5340dc9416e5834263a4d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.066681 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.067368 21639 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.067947 22748 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.071456 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.072353 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.070279 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.070941 22748 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.075655 22748 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.076663 22767 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.077574 22767 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.078011 22767 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.081441 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.082477 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.082942 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.071331 22788 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:40.084663 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.085332 21636 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.087702 22737 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.088157 22737 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.088188 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.088665 22737 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.088912 21636 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.089617 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.090551 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.090991 22755 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.091410 22755 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.091621 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.091796 22755 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.091869 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.092814 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.093571 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.094980 22749 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.095214 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.095731 22749 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.096153 22749 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.096664 22749 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.097447 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.098387 21635 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.098829 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.099440 21637 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.099660 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.095983 22771 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.100513 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.101246 22771 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.102459 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.103441 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.103894 21642 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.104398 22742 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.095940 22745 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.104660 22742 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.105034 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.105114 22742 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.105123 22745 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.098644 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.107851 22771 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.090154 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.109156 21636 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.108282 21643 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.110208 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.116267 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.120867 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.121978 22740 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.129277 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.129603 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.138644 21641 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:40.137787 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.141846 21636 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.119789 22745 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:40.132401 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.151486 21643 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:40.156440 22742 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.132825 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:40.162499 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 69730.8us
I20260709 13:06:40.146955 21493 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:40.167150 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:40.168466 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.169402 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.171113 22749 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.180099 22737 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.180625 21640 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:40.192317 22742 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.193017 22742 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.193410 22742 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.193753 22742 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.198817 21493 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.179219 22768 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.201442 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:40.211304 22240 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:40.212208 22737 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.191031 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.205026 22785 consensus_queue.cc:1059] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.214661 22785 raft_consensus.cc:3055] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.215075 22785 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.215991 22785 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.217365 22785 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.206338 22245 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.219017 22755 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.195977 22749 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.208792 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:40.221172 22755 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.221400 21639 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.195250 22748 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.167016 22788 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.223577 22748 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.209729 22793 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.229104 22777 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.214313 21643 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:40.232281 22777 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.228106 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:40.233932 22732 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.236337 22732 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.239214 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.243307 22768 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:40.244167 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 74825.7us
I20260709 13:06:40.245141 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.247085 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.258860 22757 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.259011 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:40.259719 22777 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.260147 22777 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:40.260536 22777 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.260695 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.262988 22746 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.263322 22770 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.263774 22770 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.264207 22770 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.267249 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:40.270990 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.273691 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:40.275593 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:40.278415 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.279203 21487 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.279944 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.280064 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.280850 21493 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.283505 22746 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.283859 21388 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 2 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:40.285600 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.285177 22746 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.285651 22738 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:40.289345 22738 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.289702 22738 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.290845 22798 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:40.291361 22798 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.293370 22241 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.293692 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.294380 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.294523 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:40.294480 21493 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.295331 22247 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:40.298233 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.290599 22738 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.298156 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.299870 22738 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.293413 22798 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.303369 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.303480 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.304011 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.300972 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.304240 21643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:52666
I20260709 13:06:40.304935 21643 raft_consensus.cc:606] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:06:40.305282 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.305562 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.241720 22767 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.305691 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.305049 21493 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.306464 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.302577 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.307986 22767 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.308323 22757 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.308722 22757 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.309237 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.309541 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.310328 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.276906 22742 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.311195 21491 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.311218 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.312211 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.312740 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.313915 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.314400 22801 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:40.312753 22742 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.314945 22801 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.317184 22801 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.317097 22770 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.318137 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.318234 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.318455 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:40.319227 22769 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:40.319813 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.320318 22769 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.320233 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.320511 21643 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:40.320977 21639 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:40.321112 22769 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.321494 22769 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:40.322237 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.322556 22769 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.322958 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.322556 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.323982 22769 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.324287 21643 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:40.324677 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.325989 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.326138 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.309592 22757 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.327534 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.328213 22757 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.328509 22743 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.328685 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:06:40.329663 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44149.3us
I20260709 13:06:40.330374 22801 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.330543 22743 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.330736 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.330391 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.331121 21491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:40.331884 21491 raft_consensus.cc:606] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:06:40.332283 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.332469 22743 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.333158 22743 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.334406 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.335002 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.335189 22790 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.335585 21642 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:40.335775 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.336468 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.336599 22790 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.337684 22790 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.343640 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.344039 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.344292 21639 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:40.341883 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.342705 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.338646 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.343673 21561 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:40.344358 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.347347 22790 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.350518 21569 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.351925 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.353019 21640 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:40.353245 22777 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.354315 21641 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:40.354939 22801 consensus_queue.cc:1059] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:40.354887 21636 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:40.356092 22801 raft_consensus.cc:3055] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.356460 22801 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:40.357597 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.357282 22801 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.358693 21562 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.358877 21561 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.359634 22801 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.360498 21562 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.360809 21561 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.361100 22785 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.358662 21569 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:40.357884 21564 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.362579 22796 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.364501 22796 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.365547 22790 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.365885 22790 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.366712 22790 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.368278 22790 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.367272 21641 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.370520 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:40.373647 22796 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.379582 21491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:40.380318 21491 raft_consensus.cc:606] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:06:40.381515 22798 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:40.382104 22798 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.413102 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.414305 22757 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.418349 21490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:40.420637 22798 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:40.423485 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.424813 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.426509 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.427670 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.428145 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.425532 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:40.429661 22770 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:40.430071 22757 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.430397 22770 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.432155 21486 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.433537 22777 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.435660 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:40.437999 22774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60044 (request call id 363) took 2093 ms. Trace:
I20260709 13:06:40.438459 22774 rpcz_store.cc:276] 0709 13:06:38.344870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.563146 (+218276us) service_pool.cc:224] Handling call
0709 13:06:39.019219 (+456073us) ts_tablet_manager.cc:934] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
0709 13:06:39.396663 (+377444us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7f98a6fbe768. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6f18d91 00007f98a6ef3c44 00007f98a6ef1bb4 00007f98aef56131 00007f98aef5cac8 00007f98aeff51df 00007f98af026f4e 00007f98af00bfdd 00007f98af00bf89 00007f98af00bf19
0709 13:06:40.060110 (+663447us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:40.276382 (+216272us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:40.279477 (+  3095us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:40.382203 (+102726us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:40.382488 (+   285us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:40.409005 (+ 26517us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:40.437849 (+ 28844us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":4291,"spinlock_wait_cycles":3593088,"tablet-copy.queue_time_us":331759,"thread_start_us":338663,"threads_started":2}
I20260709 13:06:40.440120 22798 raft_consensus.cc:993] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:06:40.441767 22774 tablet_copy_client.cc:806] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:40.445868 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.447790 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.450119 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:40.450920 22795 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.452507 22795 raft_consensus.cc:1081] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:06:40.453163 22774 tablet_copy_client.cc:670] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:40.455299 22807 ts_tablet_manager.cc:933] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.455968 21564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:40994
I20260709 13:06:40.456610 21564 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.456964 21564 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.467985 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.465873 22796 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.471091 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.472031 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.472388 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.472767 21493 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.468621 22770 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.470289 22743 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.480098 22743 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.475040 22746 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.488240 22774 tablet_copy_client.cc:538] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:40.494274 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.499279 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.501045 22785 raft_consensus.cc:993] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: : Instructing follower 549b31ac31b6428994b45938abc223a7 to start an election
I20260709 13:06:40.501562 22785 raft_consensus.cc:1081] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Signalling peer 549b31ac31b6428994b45938abc223a7 to start an election
I20260709 13:06:40.503926 21569 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.505206 22241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:45634
W20260709 13:06:40.506758 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.506641 22241 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.507170 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.507565 22241 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.511555 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.511596 21564 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.512336 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.512867 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.513044 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.514022 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.514358 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.514660 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.514976 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.518873 21635 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:40.527258 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.517742 21639 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:40.515957 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.539520 21490 raft_consensus.cc:606] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:06:40.539987 21490 raft_consensus.cc:614] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:40.540020 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 67708us
I20260709 13:06:40.541024 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.542695 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.545099 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.542919 22757 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.546320 21564 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.549027 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.549830 22757 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.550182 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.550494 22774 tablet_bootstrap.cc:492] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:40.550982 22757 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.552755 22795 raft_consensus.cc:993] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:06:40.553328 22750 raft_consensus.cc:1081] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:06:40.552868 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.554800 22757 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.555284 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.556057 22757 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.556464 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:40.557245 22757 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.557094 22241 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.557972 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.558054 22757 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.558987 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.559140 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.559450 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.560338 22785 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.560678 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.561406 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.561570 22241 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.561718 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:40.561791 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.562641 21564 raft_consensus.cc:2393] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 2: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:40.564265 22770 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.564649 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.565227 21486 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.565518 21486 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:40.565697 22770 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.560158 22746 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:40.566121 22770 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.566725 22746 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.545195 22809 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.567117 22746 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.567068 22770 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.567703 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.568313 21638 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:40.568416 22770 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.568136 22746 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.569509 22746 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.569478 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.570766 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.571132 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.560235 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.571905 21643 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:40.573877 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.561450 21640 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:40.574388 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.575033 21564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:40994
I20260709 13:06:40.566335 21486 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.575407 22785 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.575630 21564 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.575996 21486 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.576112 21564 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.576395 22809 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.576751 22809 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.578071 21490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:40.578645 21490 raft_consensus.cc:606] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:06:40.579115 21490 raft_consensus.cc:614] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:40.581733 21641 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:40.537685 22807 tablet_copy_client.cc:323] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.131:41367
I20260709 13:06:40.583194 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.576691 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.559986 22757 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.587327 21490 raft_consensus.cc:2955] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:40.589069 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.593312 22738 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.564191 22743 raft_consensus.cc:2955] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:40.588554 22790 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:40.599094 22738 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:40.583250 22809 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.599473 22738 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.600289 22809 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.602937 22790 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.603327 22790 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.604153 22790 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.605533 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.606923 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.607205 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.608479 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.616147 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.612515 22757 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:40.617342 22757 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.617617 21493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:40.617734 22757 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.618259 21493 raft_consensus.cc:606] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:06:40.618530 21564 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.619163 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.619901 22757 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.620699 22767 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.621071 22767 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.621439 22767 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.622458 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.623139 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:40.624818 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:40.625099 22750 raft_consensus.cc:993] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:06:40.625562 22801 raft_consensus.cc:1081] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:06:40.627431 21568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:40994
I20260709 13:06:40.628021 21568 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.628376 21568 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.629055 21564 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.631042 22757 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.600294 22738 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.605525 22790 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.637132 22738 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.638024 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:40.638650 21493 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.638968 21493 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:40.639709 21493 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.640707 21493 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.610702 21642 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:40.611250 21486 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.640866 21638 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:40.615397 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.641729 22746 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:40.651278 21639 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:40.651835 22785 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.659637 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:40.660614 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:40.663419 21561 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.666889 22785 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.671556 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.671775 21568 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.672912 21388 catalog_manager.cc:5697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 1 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:40.675299 22777 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.686646 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.686975 22777 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:40.693111 22803 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.693629 22803 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.693346 22777 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.694068 22803 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.694932 22742 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.695348 22742 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.695716 22742 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.685775 21568 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.702101 22743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36036 (request call id 7) took 1279 ms. Trace:
I20260709 13:06:40.683558 22785 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.688102 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:40.708875 22785 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.720350 22779 tablet_bootstrap.cc:492] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:40.720121 22803 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.722424 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.723366 22779 tablet_bootstrap.cc:492] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:40.724433 22779 ts_tablet_manager.cc:1403] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.746s	user 0.051s	sys 0.018s
I20260709 13:06:40.724669 22749 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.725118 22749 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.726891 22749 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.737948 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.738294 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.738584 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.739634 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.740417 21634 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.740684 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.741369 21635 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.741237 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.725617 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.742202 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.743119 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.743302 22804 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.743678 22804 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.744043 22804 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.745364 21638 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.747828 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.748616 21638 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.748405 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.749281 21640 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:40.749096 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.750321 21641 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.751346 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.752964 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.753392 21639 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.753448 21636 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.755254 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.755321 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.756804 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.757961 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.758714 21640 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:40.759524 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.762188 21636 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.763139 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.763691 21636 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.760036 21643 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.760365 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.761154 22742 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.763921 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.761526 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.761669 21635 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.766685 21640 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.767663 22742 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.702562 22743 rpcz_store.cc:276] 0709 13:06:39.422579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.422851 (+   272us) service_pool.cc:224] Handling call
0709 13:06:39.499813 (+ 76962us) log.cc:844] Serialized 513 byte log entry
0709 13:06:39.835514 (+335701us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b540007a920. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f5b142 00007f98a9f3beaa 00007f98a9f42d53 00007f98a9f42cd9 00007f98a9f42c69 00007f98a9f42c31 00007f98a9f41dfd 000000000038f354 000000000038f199 00007f98a6ef5475
0709 13:06:40.701986 (+866472us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9276,"raft.queue_time_us":12976,"raft.run_cpu_time_us":3797,"raft.run_wall_time_us":7093,"spinlock_wait_cycles":6563968,"thread_start_us":320387,"threads_started":1,"wal-append.queue_time_us":319883}
I20260709 13:06:40.771773 22804 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.763857 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.765147 21641 raft_consensus.cc:2376] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2. Re-sending same reply.
I20260709 13:06:40.692101 21493 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.774909 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.778236 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:06:40.778743 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 186890us
I20260709 13:06:40.779670 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:40.780457 21642 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:40.781018 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.781941 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.783335 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.784397 22793 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.784955 22793 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.785403 22793 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.788002 21490 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.786026 21638 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:40.764042 21636 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:40.795581 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.843109 21493 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.677333 22767 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.783515 22768 raft_consensus.cc:2764] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:40.783728 22755 raft_consensus.cc:2764] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:40.852133 21640 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.796443 22732 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.794423 21634 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:40.844568 22737 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.863142 22749 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:40.864547 22804 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.865391 22804 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.865852 22804 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.866088 22749 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:40.877573 22767 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.783401 22795 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:06:40.866324 22804 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.861373 22732 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.881003 22732 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.889453 21636 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:40.914343 21636 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.875451 22779 raft_consensus.cc:359] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:40.910878 22753 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.910583 22803 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:40.911577 21634 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:40.912238 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:40.911556 21653 tablet_copy_service.cc:140] P a87bd86b86e74aa8bb61189215b73439: Received BeginTabletCopySession request for tablet 22b45f3e8b8e428ea4709e7e9ee43868 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36050)
I20260709 13:06:40.932943 21653 tablet_copy_service.cc:161] P a87bd86b86e74aa8bb61189215b73439: Beginning new tablet copy session on tablet 22b45f3e8b8e428ea4709e7e9ee43868 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36050: session id = 549b31ac31b6428994b45938abc223a7-22b45f3e8b8e428ea4709e7e9ee43868
I20260709 13:06:40.915475 21568 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.915380 22753 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:40.929311 21639 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:40.935287 22753 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.936968 22753 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.952715 22769 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:40.954275 22797 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.954767 22797 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:40.955931 22797 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:40.957450 22797 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.915699 22779 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:40.965363 22779 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:06:40.980351 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.992914 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 197405us
I20260709 13:06:40.993748 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.994884 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:40.995668 22755 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.996033 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:40.996047 22755 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:40.996852 22820 raft_consensus.cc:2764] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:40.997205 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:40.997432 22820 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.997972 22755 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.998238 22818 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.000773 22793 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.001933 21562 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.002524 21391 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:41.005692 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.006717 22820 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.007944 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.008663 22820 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.009481 22804 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.009809 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:41.010740 22820 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.011261 22820 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.012313 21564 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.012130 22820 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.013774 22755 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.018689 21564 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.033143 22795 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:41.034945 22795 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.035425 22793 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:41.036979 22755 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:41.035429 22795 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.018220 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.024700 22732 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.039048 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:41.038757 22795 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.040302 22755 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.040421 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.040652 22795 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.041066 22755 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.041289 22821 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.041584 22755 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.041846 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.042711 22818 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.016400 22769 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:41.043437 22732 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:41.044250 22801 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.044359 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:41.045002 22801 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.046022 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.046434 22801 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.047222 22818 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.047741 22818 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.047947 22801 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.048431 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.048691 22818 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.049329 22748 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.049796 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:41.050168 22748 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.050773 22748 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:41.021952 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 57954.4us
I20260709 13:06:41.036983 22804 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:41.051506 22748 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.052505 22748 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.021768 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:41.055706 22823 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:41.056223 22823 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:41.056699 22823 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.060411 21636 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:41.026155 22779 ts_tablet_manager.cc:1434] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.301s	user 0.009s	sys 0.004s
I20260709 13:06:41.067584 21653 tablet_copy_source_session.cc:215] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:41.052073 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.069770 21579 tablet_copy_service.cc:342] P 5727b19579474da6a12f79730b924770: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-377467a782f94dd2b6e76b88920dfb8b received from {username='slave'} at 127.0.0.1:36572
I20260709 13:06:41.070334 21579 tablet_copy_service.cc:434] P 5727b19579474da6a12f79730b924770: ending tablet copy session 549b31ac31b6428994b45938abc223a7-377467a782f94dd2b6e76b88920dfb8b on tablet 377467a782f94dd2b6e76b88920dfb8b with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:41.073161 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:06:41.074002 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52347.9us
I20260709 13:06:41.075488 22749 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.075927 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.076043 22750 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.076458 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.076894 22750 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.077795 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.078222 22788 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.078543 22821 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.078379 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.078253 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.079854 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.080174 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.084561 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:41.085628 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.085846 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:41.086467 22804 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.086133 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:41.086890 22818 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.087127 22804 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.088132 22804 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.089432 22745 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.090199 22745 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:41.090552 22745 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:41.090952 22745 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.092429 22798 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.094573 22732 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.099220 22732 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.100564 22732 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.106878 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.115058 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.116139 21643 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:41.116792 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.117043 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.118813 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.094204 22755 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.080296 22788 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.079975 22749 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.122612 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:41.127523 21643 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.127688 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.128273 21493 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.128551 21493 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.110262 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.124065 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.124990 21562 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.124102 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.126231 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.126770 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.136961 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.137168 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.138160 21636 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:41.139441 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53872.7us
I20260709 13:06:41.140125 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.143532 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.144595 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.145795 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.152663 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.156349 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.125976 22769 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:41.157397 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 72217.6us
I20260709 13:06:41.160385 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.161283 21569 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.161562 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.164125 21636 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:41.165103 21568 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.167230 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.138130 22743 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.169591 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.171360 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:41.144704 22801 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.180204 21493 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.188407 22827 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.154363 22798 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.189724 22798 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:41.193303 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 47524.3us
I20260709 13:06:41.194362 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.200541 21493 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.203999 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.204574 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.212433 22823 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.177234 22788 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.215759 21564 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.190339 21562 raft_consensus.cc:2955] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:06:41.223193 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.232865 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:41.235213 21486 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:41.237231 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:41.231050 22795 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.235960 22809 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:41.239509 22809 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.239914 22809 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:41.240842 22809 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.242062 22809 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.237402 22753 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.226470 22743 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:06:41.248672 22743 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.249043 22743 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:41.195839 22827 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:41.249902 22743 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:41.256058 22827 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:41.256495 22827 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.258500 21488 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:41.256728 22743 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.250973 22240 raft_consensus.cc:1217] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:41.191336 22745 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.264796 22745 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:41.149591 22749 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.191148 22796 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:06:41.270712 22785 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.271133 22785 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:41.278072 21487 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:41.291625 22785 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.293365 22785 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.280103 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.280143 22801 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.287690 21564 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:41.293810 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.279423 21457 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:41.303423 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.304033 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.315460 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:41.319547 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:41.320667 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.320466 22767 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.318472 22748 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.323314 22767 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.320602 22829 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.324363 22767 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:41.325570 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46217.9us
I20260709 13:06:41.314366 22737 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.326393 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.326622 22829 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:41.327131 22803 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.327670 22803 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.328779 22803 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.327534 22798 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.320454 22801 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.327549 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.326282 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.347322 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.348503 22737 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.348664 22795 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.349125 22737 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.349668 22795 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.336766 21388 catalog_manager.cc:5697] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:41.341326 21564 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.342202 22774 tablet_bootstrap.cc:492] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:41.327723 22797 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.355033 22797 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.355671 22774 tablet_bootstrap.cc:492] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
W20260709 13:06:41.356220 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.355988 22797 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.350039 22737 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.347046 22801 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.350023 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.350871 22821 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:41.358628 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.359191 22821 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.359879 22821 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.354689 22750 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:06:41.360278 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.361440 22750 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.364130 22750 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.348526 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.365695 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.361629 22797 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.366847 22819 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.367997 22823 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:41.370951 21491 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:41.371048 22750 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.340891 22827 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.322259 22755 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.358017 22774 ts_tablet_manager.cc:1403] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.808s	user 0.039s	sys 0.003s
I20260709 13:06:41.372404 22750 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.376610 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.375784 22795 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.375103 22769 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:41.463972 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 87140.5us
W20260709 13:06:41.464051 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 87502.7us
W20260709 13:06:41.464877 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 293573us
I20260709 13:06:41.467216 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:41.464918 21457 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:41.463037 22753 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.474828 22827 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:41.476699 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:41.477641 21457 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:41.472155 22829 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.483378 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.492260 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:41.484578 22829 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.495172 22829 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.495776 22745 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.496376 22745 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:41.472050 22823 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:41.499504 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.499622 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:41.502022 22795 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.486840 22798 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.500303 22769 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.482142 22755 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.499697 22827 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.499392 22823 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:41.513829 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.516966 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.524036 22798 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.525220 22798 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.515153 22745 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.545270 22247 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:41.530329 22830 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:06:41.520008 22823 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.546577 22841 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.546124 22755 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.571761 22801 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.548496 22737 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:41.576107 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.548321 22827 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:41.519856 22831 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:06:41.575493 22841 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.598714 22841 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:41.587303 22737 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:41.593648 22240 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.593928 22788 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.586349 22795 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.610425 22745 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:41.631292 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.616652 21564 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:41.637070 22834 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:41.632306 22745 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:41.664988 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.681198 22797 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:41.685039 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:41.685103 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 185664us
I20260709 13:06:41.687508 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:41.631541 22827 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.692255 21391 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:41.688290 22753 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.655097 22774 raft_consensus.cc:359] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:41.707204 21488 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:41.712383 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.712584 22745 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:41.656147 22737 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.713649 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.715991 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.718539 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.700886 22788 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.722357 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.723589 22807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b45f3e8b8e428ea4709e7e9ee43868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.723860 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.728689 21562 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.708125 22753 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.711230 22774 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:41.734817 22803 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:41.756491 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:41.756306 22843 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:41.734998 22795 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.762303 22823 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.764948 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.765393 21487 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:41.746613 22788 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:06:41.779790 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 226427us
W20260709 13:06:41.790676 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.794207 22788 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.795331 22753 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.796574 22753 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.797135 22823 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:41.794277 22846 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.785367 22842 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:41.776803 22803 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.804529 21491 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.804651 22803 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:41.808566 21487 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.765520 22774 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:41.824740 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:41.825423 21562 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:41.826764 21488 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.829051 21487 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.829295 21635 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.830955 22842 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.831561 22842 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.833746 22842 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:41.836715 21491 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.839377 22774 ts_tablet_manager.cc:1434] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.460s	user 0.014s	sys 0.010s
I20260709 13:06:41.842705 21635 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:41.848033 21635 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.853797 21635 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:41.872089 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.872637 21486 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.874374 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:41.878971 22798 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.879401 22798 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.880098 22241 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.880246 22798 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.881165 22245 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.881444 22798 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.884435 21388 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 2 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:41.886579 22840 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.887279 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:41.887537 22750 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.887926 22750 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.888124 22849 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.889036 21562 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.888767 22750 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:41.889922 22750 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.890957 22797 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:41.891788 22797 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.891974 21491 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.892094 22797 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:41.893077 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:41.893110 22797 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:41.895644 22849 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.896246 22797 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.899374 21493 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.900115 22240 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.905066 21641 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:41.902632 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.902890 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 138156us
I20260709 13:06:41.903136 21635 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:41.907160 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.909814 21641 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.930747 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.904989 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:41.941310 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:41.942046 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:41.943748 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:41.944380 21490 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:41.944664 21636 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.946070 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:41.947923 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:41.948773 21488 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:41.887939 21564 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:41.941704 22842 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.951704 22842 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.952077 22842 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.952159 21489 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.955075 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-eae01b9fdd5340dc9416e5834263a4d6 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:06:41.955628 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-eae01b9fdd5340dc9416e5834263a4d6 on tablet eae01b9fdd5340dc9416e5834263a4d6 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:41.937099 22827 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.960317 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:41.940824 22846 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.976827 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:41.933211 22755 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:06:41.983084 22809 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:41.933856 22843 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:06:41.992533 22809 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:41.995129 22809 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:41.999711 22244 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:42.001659 22749 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.004650 22818 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:42.008612 21489 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.000926 22827 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.003013 22838 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:42.042472 21569 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.043203 21562 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.052986 22241 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.055934 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:42.056071 22831 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.056999 22831 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.021466 22827 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.079636 22768 raft_consensus.cc:1064] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:06:42.073078 22245 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.072471 22841 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.072999 22827 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.102316 22753 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.127151 22753 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:42.128062 22753 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.129271 22753 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.135061 22799 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:42.103812 21564 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.072193 22854 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:06:42.138382 22854 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:42.074023 22798 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:06:42.151569 22768 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.227114 22785 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:42.227876 22785 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.232095 22785 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:06:42.244824 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.268751 21568 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.269270 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.244100 22831 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.273185 22785 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.243753 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45634 (request call id 211) took 1817 ms. Trace:
W20260709 13:06:42.274909 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 277085us
I20260709 13:06:42.282866 21391 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.238722 22842 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.293624 21391 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.298905 22842 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:42.299093 22247 raft_consensus.cc:2368] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3.
I20260709 13:06:42.298810 21391 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.290709 22785 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.301386 21391 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.310094 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:42.310866 21561 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.299495 22838 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.316529 22785 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:42.317087 22809 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.317605 22809 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.275797 22788 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:06:42.320851 21568 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.261909 22827 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.331442 21561 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:42.333509 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:42.333277 21391 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.337103 21391 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.337189 22809 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:42.331979 22785 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.358451 21391 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.338904 22823 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:42.364748 21391 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.367807 21391 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.336344 22838 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:06:42.370087 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 406214us
I20260709 13:06:42.339151 22795 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:42.373425 21391 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.286883 22807 rpcz_store.cc:276] 0709 13:06:40.426277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.426409 (+   132us) service_pool.cc:224] Handling call
0709 13:06:40.455692 (+ 29283us) ts_tablet_manager.cc:934] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
0709 13:06:41.695137 (+1239445us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:41.848122 (+152985us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:41.848269 (+   147us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:42.242813 (+394544us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:42.243188 (+   375us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:42.243582 (+   394us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:42.243670 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":320,"spinlock_wait_cycles":26368,"tablet-copy.queue_time_us":25541,"thread_start_us":87190,"threads_started":2}
I20260709 13:06:42.386821 22827 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:42.387302 22807 tablet_copy_client.cc:806] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:42.387902 22807 tablet_copy_client.cc:670] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:42.388692 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:42.389358 21561 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.369993 22823 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:42.348331 22749 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:42.344866 22818 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:06:42.365628 22785 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.393013 21391 catalog_manager.cc:5697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.404937 21561 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:42.402668 21388 catalog_manager.cc:5697] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.415740 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:42.390564 22823 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.422668 22867 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:42.432399 22867 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:42.436597 22785 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:42.437314 22785 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.439317 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 462567us
W20260709 13:06:42.440837 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.440984 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:42.416203 21388 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.444443 21487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:42.445245 21487 raft_consensus.cc:606] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:06:42.445657 21487 raft_consensus.cc:614] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:42.446154 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:42.446767 21635 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:42.448076 21388 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.454605 21487 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.459128 21486 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.460553 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:42.461088 21493 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.463013 21635 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.463996 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:42.490094 21493 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:42.490703 21488 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.447177 22797 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:42.497195 22245 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:42.473037 22809 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.467139 21490 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.463588 22748 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:42.507730 21492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:42.525358 21492 raft_consensus.cc:606] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:06:42.525771 21492 raft_consensus.cc:614] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:42.531168 22840 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:42.531941 22840 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.525933 22804 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.544272 22804 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.502434 22753 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:42.547225 21491 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.548904 22753 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.549343 22753 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:42.551481 21564 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.553784 21634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:52666
I20260709 13:06:42.550124 22753 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.554625 21634 raft_consensus.cc:606] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:42.555133 21634 raft_consensus.cc:614] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:42.557070 22750 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.557614 22750 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:42.557893 22748 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.558594 22748 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.509891 22809 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.560890 22788 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:42.565304 21485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:42.477564 21487 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.478991 21643 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.437886 22785 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.477430 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:42.576979 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 99649.4us
I20260709 13:06:42.578228 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:42.434746 22867 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.580693 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.589246 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.593595 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.596391 22818 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.583714 21485 raft_consensus.cc:606] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:06:42.580031 22827 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.584821 22846 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.622882 21643 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.630009 21635 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.604548 21485 raft_consensus.cc:614] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:42.604612 22807 tablet_copy_client.cc:538] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:42.558727 22750 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:42.622597 22846 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.640057 21488 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:42.646914 22755 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:06:42.654076 22748 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.699837 22845 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.650164 21640 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.703975 21634 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.709378 21634 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.653963 22827 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:06:42.655833 22750 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.661772 22846 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.717190 22840 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.718657 22804 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.727667 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.725730 22753 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.728475 21561 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:42.734436 21488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:42.735136 21488 raft_consensus.cc:606] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:06:42.735504 21488 raft_consensus.cc:614] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:42.760875 21634 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.729038 22845 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.759889 22840 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.797389 22785 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:42.799065 22840 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.807017 22840 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.809260 22809 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:42.810000 22809 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:42.814244 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.829090 22840 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.829638 22840 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.834169 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.832602 22840 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.810457 22809 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.860347 22750 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.868299 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.861006 22750 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.857975 22840 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.892585 22795 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.891171 22798 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.896739 22798 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.896044 22795 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.908183 22795 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.908931 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.909631 21566 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:42.910094 22845 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.910859 21459 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:42.911819 22795 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.912201 22795 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.912339 22871 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.912611 22795 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.913095 22871 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.914506 22798 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.915202 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.915668 22785 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.916309 22785 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.893649 22840 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:42.927224 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.929276 22750 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.932034 22840 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:42.932734 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:42.935729 22807 tablet_bootstrap.cc:492] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:06:42.945305 22785 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:42.987151 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.021028 22785 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.028358 21641 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.008s	sys 0.013s
W20260709 13:06:43.029443 21641 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.009s	sys 0.013s
W20260709 13:06:43.074144 21638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.011s	sys 0.048s
W20260709 13:06:43.074656 21638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.011s	sys 0.048s
W20260709 13:06:43.086457 22829 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.014s
I20260709 13:06:43.087060 22750 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.102598 22829 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.007s	sys 0.014s
I20260709 13:06:43.102880 22750 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.013108 22795 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.067078 22871 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:43.114270 21608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.007s	sys 0.037s
W20260709 13:06:43.117978 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 469275us
I20260709 13:06:43.118849 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:43.067461 22785 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:43.119877 22210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.019s	sys 0.010s
W20260709 13:06:43.114684 21608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.007s	sys 0.037s
W20260709 13:06:43.120993 22210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.019s	sys 0.010s
W20260709 13:06:43.121333 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 534688us
W20260709 13:06:43.119978 21639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.008s	sys 0.022s
W20260709 13:06:43.126242 21639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.008s	sys 0.022s
I20260709 13:06:43.120445 22845 raft_consensus.cc:2764] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:43.150379 21566 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:43.136492 22877 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.163415 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:06:43.165231 21609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.019s	sys 0.029s
W20260709 13:06:43.165594 21609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.019s	sys 0.029s
I20260709 13:06:43.150667 22840 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.152590 22843 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.000s	sys 0.025s
I20260709 13:06:43.150184 22809 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:43.145077 22863 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:43.142457 22846 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:43.162573 21564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.003s	sys 0.020s
I20260709 13:06:43.225063 21487 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:43.184794 22788 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.016s	sys 0.012s
W20260709 13:06:43.193245 21636 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.019s	sys 0.007s
W20260709 13:06:43.228389 21636 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.022s	sys 0.008s
I20260709 13:06:43.155385 22845 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:06:43.165869 22818 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 13:06:43.225392 21564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.004s	sys 0.021s
W20260709 13:06:43.214012 22769 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.030s	sys 0.007s
W20260709 13:06:43.229756 21457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.015s	sys 0.016s
W20260709 13:06:43.252283 21457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.015s	sys 0.016s
I20260709 13:06:43.183878 22842 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:06:43.215049 22843 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.000s	sys 0.026s
W20260709 13:06:43.229123 22788 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.017s	sys 0.013s
I20260709 13:06:43.187703 22768 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 13:06:43.225967 21606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.012s	sys 0.019s
W20260709 13:06:43.270339 21606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.013s	sys 0.019s
I20260709 13:06:43.270752 21640 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:43.255111 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:43.253543 22769 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.030s	sys 0.008s
I20260709 13:06:43.258302 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:43.231029 22800 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.015s	sys 0.016s
I20260709 13:06:43.268127 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:43.273393 21490 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:43.269366 21634 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:43.255273 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:43.288578 21487 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:43.276357 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:43.289681 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:43.290493 21566 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:43.252600 22809 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:43.268896 22872 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:06:43.156414 22877 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.227514 22840 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.286026 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:43.263957 22750 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:43.311873 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.251227 22748 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:06:43.336823 21561 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:43.288272 22800 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.015s	sys 0.016s
W20260709 13:06:43.282684 22855 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.015s	sys 0.017s
W20260709 13:06:43.282900 22831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.009s	sys 0.023s
I20260709 13:06:43.282858 22795 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:43.343761 22867 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.014s	sys 0.033s
I20260709 13:06:43.286728 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:43.288599 22797 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
W20260709 13:06:43.358131 22855 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.016s	sys 0.017s
I20260709 13:06:43.283298 22788 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:06:43.301024 22798 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:06:43.335214 22886 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:43.335803 21492 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:43.363696 21561 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
W20260709 13:06:43.351059 21443 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.013s	sys 0.040s
W20260709 13:06:43.360139 22831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.010s	sys 0.023s
I20260709 13:06:43.365873 22785 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:43.378535 22867 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.015s	sys 0.034s
W20260709 13:06:43.361581 21562 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.011s	sys 0.025s
I20260709 13:06:43.411679 22893 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.384620 22845 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.346112 22750 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:06:43.385437 22885 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.337567 22809 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:06:43.429133 21562 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.011s	sys 0.025s
W20260709 13:06:43.414327 21443 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.013s	sys 0.041s
I20260709 13:06:43.345875 22887 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
W20260709 13:06:43.464462 22211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.005s	sys 0.018s
W20260709 13:06:43.467129 22211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.006s	sys 0.018s
W20260709 13:06:43.501150 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 216208us
W20260709 13:06:43.439651 22745 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.017s	sys 0.003s
I20260709 13:06:43.508004 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 881) took 1002 ms. Trace:
I20260709 13:06:43.431183 22892 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:43.421435 22842 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:06:43.517525 22878 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.518123 22871 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:06:43.518611 21535 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.018s	sys 0.052s
I20260709 13:06:43.520777 22809 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:43.521605 21641 rpcz_store.cc:276] 0709 13:06:42.457687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.457829 (+   142us) service_pool.cc:224] Handling call
0709 13:06:42.458127 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.458296 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:43.029973 (+571677us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.460024 (+430051us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.460111 (+    87us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:43.460172 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.460265 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.460436 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23733,"prepare.queue_time_us":809966,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"thread_start_us":943811,"threads_started":2}
W20260709 13:06:43.510747 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 282189us
I20260709 13:06:43.430826 22823 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:06:43.499768 22785 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.420804 22886 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.546900 22888 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:43.547515 22888 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.550658 22888 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:43.554836 21535 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.021s	sys 0.054s
W20260709 13:06:43.521514 22745 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.018s	sys 0.003s
I20260709 13:06:43.522254 22829 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.523069 22843 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:43.443382 22885 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.537629 22894 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.528057 22846 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.445082 22845 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:43.545015 22798 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:43.574980 22809 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:43.543999 22804 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:43.589794 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:43.582577 22768 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:06:43.595268 22919 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.595444 21532 leader_election.cc:400] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3.
I20260709 13:06:43.595431 22923 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:43.457782 22893 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.602165 22895 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:43.543744 22871 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.556692 22785 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.584465 22889 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:43.596154 22886 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:43.617199 22840 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.575090 22829 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.573135 22755 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:06:43.543346 22878 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:43.609622 22846 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:43.628219 22888 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:43.642084 22878 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:43.620728 22877 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:43.642477 22888 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.642911 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 892) took 1063 ms. Trace:
I20260709 13:06:43.643074 22846 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:43.643435 22885 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:43.643308 21639 rpcz_store.cc:276] 0709 13:06:42.579656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.580531 (+   875us) service_pool.cc:224] Handling call
0709 13:06:42.580799 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.126691 (+545892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.126747 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.138550 (+ 11803us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.468376 (+329826us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:43.468956 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.469890 (+   934us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.642637 (+172747us) raft_consensus.cc:1685] finished
0709 13:06:43.642657 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.642826 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":330732,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"thread_start_us":836261,"threads_started":2,"wal-append.queue_time_us":488824}
I20260709 13:06:43.644586 22888 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:43.645464 22846 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.645628 22893 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.607851 22798 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:43.646629 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 883) took 1188 ms. Trace:
I20260709 13:06:43.537705 22892 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.647132 21642 rpcz_store.cc:276] 0709 13:06:42.458376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.458500 (+   124us) service_pool.cc:224] Handling call
0709 13:06:42.479685 (+ 21185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.844382 (+364697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.844423 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.846380 (+  1957us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.915374 (+ 68994us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b480021c258. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f 00007f98aeff9f37 00007f98af00e55c 00007f98af00e508 00007f98af00e488 00007f98af00e443 00007f98af00d6ec 00007f98adf37a96
0709 13:06:43.376639 (+461265us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:43.376698 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.376798 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.646286 (+269488us) raft_consensus.cc:1685] finished
0709 13:06:43.646313 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.646565 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":318236,"raft.run_cpu_time_us":1367,"raft.run_wall_time_us":117175,"spinlock_wait_cycles":4344576,"thread_start_us":782432,"threads_started":2,"wal-append.queue_time_us":594752}
I20260709 13:06:43.647967 22798 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.629603 22895 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:43.639062 22889 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:43.601536 22894 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.655711 22889 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.628033 22919 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.652321 22896 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:43.657075 22894 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:43.609153 22804 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:43.606040 22809 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:43.611333 22843 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.635713 22887 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.657161 22896 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:43.673573 22809 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:43.654769 22895 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:43.670962 22829 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.675675 22892 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:43.760236 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 894) took 1178 ms. Trace:
I20260709 13:06:43.760821 21643 rpcz_store.cc:276] 0709 13:06:42.581846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.647970 (+ 66124us) service_pool.cc:224] Handling call
0709 13:06:42.659251 (+ 11281us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:06:42.659517 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.155811 (+496294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.155843 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.179722 (+ 23879us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.509175 (+329453us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:43.509247 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.509381 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.759866 (+250485us) raft_consensus.cc:1685] finished
0709 13:06:43.759893 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.760161 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27774,"raft.queue_time_us":322523,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":1685,"spinlock_wait_cycles":2698496,"thread_start_us":745408,"threads_started":2,"wal-append.queue_time_us":430851}
I20260709 13:06:43.763953 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 895) took 1178 ms. Trace:
I20260709 13:06:43.764482 21635 rpcz_store.cc:276] 0709 13:06:42.586052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.653520 (+ 67468us) service_pool.cc:224] Handling call
0709 13:06:42.657164 (+  3644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.162616 (+505452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.162657 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.186236 (+ 23579us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.510530 (+324294us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:43.510570 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.510655 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.756869 (+246214us) raft_consensus.cc:1685] finished
0709 13:06:43.763657 (+  6788us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.763877 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":302121,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":4872,"thread_start_us":708601,"threads_started":2,"wal-append.queue_time_us":514761}
I20260709 13:06:43.748394 22919 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.632022 22923 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:43.781911 22845 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:43.743791 22887 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:43.788730 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 499594us
W20260709 13:06:43.817070 22909 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:06:43.949715 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 888) took 1471 ms. Trace:
W20260709 13:06:43.878510 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 85319.1us
W20260709 13:06:43.921787 21636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.010s	sys 0.009s
W20260709 13:06:43.955209 21636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.010s	sys 0.011s
W20260709 13:06:43.860172 21460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.015s
W20260709 13:06:43.955811 21460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.000s	sys 0.019s
I20260709 13:06:43.956616 22801 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:43.817875 22785 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:43.957329 22801 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.960150 22801 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.961009 22801 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.961565 22801 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.964059 22801 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.965184 22918 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:43.965842 22918 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.968588 22918 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.969144 22920 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:43.970294 22829 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:43.970160 22920 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.971257 22829 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.973843 22920 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.974033 22829 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.969301 22918 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.975059 22918 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.977131 22920 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:43.977782 22918 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:43.977905 22920 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:43.978979 22829 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:43.979705 22829 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:43.981580 22750 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.982271 22750 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:43.993589 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.010560 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 1533) took 1208 ms. Trace:
W20260709 13:06:43.883430 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.950261 21638 rpcz_store.cc:276] 0709 13:06:42.478750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.478916 (+   166us) service_pool.cc:224] Handling call
0709 13:06:42.499798 (+ 20882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.911512 (+411714us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b480021c258. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f 00007f98aeff9f37 00007f98af00e55c 00007f98af00e508 00007f98af00e488 00007f98af00e443 00007f98af00d6ec 00007f98adf37a96
0709 13:06:43.075094 (+163582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.075143 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.113451 (+ 38308us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.488438 (+374987us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:43.488584 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.488807 (+   223us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.891879 (+403072us) raft_consensus.cc:1685] finished
0709 13:06:43.891916 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.949647 (+ 57731us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":300430,"raft.run_cpu_time_us":3038,"raft.run_wall_time_us":111027,"spinlock_wait_cycles":27624320,"thread_start_us":924962,"threads_started":2,"wal-append.queue_time_us":492390}
I20260709 13:06:44.020910 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:43.816133 22887 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:44.053449 21486 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:44.015117 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:44.057871 21459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.013s	sys 0.006s
I20260709 13:06:44.058007 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.004338 22829 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:44.016700 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:44.056425 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 457246us
I20260709 13:06:44.062664 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:44.058651 21486 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:44.022580 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.068069 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:44.015601 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.070365 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.068226 22921 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:06:43.916263 22880 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.631s	user 0.000s	sys 0.004s
W20260709 13:06:44.065807 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 458921us
I20260709 13:06:43.834182 22896 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:06:44.058228 21459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.013s	sys 0.006s
I20260709 13:06:44.002552 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.000499 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.198196 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.075946 21490 raft_consensus.cc:2368] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:44.412508 21488 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:44.071223 21494 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
W20260709 13:06:44.155372 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 95922.6us
I20260709 13:06:44.011164 21562 rpcz_store.cc:276] 0709 13:06:42.726766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.727319 (+   553us) service_pool.cc:224] Handling call
0709 13:06:42.727659 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.727897 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:43.510124 (+782227us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.885058 (+374934us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.885140 (+    82us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:43.885200 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.934873 (+ 49673us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.935016 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15393,"prepare.queue_time_us":5809,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":1698,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":25725,"thread_start_us":1055291,"threads_started":2}
I20260709 13:06:44.154773 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.414537 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:44.415099 21493 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
W20260709 13:06:44.412582 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.088213 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:43.885641 22769 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.434093 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:44.015581 22785 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:06:44.420115 21566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.010s	sys 0.043s
I20260709 13:06:44.420730 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.419965 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.432755 22244 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.438773 21488 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:44.015878 22809 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:44.438356 21566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.010s	sys 0.043s
I20260709 13:06:43.899334 22923 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:44.416225 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:43.834617 22843 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:44.056113 22892 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.051528 22895 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:44.441380 22867 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:44.059185 22894 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:44.437299 22245 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:44.442090 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:06:44.406816 22876 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.651s	user 0.001s	sys 0.004s
I20260709 13:06:44.278206 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:44.014251 22918 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.277230 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.076040 22888 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.076045 22887 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:44.446453 21488 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:44.446655 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.442112 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:44.055545 22845 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:44.447474 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:43.996460 22750 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:44.228159 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 70) took 1655 ms. Trace:
I20260709 13:06:44.277453 22891 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:44.155156 22840 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.069480 22829 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.393206 22878 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.532222 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.441674 22818 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:44.279486 22920 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:44.534690 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 92691.2us
I20260709 13:06:44.450623 21492 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:44.539987 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:44.534457 22934 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.550160 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.583550 21493 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:44.222159 22896 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.367390 22886 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.357667 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 58) took 1083 ms. Trace:
I20260709 13:06:44.571218 22788 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.586272 22788 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.587361 22942 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.587891 22942 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.588806 22788 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:44.555083 21494 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:44.560313 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:44.535075 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 87750.2us
I20260709 13:06:44.539597 21491 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:44.442147 22936 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.449795 22849 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:44.571050 22244 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 2 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:44.468220 22801 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.466084 22928 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.539044 22843 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.549458 22918 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.204048 22917 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.531961 21485 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:44.537210 22931 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.554517 22899 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.561903 22878 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.603627 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:44.448590 22892 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.561415 22827 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.607791 21490 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:44.568542 22823 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.448935 22867 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.565891 22893 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:44.567704 22818 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:44.456310 22785 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.465370 22894 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.537114 22923 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.448896 22769 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:44.464264 22809 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.549783 22887 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.456534 22921 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.558341 22845 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.550235 22888 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:44.562726 22829 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.448825 22895 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.557221 22840 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.548856 22891 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:44.777813 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 185749us
W20260709 13:06:44.720976 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 160722us
I20260709 13:06:44.969481 21388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 237) took 1610 ms. Trace:
I20260709 13:06:44.980125 21388 rpcz_store.cc:276] 0709 13:06:43.212862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.213069 (+   207us) service_pool.cc:224] Handling call
0709 13:06:43.415284 (+202215us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4c090 00007f98a9feaf3a 00007f98afda11cc 00007f98afe9f37e 00007f98ae3602a4 00007f98ae360232 00007f98ae360161 00007f98ae3600dc 00007f98ae35f392 00007f98a831d48c 00007f98a831c8c6
0709 13:06:44.822700 (+1407416us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":294997888}
I20260709 13:06:44.620069 22247 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:44.980227 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:44.989967 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 386447us
I20260709 13:06:44.990918 21459 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:44.996610 22930 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:44.997134 22930 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.620186 22928 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.997969 22867 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:44.635646 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 882) took 2160 ms. Trace:
I20260709 13:06:44.618336 22939 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.998914 22918 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:44.967330 22935 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:06:44.998034 22928 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.597038 22936 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:44.775395 22927 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:06:44.999994 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:45.003383 21487 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:45.004024 21486 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:44.824986 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:44.968719 22788 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.712028 22803 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:44.755667 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:44.712635 22849 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.620420 22801 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.613075 22886 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.613976 22896 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.677588 22843 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:45.203076 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:45.249142 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 249201us
I20260709 13:06:45.192672 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.227104 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.036857 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.037303 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.252668 21569 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:45.252905 21561 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:45.151722 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.034216 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.000602 22749 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:45.266083 21567 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 2: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:44.799711 22951 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:45.273391 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 293209us
I20260709 13:06:45.274304 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:44.999343 22930 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:06:45.096728 22903 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.502s	user 0.001s	sys 0.000s
I20260709 13:06:45.278537 21606 leader_election.cc:400] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:45.280140 21606 leader_election.cc:403] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.202320 22745 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.988261 22827 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.010428 22795 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.110602 22942 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.024811 22936 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.010571 22931 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:45.301411 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 317245us
I20260709 13:06:44.988253 22823 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.994567 22893 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:45.297724 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:45.257158 22949 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:45.327638 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:45.328562 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:45.328850 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.318645 22958 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.276119 22948 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.280728 22750 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:45.262665 22803 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:45.306856 22918 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.317216 22930 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:45.003162 22917 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:45.341022 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.264681 22788 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.347337 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:45.347038 22750 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.351795 22769 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:45.352679 22823 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.353039 22929 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.353349 22933 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:45.327131 22923 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:45.337241 22947 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:06:45.323191 22931 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.276597 22749 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:45.324090 22942 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:45.330348 22795 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:44.619298 22934 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:45.373029 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.316751 22951 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:44.999323 22939 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.343580 22958 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:45.318853 22745 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.348563 22948 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:44.988185 22899 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.318625 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:45.340283 22949 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:44.533012 21564 rpcz_store.cc:276] 0709 13:06:42.566327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.570600 (+  4273us) service_pool.cc:224] Handling call
0709 13:06:42.604843 (+ 34243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.263456 (+658613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.265320 (+  1864us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.361626 (+ 96306us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.524758 (+163132us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:43.536340 (+ 11582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.543405 (+  7065us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.076129 (+532724us) raft_consensus.cc:1685] finished
0709 13:06:44.076154 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.222057 (+145903us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47445,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"thread_start_us":661755,"threads_started":2,"wal-append.queue_time_us":445565,"wal-append.run_cpu_time_us":2673,"wal-append.run_wall_time_us":1366036}
W20260709 13:06:45.567427 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 123513us
W20260709 13:06:45.579037 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 231774us
I20260709 13:06:44.998708 21637 rpcz_store.cc:276] 0709 13:06:42.458041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.458635 (+   594us) service_pool.cc:224] Handling call
0709 13:06:42.475301 (+ 16666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.475712 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.475750 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.476266 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.959073 (+482807us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:42.964559 (+  5486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.010817 (+ 46258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.900029 (+889212us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:06:44.573852 (+673823us) raft_consensus.cc:1685] finished
0709 13:06:44.573894 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.605195 (+ 31301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":316309,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":5264,"spinlock_wait_cycles":31955712,"thread_start_us":455847,"threads_started":1,"wal-append.queue_time_us":754741}
I20260709 13:06:45.640194 22892 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:44.586215 21640 rpcz_store.cc:276] 0709 13:06:43.273969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.279716 (+  5747us) service_pool.cc:224] Handling call
0709 13:06:43.340611 (+ 60895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.361891 (+ 21280us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:43.437544 (+ 75653us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.200413 (+762869us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.206054 (+  5641us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.229885 (+ 23831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.267308 (+ 37423us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.322664 (+ 55356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66056,"prepare.queue_time_us":36132,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":8376,"raft.queue_time_us":151924,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":30575,"thread_start_us":463226,"threads_started":1,"wal-append.queue_time_us":1090907}
I20260709 13:06:45.645730 22801 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.646375 22896 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:45.632771 22932 log.cc:927] Time spent T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.347s	user 0.000s	sys 0.000s
I20260709 13:06:45.639149 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:45.634752 21569 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:45.631816 22963 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.366828 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:45.396168 21492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.001s	sys 0.005s
I20260709 13:06:45.377033 22769 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.412065 22945 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.648s	user 0.001s	sys 0.000s
I20260709 13:06:45.632448 22955 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.285s
W20260709 13:06:45.568568 22940 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.449s	user 0.001s	sys 0.001s
I20260709 13:06:45.665086 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.452958 22887 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.444720 22829 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.666215 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:45.380403 22923 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.436474 22818 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.627027 22785 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:45.691151 22827 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:45.671042 22964 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:06:45.672518 22934 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.673005 22949 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.585230 22917 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:45.635010 22958 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.634567 22948 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.638507 22931 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.419240 22849 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:45.632604 22960 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.361738 22918 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.662362 22892 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.685945 22750 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:45.678881 21491 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:45.687287 22951 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:45.674193 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.664270 22896 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.366518 22930 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:45.674557 21492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.004s	sys 0.011s
I20260709 13:06:45.644271 22942 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.473399 22928 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.690135 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.754154 21569 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:45.717541 22795 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:45.382694 22929 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.669039 22241 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:45.443156 22933 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:45.721626 21608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.003s	sys 0.010s
I20260709 13:06:45.729243 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 868) took 1234 ms. Trace:
W20260709 13:06:45.767515 21608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.003s	sys 0.010s
W20260709 13:06:45.767864 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 787670us
I20260709 13:06:45.767637 21488 rpcz_store.cc:276] 0709 13:06:44.494899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.535667 (+ 40768us) service_pool.cc:224] Handling call
0709 13:06:44.536063 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.536416 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.536445 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.562458 (+ 26013us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.289718 (+727260us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18000ea220. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:06:45.583632 (+293914us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:45.583694 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.583802 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.728794 (+144992us) raft_consensus.cc:1685] finished
0709 13:06:45.728821 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.729138 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25366,"raft.queue_time_us":34906,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":8470,"spinlock_wait_cycles":24210688,"thread_start_us":293029,"threads_started":1,"wal-append.queue_time_us":1086351}
W20260709 13:06:45.734402 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 68302.3us
I20260709 13:06:45.715749 22923 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.713487 22893 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.712930 22843 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.679054 22963 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:45.714439 22797 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:45.720252 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 59) took 2360 ms. Trace:
I20260709 13:06:45.717868 22878 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:45.681813 22769 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.725643 22785 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.723512 22803 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.719477 22969 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.743978 22917 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.755163 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:45.872283 21569 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
W20260709 13:06:45.710913 21568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.022s	sys 0.007s
W20260709 13:06:45.873319 21568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.022s	sys 0.008s
I20260709 13:06:45.746495 22892 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:45.748353 22788 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.774464 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 873) took 1236 ms. Trace:
I20260709 13:06:45.761106 22929 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.754010 22896 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.778482 22963 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.760584 22979 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:46.000067 22937 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.337s	user 0.001s	sys 0.001s
I20260709 13:06:45.875698 22892 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.878463 21493 rpcz_store.cc:276] 0709 13:06:44.537939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.990848 (+452909us) service_pool.cc:224] Handling call
0709 13:06:44.991192 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.151679 (+160487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.151713 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.215454 (+ 63741us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.322145 (+106691us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:45.322213 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.322341 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.774256 (+451915us) raft_consensus.cc:1685] finished
0709 13:06:45.774277 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.774406 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":230411,"raft.queue_time_us":199117,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"thread_start_us":106139,"threads_started":1,"wal-append.queue_time_us":127258}
I20260709 13:06:45.735597 22954 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.471s
W20260709 13:06:45.886219 22807 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:06:45.876739 22749 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:45.784485 22797 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:45.872545 22969 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:45.771682 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:46.467140 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:46.146765 21457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.008s	sys 0.000s
I20260709 13:06:45.874372 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 869) took 1379 ms. Trace:
I20260709 13:06:45.872005 22785 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.487288 21569 raft_consensus.cc:2410] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:46.473693 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:46.502005 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:45.872064 22917 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.485349 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 864) took 2040 ms. Trace:
W20260709 13:06:46.461982 22936 consensus_meta.cc:287] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.129s	user 0.014s	sys 0.000s
I20260709 13:06:45.885887 22745 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:46.528420 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 81) took 2271 ms. Trace:
I20260709 13:06:46.467316 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:46.480361 21457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.010s	sys 0.000s
W20260709 13:06:46.506191 21534 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.005s	sys 0.009s
I20260709 13:06:45.885694 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:46.530068 21534 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.005s	sys 0.009s
I20260709 13:06:46.530159 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 1558) took 1258 ms. Trace:
I20260709 13:06:46.002274 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.537555 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.513540 21490 rpcz_store.cc:276] 0709 13:06:44.444914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.445038 (+   124us) service_pool.cc:224] Handling call
0709 13:06:44.607403 (+162365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.968443 (+361040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.485116 (+1516673us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54003f9650. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:46.485279 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372688768}
I20260709 13:06:46.471073 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:46.099359 22962 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.393s	user 0.001s	sys 0.001s
W20260709 13:06:46.469444 21608 connection.cc:256] RPC call timeout handler was delayed by -1.1681987309999613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:06:46.520429 22212 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.518s (SENT) [suppressed 14 similar messages]
I20260709 13:06:46.523810 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.000157 22899 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:46.026949 22979 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:46.316552 21485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.005s	sys 0.018s
I20260709 13:06:46.507954 22785 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:46.186751 22975 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:06:46.176257 22942 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.528875 21565 rpcz_store.cc:276] 0709 13:06:44.250632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.251490 (+   858us) service_pool.cc:224] Handling call
0709 13:06:44.448902 (+197412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.004154 (+555252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.004182 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.004220 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:45.004247 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.522103 (+1517856us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b540028a5d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:46.522159 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.522322 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276462336}
I20260709 13:06:46.467481 22933 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.185415 22976 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.541242 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.449234 22939 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:46.530666 21567 rpcz_store.cc:276] 0709 13:06:45.271966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.467024 (+1195058us) service_pool.cc:224] Handling call
0709 13:06:46.530094 (+ 63070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.548249 21562 raft_consensus.cc:2410] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:46.548662 21569 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:46.439476 22930 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.033727 22974 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.232299 22769 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:06:46.540542 21608 connection.cc:256] RPC call timeout handler was delayed by -1.1519987309999351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:06:46.572377 21608 connection.cc:256] RPC call timeout handler was delayed by -1.0628987310000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 13:06:46.572729 21608 connection.cc:256] RPC call timeout handler was delayed by -1.0385987309999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:06:46.092453 22965 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:46.552522 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:46.384033 22918 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.490361 22969 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.527418 22917 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.562943 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 890) took 3986 ms. Trace:
I20260709 13:06:46.566386 21561 raft_consensus.cc:2410] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:46.557025 21457 connection.cc:256] RPC call timeout handler was delayed by -1.1696833059999108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:06:46.555688 21485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.006s	sys 0.020s
I20260709 13:06:46.571636 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.571803 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.576649 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 885) took 1409 ms. Trace:
I20260709 13:06:46.556034 22979 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.579411 21490 rpcz_store.cc:276] 0709 13:06:45.167464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.552244 (+1384780us) service_pool.cc:224] Handling call
0709 13:06:46.576591 (+ 24347us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.587598 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.587955 21562 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:46.588316 21567 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:46.578033 21636 rpcz_store.cc:276] 0709 13:06:42.576334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.577130 (+   796us) service_pool.cc:224] Handling call
0709 13:06:42.584772 (+  7642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.228826 (+644054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.228857 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.232875 (+  4018us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.955796 (+722921us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:43.955871 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.955976 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.562631 (+2606655us) raft_consensus.cc:1685] finished
0709 13:06:46.562660 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.562870 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":326949,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":1327185,"threads_started":2,"wal-append.queue_time_us":2079921}
I20260709 13:06:46.537377 22936 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.588917 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:46.589471 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.589579 21490 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:46.590531 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.590837 21561 raft_consensus.cc:2368] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:46.590812 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.591640 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.592211 21562 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:46.592971 21569 raft_consensus.cc:2410] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:06:46.592918 21457 connection.cc:256] RPC call timeout handler was delayed by -1.1579833060000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
I20260709 13:06:46.593844 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.606550 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:46.607400 21562 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:06:46.569366 22242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 223) took 1976 ms (client timeout 2005 ms). Trace:
I20260709 13:06:46.609853 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:46.588024 22963 consensus_meta.cc:287] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.002s
I20260709 13:06:46.610502 21562 raft_consensus.cc:2410] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:46.567126 22956 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.006s	sys 0.018s
W20260709 13:06:46.628247 22956 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.006s	sys 0.018s
W20260709 13:06:46.608767 21457 connection.cc:256] RPC call timeout handler was delayed by -1.10664998499999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 13:06:46.577103 22939 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:06:46.577720 21564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 1556) took 1539 ms (client timeout 1956 ms). Trace:
I20260709 13:06:46.629241 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:46.490664 21492 rpcz_store.cc:276] 0709 13:06:44.495310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.576777 (+ 81467us) service_pool.cc:224] Handling call
0709 13:06:44.577270 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.577721 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.577761 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.578426 (+   665us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.758125 (+1179699us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:45.767054 (+  8929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.773828 (+  6774us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.775761 (+  1933us) raft_consensus.cc:1685] finished
0709 13:06:45.778177 (+  2416us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.864770 (+ 86593us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43131,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":84172,"thread_start_us":1173715,"threads_started":1,"wal-append.queue_time_us":988386}
I20260709 13:06:46.631543 22245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 208) took 2031 ms. Trace:
W20260709 13:06:46.591547 22977 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.440s	user 0.001s	sys 0.001s
W20260709 13:06:46.606150 22953 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.157s	sys 0.329s
I20260709 13:06:46.592530 22749 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.634647 21457 connection.cc:256] RPC call timeout handler was delayed by -1.0940499849999696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 13:06:46.570283 22976 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:46.634552 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.635032 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 80) took 2404 ms. Trace:
I20260709 13:06:46.654623 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.636008 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:46.590726 22948 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.003s
I20260709 13:06:46.589347 22951 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.636898 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:46.639782 22929 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.001s
I20260709 13:06:46.640043 22871 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:46.640467 22960 consensus_meta.cc:287] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.888s	user 0.008s	sys 0.001s
I20260709 13:06:46.579064 22981 raft_consensus.cc:476] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:06:46.635654 22963 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:46.644412 22245 rpcz_store.cc:276] 0709 13:06:44.580892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.581073 (+   181us) service_pool.cc:224] Handling call
0709 13:06:44.581442 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.680910 (+ 99468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.680953 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.754662 (+ 73709us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.211120 (+456458us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:45.211173 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.211269 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.611567 (+1400298us) raft_consensus.cc:1685] finished
0709 13:06:46.611586 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.611714 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98989,"raft.queue_time_us":132663,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":41223,"thread_start_us":213319,"threads_started":1,"wal-append.queue_time_us":294258}
I20260709 13:06:46.664340 22797 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.653775 21568 rpcz_store.cc:276] 0709 13:06:44.231079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.231237 (+   158us) service_pool.cc:224] Handling call
0709 13:06:44.231636 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.575033 (+343397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.575076 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.575595 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.873781 (+1298186us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:45.873838 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.873934 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.634810 (+760876us) raft_consensus.cc:1685] finished
0709 13:06:46.634832 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.634968 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34915,"raft.queue_time_us":215915,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":15858,"thread_start_us":1296114,"threads_started":2,"wal-append.queue_time_us":1176169}
I20260709 13:06:46.678673 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36572 (request call id 88) took 1001 ms. Trace:
W20260709 13:06:46.687361 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 113710us
I20260709 13:06:46.688233 22981 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:46.689488 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 147768us
W20260709 13:06:46.655565 22923 consensus_meta.cc:287] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.885s	user 0.012s	sys 0.000s
I20260709 13:06:46.708263 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:46.699534 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.686167 21569 rpcz_store.cc:276] 0709 13:06:45.677247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.616676 (+939429us) service_pool.cc:224] Handling call
0709 13:06:46.678599 (+ 61923us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:46.700812 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 169235us
I20260709 13:06:46.709429 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 85) took 1361 ms. Trace:
W20260709 13:06:46.651486 22953 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.158s	sys 0.331s
I20260709 13:06:46.709247 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:46.712550 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:46.709944 21568 rpcz_store.cc:276] 0709 13:06:45.347951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.708353 (+1360402us) service_pool.cc:224] Handling call
0709 13:06:46.708778 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.709009 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.709043 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.709101 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:46.709146 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.709220 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.709358 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:46.609045 22242 rpcz_store.cc:269] 0709 13:06:44.588193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.594963 (+  6770us) service_pool.cc:224] Handling call
0709 13:06:45.647001 (+1052038us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:46.564505 (+917504us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56014208}
W20260709 13:06:46.682063 22983 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 13:06:46.716058 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 87) took 1083 ms. Trace:
I20260709 13:06:46.719624 21569 rpcz_store.cc:276] 0709 13:06:45.632265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.715247 (+1082982us) service_pool.cc:224] Handling call
0709 13:06:46.715560 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.715732 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.715756 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.715800 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:46.715835 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.715893 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.716008 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.683647 22960 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
W20260709 13:06:46.638837 21564 rpcz_store.cc:269] 0709 13:06:45.036070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.874620 (+838550us) service_pool.cc:224] Handling call
0709 13:06:46.575779 (+701159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:46.700202 22807 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:46.635632 22939 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:46.593712 22965 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:46.700297 22769 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:46.721740 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 89) took 1030 ms. Trace:
I20260709 13:06:46.736608 21562 rpcz_store.cc:276] 0709 13:06:45.691477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.719622 (+1028145us) service_pool.cc:224] Handling call
0709 13:06:46.721264 (+  1642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.721449 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.721473 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.721509 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:46.721538 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.721586 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.721684 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.699986 22918 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:46.699471 22804 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.587714 22974 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:46.725231 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:46.726028 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:46.726251 22212 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:46.727018 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 875) took 2188 ms. Trace:
I20260709 13:06:46.682301 22929 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.707749 22951 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.729069 21493 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:46.713074 22942 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:06:46.682072 22749 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:46.731901 22807 tablet_bootstrap.cc:492] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:46.732869 22979 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.734207 22976 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.734556 22936 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:46.715758 22914 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:46.740999 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:46.683331 22948 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:46.688809 22981 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.749696 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:46.730139 22917 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.735386 22956 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:46.715339 22923 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:46.752633 22931 consensus_meta.cc:287] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.006s	user 0.005s	sys 0.006s
I20260709 13:06:46.750233 22239 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:46.767690 21565 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:46.777599 22954 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:06:46.774688 22939 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:46.745273 22918 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.806176 22807 tablet_bootstrap.cc:492] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:06:46.807086 22807 ts_tablet_manager.cc:1403] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 3.887s	user 0.069s	sys 0.064s
I20260709 13:06:46.783357 21566 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:46.767823 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 874) took 2229 ms. Trace:
I20260709 13:06:46.807282 22785 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.742132 22769 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:45.780287 21634 rpcz_store.cc:276] 0709 13:06:43.357701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.361755 (+  4054us) service_pool.cc:224] Handling call
0709 13:06:43.420654 (+ 58899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.866121 (+445467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.866175 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.866894 (+   719us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.449863 (+582969us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.988136 (+538273us) log.cc:844] Serialized 14 byte log entry
0709 13:06:45.308452 (+320316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.319664 (+ 11212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.692725 (+373061us) raft_consensus.cc:1685] finished
0709 13:06:45.692759 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.718074 (+ 25315us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74163,"prepare.queue_time_us":856958,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":4074,"raft.queue_time_us":438542,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":31111,"thread_start_us":1456584,"threads_started":4,"wal-append.queue_time_us":723793}
W20260709 13:06:46.766950 22958 consensus_meta.cc:287] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.021s	user 0.009s	sys 0.008s
I20260709 13:06:46.754355 22899 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:46.822150 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 299584us
I20260709 13:06:46.808451 22956 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.847500 22892 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.863948 22769 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:46.864410 22921 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:46.864837 22892 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:46.850687 22807 raft_consensus.cc:359] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:46.866376 22807 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:06:46.867179 22807 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:46.869833 22807 ts_tablet_manager.cc:1434] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.062s	user 0.000s	sys 0.007s
I20260709 13:06:46.871289 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.871613 22948 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.783299 22914 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.872716 22914 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.872808 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:46.873515 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:46.874924 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 130088us
I20260709 13:06:46.861878 22956 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.871676 21391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 241) took 3922 ms. Trace:
I20260709 13:06:46.768040 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:46.891323 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.891310 22990 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:46.893982 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.894275 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 889) took 1131 ms. Trace:
I20260709 13:06:46.894682 21493 rpcz_store.cc:276] 0709 13:06:45.763281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.501634 (+738353us) service_pool.cc:224] Handling call
0709 13:06:46.894099 (+392465us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54000b7554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:46.894218 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520095104}
I20260709 13:06:46.894528 22990 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.894527 21391 rpcz_store.cc:276] 0709 13:06:42.949349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.949589 (+   240us) service_pool.cc:224] Handling call
0709 13:06:43.417875 (+468286us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4c090 00007f98a9feaf3a 00007f98afda11cc 00007f98afe9f37e 00007f98ae3602a4 00007f98ae360232 00007f98ae360161 00007f98ae3600dc 00007f98ae35f392 00007f98a831d48c 00007f98a831c8c6
0709 13:06:46.871615 (+3453740us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157544,"reported_tablets":4,"spinlock_wait_cycles":1006023040}
I20260709 13:06:46.775122 22749 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.897087 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.897382 22990 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:46.897783 21637 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:46.898100 22963 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:46.898500 21487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1311) took 2883 ms (client timeout 1644 ms). Trace:
I20260709 13:06:46.896104 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:46.859730 22899 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:46.899256 22899 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.899219 21493 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:46.899919 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.900779 21636 raft_consensus.cc:2410] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:46.891777 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.901871 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.902217 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 401) took 1923 ms. Trace:
I20260709 13:06:46.902676 21635 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:46.902638 22247 rpcz_store.cc:276] 0709 13:06:44.979009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.992700 (+ 13691us) service_pool.cc:224] Handling call
0709 13:06:44.992988 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.001690 (+  8702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.001724 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.001766 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:45.001797 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.901991 (+1900194us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b540045abd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:46.902043 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.902163 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19603328}
I20260709 13:06:46.904551 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.907420 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:46.908263 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.908655 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.909314 21641 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:06:46.898931 21487 rpcz_store.cc:269] 0709 13:06:44.014591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.014711 (+   120us) service_pool.cc:224] Handling call
0709 13:06:46.898312 (+2883601us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54003f8754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:46.898405 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174392704}
I20260709 13:06:46.909852 21639 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:46.776551 22974 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.912528 21638 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:46.911790 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.913497 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.776409 22896 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:46.917027 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.917775 21637 raft_consensus.cc:2410] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:46.914098 21641 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:46.920279 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:46.921099 21493 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:46.923168 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.808512 21494 rpcz_store.cc:276] 0709 13:06:44.538230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.989299 (+451069us) service_pool.cc:224] Handling call
0709 13:06:45.026909 (+ 37610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.299027 (+272118us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:45.680871 (+381844us) log.cc:844] Serialized 14 byte log entry
0709 13:06:45.737010 (+ 56139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.737065 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:45.737111 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.767598 (+1030487us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54002774d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:46.767641 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.767768 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21114,"prepare.queue_time_us":455648,"raft.queue_time_us":252,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":2904,"spinlock_wait_cycles":632166016,"thread_start_us":377155,"threads_started":2,"wal-append.queue_time_us":365568}
I20260709 13:06:46.929020 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:46.929692 21487 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:46.930701 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:46.931520 21487 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.933890 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.937384 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:46.939312 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.892021 22918 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:46.775113 22994 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.165s
I20260709 13:06:46.952042 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:46.808193 22931 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.919162 22892 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:46.963613 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:46.999353 21494 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.966946 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:46.956360 23005 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:46.940894 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.919229 22242 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:46.940337 22936 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:47.020867 22936 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:46.860693 22958 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:46.977209 21635 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:46.746582 21485 rpcz_store.cc:276] 0709 13:06:44.538543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.996961 (+458418us) service_pool.cc:224] Handling call
0709 13:06:44.997302 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.029007 (+ 31705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.062290 (+ 33283us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.342589 (+280299us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.593633 (+1251044us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:46.606335 (+ 12702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.612708 (+  6373us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.726733 (+114025us) raft_consensus.cc:1685] finished
0709 13:06:46.726760 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.726959 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61909,"raft.queue_time_us":18119,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":114381,"thread_start_us":1143404,"threads_started":1,"wal-append.queue_time_us":1178115}
I20260709 13:06:46.953513 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.951980 22990 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:47.027341 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:47.035939 21487 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:47.043015 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.966277 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:46.951830 22871 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:46.951910 22960 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:46.952129 22878 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:06:47.123157 21606 connection.cc:256] RPC call timeout handler was delayed by -1.368100711000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:06:47.060079 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:47.329826 21494 raft_consensus.cc:2410] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:47.117617 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:47.117875 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 194431us
I20260709 13:06:47.366897 21569 raft_consensus.cc:2410] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:47.346750 21606 connection.cc:256] RPC call timeout handler was delayed by -1.1224007110000684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 13:06:47.378556 21606 connection.cc:256] RPC call timeout handler was delayed by -1.1224007110000684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 13:06:47.379020 21606 connection.cc:256] RPC call timeout handler was delayed by -1.0432007110000541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 13:06:47.044220 21635 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:47.383317 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:47.384100 21635 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:47.397555 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:47.399870 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:47.406759 21562 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:47.421950 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:47.254642 23002 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:06:47.431949 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:47.433691 21562 raft_consensus.cc:2410] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:47.251590 22969 consensus_meta.cc:287] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.000s
W20260709 13:06:47.175791 22999 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:06:47.255769 22785 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:47.248643 22931 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:47.028475 22979 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:47.146472 22959 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:47.042685 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:47.256270 22965 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:47.160785 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:47.256687 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:47.443674 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:47.250643 22914 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:47.430469 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:46.949184 22921 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:47.057876 21634 raft_consensus.cc:2368] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4.
I20260709 13:06:47.028952 22951 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:47.043164 22923 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:47.467305 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:47.015280 22892 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:47.451112 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:47.426183 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:47.016422 22956 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:47.035979 21640 raft_consensus.cc:2376] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3. Re-sending same reply.
I20260709 13:06:47.428555 22958 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:47.466746 21637 raft_consensus.cc:2368] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3.
I20260709 13:06:47.479835 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:47.483798 21562 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:47.058482 22981 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:47.448619 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:47.036029 22990 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:47.413235 22871 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:47.425550 22960 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:47.405650 22878 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:47.561903 21488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 891) took 1793 ms (client timeout 1577 ms). Trace:
I20260709 13:06:47.015672 23005 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:47.464349 22969 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:47.494558 22936 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:06:47.479454 22939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.032s	sys 0.037s
I20260709 13:06:47.560062 21489 raft_consensus.cc:2368] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:47.565332 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:47.566640 21608 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.796s (SENT)
I20260709 13:06:47.517084 21494 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
W20260709 13:06:47.565997 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 183869us
I20260709 13:06:47.568542 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:47.535609 22243 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:06:47.567117 21488 rpcz_store.cc:269] 0709 13:06:45.768109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.522147 (+1754038us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:47.561819 (+ 39672us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:47.562526 21564 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:47.578959 21561 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:47.494019 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:47.481516 22959 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:47.530256 22921 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:47.563586 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:47.887064 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:47.978231 21640 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:47.978641 21487 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 1.
I20260709 13:06:47.978914 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1553) took 1015 ms. Trace:
W20260709 13:06:47.644201 23004 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:47.687430 21635 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:47.980649 21569 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:47.511826 21485 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:47.644119 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:47.992156 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.018733 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:48.019580 21488 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.016883 21639 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.028486 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1326) took 1152 ms. Trace:
I20260709 13:06:48.028990 21494 rpcz_store.cc:276] 0709 13:06:46.875998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.429489 (+553491us) service_pool.cc:224] Handling call
0709 13:06:48.028398 (+598909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.030157 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:47.979354 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1327) took 1103 ms. Trace:
I20260709 13:06:48.032294 21487 rpcz_store.cc:276] 0709 13:06:46.876243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.886638 (+1010395us) service_pool.cc:224] Handling call
0709 13:06:47.979242 (+ 92604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.033533 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.034543 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1330) took 1131 ms. Trace:
I20260709 13:06:48.035514 21487 rpcz_store.cc:276] 0709 13:06:46.903061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.033201 (+1130140us) service_pool.cc:224] Handling call
0709 13:06:48.034474 (+  1273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.050652 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:47.565227 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 877) took 3014 ms. Trace:
I20260709 13:06:48.053941 21494 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:47.646111 22899 consensus_meta.cc:287] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.000s
I20260709 13:06:48.066742 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:47.959988 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 210) took 3366 ms. Trace:
I20260709 13:06:47.641831 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:48.070408 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 78376.1us
I20260709 13:06:47.979493 22878 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:47.686578 23010 log.cc:927] Time spent T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:06:47.907521 22994 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:47.964643 22892 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:47.979360 21640 rpcz_store.cc:276] 0709 13:06:46.963961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.560060 (+596099us) service_pool.cc:224] Handling call
0709 13:06:47.978849 (+418789us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.073122 21639 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:47.644802 22956 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:47.969214 23005 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:48.059715 22939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.034s	sys 0.043s
I20260709 13:06:47.647667 22969 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.048276 22936 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:48.057173 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.071508 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1405) took 1119 ms. Trace:
I20260709 13:06:48.074838 22958 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.083189 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.123673 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1409) took 1110 ms. Trace:
W20260709 13:06:48.071127 21489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1314) took 4049 ms (client timeout 2075 ms). Trace:
I20260709 13:06:48.080137 21637 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.075996 22914 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:48.120222 21607 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:58388 dropped due to backpressure: service queue is full with 50 items
I20260709 13:06:48.080304 22878 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.081868 22895 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:48.077631 22243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 222) took 3485 ms (client timeout 1917 ms). Trace:
I20260709 13:06:48.068717 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1323) took 1182 ms. Trace:
I20260709 13:06:48.113565 22936 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:48.102721 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.124436 21569 rpcz_store.cc:276] 0709 13:06:47.013112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.073682 (+1060570us) service_pool.cc:224] Handling call
0709 13:06:48.123614 (+ 49932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.081399 22990 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.127456 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1542) took 1220 ms. Trace:
I20260709 13:06:48.131675 21639 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.074164 22238 rpcz_store.cc:276] 0709 13:06:44.593519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.766027 (+172508us) service_pool.cc:224] Handling call
0709 13:06:44.775932 (+  9905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.685212 (+909280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.685250 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.685318 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:45.685352 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.935270 (+2249918us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b540045fbd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:47.946391 (+ 11121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.958765 (+ 12374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066307840}
I20260709 13:06:48.111810 22871 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:48.120533 22840 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.082304 22994 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:48.132457 21643 rpcz_store.cc:276] 0709 13:06:46.907387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.907500 (+   113us) service_pool.cc:224] Handling call
0709 13:06:46.907798 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.913039 (+  5241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.913070 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.913499 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.323779 (+410280us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:47.516339 (+192560us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.516720 (+   381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.516801 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.127235 (+610434us) raft_consensus.cc:1685] finished
0709 13:06:48.127260 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.127391 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247,"prepare.queue_time_us":319223,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":12166,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":29905,"thread_start_us":522793,"threads_started":2,"wal-append.queue_time_us":548350}
I20260709 13:06:48.123193 22958 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:48.121481 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 878) took 3555 ms. Trace:
I20260709 13:06:48.077805 22899 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:48.105923 21564 rpcz_store.cc:276] 0709 13:06:46.950086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.111873 (+161787us) service_pool.cc:224] Handling call
0709 13:06:48.068965 (+957092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.126108 21634 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.145049 21488 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:48.146991 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1329) took 1270 ms. Trace:
I20260709 13:06:48.147140 21487 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:48.147373 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.147558 21488 rpcz_store.cc:276] 0709 13:06:46.876735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.018398 (+1141663us) service_pool.cc:224] Handling call
0709 13:06:48.146925 (+128527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.140872 22960 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:48.149837 21488 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:48.140302 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.128681 21607 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:58388 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 67)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 61)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 910)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 914)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 64)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 65)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 909)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 906)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 919)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 911)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 913)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 905)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 908)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 907)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 68)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 66)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 903)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1558)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 60)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 63)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 897)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 898)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 899)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 900)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 901)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 902)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 912)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 915)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 916)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 917)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 918)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 920)
I20260709 13:06:48.150601 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1410) took 1137 ms. Trace:
I20260709 13:06:48.155853 21569 rpcz_store.cc:276] 0709 13:06:47.013273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.139902 (+1126629us) service_pool.cc:224] Handling call
0709 13:06:48.150469 (+ 10567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.144980 22958 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.153875 21494 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:48.131690 21485 rpcz_store.cc:276] 0709 13:06:46.875240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.110834 (+235594us) service_pool.cc:224] Handling call
0709 13:06:48.057644 (+946810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.151470 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 105) took 3590 ms. Trace:
I20260709 13:06:48.157629 22959 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:48.124224 21489 rpcz_store.cc:269] 0709 13:06:44.021835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.053137 (+ 31302us) service_pool.cc:224] Handling call
0709 13:06:47.354954 (+3301817us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b5800011198. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebde9c 00007f98a6ebda5b 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:48.069259 (+714305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39655296}
I20260709 13:06:48.158767 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1331) took 1255 ms. Trace:
I20260709 13:06:48.164481 21488 rpcz_store.cc:276] 0709 13:06:44.581585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.148454 (+3566869us) service_pool.cc:224] Handling call
0709 13:06:48.148669 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.151150 (+  2481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.151418 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.164722 21494 rpcz_store.cc:276] 0709 13:06:46.903338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.029829 (+1126491us) service_pool.cc:224] Handling call
0709 13:06:48.158695 (+128866us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.166316 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.158736 22240 raft_consensus.cc:2393] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:06:48.131022 22243 rpcz_store.cc:269] 0709 13:06:44.587894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.594556 (+  6662us) service_pool.cc:224] Handling call
0709 13:06:47.016051 (+2421495us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:48.070182 (+1054131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92902784}
I20260709 13:06:48.173703 21494 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.183772 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 880) took 3615 ms. Trace:
I20260709 13:06:48.184230 21494 rpcz_store.cc:276] 0709 13:06:44.568107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.173334 (+3605227us) service_pool.cc:224] Handling call
0709 13:06:48.173580 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.183445 (+  9865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.183697 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.186223 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 107) took 3596 ms. Trace:
I20260709 13:06:48.175407 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 106) took 3593 ms. Trace:
I20260709 13:06:48.175879 22994 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.176272 21569 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:48.193826 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1412) took 1180 ms. Trace:
I20260709 13:06:48.194125 21569 rpcz_store.cc:276] 0709 13:06:47.013612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.156645 (+1143033us) service_pool.cc:224] Handling call
0709 13:06:48.193767 (+ 37122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.177814 22894 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:48.179245 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.195622 21634 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.188930 21485 rpcz_store.cc:276] 0709 13:06:44.581979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.174337 (+3592358us) service_pool.cc:224] Handling call
0709 13:06:48.174710 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.174960 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.174998 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.175053 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:48.175102 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.175181 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.175334 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.196205 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1559) took 1029 ms. Trace:
I20260709 13:06:48.196589 21634 rpcz_store.cc:276] 0709 13:06:47.167134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.157061 (+989927us) service_pool.cc:224] Handling call
0709 13:06:48.196147 (+ 39086us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:48.196985 22823 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.457s	user 0.022s	sys 0.030s
I20260709 13:06:48.197513 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.198148 21634 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.179725 22899 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:48.181432 22891 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.158249 21640 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.158393 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.192328 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.203130 21567 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.192816 22845 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.071344 21492 rpcz_store.cc:276] 0709 13:06:44.551365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.700298 (+2148933us) service_pool.cc:224] Handling call
0709 13:06:46.747803 (+ 47505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.775598 (+ 27795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.775639 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.776230 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.916879 (+140649us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:46.916922 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.916999 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.517671 (+600672us) raft_consensus.cc:1685] finished
0709 13:06:47.522550 (+  4879us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.562999 (+ 40449us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11091,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":140213,"threads_started":1,"wal-append.queue_time_us":266620}
I20260709 13:06:48.188289 22914 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.205297 22914 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.205827 22886 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:48.200241 21607 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:58388 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 67)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 61)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 910)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 914)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 64)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 65)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 922)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 924)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 909)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 906)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 919)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 911)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 913)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 905)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 928)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 908)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 907)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 68)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 66)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 903)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1558)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 60)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 63)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 897)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 898)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 899)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 900)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 901)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 902)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 912)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 915)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 916)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 917)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 918)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 920)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 925)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 926)
I20260709 13:06:48.207571 22914 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:48.199112 21565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1378) took 2490 ms (client timeout 1946 ms). Trace:
W20260709 13:06:48.208428 21565 rpcz_store.cc:269] 0709 13:06:45.708531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.571898 (+863367us) service_pool.cc:224] Handling call
0709 13:06:48.198846 (+1626948us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54001fa4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:48.198983 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405103488}
I20260709 13:06:48.209632 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.211028 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.198601 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1557) took 1032 ms. Trace:
I20260709 13:06:48.204169 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:48.214136 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 648314us
W20260709 13:06:48.214403 21486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1317) took 4191 ms (client timeout 1917 ms). Trace:
I20260709 13:06:48.214563 21567 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.207929 21607 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:58388 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 67)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 61)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 910)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 914)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 64)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 65)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 922)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 924)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 909)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 906)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 919)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 911)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 913)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 905)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 928)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 908)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 907)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 68)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 66)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 903)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1558)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 60)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 63)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 897)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 898)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 899)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 900)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 901)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 902)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 912)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 915)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 916)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 917)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 918)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 920)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 925)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 926)
I20260709 13:06:48.211772 21565 raft_consensus.cc:2410] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:48.186710 21494 rpcz_store.cc:276] 0709 13:06:44.590073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.185188 (+3595115us) service_pool.cc:224] Handling call
0709 13:06:48.185598 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.185820 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.185859 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.185915 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:48.185959 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.186029 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.186154 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.144500 21491 rpcz_store.cc:276] 0709 13:06:44.557970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.896150 (+2338180us) service_pool.cc:224] Handling call
0709 13:06:46.896502 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.896914 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.896969 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.897489 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.117027 (+219538us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:47.131669 (+ 14642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.246318 (+114649us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.100977 (+854659us) raft_consensus.cc:1685] finished
0709 13:06:48.102111 (+  1134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.113624 (+ 11513us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1947,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":129,"thread_start_us":130842,"threads_started":1,"wal-append.queue_time_us":615983}
I20260709 13:06:48.212275 21564 raft_consensus.cc:2368] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:48.223551 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1411) took 1210 ms. Trace:
I20260709 13:06:48.223955 21564 rpcz_store.cc:276] 0709 13:06:47.013448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.151248 (+1137800us) service_pool.cc:224] Handling call
0709 13:06:48.223488 (+ 72240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.224946 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.225528 21564 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.225840 22936 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.212714 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.213056 22809 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.211066 22953 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.213343 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 883) took 3493 ms. Trace:
W20260709 13:06:48.215595 21608 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.992s (SENT)
I20260709 13:06:48.216528 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.228627 21639 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.229197 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1567) took 1052 ms. Trace:
I20260709 13:06:48.229601 21639 rpcz_store.cc:276] 0709 13:06:47.176680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.216275 (+1039595us) service_pool.cc:224] Handling call
0709 13:06:48.229138 (+ 12863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.231051 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 110) took 2595 ms. Trace:
I20260709 13:06:48.231243 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.231709 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 882) took 3611 ms. Trace:
I20260709 13:06:48.231851 21639 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.232635 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1566) took 1063 ms. Trace:
I20260709 13:06:48.231449 21494 rpcz_store.cc:276] 0709 13:06:45.635317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.218951 (+2583634us) service_pool.cc:224] Handling call
0709 13:06:48.219267 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.219620 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.219647 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.220069 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.229099 (+  9030us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:48.229136 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.229208 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.230816 (+  1608us) raft_consensus.cc:1685] finished
0709 13:06:48.230838 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.230993 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":8670,"threads_started":1,"wal-append.queue_time_us":9038}
W20260709 13:06:48.214769 21486 rpcz_store.cc:269] 0709 13:06:44.022835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.087474 (+ 64639us) service_pool.cc:224] Handling call
0709 13:06:48.214235 (+4126761us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540002e4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:48.214333 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345119104}
I20260709 13:06:48.217657 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.234284 21567 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.232412 21485 rpcz_store.cc:276] 0709 13:06:44.620419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.196828 (+3576409us) service_pool.cc:224] Handling call
0709 13:06:48.204381 (+  7553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.213792 (+  9411us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:48.218971 (+  5179us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.231299 (+ 12328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.231369 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:48.231421 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.231498 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.231647 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2854,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":100,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":11644,"threads_started":1,"wal-append.queue_time_us":10643}
I20260709 13:06:48.234956 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 111) took 2595 ms. Trace:
I20260709 13:06:48.234994 22994 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.218508 22823 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.480s	user 0.023s	sys 0.030s
I20260709 13:06:48.235915 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 887) took 2473 ms. Trace:
I20260709 13:06:48.218604 22963 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:48.235841 22994 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.236661 22963 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.236405 21485 rpcz_store.cc:276] 0709 13:06:45.762428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.234954 (+2472526us) service_pool.cc:224] Handling call
0709 13:06:48.235276 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.235568 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.235608 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.235656 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:48.235692 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.235750 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.235858 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.238291 22994 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:48.219537 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 214) took 2453 ms. Trace:
I20260709 13:06:48.235149 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.221084 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.238757 22963 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:48.235438 21486 rpcz_store.cc:276] 0709 13:06:45.640164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.234181 (+2594017us) service_pool.cc:224] Handling call
0709 13:06:48.234498 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.234652 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.234674 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.234712 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:48.234739 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.234811 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.234902 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.239941 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.238932 22246 rpcz_store.cc:276] 0709 13:06:45.765930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.767219 (+  1289us) service_pool.cc:224] Handling call
0709 13:06:48.218774 (+2451555us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdf8c 00007f98a6ebdef6 0000000000375939 00007f98aef311e0 00007f98aeffa0c4 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:06:48.218952 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.219146 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.219178 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.219231 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:48.219275 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.219350 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.219477 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39253248}
I20260709 13:06:48.226985 21569 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.241295 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.241477 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1328) took 1365 ms. Trace:
I20260709 13:06:48.241808 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.219854 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.218084 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.241956 21486 rpcz_store.cc:276] 0709 13:06:46.876498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.240727 (+1364229us) service_pool.cc:224] Handling call
0709 13:06:48.240999 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.241181 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.241205 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.241246 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:48.241276 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.241327 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.241423 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.242990 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.243687 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:48.238993 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 888) took 2476 ms. Trace:
I20260709 13:06:48.244534 21485 rpcz_store.cc:276] 0709 13:06:45.762998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.238108 (+2475110us) service_pool.cc:224] Handling call
0709 13:06:48.238456 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.238638 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.238668 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.238710 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:48.238747 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.238830 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.238942 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.245970 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 879) took 3684 ms. Trace:
I20260709 13:06:48.246302 21640 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 2: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.247308 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.246348 21488 rpcz_store.cc:276] 0709 13:06:44.561513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.172906 (+3611393us) service_pool.cc:224] Handling call
0709 13:06:48.188406 (+ 15500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.188640 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:48.201695 (+ 13055us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.245195 (+ 43500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.245243 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:48.245279 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.245802 (+   523us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.245918 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12835,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":96,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":117,"thread_start_us":43107,"threads_started":1,"wal-append.queue_time_us":39501}
I20260709 13:06:48.233137 21639 rpcz_store.cc:276] 0709 13:06:47.169342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.230717 (+1061375us) service_pool.cc:224] Handling call
0709 13:06:48.232567 (+  1850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.248908 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.247928 21640 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.249655 21639 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.250128 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1562) took 1082 ms. Trace:
I20260709 13:06:48.250659 21640 rpcz_store.cc:276] 0709 13:06:47.168088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.247068 (+1078980us) service_pool.cc:224] Handling call
0709 13:06:48.250070 (+  3002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.252105 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.252950 21640 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:48.242388 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.253693 21567 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.253945 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.254547 21640 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.250167 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1569) took 1072 ms. Trace:
I20260709 13:06:48.260128 21639 rpcz_store.cc:276] 0709 13:06:47.177323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.248602 (+1071279us) service_pool.cc:224] Handling call
0709 13:06:48.250119 (+  1517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.261211 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.238407 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:48.264065 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:48.264537 22929 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:48.226395 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.267475 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:48.222925 21634 rpcz_store.cc:276] 0709 13:06:47.166440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.197258 (+1030818us) service_pool.cc:224] Handling call
0709 13:06:48.198550 (+  1292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.271165 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.227875 22953 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:48.271943 21639 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:48.271629 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:48.272652 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 84811.2us
I20260709 13:06:48.273746 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:48.276464 22809 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.272316 22953 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:48.281431 22809 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.281467 22953 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.278343 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0927477440000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:06:48.272948 22963 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.226586 22958 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.288393 22958 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:48.279824 21638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1537) took 1404 ms (client timeout 1676 ms). Trace:
W20260709 13:06:48.289032 21638 rpcz_store.cc:269] 0709 13:06:46.875445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.891468 (+ 16023us) service_pool.cc:224] Handling call
0709 13:06:48.279662 (+1388194us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b540021b954. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:48.279755 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20799360}
I20260709 13:06:48.290308 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.290982 21638 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:48.291985 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.277561 22917 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:48.284099 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:48.285689 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0927477440000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:06:48.292820 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0864477439999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 13:06:48.292819 21638 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:48.228428 21492 rpcz_store.cc:276] 0709 13:06:44.719784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.212437 (+3492653us) service_pool.cc:224] Handling call
0709 13:06:48.212800 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.212979 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.213014 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.213060 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:48.213103 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.213166 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.213288 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:48.293422 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0864477439999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 13:06:48.293779 21637 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 2: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.296322 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 82) took 3284 ms. Trace:
I20260709 13:06:48.296694 21566 rpcz_store.cc:276] 0709 13:06:45.011924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.682013 (+1670089us) service_pool.cc:224] Handling call
0709 13:06:46.684256 (+  2243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.808343 (+124087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.296081 (+1487738us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b54000a2b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:48.296262 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192662784}
I20260709 13:06:48.298391 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.299146 21638 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:48.300163 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.300450 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:48.303308 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:48.304975 22943 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:48.305423 21635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1552) took 1355 ms (client timeout 1767 ms). Trace:
I20260709 13:06:48.305557 22943 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:48.306167 22943 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:48.309160 22241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 399) took 3875 ms (client timeout 1856 ms). Trace:
W20260709 13:06:48.309758 22241 rpcz_store.cc:269] 0709 13:06:44.434027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.437247 (+  3220us) service_pool.cc:224] Handling call
0709 13:06:48.308893 (+3871646us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400622854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:48.309060 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2482826112}
I20260709 13:06:48.312495 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.301529 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.315541 21638 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.316044 22953 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.316439 22953 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:48.316833 22953 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.285883 21608 leader_election.cc:400] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:48.272527 21634 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:48.318220 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.274199 23014 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.318871 21634 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
W20260709 13:06:48.305908 21635 rpcz_store.cc:269] 0709 13:06:46.949684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.421623 (+471939us) service_pool.cc:224] Handling call
0709 13:06:48.305259 (+883636us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54000f4454. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:48.305367 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608729472}
I20260709 13:06:48.323863 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.325096 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.325800 21634 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.292902 21639 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.327389 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.327956 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 881) took 3745 ms. Trace:
I20260709 13:06:48.328377 21489 rpcz_store.cc:276] 0709 13:06:44.582449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.181971 (+3599522us) service_pool.cc:224] Handling call
0709 13:06:48.327184 (+145213us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b5800011198. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:06:48.327382 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.327581 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.327630 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.327675 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:48.327718 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.327786 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.327900 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7686400}
I20260709 13:06:48.329975 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.330919 22888 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:48.328150 21639 raft_consensus.cc:2410] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:48.333868 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.326542 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.334751 21635 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:48.335234 21634 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:48.336022 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.336257 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.336968 21634 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:48.337051 21635 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.338763 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.339386 21635 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
W20260709 13:06:48.339640 22996 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.477s	user 0.016s	sys 0.008s
I20260709 13:06:48.340301 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.340381 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.341074 21635 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.341018 21639 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:48.342175 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.342484 22243 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:48.342978 21639 raft_consensus.cc:2410] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:48.343679 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.344480 21639 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.345796 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1558) took 1179 ms. Trace:
I20260709 13:06:48.346195 21639 rpcz_store.cc:276] 0709 13:06:47.166826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.344995 (+1178169us) service_pool.cc:224] Handling call
0709 13:06:48.345278 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.345458 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.345497 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.345550 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:48.345592 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.345652 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.345749 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.347874 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1568) took 1170 ms. Trace:
I20260709 13:06:48.347774 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:48.349331 21639 rpcz_store.cc:276] 0709 13:06:47.177005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.347198 (+1170193us) service_pool.cc:224] Handling call
0709 13:06:48.347447 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.347600 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.347623 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.347661 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:48.347688 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.347736 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.347830 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.350766 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:48.351158 22938 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:48.351512 22953 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.353595 22953 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:48.354636 22921 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:48.356420 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 104) took 3795 ms. Trace:
I20260709 13:06:48.356982 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:48.316448 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.359330 21638 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:48.360208 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.360829 21638 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:48.361960 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.362929 21638 raft_consensus.cc:2410] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:48.363245 22987 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.363626 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.364204 21638 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:48.364943 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.365931 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.366389 21638 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.350466 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64692.9us
I20260709 13:06:48.350592 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.367339 21643 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.367936 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1556) took 1205 ms. Trace:
I20260709 13:06:48.368223 21643 rpcz_store.cc:276] 0709 13:06:47.162630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.350347 (+1187717us) service_pool.cc:224] Handling call
0709 13:06:48.367880 (+ 17533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.369060 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.369724 21643 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.363664 22987 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:48.370729 22987 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.356786 21487 rpcz_store.cc:276] 0709 13:06:44.560686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.069830 (+3509144us) service_pool.cc:224] Handling call
0709 13:06:48.146917 (+ 77087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.147704 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.356212 (+208508us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b540008aa50. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:48.356353 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176352128}
I20260709 13:06:48.340919 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 876) took 3802 ms. Trace:
I20260709 13:06:48.371963 21490 rpcz_store.cc:276] 0709 13:06:44.540615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.614453 (+2073838us) service_pool.cc:224] Handling call
0709 13:06:46.636064 (+ 21611us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.636410 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.636438 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.636901 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.746327 (+109426us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:46.746389 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.747032 (+   643us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.339088 (+1592056us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:06:48.340615 (+  1527us) raft_consensus.cc:1685] finished
0709 13:06:48.340636 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.340864 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":5720,"spinlock_wait_cycles":28020992,"thread_start_us":61841,"threads_started":1,"wal-append.queue_time_us":185899}
I20260709 13:06:48.372906 22943 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:48.375842 21635 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:48.377889 21635 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.337951 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.379623 21634 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:48.380117 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.380722 21560 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.378204 22987 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:48.381675 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.382130 21634 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.382483 21568 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.383267 22987 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.383605 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:48.385655 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.386413 21641 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
W20260709 13:06:48.386991 21641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1549) took 1458 ms (client timeout 1790 ms). Trace:
W20260709 13:06:48.387432 21641 rpcz_store.cc:269] 0709 13:06:46.928797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.928934 (+   137us) service_pool.cc:224] Handling call
0709 13:06:48.385478 (+1456544us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:48.386921 (+  1443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8355712}
I20260709 13:06:48.388839 21641 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.390130 21641 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:48.390270 21567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:06:48.390915 21567 raft_consensus.cc:606] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:48.393105 22240 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 215) took 2618 ms (client timeout 1819 ms). Trace:
W20260709 13:06:48.393534 22240 rpcz_store.cc:269] 0709 13:06:45.775184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.775902 (+   718us) service_pool.cc:224] Handling call
0709 13:06:46.872698 (+1096796us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebdeee 0000000000375939 00007f98aef311e0 00007f98aeffa0c4 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:48.392906 (+1520208us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400540e54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:48.393038 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4357590656}
I20260709 13:06:48.394157 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:48.394595 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:48.395033 21635 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.395751 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.396278 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:48.292205 21640 raft_consensus.cc:2410] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:48.397033 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.397670 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:48.397812 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.398286 21564 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.397814 22953 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.399245 22953 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:48.399631 22953 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.404491 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:48.405123 22245 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:48.405923 21459 connection.cc:256] RPC call timeout handler was delayed by -1.1501775560000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260709 13:06:48.407236 21459 connection.cc:256] RPC call timeout handler was delayed by -1.0284760020000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 13:06:48.407938 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:48.410938 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.411561 21567 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.412343 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.413345 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.414315 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.415414 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.416309 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.416922 22245 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.417761 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.418674 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:48.419363 21457 connection.cc:256] RPC call timeout handler was delayed by -1.3405787920000876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 13:06:48.419559 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.412249 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:06:48.420585 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.422289 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.424384 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:48.418777 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.426316 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:48.431582 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.437156 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.438418 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:48.438264 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.439232 21638 raft_consensus.cc:2410] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:48.439639 21641 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.440555 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.442085 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:48.442390 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.441140 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.443675 21641 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.445108 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:48.445688 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:48.447094 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:48.447465 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.430099 22943 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:48.449826 22958 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.451182 22958 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:48.451565 22958 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.454290 22953 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.449887 22929 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.432255 22954 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.455307 22929 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.455404 22954 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.455717 22929 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.455878 22954 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.456024 21561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1399) took 1522 ms (client timeout 1783 ms). Trace:
I20260709 13:06:48.456559 22953 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:48.456422 21561 rpcz_store.cc:269] 0709 13:06:46.933314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.933521 (+   207us) service_pool.cc:224] Handling call
0709 13:06:48.455819 (+1522298us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400152054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:48.455968 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452391808}
I20260709 13:06:48.430512 22933 raft_consensus.cc:2764] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:48.446528 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:48.446246 22963 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.438230 22241 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.397671 23027 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.442687 22978 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:48.432416 23014 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.449249 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.444880 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.459136 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.459630 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.460284 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.446976 22921 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.482350 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.482473 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.460786 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.461542 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.462630 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.464556 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.483505 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.483608 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.464474 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.484762 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.484834 21494 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:48.437541 22966 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.441638 22845 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.473381 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:48.441810 22888 raft_consensus.cc:2764] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:48.488088 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.449918 22994 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.483595 21638 raft_consensus.cc:2376] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3. Re-sending same reply.
I20260709 13:06:48.486613 21486 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.486694 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:48.484133 21488 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:48.501986 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.487294 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.450105 22956 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.474949 23027 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:48.488161 21634 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:48.506063 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.480350 23014 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:48.486137 22978 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:48.507014 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.507035 22972 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:48.507573 22928 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.479067 22240 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.508123 22972 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:48.507790 22978 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.486758 22966 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:48.508944 22966 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.509114 22972 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:48.474099 22963 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:48.510751 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1554) took 1451 ms. Trace:
I20260709 13:06:48.511023 22963 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.511257 21637 rpcz_store.cc:276] 0709 13:06:47.059192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.220769 (+1161577us) service_pool.cc:224] Handling call
0709 13:06:48.510542 (+289773us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b540024ca54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:48.510693 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122439552}
I20260709 13:06:48.505223 22809 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:48.512478 22809 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:48.512601 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.513233 21637 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.513513 21564 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:48.513386 22809 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:48.514117 22987 raft_consensus.cc:2764] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:48.514286 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.499117 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:48.517858 21494 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.499403 22914 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:48.516505 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.490644 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.495848 22933 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.448993 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 94) took 1077 ms. Trace:
I20260709 13:06:48.519981 21565 rpcz_store.cc:276] 0709 13:06:47.371713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.244550 (+872837us) service_pool.cc:224] Handling call
0709 13:06:48.244878 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.245073 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:48.292761 (+ 47688us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.448746 (+155985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.448797 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:48.448824 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.448869 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.448952 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6579,"prepare.queue_time_us":69612,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":16700,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":11767,"spinlock_wait_cycles":10496,"thread_start_us":196391,"threads_started":2}
I20260709 13:06:48.505265 22956 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.523115 22956 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.525244 22914 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.525590 22914 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:48.526425 22914 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:48.528050 22914 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.528995 22933 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:48.529490 22933 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.532217 23021 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:06:48.532537 22958 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.536541 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.537237 21640 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.538141 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.482911 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.502326 21391 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 2 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:06:48.538965 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 56127.7us
W20260709 13:06:48.540591 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 105945us
I20260709 13:06:48.502703 21641 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.505179 22930 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.507242 23014 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.497745 21653 tablet_copy_service.cc:342] P a87bd86b86e74aa8bb61189215b73439: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-22b45f3e8b8e428ea4709e7e9ee43868 received from {username='slave'} at 127.0.0.1:36050
I20260709 13:06:48.498526 21493 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:06:48.498821 22845 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:48.490267 22950 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.508311 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.504127 22843 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.515372 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.571413 21636 raft_consensus.cc:2410] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:48.500427 22954 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.517107 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.552945 22921 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.505033 23027 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.542963 21459 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:48.526589 22929 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.543663 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.546999 21494 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:48.551589 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.578998 21643 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 2: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.555894 21486 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:48.564836 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:48.579357 21638 raft_consensus.cc:2376] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3. Re-sending same reply.
W20260709 13:06:48.563501 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 84954.3us
I20260709 13:06:48.552474 22958 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:48.573056 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 69559.8us
I20260709 13:06:48.538208 22994 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.571242 22917 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.574936 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1546) took 1666 ms. Trace:
I20260709 13:06:48.585244 21636 rpcz_store.cc:276] 0709 13:06:46.908635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.910035 (+  1400us) service_pool.cc:224] Handling call
0709 13:06:48.515236 (+1605201us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:48.574855 (+ 59619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15503744}
I20260709 13:06:48.542603 21640 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:48.543522 21487 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:48.557437 22930 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:48.574685 21634 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.587914 22930 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.589650 22954 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:48.581868 22840 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.591791 22840 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:48.592098 22929 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:48.594266 22963 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.595558 23027 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:48.596715 22963 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:48.583737 22987 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:48.597306 22963 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:48.579704 21493 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:48.564033 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:48.580226 22210 connection.cc:256] RPC call timeout handler was delayed by -3.0041885719999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
I20260709 13:06:48.569291 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.556955 21637 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:48.567847 22845 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.577526 22921 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:48.582554 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.604056 21638 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:48.582522 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:48.605919 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:48.575124 21653 tablet_copy_service.cc:434] P a87bd86b86e74aa8bb61189215b73439: ending tablet copy session 549b31ac31b6428994b45938abc223a7-22b45f3e8b8e428ea4709e7e9ee43868 on tablet 22b45f3e8b8e428ea4709e7e9ee43868 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:06:48.570730 22843 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:48.572768 22928 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.584335 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.556963 22942 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.574705 22795 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.597808 22987 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.598855 21488 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:48.598914 21641 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 2: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:48.604350 22921 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.598827 22210 connection.cc:256] RPC call timeout handler was delayed by -3.0041885719999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
I20260709 13:06:48.646950 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:48.647315 22210 connection.cc:256] RPC call timeout handler was delayed by -2.9906885719999536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 13:06:48.647758 21636 raft_consensus.cc:2368] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3.
I20260709 13:06:48.648623 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.649394 21636 raft_consensus.cc:2410] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:48.603062 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1573) took 1034 ms. Trace:
I20260709 13:06:48.567288 22950 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.611029 22843 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.592197 22840 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.627988 22942 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:48.605072 22963 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.599330 21635 raft_consensus.cc:2368] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4.
W20260709 13:06:48.650260 22210 connection.cc:256] RPC call timeout handler was delayed by -2.4793364380000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 13:06:48.650436 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.676016 21636 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.607810 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1543) took 1700 ms. Trace:
I20260709 13:06:48.649768 21639 rpcz_store.cc:276] 0709 13:06:47.569203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.351226 (+782023us) service_pool.cc:224] Handling call
0709 13:06:48.351533 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.351748 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.351773 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.352255 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.446364 (+ 94109us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:48.572863 (+126499us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.573111 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.573179 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.602877 (+ 29698us) raft_consensus.cc:1685] finished
0709 13:06:48.602895 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.603019 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1444,"prepare.queue_time_us":76596,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":142,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4454,"thread_start_us":184425,"threads_started":2,"wal-append.queue_time_us":163842}
I20260709 13:06:48.677227 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.678102 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.678478 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.679390 21639 raft_consensus.cc:2410] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:48.680523 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.682096 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.682818 21639 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:48.676659 21642 rpcz_store.cc:276] 0709 13:06:46.907662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.907771 (+   109us) service_pool.cc:224] Handling call
0709 13:06:48.413989 (+1506218us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:06:48.414177 (+   188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.414526 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.414565 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.415022 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.474094 (+ 59072us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:48.581616 (+107522us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.581832 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.582300 (+   468us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.599870 (+ 17570us) raft_consensus.cc:1685] finished
0709 13:06:48.607408 (+  7538us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.607675 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44385,"prepare.queue_time_us":49065,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":2643,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":7640,"spinlock_wait_cycles":14105984,"thread_start_us":122263,"threads_started":2,"wal-append.queue_time_us":159840}
I20260709 13:06:48.637077 22795 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.661064 22950 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.646174 22987 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:48.598259 23027 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.604863 22966 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:48.675851 22210 connection.cc:256] RPC call timeout handler was delayed by -2.0918587039999466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:06:48.699208 22210 connection.cc:256] RPC call timeout handler was delayed by -1.5947885719999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.326s for a response
I20260709 13:06:48.651387 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:48.700379 21641 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
I20260709 13:06:48.701573 21641 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:48.599030 22953 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:06:48.687217 21636 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:48.704322 21636 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.675977 22942 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.707219 21636 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:48.627074 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48372.8us
I20260709 13:06:48.636402 22928 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:48.690234 22795 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.718231 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 140723us
I20260709 13:06:48.721714 21641 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.712215 22953 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:06:48.721309 23040 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 13:06:48.749513 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 143680us
I20260709 13:06:48.750592 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.719908 22987 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.769481 23046 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.779474 22963 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:48.746876 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 47098.3us
I20260709 13:06:48.797199 22956 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.767071 23041 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:48.801095 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.801494 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 86984.2us
I20260709 13:06:48.813679 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:06:48.800473 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 78614.1us
I20260709 13:06:48.815436 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:48.816872 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.821393 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:48.827467 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:48.827777 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:48.823858 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:48.828486 21486 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.870240 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.871034 21638 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.879398 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.798405 22987 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.887075 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.887298 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:48.887813 21639 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.897850 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.898569 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.898468 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 74706.8us
I20260709 13:06:48.899420 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:48.802060 23041 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:48.881477 22823 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:48.919025 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 90118.3us
I20260709 13:06:48.822937 23014 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:48.923806 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 173297us
I20260709 13:06:49.064117 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:06:49.037948 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 217274us
I20260709 13:06:48.937737 21635 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
W20260709 13:06:49.045460 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.056239 21638 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
W20260709 13:06:49.072152 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 172642us
I20260709 13:06:49.073972 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:49.057920 21639 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:49.059175 21565 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.076097 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.079572 21486 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:48.913369 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:48.914551 22823 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:48.935732 22899 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.910830 22930 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.129863 22899 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:49.130365 21565 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.991063 22933 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.128831 22943 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:48.952435 22942 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.911212 22966 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:49.004233 23014 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:48.907333 23041 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:49.141533 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61024us
I20260709 13:06:48.996425 23042 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:49.143222 23042 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.143038 22843 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.143733 22914 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.144268 22914 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.145063 23042 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:48.907298 23044 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.010327 23046 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.146878 23044 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:49.147639 23044 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.913672 23049 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.104982 23067 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:49.108588 22978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.015s	sys 0.005s
I20260709 13:06:48.989094 22921 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.112408 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:49.128844 22867 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.130512 22899 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.123721 22788 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.141649 22246 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.146085 22843 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.091472 22956 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.150213 23049 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:49.154757 21491 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:49.158812 22978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.016s	sys 0.006s
I20260709 13:06:49.159761 22933 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.146651 23042 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.166810 22788 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.175143 21634 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.166514 22823 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.175509 22788 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.176716 23049 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.166486 22950 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:49.180204 22928 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:06:49.182806 22845 consensus_meta.cc:287] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.012s
W20260709 13:06:49.189679 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82000.7us
I20260709 13:06:49.193339 23066 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.156842 23067 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:49.163372 23048 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:49.193795 23066 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.200089 22845 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.202402 22950 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:06:49.163879 23040 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:49.215072 22942 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:49.217468 22840 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.009s
I20260709 13:06:49.218030 22840 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.198755 23067 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.217537 22930 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.225714 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:49.207698 23066 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.232172 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:49.241468 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46430.3us
I20260709 13:06:49.251192 22840 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:49.247911 22930 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.252019 21459 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:49.256981 23074 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.257515 23074 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.257910 23074 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.256096 22930 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:49.265875 22930 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.254630 22845 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.264187 22867 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:06:49.277905 22867 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.278395 22867 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:49.282939 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.284577 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:49.285744 23073 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.286680 23073 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.287065 23073 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.287413 23073 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.290452 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:49.292671 23069 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.293285 23069 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:49.293809 23069 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:49.289573 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46061.9us
W20260709 13:06:49.298615 22795 consensus_meta.cc:287] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.010s
I20260709 13:06:49.299971 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:49.301630 22823 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.302250 23070 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.305573 22795 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.316200 23070 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:49.318409 22795 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:49.307243 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:49.319583 22929 raft_consensus.cc:2764] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:49.320689 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.321550 22929 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.309060 22921 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:49.325454 22245 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.311225 22914 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.329686 22914 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.314721 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 925) took 1123 ms. Trace:
I20260709 13:06:49.314905 23041 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.305773 22867 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.307101 22994 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:49.317767 23070 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.327028 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.333285 23044 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.334674 23066 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.331117 21641 rpcz_store.cc:276] 0709 13:06:48.190962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.702259 (+511297us) service_pool.cc:224] Handling call
0709 13:06:48.706958 (+  4699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.723165 (+ 16207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.314043 (+590878us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b540029e854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:49.314431 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33360128}
I20260709 13:06:49.337451 23069 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:49.341544 22942 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.342942 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.347998 23070 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.348994 23044 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.349135 23066 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:49.345037 22994 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.351164 22240 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.352303 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.352769 22867 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.353673 22795 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.353893 21388 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 2, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 2 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.356154 23061 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.356318 23049 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.351482 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:49.365631 23073 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.326390 22823 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.316722 22788 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.368202 22942 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:49.347048 23067 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.389094 23061 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:49.393010 22942 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.396144 22929 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:49.402310 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 59587.3us
I20260709 13:06:49.403553 23069 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.404383 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.406904 23077 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:49.407627 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.408212 22795 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.408716 22795 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:49.409188 22795 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:49.413594 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.412084 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 59908.2us
I20260709 13:06:49.398375 23061 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.417603 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:49.419160 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.419809 23069 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.420500 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:49.424733 21388 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 3, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 3 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.426621 23041 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.427135 23073 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.411535 22994 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.428416 23067 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.418349 22899 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:49.429656 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 139405us
W20260709 13:06:49.430709 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 98077.4us
I20260709 13:06:49.431895 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.432008 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:49.433408 22929 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.433969 22929 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.434357 22929 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.433543 21388 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 3, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 3 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.439137 23049 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:49.440842 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.441707 23054 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.442518 22788 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.442572 23054 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.443224 23054 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.437098 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:49.443011 23081 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:49.444406 23074 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.448333 23077 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:49.448505 22899 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.448956 23077 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.450039 23077 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.451253 23049 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.451406 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:49.451766 23049 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:49.452395 23041 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.452988 21457 leader_election.cc:400] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3.
I20260709 13:06:49.453051 23041 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:49.453430 21457 leader_election.cc:403] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.450563 23069 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.443887 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:49.453673 23041 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.454891 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.455914 22845 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:49.456421 22845 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.457316 22845 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.458588 23081 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.459039 23081 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:49.460551 23081 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.461912 23081 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.462767 23041 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.465579 23066 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3.
I20260709 13:06:49.465718 23067 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.466308 23067 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:49.466887 23067 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.446674 23074 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.470058 22942 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.470597 22994 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.474282 22795 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.484668 22795 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.476137 22930 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.463593 22788 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.487056 22788 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.487471 22788 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.476817 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.483784 23061 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.492055 21457 leader_election.cc:400] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4.
I20260709 13:06:49.492465 21457 leader_election.cc:403] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.493183 23066 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.493268 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:49.493983 23066 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.496863 23067 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.459910 23049 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.480413 21459 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.475885 23054 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.500346 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.502929 22914 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:49.507164 22971 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:49.503473 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.508836 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.509999 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.510460 22930 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:49.511049 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.507494 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.513166 23069 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.530733 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.530478 23041 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.493976 23061 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.519333 22914 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.533656 22914 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.534260 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.534776 23049 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.538074 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.530478 21459 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.538735 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.539664 21562 raft_consensus.cc:2410] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:49.539932 23049 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.521824 22246 raft_consensus.cc:1217] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:49.536335 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.539681 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.541253 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.536401 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.542083 22240 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:49.537142 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.543386 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:49.543816 21561 raft_consensus.cc:2410] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:49.535400 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 43523.5us
I20260709 13:06:49.544126 22246 raft_consensus.cc:2368] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.544044 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.541064 23069 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.546115 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.525270 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.546490 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.546712 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.532140 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.547436 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.547864 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.503316 22942 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:49.535997 23066 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4.
I20260709 13:06:49.535971 23077 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:49.535151 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.540057 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:06:49.516997 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.555648 21568 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:49.553486 23077 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.556088 21565 raft_consensus.cc:2368] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.556934 23077 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.557928 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.558398 23077 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.558667 22245 raft_consensus.cc:2368] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.555657 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.559384 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.537547 23067 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:49.540652 22930 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.514468 22929 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.549875 22795 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.566222 21563 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:49.567040 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.567193 21565 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.567514 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.564504 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.567348 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.575134 22246 raft_consensus.cc:2368] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.570178 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.573385 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:49.576165 22244 raft_consensus.cc:2368] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.576644 22243 raft_consensus.cc:2410] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:49.573967 22245 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.574514 22240 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:49.579690 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.581643 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.581956 22929 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:49.583207 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.583406 23074 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:49.584332 23061 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.584697 23061 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:49.585575 23061 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.587374 21566 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:49.564688 23041 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:49.590586 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.591387 22240 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:49.591603 23061 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.593321 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.594899 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.596305 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.596797 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.597744 21562 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:06:49.597695 21564 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:49.598820 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.599509 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.601383 23054 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.601661 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.601399 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.602769 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.603139 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.603880 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.609884 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.610821 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.609297 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.611783 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.612022 21563 raft_consensus.cc:2368] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.610948 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.613581 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.614602 21488 raft_consensus.cc:2368] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.615206 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.608135 23041 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:49.618502 21491 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:49.623031 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.623238 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.624994 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.626653 21563 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:49.626726 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:49.627946 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.629693 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.622979 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.632537 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.634363 21491 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.630769 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.635556 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.636349 21487 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:49.638031 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.635586 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.645466 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.646788 21488 raft_consensus.cc:2368] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.647024 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.647749 21487 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.648360 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.646718 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.650218 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.643198 22930 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.650695 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.653120 21493 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:49.653669 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.654301 21487 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.637682 22788 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.656075 21568 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:49.658133 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.658023 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.658882 21494 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:49.658020 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.663244 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.663391 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.663852 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.656090 22243 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:06:49.664175 22240 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:49.665187 22243 pending_rounds.cc:85] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 4
I20260709 13:06:49.665280 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.667296 21486 raft_consensus.cc:2410] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:49.667690 22245 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.670104 22241 raft_consensus.cc:2368] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.672307 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.673758 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.672603 21487 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:49.665939 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.677009 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.678244 21494 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.679194 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.668494 22243 pending_rounds.cc:107] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:49.664506 23041 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.680461 22243 raft_consensus.cc:2889] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.682216 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.683928 21493 raft_consensus.cc:2393] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.684029 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.680819 21569 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:49.684768 21562 raft_consensus.cc:2368] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.686132 21487 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.693070 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.693884 22788 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.694640 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.695040 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.695518 21486 raft_consensus.cc:2368] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.695781 21493 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.695312 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.696260 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.695905 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.696684 21491 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.697804 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.697925 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.698858 21569 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:06:49.698753 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.700037 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.699719 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.701028 21569 pending_rounds.cc:85] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 3
I20260709 13:06:49.700445 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.702625 21568 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:49.694648 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.704095 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.701956 21488 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:49.707764 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.702546 21569 pending_rounds.cc:107] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:06:49.715346 21459 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.716287 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:49.717128 21569 raft_consensus.cc:2917] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:06:49.720569 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.722587 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.724934 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.727018 21489 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:49.728040 21569 raft_consensus.cc:2889] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:49.729594 21606 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.644s (SENT)
I20260709 13:06:49.730226 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:49.731114 22921 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.735731 21566 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:49.734747 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:49.738937 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.722365 23041 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.743465 21488 raft_consensus.cc:2368] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.735411 22994 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.744474 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.743180 23077 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.743098 21489 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.756807 22921 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.758952 22994 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:49.761397 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:49.762281 23077 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.762267 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.765827 22245 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:06:49.766700 22245 pending_rounds.cc:85] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 3
I20260709 13:06:49.767074 22245 pending_rounds.cc:107] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:06:49.766172 22843 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.767316 22245 raft_consensus.cc:2917] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
W20260709 13:06:49.769320 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.771914 21487 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:49.772104 22245 raft_consensus.cc:2889] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.773207 21566 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.774063 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.779242 21487 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:49.779743 21489 raft_consensus.cc:2368] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.781155 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.781942 21487 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.775116 21459 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.790938 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.789844 22843 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:49.795202 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.795254 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.798995 22942 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:49.799846 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.800704 21488 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:49.801748 21487 raft_consensus.cc:2368] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.805199 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.805794 21488 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:49.800724 22942 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:49.806591 22942 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.801986 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.808025 21489 raft_consensus.cc:2410] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:49.807608 22942 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.809020 23077 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:49.810276 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.811254 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.812090 21494 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.812909 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:49.813033 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.811905 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.813827 23041 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.813858 21491 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.815071 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:49.808960 22942 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.815757 23054 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:49.822460 23077 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:49.823091 23054 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.823002 22971 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:49.823558 23077 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:49.823863 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.824494 22950 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:49.824744 22971 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.824879 22950 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.825819 22950 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.818387 22845 raft_consensus.cc:3055] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:49.826936 22845 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.827600 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:49.828219 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.823985 23077 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.828851 22788 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.823588 23054 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.829392 23077 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.830314 22788 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:49.827909 22845 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.828434 23081 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.831454 23061 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.831512 23077 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.831950 23061 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:49.832377 22845 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.832929 23061 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.817642 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.833489 22994 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:49.834098 21489 raft_consensus.cc:2376] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4. Re-sending same reply.
I20260709 13:06:49.834434 23061 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.830476 23054 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.836019 23054 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.839190 23041 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:49.840668 23041 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.836944 22994 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.841048 23041 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:49.831534 22950 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.841843 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.842051 23041 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.842742 22914 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.842953 22930 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:49.844393 23041 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.844802 22930 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.845199 22930 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:49.846077 22930 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.847548 22930 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.851126 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.851893 21487 raft_consensus.cc:2368] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.821584 22843 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.852815 22921 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:49.853488 22921 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.832263 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:49.857471 22788 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.857765 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:49.858629 21636 raft_consensus.cc:2410] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:49.859505 22921 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:49.862617 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:49.863977 22795 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.866758 21487 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.868208 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:49.869091 22971 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:49.869170 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:49.869709 22971 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.870803 22971 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.863965 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:49.871920 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:49.873080 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.874838 21636 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.877152 23041 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.877631 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:49.878247 23041 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.878345 22994 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:49.879613 22994 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.880012 22994 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:49.881186 22994 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:49.883396 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.883694 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.884219 22245 raft_consensus.cc:2393] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:49.884045 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.884893 21491 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.879880 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:49.885074 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.885813 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.885753 23041 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:49.878334 21636 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.882561 22994 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.892772 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.893237 22921 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:49.893731 21492 raft_consensus.cc:2376] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3. Re-sending same reply.
I20260709 13:06:49.893895 22921 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.895099 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.895634 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.896140 21494 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.896463 21485 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.896198 22921 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:49.897482 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.898375 21491 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:49.899772 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:49.901486 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.911312 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.915262 21487 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.915527 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:49.923149 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.924161 22241 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:49.924191 21389 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 3, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.925818 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:49.926728 22243 raft_consensus.cc:2393] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:49.927127 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.927551 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.927937 23073 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.928352 21488 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:49.929303 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.929481 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.930115 21493 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.926204 21389 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 3, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.925125 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:49.931517 22245 raft_consensus.cc:2368] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.931999 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.931555 21389 catalog_manager.cc:5697] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 3, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.932623 21485 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.935027 23061 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.935581 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:49.936339 22921 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.936365 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:49.937647 23061 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.938170 21388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 138) took 1417 ms. Trace:
I20260709 13:06:49.939545 23061 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:49.940692 23073 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.941167 23073 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:49.942128 23073 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.943574 21606 leader_election.cc:400] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.943910 21606 leader_election.cc:403] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.944489 22921 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.944763 21606 leader_election.cc:400] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.945869 21606 leader_election.cc:400] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.946164 21606 leader_election.cc:403] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.912891 23041 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:49.947706 23041 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:49.950490 22240 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:49.951052 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:49.952057 22921 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.937532 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:06:49.953886 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 61928.6us
I20260709 13:06:49.965068 21493 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:49.968745 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:49.972119 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:49.978088 22795 raft_consensus.cc:2764] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:49.979857 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:49.981638 22921 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.987110 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:49.988016 21566 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:49.989126 22921 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:49.989856 22921 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.994208 23073 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.995401 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:50.001250 21489 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:49.976815 22788 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:50.016237 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 61814.2us
I20260709 13:06:50.022616 21566 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.031438 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.032374 21642 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:50.033660 21642 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:50.030223 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.036625 21638 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.036753 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:50.001327 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.034622 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.039391 22788 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:50.024720 21485 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:50.045120 22788 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.046939 21490 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.047533 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:50.048002 21643 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.048254 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:50.049350 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.051295 21639 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:50.052006 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:50.052829 22240 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:50.052665 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.054173 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:49.938525 21388 rpcz_store.cc:276] 0709 13:06:48.520731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.521821 (+  1090us) service_pool.cc:224] Handling call
0709 13:06:49.938093 (+1416272us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:49.622082 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:49.679101 (+ 57019us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:49.685279 (+  6178us) write_op.cc:435] Acquired schema lock
0709 13:06:49.685323 (+    44us) tablet.cc:662] Decoding operations
0709 13:06:49.686000 (+   677us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:49.686098 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:49.686124 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:49.686562 (+   438us) tablet.cc:701] Row locks acquired
0709 13:06:49.686617 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:06:49.686806 (+   189us) write_op.cc:270] Start()
0709 13:06:49.686972 (+   166us) write_op.cc:276] Timestamp: P: 1783602409686720 usec, L: 0
0709 13:06:49.687005 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:06:49.687611 (+   606us) log.cc:844] Serialized 1311 byte log entry
0709 13:06:49.766392 (+ 78781us) op_driver.cc:464] REPLICATION: finished
0709 13:06:49.799495 (+ 33103us) write_op.cc:301] APPLY: starting
0709 13:06:49.799624 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:49.799769 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:49.799906 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:49.800484 (+   578us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:49.800725 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:06:49.800787 (+    62us) write_op.cc:312] APPLY: finished
0709 13:06:49.803638 (+  2851us) log.cc:844] Serialized 35 byte log entry
0709 13:06:49.816836 (+ 13198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:49.855291 (+ 38455us) write_op.cc:454] Released schema lock
0709 13:06:49.855342 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:49.867027 (+ 11685us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:49.867057 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":28480,"apply.run_cpu_time_us":2609,"apply.run_wall_time_us":68665,"num_ops":3,"prepare.queue_time_us":110025,"prepare.run_cpu_time_us":3870,"prepare.run_wall_time_us":81587,"replication_time_us":79214,"thread_start_us":65540,"threads_started":2}]]}
I20260709 13:06:50.057596 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:50.059312 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:50.060401 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.061302 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.061725 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.062259 21637 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:50.062927 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.063498 21635 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.064493 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.065285 21634 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.067242 21640 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:50.068584 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.069353 21640 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.091687 21635 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:50.079372 21639 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
W20260709 13:06:50.091092 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45106.4us
W20260709 13:06:50.095438 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 94628.8us
I20260709 13:06:50.101498 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:50.106679 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.108494 21490 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:50.110140 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.115790 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:50.126360 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:50.131907 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.128198 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:50.133176 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:50.133695 22240 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:50.134590 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:50.134914 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:50.135470 22246 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:50.136183 23094 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.136458 21485 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.136788 23094 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.137327 23094 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.139065 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.140369 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.141497 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.108115 22914 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.125780 22921 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:06:50.146409 22921 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.146898 22921 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:50.147440 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:50.130577 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.148023 22921 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.149437 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.149879 22921 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.097981 23069 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:06:50.151433 23069 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:50.151763 23069 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:50.150558 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.152722 21641 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.152536 23069 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.153939 23069 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.157277 21487 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:50.158396 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:50.159160 21487 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:50.159543 21636 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:50.161855 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:50.142457 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.166306 21638 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:50.168195 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:50.170560 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.175002 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.175968 21636 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:50.178596 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.179329 21490 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:50.179666 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.180538 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:50.181740 21487 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:50.189934 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.142304 22914 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.160688 22845 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.162989 23081 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.195755 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:50.197535 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.198526 21638 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.203787 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:50.207545 22243 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:50.191871 23073 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.188592 22930 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.217556 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.191289 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:50.195405 23041 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:50.222810 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 126651us
I20260709 13:06:50.225262 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:50.232477 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 295038us
I20260709 13:06:50.237177 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.217378 22795 raft_consensus.cc:2764] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:50.208989 23067 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:50.244191 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.250084 21638 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
W20260709 13:06:50.251919 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 125675us
I20260709 13:06:50.253756 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.233835 23073 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:50.256769 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:50.257625 21635 raft_consensus.cc:2410] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:50.258903 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 97155us
I20260709 13:06:50.241036 23041 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.241871 22930 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.271183 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:50.277395 21488 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.273900 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:50.278594 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:50.285553 21643 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:50.287624 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:50.288368 21490 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:50.289412 21637 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.270252 23054 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:50.290477 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.291851 22914 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:50.296737 21391 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:06:50.301162 21391 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 2 to 3, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 3 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.304045 23061 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:50.319219 21494 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.319595 22241 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:50.320182 23081 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:50.320571 23081 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:50.321480 23081 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.308220 21640 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:50.322852 21486 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.308600 23054 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.323303 21637 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.299098 21485 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:06:50.310114 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 74818.5us
I20260709 13:06:50.327481 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:50.328341 21487 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.329571 23077 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:50.313081 23096 log.cc:927] Time spent T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.193s	user 0.002s	sys 0.000s
I20260709 13:06:50.329756 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.270439 23067 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:50.330885 23077 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.331588 23067 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.323951 22950 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.323719 23054 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:50.309664 23092 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.348s	user 0.005s	sys 0.000s
I20260709 13:06:50.325070 21391 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:50.335855 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 98746.6us
I20260709 13:06:50.340909 21641 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:50.344314 21638 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:50.345691 22950 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.346670 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:50.347327 21486 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:50.348029 22950 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:50.350239 21487 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.352065 21485 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.353929 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:50.356818 22942 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:50.357441 22942 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:50.357599 23073 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.358646 22942 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.342757 21494 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:50.344297 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.344792 21638 pending_rounds.cc:85] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 1
I20260709 13:06:50.367609 21643 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.372192 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:50.369385 21638 pending_rounds.cc:107] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:06:50.377760 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:50.379576 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 112336us
I20260709 13:06:50.368963 21391 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 2 to 3, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 3 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.384250 21566 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:50.384635 21643 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:50.384603 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:50.385296 22843 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.385537 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:50.388162 21494 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:50.379406 21638 raft_consensus.cc:2917] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
W20260709 13:06:50.397331 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 129783us
I20260709 13:06:50.362172 23105 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.402680 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:50.318631 23094 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.373706 22845 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.427173 21606 leader_election.cc:400] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:50.401166 23041 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:50.428510 22994 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.002s
I20260709 13:06:50.415072 22241 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:50.415751 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.418452 23094 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:50.420241 21634 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:50.420775 21638 raft_consensus.cc:2889] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:50.422068 21636 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:50.407322 21485 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:50.423067 21639 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:50.425150 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:50.453233 21635 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:50.439489 21608 leader_election.cc:400] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:50.431283 21642 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:50.454221 21608 leader_election.cc:403] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:50.433779 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.433537 21606 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:50.432291 21493 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:50.457932 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36036 (request call id 8) took 9684 ms. Trace:
I20260709 13:06:50.458346 21638 rpcz_store.cc:276] 0709 13:06:40.773254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.773374 (+   120us) service_pool.cc:224] Handling call
0709 13:06:40.939616 (+166242us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4c001db740. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a82aea20 00007f98a82bfa29 00007f98a8285644 00007f98a82acf2d 00007f98a82acb93 00007f98a9f3b1af 00007f98a9f3af3e 00007f98a9fc0888 00007f98a9fdd75c 00007f98a9fde76a 00007f98a9fdd91b
0709 13:06:40.940987 (+  1371us) log.cc:844] Serialized 513 byte log entry
0709 13:06:50.457800 (+9516813us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":281,"raft.run_cpu_time_us":1791,"raft.run_wall_time_us":2921,"spinlock_wait_cycles":41359488,"thread_start_us":69948,"threads_started":1,"wal-append.queue_time_us":53486,"wal-append.run_cpu_time_us":1872,"wal-append.run_wall_time_us":1010708}
W20260709 13:06:50.430847 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 158123us
I20260709 13:06:50.463963 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.465093 22788 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:50.465569 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet e0950a4a64c4484ba4b753d544c7f1eb: Aborted: Op aborted by new leader
I20260709 13:06:50.466219 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:50.467645 22788 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:50.468137 22788 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:50.468994 22788 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.471408 23081 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.473312 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.486982 21638 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.488085 21493 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.447137 23077 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.457060 23054 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:50.503791 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 70351.7us
I20260709 13:06:50.433374 23105 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:06:50.447844 23111 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:06:50.483201 23107 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.530377 21485 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.502380 22921 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:50.433586 23103 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:06:50.508288 23094 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.543715 21606 leader_election.cc:400] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:50.546329 21606 leader_election.cc:403] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:50.507633 23124 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:06:50.555927 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 178263us
I20260709 13:06:50.557123 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.570200 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.544857 23123 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.571681 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:50.573134 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 61498.7us
W20260709 13:06:50.576313 21606 leader_election.cc:336] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.917s (SENT)
I20260709 13:06:50.574656 23112 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:06:50.575001 23122 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.576025 23123 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.577834 23122 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.575868 22921 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:50.579619 23123 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:50.579632 23112 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:50.580125 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.580292 23112 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:50.581118 23112 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.571041 23067 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.582039 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:50.584901 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:50.585278 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.585889 22241 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:50.586174 23069 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.586601 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:50.582815 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:50.589871 23127 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.587709 23069 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.593887 23127 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:06:50.594220 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.595115 23127 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.591776 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:50.599032 22246 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.600760 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:50.602735 23122 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.602939 23067 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.603313 23122 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:50.604524 23112 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.604202 23122 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.612668 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:50.613722 23107 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:50.614171 23107 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:50.615525 22930 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.615221 23107 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.616695 23107 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:50.617131 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.617607 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.608628 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 62749.9us
I20260709 13:06:50.619642 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.622560 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:50.624989 23111 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.625710 22942 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:50.624293 23069 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:50.628086 23069 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.630172 23094 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.623921 22246 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:50.634814 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:50.620010 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:50.640779 23122 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:50.651880 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 70540.6us
I20260709 13:06:50.641295 22942 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.659816 22240 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.660298 21634 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:50.658902 23122 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:50.662143 22246 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.662014 23122 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.664855 21569 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.665351 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:50.653908 23094 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:50.667219 22795 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:50.669240 22942 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:50.671032 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:50.672601 23067 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.673058 23067 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:50.671638 23077 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:50.673674 22942 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.674080 23067 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.666798 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:50.675282 23067 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.676383 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:50.676997 21569 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:50.677217 22930 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.679427 22930 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:50.680564 22843 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:50.680397 22930 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.681536 23111 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:50.682421 23041 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.682857 23041 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:50.683748 23105 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.683849 23041 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.684645 21608 leader_election.cc:400] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:50.687023 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:50.692071 21389 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 3, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.695515 22795 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:50.697710 22845 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.698194 22845 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.698563 22845 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.705256 21391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 238) took 1118 ms. Trace:
I20260709 13:06:50.692133 22246 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:50.707149 22994 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:50.686724 23094 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:50.699301 23118 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:06:50.718730 21606 leader_election.cc:400] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:50.721566 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.699895 23077 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:06:50.724956 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:50.725770 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.731972 21494 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:50.733767 23105 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.735199 23107 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:50.736440 23041 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.737588 23117 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.740216 23094 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.723470 23127 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:50.706585 21391 rpcz_store.cc:276] 0709 13:06:49.588201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.588852 (+   651us) service_pool.cc:224] Handling call
0709 13:06:50.705163 (+1116311us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:50.452505 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:50.458479 (+  5974us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:50.458517 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:06:50.458535 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:50.459182 (+   647us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:50.459234 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:50.459264 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:50.459645 (+   381us) tablet.cc:701] Row locks acquired
0709 13:06:50.459659 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:06:50.459789 (+   130us) write_op.cc:270] Start()
0709 13:06:50.459894 (+   105us) write_op.cc:276] Timestamp: P: 1783602410459749 usec, L: 0
0709 13:06:50.459910 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:06:50.460523 (+   613us) log.cc:844] Serialized 1772 byte log entry
0709 13:06:50.462731 (+  2208us) op_driver.cc:464] REPLICATION: finished
0709 13:06:50.463217 (+   486us) write_op.cc:301] APPLY: starting
0709 13:06:50.463303 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:50.463476 (+   173us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:50.465050 (+  1574us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:50.465798 (+   748us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:50.466059 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:50.466126 (+    67us) write_op.cc:312] APPLY: finished
0709 13:06:50.466416 (+   290us) log.cc:844] Serialized 41 byte log entry
0709 13:06:50.466604 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:50.466731 (+   127us) write_op.cc:454] Released schema lock
0709 13:06:50.466807 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:50.467195 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:50.467238 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":194076,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":274,"apply.run_cpu_time_us":2461,"apply.run_wall_time_us":3909,"num_ops":4,"prepare.queue_time_us":8603,"prepare.run_cpu_time_us":2939,"prepare.run_wall_time_us":11491,"replication_time_us":2719}]]}
I20260709 13:06:50.729574 22950 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.730008 22795 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.755342 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.763217 21637 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:50.764424 23069 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.764832 23069 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:50.765789 23069 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:50.768734 23069 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.769065 23107 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:50.769424 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.766304 22971 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.771696 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.772517 22950 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.774642 22950 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:50.789726 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.790591 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:50.796494 21390 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 242) took 1161 ms. Trace:
I20260709 13:06:50.760931 22795 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.800508 22795 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:50.802627 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:50.803071 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:50.802870 22845 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.804955 22845 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:50.805321 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.807972 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:50.796943 21390 rpcz_store.cc:276] 0709 13:06:49.635133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.635349 (+   216us) service_pool.cc:224] Handling call
0709 13:06:50.796273 (+1160924us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":17}
I20260709 13:06:50.811606 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.810990 23041 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.775717 22950 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:50.817138 22971 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:50.817636 22971 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.811173 23105 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.787366 22994 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:06:50.823328 22942 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:50.793417 23077 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.832108 21608 leader_election.cc:400] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:50.832469 21608 leader_election.cc:403] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:50.788463 23117 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:06:50.833793 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 72518.8us
I20260709 13:06:50.835345 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:50.836462 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:50.833177 21566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24789f7f25d44609b76928ec55894739"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:06:50.839149 22921 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.839339 23103 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.827181 22845 consensus_queue.cc:1059] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:06:50.839485 21566 raft_consensus.cc:606] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.840297 21566 raft_consensus.cc:614] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:50.844214 22921 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:50.844710 22921 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.829511 23054 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.837251 23123 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
W20260709 13:06:50.873584 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 49705.2us
I20260709 13:06:50.853832 23054 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.836593 23077 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:06:50.874373 23117 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:50.890244 23117 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:50.891261 23117 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.892808 23117 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.919220 21642 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:50.883958 23105 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.894862 23054 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.917068 21391 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 3, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 3 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.925436 21391 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 3, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 3 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.927567 21391 catalog_manager.cc:5697] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 2, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 2 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.918406 23123 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.934723 21566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:06:50.935137 21642 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:50.935361 21566 raft_consensus.cc:606] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:50.936245 21566 raft_consensus.cc:614] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:50.920931 23067 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.895251 23094 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:06:50.899493 22971 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:50.936920 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 100525us
I20260709 13:06:50.964195 21606 leader_election.cc:400] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
W20260709 13:06:50.955215 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 109719us
I20260709 13:06:50.938536 22914 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.968679 22914 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:50.969545 22921 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.969641 22914 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.938030 22845 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:50.934388 23069 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:06:50.972056 22921 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:50.972705 23069 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.973223 23069 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:50.974447 22914 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:50.937201 23138 log.cc:927] Time spent T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:06:50.998759 21569 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.994217 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:51.006496 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 96134.9us
I20260709 13:06:51.010169 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.013103 21606 leader_election.cc:400] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:51.013475 21606 leader_election.cc:403] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:50.983603 23067 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.038643 21566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:06:51.039430 21566 raft_consensus.cc:606] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:51.028411 22921 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.049288 22921 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:51.050251 23077 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:51.049276 23141 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:06:51.033798 23150 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:06:51.055971 23150 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:51.056376 23150 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:51.057875 23069 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.060087 23067 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.060359 23147 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:51.036708 23123 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.062208 23123 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:51.063521 23123 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.063808 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.065371 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.066035 21642 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:51.066605 22971 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.067510 21566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:06:51.067687 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:51.057351 23150 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:51.068976 23150 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.068737 23054 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:51.071321 23054 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.041373 23094 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:06:51.068125 21566 raft_consensus.cc:606] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:51.087484 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 54065.6us
I20260709 13:06:51.091519 23154 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.092005 21642 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.092119 23154 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.093225 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:51.093834 21494 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:51.094036 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.094637 21642 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:51.087740 22843 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.095708 22843 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.095762 21566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:06:51.096187 22843 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.096446 21566 raft_consensus.cc:606] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:51.092644 21637 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.084398 23127 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.099150 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 151632us
I20260709 13:06:51.101678 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:51.102066 22240 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:51.102288 21493 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.104672 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.105260 22244 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:51.097994 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:51.040495 22942 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:06:51.088322 23054 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.107601 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:51.111174 21566 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:51.132308 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.135687 21494 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:51.139021 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:51.139802 21565 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.094635 23154 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:51.090544 22994 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.150471 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.150740 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:51.155400 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 142447us
I20260709 13:06:51.150471 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.151240 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:51.154243 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.154456 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.156917 21562 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:51.156256 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.156949 21568 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:51.150648 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:51.156302 21567 raft_consensus.cc:2410] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:51.155515 21560 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:51.159317 21561 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.158403 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:51.162881 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:06:51.163445 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.168073 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.106678 23127 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.138069 23107 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:06:51.171940 23073 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.177599 23107 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.178043 23073 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.179237 21565 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:51.151216 22930 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:06:51.179593 21606 leader_election.cc:400] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:51.180084 21606 leader_election.cc:403] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:51.180200 23153 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.172964 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:51.175381 21562 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:06:51.162127 22994 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.172004 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:51.175421 22971 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:06:51.189971 23159 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.171659 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:51.172063 23156 consensus_queue.cc:1059] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:51.174921 23127 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.180734 23153 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.157732 23054 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.172168 23160 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.174587 23154 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.167098 23112 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.224536 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 52924.9us
I20260709 13:06:51.178053 23107 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.217358 23148 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:51.170375 23152 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:06:51.248582 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 69102.5us
I20260709 13:06:51.224463 23150 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:51.238224 23081 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.274705 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.277479 21641 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:51.277987 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 105088us
I20260709 13:06:51.242786 23148 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:51.248572 23169 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:51.271080 23154 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.235473 22942 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.282737 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.285930 23154 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:51.268889 22914 consensus_queue.cc:1059] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:06:51.243080 23112 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.268018 23145 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:06:51.234885 23160 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.291458 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.281318 23081 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.296216 23081 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.296895 23151 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:51.297473 23151 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.299391 23153 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:51.299445 23148 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.301363 23148 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.303401 21485 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:51.303910 22950 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.304322 22950 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:51.305128 22950 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.306774 23112 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.307246 23107 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.289141 23154 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.308540 23054 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.287531 21492 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:51.310884 22994 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.313330 22843 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.315816 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.317018 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.317122 22843 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.317829 21563 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:51.325888 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.326680 21642 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:51.318174 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.328584 23151 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.329681 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:51.330453 23125 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.330816 23125 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.318882 23160 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:51.319656 23112 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:51.320629 23166 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.341004 23166 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.343979 23166 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.286275 22942 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.344835 22942 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.302582 23123 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.352020 23123 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:51.321201 23073 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.323051 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:51.323225 23107 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:51.289032 23159 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.364574 21492 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:51.324261 23145 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.368640 21643 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:51.336288 23125 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.354729 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.375959 21636 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:51.363242 21642 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:51.364261 23103 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.392035 21563 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.365869 21640 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:51.367969 23169 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:51.378700 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:51.379549 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:51.399070 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:51.375181 23145 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:51.396916 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:51.398062 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:51.383206 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 91799.3us
I20260709 13:06:51.402652 21565 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:51.402946 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.405864 23146 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.406533 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.406476 21563 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:51.407238 21562 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
W20260709 13:06:51.408665 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 120646us
I20260709 13:06:51.412774 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.413554 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.415568 21640 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:51.406451 23146 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.344226 23154 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.426928 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:51.406813 23073 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.420094 22795 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.445505 21606 leader_election.cc:400] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:51.446635 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.408190 23041 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:51.448558 23159 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:51.427059 23094 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.445674 23073 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.455627 23073 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.412403 23169 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.457659 23169 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:51.430228 23122 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:51.440074 23118 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:06:51.428526 23123 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.454135 23154 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:51.462633 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.464360 21566 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:51.460597 21606 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.452628 23145 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.465416 23145 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.467767 22246 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:51.468410 21492 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.469368 22244 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:51.469612 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:51.470331 21492 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:51.470639 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:51.470999 22240 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:51.471287 21494 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.472082 22243 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:51.467824 22241 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:51.471310 22238 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:51.473975 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:51.472319 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:51.474532 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.475642 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.476233 21638 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:51.479552 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.480257 21638 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:51.477101 23159 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:51.487815 23159 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.490876 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.494184 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.495807 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.445515 22795 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.502408 21638 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 1.
I20260709 13:06:51.504458 21488 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:51.424132 22942 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.513181 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.440639 23164 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:06:51.519006 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:51.516299 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:51.492722 23154 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.521842 21638 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.501003 23094 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:51.523499 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.527164 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:51.527910 21565 raft_consensus.cc:2393] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:51.529422 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:51.504473 22795 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.512495 23123 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.515462 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:51.535741 23171 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.535982 23163 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.544880 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.537114 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.538846 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.522581 23148 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.535141 23172 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.546456 21561 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:51.550647 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:51.533568 23169 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.518815 23150 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:06:51.555267 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:51.559952 21488 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:51.533793 23153 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:51.532763 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:51.518608 23166 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:06:51.518216 23069 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:06:51.561729 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:51.520946 23111 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:51.544482 23127 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.527171 23054 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:51.540031 23094 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:51.524081 23122 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:51.573411 23165 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:06:51.591336 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 99502us
I20260709 13:06:51.574167 23174 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:06:51.574577 23073 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.555732 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:51.541429 23152 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:51.549497 21492 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:51.558944 23123 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.533404 23125 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:51.610039 23175 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:51.611544 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:51.611718 23125 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.612335 21485 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:51.587584 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:51.565488 23041 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:51.596591 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:51.598040 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:51.596665 23154 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.568969 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:51.557133 23148 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.582005 23153 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:51.641794 21489 raft_consensus.cc:2410] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:51.578771 22238 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:51.607591 22240 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:51.608659 23140 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.608911 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:51.615536 21562 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:51.580696 23170 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.591213 23146 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.578246 22942 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.559118 23172 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.586259 23127 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:51.657660 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 72557.9us
I20260709 13:06:51.656366 22243 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:06:51.666450 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 69937.1us
W20260709 13:06:51.703091 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 165864us
I20260709 13:06:51.638317 23041 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.661666 23123 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.715406 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:51.655392 23166 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:51.717511 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:51.656155 23140 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:51.664520 23154 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.642014 23153 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.722065 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:51.720455 21492 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:51.727592 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:51.729699 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:51.730012 23183 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:51.730386 21489 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:51.730587 23183 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:51.731624 23183 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.724834 22942 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.732956 22942 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.733306 22942 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.719784 23123 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:51.723839 23170 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.723730 23154 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:51.724943 23125 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.726976 22994 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.787370 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:51.787766 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:51.788844 21487 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.750963 23154 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.746318 23123 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.790586 23122 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.828406 23191 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:06:51.726738 23146 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:51.716879 23094 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.722940 23166 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.836732 21563 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:51.830881 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:51.750214 23103 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.838466 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:51.748175 23170 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:51.844216 21640 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.749996 22994 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:51.846493 21490 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:51.838279 23054 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.869501 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:51.872037 21637 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.829607 23150 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:51.787671 23125 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:51.849414 22994 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.844717 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:51.848842 23159 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:51.846513 23170 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.874907 23148 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:06:51.878268 23173 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:06:51.878057 23159 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.878860 23172 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:51.879356 23190 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:51.880622 23159 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:51.871577 23073 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:51.880738 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.881587 22212 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:51.889206 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 58431.5us
I20260709 13:06:51.873063 23054 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.895004 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:51.880873 23193 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:06:51.883011 23189 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:06:51.843989 23122 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.892956 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:51.904546 21566 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.899106 21640 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
W20260709 13:06:51.884152 23182 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:06:51.892304 22212 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:51.908262 23146 raft_consensus.cc:993] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:06:51.790495 23140 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.887748 21489 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.883391 23117 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:51.914575 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:51.916260 23200 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.884653 23127 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.887601 23166 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.910516 23148 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.900208 23054 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.875882 23150 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:51.913471 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 86719.8us
I20260709 13:06:51.932499 23148 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.932739 23196 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.936074 23122 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.938195 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:51.939201 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:51.910778 22238 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.942183 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:51.918295 23094 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:51.930662 23140 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.964426 21640 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:51.920157 23117 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:51.966210 21566 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:51.967556 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:51.971185 21568 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:51.947919 23148 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.947554 23172 raft_consensus.cc:1081] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:06:51.970271 21459 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:51.948201 23196 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.965873 23200 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.977741 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:51.966949 23122 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.972630 23171 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:51.978150 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 61796.3us
I20260709 13:06:51.987053 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:51.990896 21640 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.974865 23041 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:51.982945 23152 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.978046 23196 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.000200 23198 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.000903 23210 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.983494 23069 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.985339 23122 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.994143 23200 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.009282 22795 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:51.967725 23094 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.026991 21640 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:52.014061 23152 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.029301 23041 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.044965 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:51.983223 23111 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:06:52.056468 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:52.057127 21640 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:52.040952 23122 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.050410 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:52.061381 21494 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:52.029673 23198 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.028363 23210 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.056337 22241 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Advancing to term 3
I20260709 13:06:52.054363 23152 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.012020 23117 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.062937 23171 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:52.078017 23209 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.083244 23209 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.084372 23158 raft_consensus.cc:3055] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:52.084988 23158 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:52.086301 23209 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.087500 23202 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.065677 23198 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.066442 23210 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.060037 23041 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.069759 23200 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.086714 23162 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.063460 22942 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.093451 23150 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.096905 23041 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.112063 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 1631) took 1254 ms. Trace:
I20260709 13:06:52.112493 21569 rpcz_store.cc:276] 0709 13:06:50.854912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.855097 (+   185us) service_pool.cc:224] Handling call
0709 13:06:50.855465 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.003786 (+148321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.109437 (+1105651us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54000186d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:52.109590 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328951040}
I20260709 13:06:52.103922 23202 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:52.189440 23200 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.086311 23158 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.186190 23103 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.204094 22942 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.204414 23170 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.208624 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:52.209467 23158 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:51.942934 23201 consensus_queue.cc:1175] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a87bd86b86e74aa8bb61189215b73439" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:52.216034 23170 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.218004 23094 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.221928 21489 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:52.223171 22795 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.198563 23200 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.226058 23200 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.228717 23152 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.231135 23152 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.232374 22994 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.245982 22241 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 3 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:52.246232 22994 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.107034 23162 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.233731 23196 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.199642 23171 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.237936 23054 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:52.226586 23203 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:06:52.252274 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 217982us
I20260709 13:06:52.196807 23041 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
W20260709 13:06:52.255851 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.255731 21640 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:52.259688 22950 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.252019 23202 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.201169 23103 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:52.262688 23122 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.264420 23103 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.248136 23162 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.265960 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:52.268746 23217 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:52.269364 23217 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.264483 23154 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.271728 23217 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.272771 23154 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.273504 23112 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.273945 23122 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.274031 23112 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:52.276000 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.276310 23112 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.276566 23215 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.277020 23215 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.277380 23215 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:52.277025 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.253806 23123 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.280083 23077 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.288578 23077 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:52.280401 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.290865 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.285110 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.291683 21568 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:52.285444 23172 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:52.287257 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.292703 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:52.287398 21569 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:52.293398 21562 raft_consensus.cc:2393] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:52.282029 21566 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:52.283221 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.277333 23210 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.244330 23148 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.287338 22930 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.296862 23127 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.297390 23069 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.297940 21494 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:52.294075 23166 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.288012 21564 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:06:52.298863 21489 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:52.290547 23077 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.299842 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:52.300196 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:52.301105 22246 raft_consensus.cc:2368] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4.
I20260709 13:06:52.301272 23196 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.302124 23210 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.292248 23172 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.304198 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:52.305198 23185 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.576s	user 0.000s	sys 0.003s
I20260709 13:06:52.305608 21491 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.306727 23159 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:52.309635 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.312834 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.311502 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:52.366364 22241 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:52.313797 23123 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.308276 23054 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.365614 23112 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.349472 23103 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:52.376987 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.310739 23152 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.320089 23217 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:52.379072 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.381834 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.286993 23198 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.385172 21493 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:52.366712 22240 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:52.311277 22930 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.311941 23069 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.392925 21494 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:52.394176 23069 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.394377 23172 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.386250 23103 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.396988 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:52.397619 21635 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.398193 23103 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.400002 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.401640 21487 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:52.384706 23112 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.392349 23152 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.405427 23112 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:52.405797 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.381839 23159 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:52.406209 23159 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:52.407234 22845 raft_consensus.cc:993] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:06:52.407186 23159 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.407989 22845 raft_consensus.cc:1081] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:06:52.408588 23159 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.412011 23148 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.349651 23215 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.414988 23215 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.311647 23127 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:52.416731 21485 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:52.417330 21492 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:52.419307 21635 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:52.420964 21488 raft_consensus.cc:2368] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:06:52.426121 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.422158 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:52.428650 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:52.423795 23127 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.313171 23166 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.439549 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.434448 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.416774 23169 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:52.430456 21635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 990) took 1316 ms (client timeout 1690 ms). Trace:
I20260709 13:06:52.444967 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.445492 21568 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:52.446293 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.446838 21562 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
W20260709 13:06:52.443030 21635 rpcz_store.cc:269] 0709 13:06:51.108707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.108811 (+   104us) service_pool.cc:224] Handling call
0709 13:06:52.396842 (+1288031us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:52.425372 (+ 28530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14127360}
I20260709 13:06:52.448246 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:52.457553 21606 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:52.459281 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:52.422111 22930 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:52.469902 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.470263 21569 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:52.440915 23183 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.441424 23123 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.387343 23217 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.442946 23169 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:52.488934 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.444291 23163 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:52.490275 21487 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:52.491153 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.490568 22930 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:52.496874 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:52.499790 21569 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.463176 22921 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:52.466171 23150 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:52.515808 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.516491 21567 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
W20260709 13:06:52.511929 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 52730.8us
I20260709 13:06:52.524742 23229 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:52.525142 23229 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:52.525955 23229 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.527221 23229 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.534013 23171 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.534665 23171 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:52.501222 23103 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.511549 23183 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:52.538344 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:52.513022 23215 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.543326 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:52.544945 21487 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.512413 23198 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.546583 23215 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.544993 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:52.548417 21567 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.546751 23169 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:52.549829 23169 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.547068 22845 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:52.536895 23171 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.513337 23163 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.557516 23217 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.563853 23166 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.550475 23215 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.565306 21569 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:06:52.566133 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.543182 23103 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:52.567221 21567 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:52.514161 22930 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.569506 21487 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:52.570767 23123 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:52.551967 23183 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:06:52.574339 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.574496 21490 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:52.556564 22845 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:52.576753 21567 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:52.582839 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.583557 21569 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:52.585391 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:52.586166 21487 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.573240 23103 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.588516 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 93) took 1358 ms. Trace:
I20260709 13:06:52.588927 21641 rpcz_store.cc:276] 0709 13:06:51.226206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.226398 (+   192us) service_pool.cc:224] Handling call
0709 13:06:51.226767 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.278614 (+ 51847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.584637 (+1306023us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b5400295254. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:52.584779 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103291648}
I20260709 13:06:52.583009 23118 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.590117 23118 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.590116 22845 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.592144 22930 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.592644 22845 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.593778 23118 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.596675 21487 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:52.599537 21490 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:52.576261 23123 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.598171 22930 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.579905 23183 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.609669 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1004) took 1103 ms. Trace:
I20260709 13:06:52.610082 21637 rpcz_store.cc:276] 0709 13:06:51.506337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.549006 (+ 42669us) service_pool.cc:224] Handling call
0709 13:06:51.549332 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.873459 (+324127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.609428 (+735969us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400143f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:52.609607 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741723392}
I20260709 13:06:52.611198 23123 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.611238 23081 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:52.611892 23081 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.613948 23081 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.620913 23163 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:06:52.621873 23226 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.063s	user 0.000s	sys 0.005s
I20260709 13:06:52.623154 23103 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.143358 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:52.631986 21391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 139) took 1863 ms. Trace:
I20260709 13:06:52.634606 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.632373 21391 rpcz_store.cc:276] 0709 13:06:50.768325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.777761 (+  9436us) service_pool.cc:224] Handling call
0709 13:06:52.631925 (+1854164us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:50.995035 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:51.058396 (+ 63361us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:51.058437 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:06:51.058454 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:51.059133 (+   679us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:51.059190 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:51.059218 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:51.059527 (+   309us) tablet.cc:701] Row locks acquired
0709 13:06:51.059545 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:51.059695 (+   150us) write_op.cc:270] Start()
0709 13:06:51.059805 (+   110us) write_op.cc:276] Timestamp: P: 1783602411059646 usec, L: 0
0709 13:06:51.059827 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:51.095217 (+ 35390us) log.cc:844] Serialized 1311 byte log entry
0709 13:06:51.138859 (+ 43642us) op_driver.cc:464] REPLICATION: finished
0709 13:06:51.170567 (+ 31708us) write_op.cc:301] APPLY: starting
0709 13:06:51.181915 (+ 11348us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:51.201366 (+ 19451us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:51.227226 (+ 25860us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:51.285572 (+ 58346us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:51.316506 (+ 30934us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:06:51.316556 (+    50us) write_op.cc:312] APPLY: finished
0709 13:06:51.316769 (+   213us) log.cc:844] Serialized 35 byte log entry
0709 13:06:51.316926 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.317017 (+    91us) write_op.cc:454] Released schema lock
0709 13:06:51.317070 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:51.674926 (+357856us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fdde28 00007f98ada18581 00007f98ada17d58 00007f98ada1c9f1 00007f98ada1c9a9 00007f98ada1c939 00007f98ada1c901 00007f98ada1bb2d 000000000038f354 000000000038f199
0709 13:06:51.721123 (+ 46197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.721818 (+   695us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":163,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":1862,"apply.run_cpu_time_us":2828,"apply.run_wall_time_us":150320,"num_ops":3,"prepare.queue_time_us":999,"prepare.run_cpu_time_us":10108,"prepare.run_wall_time_us":729314,"replication_time_us":39040,"spinlock_wait_cycles":63216384}]]}
I20260709 13:06:52.637921 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.637846 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:52.638622 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:52.639292 21567 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:52.639256 21569 raft_consensus.cc:2368] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:52.640340 23163 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:52.644476 22795 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:52.644946 22795 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:52.645826 22795 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.653465 23159 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:52.654047 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1463) took 1138 ms. Trace:
I20260709 13:06:52.654345 23159 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.666265 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:52.668071 23107 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:52.668633 23107 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.669898 21569 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:52.671435 21566 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.672685 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:52.654524 21563 rpcz_store.cc:276] 0709 13:06:51.515808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.515997 (+   189us) service_pool.cc:224] Handling call
0709 13:06:52.653824 (+1137827us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001469d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:52.653951 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459659520}
W20260709 13:06:52.686370 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.688199 21606 leader_election.cc:400] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:06:52.688562 21606 leader_election.cc:403] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.681193 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.671048 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.689589 21606 leader_election.cc:400] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4.
I20260709 13:06:52.689872 21606 leader_election.cc:403] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.689951 21567 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:52.680361 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:52.685652 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:52.708756 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:52.709975 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:52.711753 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:52.712898 21608 leader_election.cc:400] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:52.714001 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:52.714751 21561 raft_consensus.cc:2368] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:52.715793 22245 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:52.715129 21608 leader_election.cc:403] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.716471 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.721035 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.721098 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.639216 21564 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:52.723191 21567 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:52.723732 21569 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:52.724278 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.723254 23202 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.681488 23123 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.677181 23125 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.657320 23159 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.670710 23107 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:52.730530 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.718856 23154 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.606514 22930 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.741971 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.726600 23202 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.744657 21493 raft_consensus.cc:2393] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:52.715862 23163 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:52.746421 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:52.746829 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.747593 21494 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:06:52.733930 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 58777.8us
I20260709 13:06:52.748973 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.749604 21459 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:06:52.734581 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.715726 23229 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.719213 23073 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:52.722330 23150 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.735204 22240 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:52.715565 23180 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.681425 23094 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:52.716096 23147 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.707415 23210 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.773965 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:52.719213 22921 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.745561 23202 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.763105 23094 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.713049 22795 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.719416 23170 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:52.724913 23230 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.738945 22843 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.727114 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.747924 21487 raft_consensus.cc:2393] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:52.750365 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.752995 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.788331 21493 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:52.750722 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:52.788712 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.789300 21487 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:52.790073 21459 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:52.770258 21489 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:52.729933 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:52.736076 23123 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:52.678047 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.756340 23067 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.781364 21389 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 3, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.797086 21389 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.783051 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:52.798267 21389 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 3, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.799167 21486 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.754966 23073 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.771910 22930 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.800737 23073 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.799847 21389 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 2, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.764675 23180 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:52.742914 23166 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.788398 21494 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
W20260709 13:06:52.791494 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.756690 23229 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.765045 23103 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:52.794947 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 65128.9us
I20260709 13:06:52.795405 23118 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.795930 23174 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.790992 21459 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:52.801323 23067 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:52.725010 23105 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.011s	sys 0.003s
I20260709 13:06:52.816481 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:52.817036 23229 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.818212 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.815625 22845 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:52.810216 21389 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 3, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:52.849388 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.819904 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:06:52.851532 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 796263us
I20260709 13:06:52.792914 22843 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.864903 23225 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.864938 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.865649 23225 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:52.865814 21560 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:52.866250 22843 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.866604 23225 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.867161 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.822966 23198 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:52.850266 23103 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.867950 21488 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:52.868296 23103 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.868989 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.864202 23122 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.867980 23198 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:52.871625 23198 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.870462 23122 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:52.873884 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:52.869593 21565 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 1.
W20260709 13:06:52.850467 23105 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.011s	sys 0.003s
I20260709 13:06:52.874521 22240 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:52.859278 23170 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:52.877316 23170 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:52.877815 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.878508 23152 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.880468 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.883047 23192 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.894713 21565 raft_consensus.cc:2410] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:52.894845 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.883291 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.883773 23094 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.885078 23123 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.885550 21564 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:52.885574 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.886471 23229 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.874678 23122 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:52.956360 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:52.887593 23127 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:52.887950 23150 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:52.888437 23170 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:52.820917 23166 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:52.819689 23118 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.813292 23201 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:06:52.895573 21562 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:52.862864 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:52.861889 21389 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.861167 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:06:52.968757 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 107779us
I20260709 13:06:52.969049 21389 catalog_manager.cc:5697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.971589 21389 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.899479 21486 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:52.899791 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.894526 23192 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:52.901674 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:52.860648 23151 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.902177 22843 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.903944 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:52.979066 21491 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 2: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:52.904486 22788 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.905150 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:52.905546 23239 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:52.995190 21567 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.907267 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:52.911329 21490 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:52.870441 23103 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:52.943908 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.003850 21641 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:52.943738 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.005196 21634 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:53.006306 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:52.944778 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:52.944932 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:52.850744 23067 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.952256 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:52.953855 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:53.009668 21643 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:53.010157 21638 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:52.960706 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:53.010910 21639 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.010810 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.011837 21643 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:52.904000 23117 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.033594 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.034497 21641 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:52.963629 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:52.909003 23125 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:52.973874 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:52.976483 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 113720us
I20260709 13:06:53.040797 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:52.983162 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:53.001281 21493 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:53.001330 21606 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:53.007550 21636 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:52.967622 23118 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.973372 23156 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.961265 23229 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:53.055382 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 77965.4us
I20260709 13:06:53.060212 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.061199 21641 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:53.056500 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:52.965018 23127 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:52.966557 23150 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.076164 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.080073 21638 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:53.077749 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.001037 23151 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:52.980512 22921 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4.
I20260709 13:06:53.009074 23165 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.081214 21635 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:52.998517 23122 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.053284 23123 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:53.008967 23183 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:53.088814 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:53.073007 23215 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:52.998699 22843 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.072170 21567 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:06:53.078372 23217 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.068495 23152 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.087399 22845 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.093772 23122 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:53.079021 23236 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:53.077955 23156 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:53.004099 22788 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:53.089735 23234 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:06:53.091356 23069 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.071377 23125 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.125270 23069 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.125468 23236 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.114694 23122 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.131263 22244 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:53.109611 22845 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.131520 23156 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.132342 22788 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:53.137099 23069 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:53.133461 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.101191 23215 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:53.165331 21639 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:53.165930 23229 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:53.168164 23236 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:53.200779 22212 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:53.172367 23125 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:53.108069 23123 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:53.139719 23230 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:53.109256 23217 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.103482 23183 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.170143 23073 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:53.226694 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.226763 23073 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:53.153090 22845 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:53.202042 21608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.849s (SENT) [suppressed 111 similar messages]
I20260709 13:06:53.113868 23152 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.230131 23152 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:53.210686 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.178804 23169 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:53.179267 23163 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:53.231135 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.233546 21568 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
W20260709 13:06:53.218760 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 140182us
W20260709 13:06:53.224092 23242 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:06:53.226504 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:53.213060 22212 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:53.209419 23215 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.169194 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:53.220350 23112 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.234947 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:53.235667 22247 raft_consensus.cc:2368] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4.
I20260709 13:06:53.219503 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:53.232352 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.246745 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:53.247483 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 78347us
I20260709 13:06:53.257589 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:53.258257 21490 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:53.259649 23152 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.259990 23164 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:53.260095 23152 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.263316 21491 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:53.249455 22212 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:53.267369 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:53.268105 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:53.268993 21491 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:53.239446 23236 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:53.154541 23151 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.276921 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:53.249256 23192 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:53.243446 23166 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:53.255786 23105 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.281914 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:53.283488 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:53.251412 23112 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.284554 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:53.272416 23152 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.296319 21488 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:53.239615 23169 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.240054 23163 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.278188 23239 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:53.275068 23236 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:53.310838 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:53.321377 21488 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:53.277838 23081 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.261238 23125 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:53.274245 21485 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:53.322768 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.292254 23105 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.296168 23112 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.292551 23150 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:53.299257 23094 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.295892 22788 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.277661 23164 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.303339 23127 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:53.335520 23196 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.330381 23081 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:53.347369 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 145358us
I20260709 13:06:53.357504 21635 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:06:53.362680 23163 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:53.343467 23105 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:53.348197 23238 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.339s	user 0.002s	sys 0.002s
I20260709 13:06:53.364717 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:53.366469 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:53.343225 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:53.344826 23239 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:53.373746 21608 leader_election.cc:400] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:53.380313 21608 leader_election.cc:403] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:53.350463 23094 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:53.354336 22843 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:53.384068 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.317236 23123 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.364466 23081 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:53.377754 23245 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:06:53.382153 23163 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.387452 23229 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.389353 23094 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.378331 23150 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:06:53.371407 23196 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.477355 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.389138 22921 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
W20260709 13:06:53.481112 23154 consensus_meta.cc:287] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.739s	user 0.008s	sys 0.001s
I20260709 13:06:53.483776 23249 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.483908 23164 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:53.473441 23201 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.487421 23248 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:06:53.490640 23169 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:53.387368 23236 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.493593 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:53.493624 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 160826us
I20260709 13:06:53.499159 21635 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:06:53.470242 23192 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.496210 23202 consensus_meta.cc:287] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.717s	user 0.007s	sys 0.005s
W20260709 13:06:53.538683 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 45184.5us
W20260709 13:06:53.543944 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.544158 21459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.077s
W20260709 13:06:53.544515 21459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.010s	sys 0.077s
W20260709 13:06:53.544775 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 504028us
I20260709 13:06:53.528945 23154 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.493762 22845 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.533499 23210 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:53.543975 23169 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.556010 21635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58388
I20260709 13:06:53.568814 21635 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:53.569551 21635 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.567116 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:53.571738 22244 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.560365 21642 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:53.554859 23236 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.533969 23201 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.555122 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:53.532121 23249 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.545002 23192 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:53.580847 23255 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.088s	user 0.001s	sys 0.003s
I20260709 13:06:53.575888 23169 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.575735 23154 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.547533 23202 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.531219 23239 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.599342 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:53.600229 21643 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.596765 23169 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.607074 22241 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 4: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:53.607933 22845 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:53.608405 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:53.586524 23171 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.568917 23210 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.631803 23165 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.635764 23196 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:53.636581 23103 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.638208 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 92552.4us
I20260709 13:06:53.638387 23264 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:06:53.643991 23117 consensus_meta.cc:287] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.596s	user 0.006s	sys 0.006s
I20260709 13:06:53.643921 22244 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:53.568722 23122 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.619649 21635 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.649844 21493 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:53.667043 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 131628us
W20260709 13:06:53.682519 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.685086 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:53.575237 23112 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.685506 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.700644 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:53.590289 23156 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:06:53.686273 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.639547 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:53.680496 23165 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.706301 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.686061 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.691555 21643 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:53.693272 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:06:53.617224 22795 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.833s	user 0.004s	sys 0.008s
I20260709 13:06:53.700004 21641 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.707096 21560 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:53.712442 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.701064 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.713325 21567 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:53.701285 22244 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.700634 21569 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:53.704353 21562 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:53.705518 21635 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:53.715638 21561 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:53.716068 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:53.720005 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:53.720589 21641 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:53.646354 22241 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
W20260709 13:06:53.703459 23147 consensus_meta.cc:287] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.928s	user 0.012s	sys 0.000s
I20260709 13:06:53.724202 21459 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:06:53.739832 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.739737 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:53.721313 22243 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:53.756845 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.681121 23171 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.721166 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:53.767258 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.767720 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:53.768289 21563 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:53.768764 22245 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:53.753831 22244 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:53.758005 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:53.771588 21568 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:53.772879 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.712894 22788 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.761670 21635 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.775791 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.773840 21568 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:53.776734 21560 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:53.777712 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.778033 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.779659 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.780121 21560 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:53.616631 23154 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.694911 23103 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.754740 22795 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.800345 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.802476 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:53.781466 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.807278 21568 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:53.807139 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:53.759959 23153 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.754573 23147 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:06:53.696719 23264 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.761961 22921 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:53.814922 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:53.821743 21486 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:53.819041 23268 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:06:53.826654 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:53.813228 23067 consensus_meta.cc:287] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.004s
I20260709 13:06:53.810987 23111 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:53.800484 23123 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.829034 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:53.743330 23117 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:06:53.819180 23274 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.811159 22795 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:53.861145 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 161351us
I20260709 13:06:53.864449 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:53.865914 21486 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:53.870121 23123 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.866724 23111 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.811703 23150 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 13:06:53.887595 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 80551.8us
I20260709 13:06:53.854467 23147 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:53.891983 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:53.861598 23163 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.828502 22921 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.908877 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:53.904579 21637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58388
I20260709 13:06:53.917703 21637 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:53.918320 21637 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.924347 21641 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:53.869201 23270 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.857717 23067 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.884114 22795 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.928804 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:53.934485 21641 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.933130 21634 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:06:53.936014 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:53.938702 21640 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:53.906262 23192 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:53.945081 23267 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:06:53.915593 23201 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:53.948621 21487 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:53.926815 23275 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.884262 23274 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.928902 23202 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:53.936474 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:53.934183 23163 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:53.904214 23147 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:53.947875 23265 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:06:53.936873 23249 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:53.941942 23122 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:53.942749 23210 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:53.964167 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:53.951977 23275 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.952632 23281 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:53.976333 21564 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.976655 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:53.977730 21640 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:06:53.978731 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:53.970059 23271 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:06:53.952355 23270 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.950841 23112 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:53.952580 23117 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:53.995404 23117 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:53.997545 23117 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.004535 21637 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:53.981000 21640 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:53.976646 23281 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:53.989274 23118 consensus_meta.cc:287] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.915s	user 0.011s	sys 0.001s
W20260709 13:06:53.992729 23081 consensus_meta.cc:287] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.001s
I20260709 13:06:53.993078 21564 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:53.984616 23171 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:53.987236 23154 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:53.967162 23163 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:54.019119 23069 consensus_meta.cc:287] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.000s
I20260709 13:06:53.976361 23275 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.036422 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.047096 23274 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.049158 21564 raft_consensus.cc:2368] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:54.031121 23081 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.050263 21564 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.050987 23081 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.052810 23169 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:54.054026 23276 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:06:54.017632 23180 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.986606 23270 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:54.074473 23270 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.039785 23111 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.079254 23180 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.028988 23118 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.045972 22242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 440) took 1093 ms. Trace:
I20260709 13:06:54.109771 23180 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.046113 23147 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.046901 23153 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.051442 21564 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.056844 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.146847 21560 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:54.147271 21560 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:54.091104 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:06:54.044880 23215 consensus_meta.cc:287] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.789s	user 0.012s	sys 0.000s
I20260709 13:06:54.148234 21560 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.178104 21560 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.109607 22242 rpcz_store.cc:276] 0709 13:06:52.952286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.031850 (+ 79564us) service_pool.cc:224] Handling call
0709 13:06:53.137299 (+105449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.217527 (+ 80228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.222572 (+  5045us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.294461 (+ 71889us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.555723 (+261262us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:53.555797 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.556243 (+   446us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.045562 (+489319us) raft_consensus.cc:1685] finished
0709 13:06:54.045591 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.045777 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10565,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4929,"thread_start_us":176089,"threads_started":1,"wal-append.queue_time_us":257786}
I20260709 13:06:54.062556 23069 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:54.188560 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 279777us
I20260709 13:06:54.111629 22795 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.161404 23264 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.169845 23067 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.163028 23163 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.149497 21640 raft_consensus.cc:2376] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4. Re-sending same reply.
I20260709 13:06:54.072613 21641 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:54.154085 23215 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.204535 23215 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.205619 23270 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:54.206902 23094 consensus_meta.cc:287] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.001s
I20260709 13:06:54.159564 23123 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.189406 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:54.219857 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:06:54.192356 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.184509 23122 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.190826 23169 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.208534 21643 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
W20260709 13:06:54.187636 23127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.017s
W20260709 13:06:54.187115 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 312790us
I20260709 13:06:54.232331 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:54.234153 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:54.221436 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:54.228657 23270 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.229236 23122 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:54.201680 23229 consensus_meta.cc:287] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.000s
I20260709 13:06:54.236863 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:54.248183 22795 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:54.235003 23127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.000s	sys 0.018s
I20260709 13:06:54.249181 23122 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.249748 23069 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.233611 23163 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.267504 23163 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.267911 23163 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.272689 23275 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.235224 23123 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.236985 23240 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.250183 23281 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:54.251686 23152 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.928s	user 0.006s	sys 0.006s
I20260709 13:06:54.275828 23152 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.277815 23152 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.261969 23202 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.280326 21568 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:06:54.262773 23105 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.884s	user 0.010s	sys 0.003s
W20260709 13:06:54.252717 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.238129 23210 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.259843 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:54.263465 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.253240 23169 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.252064 23229 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:54.223179 23094 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.292233 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.292765 21640 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:54.294109 21639 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.288659 23123 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.297101 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.299422 21636 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:54.287955 23163 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.300313 23123 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:54.303701 23123 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.303761 23094 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.305068 23217 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.309186 21560 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:54.289026 23105 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:06:54.313705 23165 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 13:06:54.315562 21640 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:54.312616 22845 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.314193 23275 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.320991 23163 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.318028 23165 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.332108 23105 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.336373 23183 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.336593 23105 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.339229 23165 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.337356 23105 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:54.344174 23105 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.341173 23123 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:54.347295 21642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1657) took 1384 ms (client timeout 1604 ms). Trace:
W20260709 13:06:54.347716 21642 rpcz_store.cc:269] 0709 13:06:52.963191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.963379 (+   188us) service_pool.cc:224] Handling call
0709 13:06:54.347133 (+1383754us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54001149d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:54.347240 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201362816}
I20260709 13:06:54.348472 23123 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.348891 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:54.349502 21642 raft_consensus.cc:2376] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4. Re-sending same reply.
W20260709 13:06:54.350373 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.350409 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 248) took 1381 ms. Trace:
I20260709 13:06:54.351339 21635 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:54.350994 22239 rpcz_store.cc:276] 0709 13:06:52.968449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.078491 (+110042us) service_pool.cc:224] Handling call
0709 13:06:54.331191 (+1252700us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:06:54.331965 (+   774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.332790 (+   825us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:54.333127 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.349860 (+ 16733us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.349920 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:54.349995 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.350097 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.350246 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2223,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":103,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":10029696,"thread_start_us":16048,"threads_started":1,"wal-append.queue_time_us":16381}
I20260709 13:06:54.352805 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.353722 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:54.354250 21635 raft_consensus.cc:2393] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:54.354970 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:54.355515 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.356201 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.356529 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.357791 21635 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:54.358386 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.359019 21642 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 1.
I20260709 13:06:54.359269 21635 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:54.357861 21643 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:54.356640 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.361083 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1410) took 1543 ms. Trace:
I20260709 13:06:54.370996 21487 rpcz_store.cc:276] 0709 13:06:52.817740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.817897 (+   157us) service_pool.cc:224] Handling call
0709 13:06:54.360855 (+1542958us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540013b0d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:54.360996 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504572160}
I20260709 13:06:54.371852 23103 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.374042 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.374608 21562 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.384351 21562 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:06:54.387796 21637 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.389021 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:54.389598 21637 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.389688 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.390472 21642 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:54.390688 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 107) took 1037 ms. Trace:
I20260709 13:06:54.391357 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:54.392089 21642 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:54.393143 22845 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:54.393658 22845 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.397985 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:54.398258 21637 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
W20260709 13:06:54.400681 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.402329 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:54.403080 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:54.405071 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:54.405525 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.391134 21639 rpcz_store.cc:276] 0709 13:06:53.352900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.353087 (+   187us) service_pool.cc:224] Handling call
0709 13:06:53.374690 (+ 21603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.294603 (+919913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.390450 (+ 95847us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54002e1b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:54.390627 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113882880}
I20260709 13:06:54.406909 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.408155 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:54.408185 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:54.408754 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.409384 21565 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.409631 21637 raft_consensus.cc:2410] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:54.409490 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:54.402556 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:54.410295 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.410562 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:54.410890 21569 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.411243 21562 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:54.411293 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:54.412451 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:54.413100 21560 raft_consensus.cc:2410] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:54.413712 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.414144 21566 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.408864 21486 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.415846 21493 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:54.416234 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.416462 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:54.417002 21560 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.418524 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:54.419021 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:54.420035 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:54.420869 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:54.421988 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:54.399339 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:54.404027 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:54.429368 22245 raft_consensus.cc:2393] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 4: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:54.429804 21487 raft_consensus.cc:2393] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:54.424443 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:54.426946 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.430636 21562 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.428424 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:54.434188 21486 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:06:54.435245 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:54.441427 21562 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:54.400138 23239 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:54.449314 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:54.447367 21560 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:54.449120 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:54.451484 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:54.439978 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:54.452584 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:54.407342 22930 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:54.417685 23041 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:54.428331 23223 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.453316 22795 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.427956 22843 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.461755 21566 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:54.454679 21569 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:54.449218 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:06:54.479626 23257 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.921s	user 0.000s	sys 0.011s
I20260709 13:06:54.479782 22241 raft_consensus.cc:2393] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:54.464124 23111 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.464923 23264 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:54.453635 23127 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.465533 22921 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.437383 23165 raft_consensus.cc:2764] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:54.428153 23122 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.469484 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:54.443858 23225 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.472489 22795 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.469648 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:54.468391 21459 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:54.448361 23117 raft_consensus.cc:2764] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:54.448800 23249 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:54.563863 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 94444.4us
I20260709 13:06:54.572620 22245 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:54.495323 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1667) took 1351 ms. Trace:
I20260709 13:06:54.577225 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:54.570704 23105 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:54.584285 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.560070 23127 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.584693 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.585086 21568 raft_consensus.cc:2393] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:54.474014 23223 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:54.437032 23217 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:06:54.460086 23192 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.443048 23153 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:54.451392 23171 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:54.493261 21565 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:54.583707 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:54.598034 21569 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.435920 23196 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:54.585722 21566 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:54.494989 23166 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:06:54.560329 23103 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:54.475206 22843 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:06:54.592599 21634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1658) took 1627 ms (client timeout 1767 ms). Trace:
I20260709 13:06:54.475926 23239 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:06:54.618940 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 165977us
I20260709 13:06:54.574482 22795 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.564389 23210 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.576604 21638 rpcz_store.cc:276] 0709 13:06:53.174308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.174442 (+   134us) service_pool.cc:224] Handling call
0709 13:06:53.174765 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.175138 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.175164 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.175587 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.298620 (+123033us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:53.298682 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.298774 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.443661 (+1144887us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:06:54.481374 (+ 37713us) raft_consensus.cc:1685] finished
0709 13:06:54.481425 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.495228 (+ 13803us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3249,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":28796,"spinlock_wait_cycles":6979456,"thread_start_us":65579,"threads_started":1,"wal-append.queue_time_us":321062}
I20260709 13:06:54.630640 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:54.586611 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 118283us
I20260709 13:06:54.634370 21493 raft_consensus.cc:2393] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:54.635643 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:54.562425 23225 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:54.564019 23154 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:54.603482 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:54.575588 23249 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.600839 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:54.614952 21568 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:54.482085 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:54.587278 23165 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:54.618114 21634 rpcz_store.cc:269] 0709 13:06:52.964774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.005967 (+ 41193us) service_pool.cc:224] Handling call
0709 13:06:54.592333 (+1586366us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b5400295c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:54.592519 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886207744}
W20260709 13:06:54.652060 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 199516us
I20260709 13:06:54.594003 21643 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:54.595268 23223 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.483225 23041 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.632521 21640 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:54.638912 21569 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:54.640347 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:54.597303 23192 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.482825 22930 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:54.632252 23069 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:54.666194 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.666509 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.667307 21635 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:54.494767 23111 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.587572 23127 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.633329 23118 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.649435 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:54.619371 22843 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.617944 23153 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:54.631948 23166 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:54.627187 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:54.623771 23122 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:54.597790 23105 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.661473 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:54.663491 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:54.663836 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:54.644570 23225 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.673223 23230 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.653625 23125 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.624141 23239 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.619449 23103 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.671401 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.701445 21640 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:54.682853 23300 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:54.674129 22212 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:54.659611 23174 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.652135 23240 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:54.665709 23192 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.688012 21493 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:54.651665 23154 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.703163 23299 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:54.721458 23153 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.724234 22930 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.731925 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:54.685878 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49220.8us
I20260709 13:06:54.672065 23111 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.691598 21608 leader_election.cc:400] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:54.740536 21608 leader_election.cc:403] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.670009 23069 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.692057 22921 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.694110 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.685581 23166 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.748809 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:54.749009 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:54.680073 23210 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:54.697572 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44414.6us
I20260709 13:06:54.667171 21638 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
I20260709 13:06:54.740545 23300 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:54.685130 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:54.758862 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:54.758594 23300 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:54.759420 23301 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:54.759908 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:54.699654 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:54.652407 23165 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.762734 21637 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:54.764535 23303 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.765060 23303 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:54.765494 23303 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.689381 22240 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:54.664575 21487 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:54.725401 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:06:54.741276 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49828.5us
I20260709 13:06:54.746959 21642 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:54.696790 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:54.749452 21493 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:54.772773 21487 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:54.745501 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:54.772691 21635 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.709885 23202 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:54.689635 23122 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.762941 23165 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.706001 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:54.750213 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:54.740383 23299 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:54.774240 23305 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.771839 22930 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:54.742766 22788 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:54.755376 22243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 437) took 1841 ms (client timeout 1934 ms). Trace:
I20260709 13:06:54.779037 23123 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.783389 21488 raft_consensus.cc:2368] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3.
I20260709 13:06:54.782634 21635 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:54.784848 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:54.706900 23264 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:54.787817 22245 raft_consensus.cc:2368] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3.
I20260709 13:06:54.746381 23163 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:54.786659 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:54.746232 23183 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:54.752990 23125 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:54.754194 23041 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.758733 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:54.727733 23174 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:54.810973 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.788064 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:54.791769 23067 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.791297 23305 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.793609 23202 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:54.830325 23202 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.833737 23223 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.793126 23229 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:06:54.838214 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 124419us
I20260709 13:06:54.817907 23094 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:54.792724 22845 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.836969 23249 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.823802 23041 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:54.862344 23041 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:54.863482 23041 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.864322 22845 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.827585 23275 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:54.866135 23275 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:54.867324 23275 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.871438 23264 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.875727 23225 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.876405 23105 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:54.878598 23298 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:54.797283 22930 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.882609 23230 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:54.883134 22930 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.883293 23230 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.819305 23183 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:54.887998 23166 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.889468 23103 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.830632 23069 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.810451 22843 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.845455 23094 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:54.851562 23223 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.850342 23127 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.851929 23154 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:54.828606 23305 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.993062 22843 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.992880 23094 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.994222 23094 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:54.795362 22243 rpcz_store.cc:269] 0709 13:06:52.906510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.906968 (+   458us) service_pool.cc:224] Handling call
0709 13:06:54.726029 (+1819061us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b540045abd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:54.746217 (+ 20188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560975616}
I20260709 13:06:54.821753 23067 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:54.995465 23067 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.996273 23127 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.996690 23111 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.854758 23299 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:54.997289 23165 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:54.857944 23174 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:54.859588 23122 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:54.826948 21489 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:54.897996 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 158183us
I20260709 13:06:54.904403 23145 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.903775 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:54.908576 23123 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:54.917900 21390 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 4, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 4 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.028278 21390 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 3, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:54.929088 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.886566 23183 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:06:54.990384 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 228064us
I20260709 13:06:55.034001 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:55.039207 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:55.039299 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:55.053911 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:55.054711 21493 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.030617 21390 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 3, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.056730 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.058426 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.059118 21485 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:55.059458 21490 raft_consensus.cc:2410] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:55.059154 23166 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:55.040511 23145 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:55.027827 23174 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.061501 23174 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:55.062109 23145 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.062397 23174 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.051342 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:55.067943 23225 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.068303 22795 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.069684 23111 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.027063 23123 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:55.048370 23127 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.072095 21486 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:55.047905 23122 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.072783 23123 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.080312 23183 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:06:55.010154 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 106456us
I20260709 13:06:55.080590 23123 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.081342 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:55.082351 23117 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.082665 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:55.082860 23117 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:55.011497 21389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 243) took 4074 ms. Trace:
I20260709 13:06:55.013566 23165 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.072685 23127 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:55.083863 23117 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:55.006469 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 219888us
I20260709 13:06:55.084939 23127 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.087467 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:55.088853 21459 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:55.089056 21532 leader_election.cc:400] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4.
I20260709 13:06:55.089309 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.089350 21532 leader_election.cc:403] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:55.100792 21459 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:55.103634 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:55.104768 21490 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:55.106115 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.108491 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.109022 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:55.109146 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.109719 21491 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.109899 21560 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:55.113046 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.115262 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.070773 22795 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.120805 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.090032 23300 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:55.084055 21389 rpcz_store.cc:276] 0709 13:06:50.925991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.926134 (+   143us) service_pool.cc:224] Handling call
0709 13:06:54.999815 (+4073681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:53.361324 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:53.361882 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:53.361914 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:06:53.361932 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:53.362831 (+   899us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:53.362895 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:53.362923 (+    28us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:53.468026 (+105103us) tablet.cc:701] Row locks acquired
0709 13:06:53.470603 (+  2577us) write_op.cc:260] PREPARE: finished
0709 13:06:53.498362 (+ 27759us) write_op.cc:270] Start()
0709 13:06:53.528890 (+ 30528us) write_op.cc:276] Timestamp: P: 1783602413494651 usec, L: 0
0709 13:06:53.531936 (+  3046us) op_driver.cc:348] REPLICATION: starting
0709 13:06:53.692755 (+160819us) log.cc:844] Serialized 3252 byte log entry
0709 13:06:54.211061 (+518306us) op_driver.cc:464] REPLICATION: finished
0709 13:06:54.296574 (+ 85513us) write_op.cc:301] APPLY: starting
0709 13:06:54.296674 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:54.300861 (+  4187us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:54.303507 (+  2646us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:54.305414 (+  1907us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:54.305620 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:06:54.305664 (+    44us) write_op.cc:312] APPLY: finished
0709 13:06:54.305909 (+   245us) log.cc:844] Serialized 65 byte log entry
0709 13:06:54.310670 (+  4761us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:54.313395 (+  2725us) write_op.cc:454] Released schema lock
0709 13:06:54.314714 (+  1319us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:54.318978 (+  4264us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:54.319980 (+  1002us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30163,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":85256,"apply.run_cpu_time_us":3344,"apply.run_wall_time_us":21743,"num_ops":8,"prepare.queue_time_us":222531,"prepare.run_cpu_time_us":19225,"prepare.run_wall_time_us":523394,"raft.queue_time_us":219748,"raft.run_cpu_time_us":25714,"raft.run_wall_time_us":98614,"replication_time_us":671899,"thread_start_us":600460,"threads_started":4,"wal-append.queue_time_us":262689}]]}
I20260709 13:06:55.100471 23302 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:55.107522 23249 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4.
W20260709 13:06:55.132402 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 121888us
I20260709 13:06:55.140654 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.107529 23165 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.151665 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.125263 21532 leader_election.cc:400] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3.
I20260709 13:06:55.170957 21532 leader_election.cc:403] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:55.167055 21491 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:55.128103 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.111075 23122 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.150067 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.145092 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.074234 23303 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.074218 23230 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.129360 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.181051 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:55.173018 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.076251 23067 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.072237 23192 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:55.138948 21493 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:55.235375 21562 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.137272 23069 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.176388 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:55.234571 23165 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:55.241870 23163 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:55.241272 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:55.235805 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 54860.8us
I20260709 13:06:55.107561 23183 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.183314 22210 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:55.239018 21485 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:55.240149 23122 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:55.182307 23302 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:55.289186 21487 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:55.254499 21491 raft_consensus.cc:2368] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:55.294210 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.144794 23300 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:55.258642 21568 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.180279 23201 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3.
I20260709 13:06:55.259284 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:55.235028 23239 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:06:55.304206 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.148610 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:55.174892 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 49760.1us
I20260709 13:06:55.261174 21565 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:55.281044 23125 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.317147 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:55.186477 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.166711 22795 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:06:55.271565 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 88314.3us
I20260709 13:06:55.320241 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:55.319727 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.320107 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.326637 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.295753 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:55.167268 23310 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:06:55.356956 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.357162 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.257519 23163 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.282778 21489 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:55.257367 23166 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.301877 21494 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.302726 21562 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:55.472599 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.473374 21562 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:55.474140 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.265403 21488 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.425689 23163 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.307153 21637 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:55.479712 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:55.480136 21637 pending_rounds.cc:85] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 1
I20260709 13:06:55.480456 21637 pending_rounds.cc:107] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:55.480491 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:55.480810 21637 raft_consensus.cc:2889] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:55.481144 21639 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.307910 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.481953 21566 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:55.309037 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:55.483182 21638 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
W20260709 13:06:55.311075 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.315196 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:55.316284 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:55.485011 21635 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.480428 21641 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:55.352596 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:55.286372 21492 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:55.353626 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:55.353940 21491 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:55.354302 21490 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:55.496222 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:55.424374 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.496347 21635 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:55.497025 21560 raft_consensus.cc:2368] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:55.497743 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:55.424317 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 70717.8us
I20260709 13:06:55.254946 23305 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:55.455328 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.455186 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.303822 23300 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.318516 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:55.317654 22788 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:55.260012 23069 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.365134 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:55.359978 22795 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:55.362056 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 50107.2us
W20260709 13:06:55.530844 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.466536 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:55.444591 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:55.306874 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.474779 21562 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:55.533160 21640 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.477200 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:06:55.533999 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56915.9us
I20260709 13:06:55.360355 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:55.503849 21565 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:55.468331 23094 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.509081 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:55.514361 22245 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:55.360771 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.468616 22921 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:55.527163 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:55.470183 23202 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:55.534637 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 68240.8us
I20260709 13:06:55.503095 23123 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.540030 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.548539 21562 raft_consensus.cc:2393] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:55.540169 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.543004 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.549198 21569 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:55.550278 21640 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:55.510319 23154 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.540930 21561 raft_consensus.cc:2368] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:55.513154 22238 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:55.540614 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.574621 21560 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.540794 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:55.576246 21635 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:55.520141 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:55.541352 21642 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.428537 23165 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.581207 22240 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:55.541260 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.582484 21565 raft_consensus.cc:2368] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4.
I20260709 13:06:55.538729 23275 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.551488 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:55.611200 22245 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.500041 23166 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.558069 21569 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.629324 21636 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:55.562331 23318 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:06:55.563370 23321 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:55.563789 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:55.564206 23317 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:06:55.564950 23315 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:06:55.526741 22788 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.543370 23230 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:55.568157 23154 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.569492 23067 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.569722 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:55.570749 23303 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:55.540079 23111 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.468874 23302 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.546566 22921 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.593948 23069 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.594709 23192 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.545192 23094 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.557935 23123 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.596143 23305 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:55.552125 23196 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.596320 21642 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
W20260709 13:06:55.604661 23320 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:55.552834 22246 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:55.551340 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:55.617486 21566 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:55.536437 21639 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:06:55.625471 21568 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:55.649255 21560 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:55.650627 22245 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:55.554738 23202 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.541148 23122 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.896587 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.863816 22795 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.897604 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:55.858297 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:55.859593 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 289922us
I20260709 13:06:55.853430 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 144) took 1043 ms. Trace:
I20260709 13:06:55.910558 21566 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:55.908347 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 356937us
I20260709 13:06:55.918207 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:55.916205 21640 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.920181 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:55.910714 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 433962us
W20260709 13:06:55.844146 23316 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.375s	user 0.000s	sys 0.004s
I20260709 13:06:55.932025 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:55.937974 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:55.934649 22795 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:55.939090 22795 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.940272 23117 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.940685 22788 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:55.848452 23067 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.783030 23125 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.915889 21564 rpcz_store.cc:276] 0709 13:06:54.810508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.810673 (+   165us) service_pool.cc:224] Handling call
0709 13:06:54.823738 (+ 13065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.824424 (+   686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.824453 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.837789 (+ 13336us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.103301 (+265512us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.103340 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.103400 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.853158 (+749758us) raft_consensus.cc:1685] finished
0709 13:06:55.853185 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.853345 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34436,"raft.queue_time_us":3237,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4538,"thread_start_us":249581,"threads_started":1,"wal-append.queue_time_us":450737}
I20260709 13:06:55.941285 21565 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:55.936648 21566 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:55.693024 23183 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:55.949896 21640 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:55.694418 22921 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:55.690858 23201 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.734653 23111 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:55.943429 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:55.970934 23183 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:55.971151 23230 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:55.971438 23183 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:55.971570 23230 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:55.971915 23183 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.972023 23230 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.972271 23111 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.972765 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:55.973592 23123 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:55.973984 23313 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:55.974730 23313 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.976842 23313 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:55.763082 22243 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:06:55.909834 23239 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:55.977921 23239 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.964825 23125 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.979430 23224 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.979614 23183 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.979961 23224 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:55.981757 23183 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:55.982040 23224 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.982867 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.982304 23239 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.976866 23202 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:55.987377 23240 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:55.987982 23240 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:55.988857 23300 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.989423 23240 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:55.990103 21561 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:55.990916 23240 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.991080 21494 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:55.995410 23125 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:55.996978 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.000718 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:56.002029 21566 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:55.944281 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:55.963750 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.003338 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:56.003870 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 65084.7us
I20260709 13:06:56.005227 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:55.886767 23112 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:06:55.974074 23145 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:55.929580 23196 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.010560 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:55.947769 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:56.000787 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:06:56.015170 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 67480.5us
I20260709 13:06:56.020604 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:56.021461 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:56.007174 22795 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:56.029767 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:55.969362 23094 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:56.037257 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:55.952157 23166 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:56.058691 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 60007.9us
I20260709 13:06:55.943816 23117 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:06:56.065045 21563 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:56.059276 21639 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:56.014640 23313 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.022060 23183 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.086969 23183 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:56.088905 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:56.089383 23183 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.035626 23305 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.091395 23305 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:56.092327 23305 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.091952 23230 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:56.069566 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.096038 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:06:56.096624 23334 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:56.098553 22795 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.099303 22795 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.099663 22795 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:56.099464 23331 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:06:56.100016 22795 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.066527 23069 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:56.103240 23069 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:56.104228 23069 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.036134 23145 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:56.061630 23154 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:56.108809 23341 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:06:56.012907 22921 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.066712 23337 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.061954 21566 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:56.074851 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:56.074678 22930 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:55.953596 23067 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.124266 22921 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:56.124306 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:56.125088 21636 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.125766 23067 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:56.090704 23240 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.110378 21569 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:56.128167 23196 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:56.022948 23192 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:06:56.128293 23067 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.128623 23249 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.129192 23249 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.128650 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:56.112313 21640 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:56.130939 21640 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:56.113008 21606 leader_election.cc:400] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:56.131834 21606 leader_election.cc:403] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:56.066257 23303 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:06:56.132951 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:06:56.113481 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.115447 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:56.069355 23081 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:56.022445 23310 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:06:56.066260 23300 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:56.069077 23174 raft_consensus.cc:2764] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:56.117705 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:56.119952 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.143936 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:56.126183 23337 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.187180 23094 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:56.056736 23153 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:06:56.261902 23230 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:56.169873 21640 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.265107 21640 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.108889 23145 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.202716 22795 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:56.170622 23163 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.000s
I20260709 13:06:56.125281 22921 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:56.159350 23240 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.145393 22246 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:56.204093 23344 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:06:56.186081 23196 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.182472 23339 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:56.204836 21638 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:06:56.259722 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 115867us
I20260709 13:06:56.300748 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.266017 23117 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.067548 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 119125us
I20260709 13:06:56.306962 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.308049 21638 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:56.252851 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.260169 21634 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:56.309073 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.191181 21636 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:56.312459 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:56.312582 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.313385 21636 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:56.266304 23249 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:56.202031 21568 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:56.314159 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.187120 23264 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:06:56.293818 21640 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:56.316823 21640 pending_rounds.cc:85] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 2
I20260709 13:06:56.317121 21640 pending_rounds.cc:107] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 13:06:56.316989 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 286687us
I20260709 13:06:56.186534 23081 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:56.287796 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:56.298381 21643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.001s	sys 0.025s
I20260709 13:06:56.263326 23275 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.301930 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.302269 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.304136 21488 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:56.186853 23154 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.305493 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:56.264343 23349 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:06:56.310271 21637 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:56.321946 21638 raft_consensus.cc:2410] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:56.322912 21637 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:56.315442 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.319096 21487 raft_consensus.cc:2410] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:56.317365 21640 raft_consensus.cc:2889] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:56.294766 22795 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:56.287264 23201 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:56.318518 21643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.001s	sys 0.025s
I20260709 13:06:56.328913 23041 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.329140 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:56.299775 23240 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.330121 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.332131 23081 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:56.297205 23224 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:06:56.332897 23343 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:56.349700 21489 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:56.313504 23196 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.366065 23154 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.366577 23154 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.367431 23196 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:56.316674 23117 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:56.357458 22243 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.368970 23154 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:56.369679 23117 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:56.335374 23239 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:56.334731 23067 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.336236 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 117) took 1155 ms. Trace:
I20260709 13:06:56.342068 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.379441 21568 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.344111 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:56.336911 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:56.266157 23094 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.296478 23163 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:56.325068 23275 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.357442 23347 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:56.361917 21492 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:56.320895 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:56.357224 23339 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.347854 21634 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:06:56.381289 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44451.4us
I20260709 13:06:56.356928 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.382056 21640 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:56.380699 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:56.376101 21643 rpcz_store.cc:276] 0709 13:06:55.181328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.181531 (+   203us) service_pool.cc:224] Handling call
0709 13:06:55.181866 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.182205 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.182240 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.234996 (+ 52756us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.484125 (+249129us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.648461 (+164336us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.335932 (+687471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.336006 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.336047 (+    41us) raft_consensus.cc:1685] finished
0709 13:06:56.336059 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.336180 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":503601,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":159404,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":86210,"thread_start_us":1069697,"threads_started":3,"wal-append.queue_time_us":493091}
I20260709 13:06:56.399999 21642 raft_consensus.cc:2368] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5.
I20260709 13:06:56.400794 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:56.388420 23196 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.403493 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:56.391002 23275 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.409543 23163 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:56.398267 23111 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:06:56.411257 23094 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:56.411144 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:56.413110 22245 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.416162 23337 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:56.402228 23313 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:56.381661 23239 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:56.417285 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 486075us
I20260709 13:06:56.418879 23239 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:56.376243 23224 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.420521 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.422084 23224 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:56.404277 23117 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.424736 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.425117 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:56.425956 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:56.425134 21568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:06:56.429862 22245 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:06:56.424592 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:56.430941 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:56.434049 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:56.434660 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:56.435642 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.436668 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.436873 21487 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:56.437988 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.438571 21643 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:56.438901 21638 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:56.440222 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:56.436223 21486 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:56.441077 21569 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:56.441448 22212 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.442090 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:56.442624 22245 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.442768 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.443081 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:56.445047 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.446075 21636 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:56.446609 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.447992 21486 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:06:56.406241 23196 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.449342 22240 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.432847 22930 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.453068 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:56.449558 21637 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:56.431717 23117 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.395740 23347 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:56.462968 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.463048 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.465557 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.467454 21494 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:56.468659 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.398836 23339 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.469827 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:56.470649 22238 raft_consensus.cc:2368] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5.
I20260709 13:06:56.470969 23094 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.443138 23333 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:06:56.471621 23339 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:56.475013 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:56.475843 21637 raft_consensus.cc:2376] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3. Re-sending same reply.
I20260709 13:06:56.445981 22788 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.478118 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.481210 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:56.466302 23117 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.443073 23350 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.441555 23145 raft_consensus.cc:2764] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:56.485811 21640 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:56.445823 23313 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:56.447794 23337 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:56.455636 21486 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:56.455176 23196 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.493746 21640 pending_rounds.cc:85] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 1
I20260709 13:06:56.506490 21640 pending_rounds.cc:107] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:56.461164 22930 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:56.497246 23337 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:56.501062 22246 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:56.502959 23339 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.473253 23122 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.503551 23313 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.505043 23333 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.495293 23303 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.506263 23350 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:56.512569 23337 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:56.514467 23350 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.516032 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.517046 23067 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:56.517652 23342 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.262s	user 0.001s	sys 0.001s
I20260709 13:06:56.518512 23067 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.524045 21487 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.536242 21564 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:56.545116 23127 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:56.550235 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 119) took 1037 ms. Trace:
I20260709 13:06:56.494387 21608 leader_election.cc:400] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:56.507551 21640 raft_consensus.cc:2889] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:56.477766 23332 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.552711 21608 leader_election.cc:403] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:56.553354 23094 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:56.509076 21560 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:56.507052 22930 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.509774 23122 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:56.556470 23122 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.509961 23339 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.550871 21635 rpcz_store.cc:276] 0709 13:06:55.512404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.578250 (+ 65846us) service_pool.cc:224] Handling call
0709 13:06:55.857671 (+279421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.875529 (+ 17858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.875573 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.876155 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.003321 (+127166us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.003362 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.003439 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.517019 (+513580us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:06:56.549895 (+ 32876us) raft_consensus.cc:1685] finished
0709 13:06:56.549924 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.550157 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38684,"raft.queue_time_us":111097,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":24465,"spinlock_wait_cycles":4042496,"thread_start_us":126835,"threads_started":1,"wal-append.queue_time_us":256525}
I20260709 13:06:56.558120 23339 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.563656 21490 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:56.574275 23362 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
I20260709 13:06:56.574896 23111 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:56.575716 23363 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 13:06:56.584267 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:56.585111 21490 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:06:56.590185 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 74234.3us
I20260709 13:06:56.591137 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:56.592099 23069 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:56.592667 23069 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:56.593036 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.593644 21562 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:56.593509 23069 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:56.595680 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 101525us
I20260709 13:06:56.592141 22795 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:56.596586 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.597275 23347 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:56.597893 23361 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
I20260709 13:06:56.598577 23094 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.594729 23069 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.615489 21634 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:56.614506 21640 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:56.599252 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:56.601228 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:56.618959 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.618827 22247 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:56.629124 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:56.632241 23302 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.634049 23111 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.635314 22795 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:56.658818 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.659344 22795 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.660028 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:56.608630 22243 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:56.641919 21488 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.661420 21608 leader_election.cc:400] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4.
I20260709 13:06:56.653800 22242 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:06:56.647776 23339 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.629976 23094 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:56.642468 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48319us
I20260709 13:06:56.667752 21634 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.640815 22245 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:56.672689 21634 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:56.673101 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 193619us
I20260709 13:06:56.661707 21608 leader_election.cc:403] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:56.663959 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:56.667758 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:06:56.656163 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.677260 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.677296 23339 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:56.674199 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:56.684947 22239 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.685917 23339 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.670550 23163 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.686704 23339 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:56.688103 21640 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:56.691044 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.696281 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:56.702064 21634 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.687042 23372 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.704599 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.714953 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.715327 21642 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:56.715793 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.701164 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.710101 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:56.710608 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.731011 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.731353 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.732249 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:56.671778 23183 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.706845 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.711586 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:56.738109 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 295399us
I20260709 13:06:56.712605 21639 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.709651 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:56.674047 23354 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.739670 22212 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.758963 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:56.780817 21641 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:06:56.767385 21642 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:56.781740 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:56.782353 21636 raft_consensus.cc:2410] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:56.692252 23094 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4.
I20260709 13:06:56.711584 21640 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.783331 21532 leader_election.cc:400] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 2 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3.
I20260709 13:06:56.704181 23111 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:56.783447 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49864.8us
I20260709 13:06:56.708009 23163 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:56.789471 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49879.9us
I20260709 13:06:56.798484 22212 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.692533 22930 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.678351 23117 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.728683 23154 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.736183 23067 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.730001 23351 raft_consensus.cc:2764] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:56.729576 23153 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.820456 22795 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.869951 22795 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:06:56.820106 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61302.2us
I20260709 13:06:56.871208 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:56.681807 23122 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:56.877818 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:06:56.883230 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55515.2us
W20260709 13:06:56.888387 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 101985us
W20260709 13:06:56.829568 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 87990.4us
I20260709 13:06:56.786631 23354 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.789949 22921 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.891779 23354 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.892005 22921 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:56.893231 22921 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:56.854912 23374 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:06:56.740087 23201 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:06:56.859513 23339 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:56.830260 23230 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.860498 23081 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.861874 23117 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:56.862229 21568 raft_consensus.cc:606] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:56.919658 21568 raft_consensus.cc:614] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:56.834719 23111 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:56.920164 21560 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:56.820118 23316 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:06:56.795369 23183 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:06:56.875720 23249 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.870415 23154 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:56.736267 23240 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:56.898576 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:56.903474 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:56.906761 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:56.788118 23192 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:06:56.832442 23094 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.945921 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:56.914430 22795 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:56.736720 23372 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:56.917119 23345 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:06:56.906828 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:56.914175 23165 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:56.945776 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47350.9us
I20260709 13:06:56.829775 23347 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.908329 23069 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.790237 23305 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.932227 23313 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:06:56.954623 23331 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.943845 23196 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:57.050104 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 93205us
I20260709 13:06:56.916925 23351 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:06:56.959991 23165 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:56.949517 23249 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:57.121212 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 230702us
I20260709 13:06:57.153776 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:06:57.154933 23383 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:06:56.920781 23230 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:56.954967 23117 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.070151 23352 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:06:57.151588 23165 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.059777 23069 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:57.156194 23069 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.157658 23230 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:57.155527 23117 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.159143 23117 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:57.159789 23384 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 13:06:56.925763 22246 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:57.071643 23305 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.932696 23299 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.160s
I20260709 13:06:56.956069 23094 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.171134 22243 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.169934 23305 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.088732 23153 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
W20260709 13:06:57.181437 23373 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:06:57.175925 23112 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.232892 23299 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:57.164126 23154 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:57.233043 23372 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:57.181746 23111 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.238643 23192 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:57.217183 23337 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:57.214361 23351 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:57.250051 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:57.257624 21564 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:57.251268 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:57.244673 22930 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:57.258882 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:06:57.261493 23122 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:57.228245 23112 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:57.243327 23350 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.273126 23351 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:57.273695 23351 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:57.257899 23230 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:57.262583 23393 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:06:57.299682 23153 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:57.304522 23153 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:06:57.301218 23394 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:06:57.247740 23337 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:57.324726 23094 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:57.316794 23351 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.271437 23350 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:57.297501 23230 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:06:57.321203 23240 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:57.335343 23400 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:57.335989 23337 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:57.330371 23112 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:57.342041 23400 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.345000 23400 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:57.305454 23153 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.347476 23153 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.333591 23397 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:57.360404 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 101639us
I20260709 13:06:57.362032 23333 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.362468 23333 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.362818 23333 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.364846 23165 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.368409 23249 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:57.369226 23117 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.360095 23397 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.371567 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:57.372031 23117 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:57.372830 23333 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:57.346698 23067 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.513s	user 0.004s	sys 0.002s
I20260709 13:06:57.388437 23333 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:57.396219 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:57.435006 21561 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.355154 23196 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:57.406383 23165 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:57.453302 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 298186us
I20260709 13:06:57.464946 21457 leader_election.cc:400] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5.
I20260709 13:06:57.466189 21457 leader_election.cc:403] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:57.469029 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:57.469866 21635 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.446817 23067 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:57.471625 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:57.472689 21640 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:06:57.399324 23350 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.449301 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:57.489652 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:57.499557 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:57.499920 21640 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:57.489727 21635 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:06:57.480976 21568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24789f7f25d44609b76928ec55894739"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:06:57.502643 21568 raft_consensus.cc:606] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:57.503155 21568 raft_consensus.cc:614] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:57.443789 23230 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:57.511489 21635 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:57.478514 23117 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.515643 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:57.515746 21642 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:57.516978 21641 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:57.502409 23224 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.498742 22241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 456) took 1071 ms. Trace:
I20260709 13:06:57.504846 23240 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.505116 23350 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.526989 21638 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:57.528059 22247 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.503327 23166 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:06:57.545321 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:57.544389 22240 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:57.533444 23240 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.539521 22243 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.564819 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:06:57.568538 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 189765us
I20260709 13:06:57.570124 21639 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.527186 23117 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:57.605940 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:57.566325 23240 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.554049 23166 consensus_queue.cc:1243] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:57.622165 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:57.631171 21457 leader_election.cc:400] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5.
W20260709 13:06:57.632391 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.599887 22238 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:57.667598 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48215.1us
W20260709 13:06:57.667800 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 504187us
I20260709 13:06:57.668841 21635 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:57.618280 23275 consensus_meta.cc:287] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.179s	user 0.011s	sys 0.012s
I20260709 13:06:57.565653 23405 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.614691 23122 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.674361 21561 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:06:57.683130 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:57.676748 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 57511.6us
I20260709 13:06:57.684011 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:57.621982 23067 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.682367 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:57.672974 22247 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:57.669123 23420 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:06:57.620188 23339 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:57.672811 23415 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:57.661692 23165 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 13:06:57.804520 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 89420us
W20260709 13:06:57.804322 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.849910 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.706730 22240 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:57.855799 21641 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.858811 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:57.696938 23094 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.687121 23067 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:57.697096 23041 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.868954 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:57.869287 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:57.870131 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:57.871003 21494 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:57.927474 21487 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:57.871078 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:06:57.906855 21637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.046s	sys 0.073s
W20260709 13:06:57.903795 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 54761.1us
I20260709 13:06:57.924523 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:57.927912 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:57.928687 21567 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:06:57.928262 21637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.059s	sys 0.077s
I20260709 13:06:57.714268 23153 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.802721 23412 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.935984 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:57.694021 23122 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.855014 23183 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.955266 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:57.961484 21486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:06:57.962121 21486 raft_consensus.cc:606] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:57.874102 23094 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.694626 23275 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:57.704707 23418 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.245s
I20260709 13:06:57.706866 23339 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.923760 23414 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.905079 23067 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.902352 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:57.703905 23405 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.015118 21643 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 5: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:58.022404 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:57.954907 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:58.023634 23123 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:58.014295 23402 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.442s	user 0.001s	sys 0.000s
I20260709 13:06:57.967803 23094 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.039999 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:06:58.042140 21608 leader_election.cc:336] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.690s (SENT)
I20260709 13:06:58.043437 21491 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:58.050529 21486 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:58.056815 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 125771us
I20260709 13:06:58.058673 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.060113 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:58.042683 23111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.025s	sys 0.039s
I20260709 13:06:58.062040 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:58.056212 23354 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.164s	user 0.013s	sys 0.001s
I20260709 13:06:58.064098 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.073046 21562 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:58.041188 23201 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:58.065375 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.014575 22921 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:06:58.067191 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:58.016548 23145 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:06:58.086222 21564 raft_consensus.cc:2368] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 2. Current term is 3.
I20260709 13:06:58.029649 21492 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:58.049525 23390 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:58.030174 23166 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:06:58.023880 23414 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.860862 23415 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:58.151719 21608 leader_election.cc:336] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.756s (SENT)
W20260709 13:06:58.433166 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 497280us
I20260709 13:06:58.433869 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:06:58.065949 23111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.025s	sys 0.040s
I20260709 13:06:58.043196 21485 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
W20260709 13:06:58.412583 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.435073 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 283392us
W20260709 13:06:58.443323 21608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.801s (SENT) [suppressed 15 similar messages]
I20260709 13:06:57.928512 23041 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:06:58.448630 23430 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:06:58.448693 23041 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.532090 22241 rpcz_store.cc:276] 0709 13:06:56.427258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.431213 (+  3955us) service_pool.cc:224] Handling call
0709 13:06:56.563174 (+131961us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:06:56.599407 (+ 36233us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebde9c 00007f98a6ebda5b 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:06:56.599647 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.599926 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:56.706988 (+107062us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.355806 (+648818us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b180035c6e0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98adeb658f 00007f98a6ef5571 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd
0709 13:06:57.471085 (+115279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.486343 (+ 15258us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:57.498318 (+ 11975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.498451 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.498661 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139985,"prepare.queue_time_us":41768,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":219683,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5275,"spinlock_wait_cycles":111881472,"thread_start_us":595530,"threads_started":3,"wal-append.queue_time_us":500167}
I20260709 13:06:58.131588 23165 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:06:58.451267 23347 consensus_meta.cc:287] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 1.437s	user 0.011s	sys 0.002s
W20260709 13:06:58.451449 23426 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:58.451736 23347 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.452518 22245 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.095654 23201 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.206462 23153 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:58.454986 23153 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.448158 23111 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:58.451743 23165 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:58.450424 23429 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:06:58.062908 23117 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:58.402884 23427 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.400s	user 0.001s	sys 0.000s
W20260709 13:06:58.102227 23417 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
W20260709 13:06:58.462702 21608 leader_election.cc:336] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.764s (SENT)
I20260709 13:06:58.468103 21608 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:58.205322 23422 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:58.095312 23069 consensus_meta.cc:287] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.939s	user 0.012s	sys 0.000s
I20260709 13:06:57.943885 23352 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.521s
W20260709 13:06:58.413071 23423 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.398s	user 0.000s	sys 0.001s
I20260709 13:06:58.435252 23275 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.465591 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:58.474660 21608 leader_election.cc:336] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.775s (SENT)
I20260709 13:06:58.475841 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:58.474299 21564 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:58.459903 23111 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.477864 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.093256 23354 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.480602 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:58.481715 21564 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.469617 23405 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.474296 23163 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.445779 23390 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:57.970466 23183 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.492499 21642 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.504791 21564 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:58.473376 23069 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.489960 23122 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.474650 23422 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:58.528587 21459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.013s	sys 0.021s
I20260709 13:06:58.529397 21638 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.513557 23418 consensus_queue.cc:1243] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:58.530457 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.499526 23117 raft_consensus.cc:3055] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:58.534648 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:57.956185 23412 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:58.535686 21459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.014s	sys 0.021s
I20260709 13:06:58.494553 23275 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:06:58.541664 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 519605us
I20260709 13:06:58.542755 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.543614 21564 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:06:58.551476 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:58.545681 23412 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.552567 23418 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:58.553102 23444 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:58.553273 23418 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.553654 23444 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.554220 21638 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.555054 23435 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:06:58.547053 23305 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.319s	user 0.015s	sys 0.002s
I20260709 13:06:58.539469 23433 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.568305 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.599128 21564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:06:58.539193 23117 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:58.546197 23432 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:06:58.567746 23350 consensus_meta.cc:287] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 1.025s	user 0.012s	sys 0.002s
W20260709 13:06:58.567515 23240 consensus_meta.cc:287] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.906s	user 0.009s	sys 0.005s
I20260709 13:06:58.568485 23434 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.601444 23412 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:58.597034 21638 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:06:58.602757 23437 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:58.608001 23165 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.632532 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:06:58.630980 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 156322us
I20260709 13:06:58.598172 23305 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.568162 23435 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.659715 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:58.613636 23442 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.610047 23201 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.603883 23433 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.669029 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:58.623646 23122 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:58.623907 23166 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.618449 23350 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:58.677956 23352 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:58.673153 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:58.674831 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:58.654425 23414 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.609633 23432 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.661636 23412 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.614418 23240 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.688128 23422 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.688354 23435 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:58.688589 23447 raft_consensus.cc:2764] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:06:58.689328 23439 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:06:58.689992 23436 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:06:58.702049 23094 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.003s
I20260709 13:06:58.683248 23166 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:58.703408 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 1056) took 2241 ms. Trace:
I20260709 13:06:58.655715 23117 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.703814 21643 rpcz_store.cc:276] 0709 13:06:56.462188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.465178 (+  2990us) service_pool.cc:224] Handling call
0709 13:06:58.703188 (+2238010us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400295754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:58.703322 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3561187072}
I20260709 13:06:58.704393 23069 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.704909 23166 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.696816 23444 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:58.706210 21643 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.706868 23094 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.677688 23354 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.618748 23434 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:58.713059 23067 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.003s
I20260709 13:06:58.719092 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1718) took 1193 ms. Trace:
I20260709 13:06:58.719344 23067 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.720000 23434 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:58.696825 23418 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.697319 23422 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.709057 23240 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.678488 23442 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.722493 23352 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:58.711732 23347 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.712417 23224 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.186s	user 0.014s	sys 0.000s
I20260709 13:06:58.712328 23371 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:58.698549 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:58.675983 23111 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.719560 21641 rpcz_store.cc:276] 0709 13:06:57.525959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.526110 (+   151us) service_pool.cc:224] Handling call
0709 13:06:57.526461 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.856366 (+329905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.718776 (+862410us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400294d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:58.719026 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756843392}
I20260709 13:06:58.681244 23183 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:06:58.723317 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45395.9us
I20260709 13:06:58.741006 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:58.741745 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:58.755954 21643 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.742137 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:58.676283 23145 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:06:58.686637 23390 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.681428 23122 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.737951 23422 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.756837 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.761068 21562 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:58.738821 23354 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.749645 23310 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.740828 23332 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:58.752099 23224 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5.
I20260709 13:06:58.684600 23350 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.767340 21563 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:58.714177 23412 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.740990 23434 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.751748 23347 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.741057 23240 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:58.796306 23240 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:58.797488 23451 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:06:58.798637 23240 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.801503 23432 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:06:58.802146 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45582.3us
I20260709 13:06:58.783694 23332 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.710636 23041 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:58.785460 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 89216.6us
I20260709 13:06:58.875631 23397 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.876493 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:58.876747 23041 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:58.877741 23350 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:58.878190 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:58.791556 23462 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:58.762418 23183 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:06:58.818753 23452 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:06:58.865880 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.878332 23350 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.767063 23422 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.778674 21643 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
W20260709 13:06:58.878559 23428 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.720s	user 0.000s	sys 0.001s
I20260709 13:06:58.812460 23347 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.758308 23371 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.896600 23454 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.815194 23122 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:58.885687 23418 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:58.886366 23390 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:58.886937 23111 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.887408 23153 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:58.793983 23457 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 13:06:58.902421 23111 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.902390 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:58.905856 23412 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.905948 23111 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:58.898418 23442 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.907100 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:58.907756 23442 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:58.908350 23067 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:58.908288 23442 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.907774 21485 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.887558 21563 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.869128 23434 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:06:58.910820 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:58.910933 23434 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.876546 23332 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.888859 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:58.894352 23433 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.777129 23310 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.892287 23432 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:58.912029 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.924979 21563 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:58.888419 21562 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.913357 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:58.915126 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.891033 23166 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.925604 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:58.926741 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:58.931473 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:58.926736 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.932845 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:58.927788 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.928692 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.899286 22246 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.937301 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.938355 21562 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:58.939792 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.937837 21563 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:58.941591 21562 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:58.942205 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.945828 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:06:58.924683 23094 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.948563 21561 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:58.949029 21561 pending_rounds.cc:85] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 2
I20260709 13:06:58.949265 21561 pending_rounds.cc:107] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:58.949507 21561 raft_consensus.cc:2889] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:58.950688 21562 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:58.950959 23421 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.236s	user 0.000s	sys 0.007s
I20260709 13:06:58.951821 23371 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.953119 21562 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:58.955349 21561 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:58.926123 23153 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.922108 23442 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.933790 23433 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.935806 23418 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.965760 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:58.960402 23462 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:06:58.967279 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 89522us
I20260709 13:06:58.954619 21562 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:58.969610 21562 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.956172 23196 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.975152 23411 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.982400 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:58.984220 21488 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:06:58.985558 21459 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:58.991123 23411 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.993474 23264 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.935424 23166 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:58.968766 23145 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.987758 23122 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:58.988657 23351 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.017858 23122 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.018312 23122 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:59.019316 23122 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:58.989360 23422 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.941716 23390 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:58.984843 23444 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.991896 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:58.994186 21459 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:59.021917 21490 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:59.022145 23069 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.021764 23444 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:59.022528 21490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1458) took 1153 ms (client timeout 1500 ms). Trace:
W20260709 13:06:59.023108 21490 rpcz_store.cc:269] 0709 13:06:57.869172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.870859 (+  1687us) service_pool.cc:224] Handling call
0709 13:06:58.991744 (+1120885us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b5800011198. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:59.022468 (+ 30724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20265728}
I20260709 13:06:59.024366 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:06:59.024956 21490 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.025408 23166 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.026234 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1463) took 1155 ms. Trace:
I20260709 13:06:59.023331 21459 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:06:58.974658 21485 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:06:59.000001 23310 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:58.969696 23433 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.020836 23122 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.029801 23433 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:58.998695 23153 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:59.030550 23153 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:59.031287 23447 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.031517 23153 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.007148 23145 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:59.033483 23145 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.008960 23434 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:58.993844 23264 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:58.997680 23224 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
W20260709 13:06:59.015935 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.022541 23069 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:59.038364 23069 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.039664 21560 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:59.040416 21564 raft_consensus.cc:606] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:59.040886 21564 raft_consensus.cc:614] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:59.041347 23459 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.033252 23462 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.026716 21491 rpcz_store.cc:276] 0709 13:06:57.870689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.870816 (+   127us) service_pool.cc:224] Handling call
0709 13:06:59.005602 (+1134786us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003f9154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:59.026164 (+ 20562us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265197312}
I20260709 13:06:58.995158 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:59.031824 23447 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.033025 23166 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.033803 22241 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:58.996881 23411 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.036621 23264 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.037400 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:59.051244 22240 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:59.044396 23166 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.052513 23166 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:59.053115 23460 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:06:59.054056 23224 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.024398 23444 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.041836 23459 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.044600 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:58.986580 22246 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
W20260709 13:06:59.046341 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51248.1us
I20260709 13:06:59.060631 23411 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:59.060912 21490 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:06:59.063205 21491 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.063371 21490 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:59.057745 21562 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:59.064078 21562 pending_rounds.cc:85] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 2
I20260709 13:06:59.064370 21562 pending_rounds.cc:107] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:59.064630 21562 raft_consensus.cc:2889] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.065523 21490 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:59.059499 23390 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.069053 23437 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:59.070941 22240 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:59.071697 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.072433 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1467) took 1169 ms. Trace:
I20260709 13:06:59.065600 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:59.075800 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:06:59.072858 21494 rpcz_store.cc:276] 0709 13:06:57.903465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.930960 (+ 27495us) service_pool.cc:224] Handling call
0709 13:06:59.071562 (+1140602us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b5800011198. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:59.072377 (+   815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17841920}
I20260709 13:06:59.081784 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.083266 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:59.084275 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1719) took 1555 ms. Trace:
I20260709 13:06:59.084779 21642 rpcz_store.cc:276] 0709 13:06:57.529208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.529363 (+   155us) service_pool.cc:224] Handling call
0709 13:06:57.530418 (+  1055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.493246 (+962828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.084058 (+590812us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b540024ead4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:59.084220 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211875712}
I20260709 13:06:59.043449 23434 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:06:59.090340 21491 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:59.092049 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.070950 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.302727 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:59.302816 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:59.124143 21493 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.305480 21493 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:06:59.299940 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.306356 23412 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.306969 23412 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.306454 21493 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.307317 23412 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.307571 21493 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.085245 23437 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.309211 23437 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.309553 23437 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.154098 23224 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.159s
I20260709 13:06:59.123828 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.295643 23390 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.314865 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1528) took 1246 ms. Trace:
I20260709 13:06:59.092314 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.315687 21569 rpcz_store.cc:276] 0709 13:06:58.068135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.118605 (+1050470us) service_pool.cc:224] Handling call
0709 13:06:59.314807 (+196202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.316279 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.316821 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:59.317139 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.317756 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.318491 23463 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:06:59.318605 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.319145 23463 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:59.150378 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45969.3us
I20260709 13:06:59.321384 23463 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.324443 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:06:59.315202 21489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1455) took 1452 ms (client timeout 1801 ms). Trace:
W20260709 13:06:59.154445 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.327656 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.328502 22247 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:59.322145 23412 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.243703 23145 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.088768 23351 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.249s
I20260709 13:06:59.120198 23264 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.333218 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:59.332192 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:59.341022 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 128) took 2608 ms. Trace:
I20260709 13:06:59.341516 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.351368 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1527) took 1285 ms. Trace:
I20260709 13:06:59.350824 21637 rpcz_store.cc:276] 0709 13:06:56.732601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.732740 (+   139us) service_pool.cc:224] Handling call
0709 13:06:57.376261 (+643521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.376767 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.376811 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.377459 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.929960 (+552501us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:57.930091 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.930272 (+   181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.449837 (+519565us) raft_consensus.cc:1685] finished
0709 13:06:58.449857 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.340739 (+890882us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b540009b350. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:59.340930 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":136,"spinlock_wait_cycles":1478918528,"thread_start_us":551769,"threads_started":1,"wal-append.queue_time_us":710130}
I20260709 13:06:59.353066 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:59.353865 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:59.351882 21568 rpcz_store.cc:276] 0709 13:06:58.065855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.341244 (+1275389us) service_pool.cc:224] Handling call
0709 13:06:59.351291 (+ 10047us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.336963 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 155) took 2448 ms. Trace:
I20260709 13:06:59.091429 23448 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:59.354625 23390 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.176201 23166 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:06:59.362687 23339 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:59.363054 23166 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.158203 23447 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.333810 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:59.337420 21569 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:06:59.176091 23069 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:06:59.364441 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.364847 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.365482 21569 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
W20260709 13:06:59.365917 23174 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:06:59.366022 23069 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.335050 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.112136 23408 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.256s
I20260709 13:06:59.087286 23123 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.090358 23434 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:06:59.117017 23419 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.133s	user 0.002s	sys 0.005s
I20260709 13:06:59.371718 23415 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.355099 21566 rpcz_store.cc:276] 0709 13:06:56.888374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.888542 (+   168us) service_pool.cc:224] Handling call
0709 13:06:56.888883 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.162738 (+273855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.162800 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.215464 (+ 52664us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.524125 (+308661us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:57.539143 (+ 15018us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.539356 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.707098 (+1167742us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b18002c48e0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419
0709 13:06:58.911443 (+204345us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:06:59.336637 (+425194us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54000a1c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:59.336683 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.336727 (+    44us) raft_consensus.cc:1685] finished
0709 13:06:59.336739 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.336881 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9920,"prepare.queue_time_us":14785,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":3128,"raft.queue_time_us":63875,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":16770,"spinlock_wait_cycles":657497088,"thread_start_us":290477,"threads_started":1,"wal-append.queue_time_us":390351}
I20260709 13:06:59.366312 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.363078 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1713) took 1854 ms. Trace:
I20260709 13:06:59.335253 23437 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.355387 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.373386 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.374066 21639 rpcz_store.cc:276] 0709 13:06:57.509144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.509294 (+   150us) service_pool.cc:224] Handling call
0709 13:06:57.527248 (+ 17954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.570699 (+ 43451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.362846 (+1792147us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b54002e2a54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:59.363023 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97976576}
I20260709 13:06:59.368506 23264 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:59.366983 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:06:59.376575 23463 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.370052 23123 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:59.358218 23153 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:59.357893 23145 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:59.357362 23444 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:06:59.397107 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:59.397421 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:59.397794 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:59.356977 23448 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.392444 23123 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.391193 23463 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:59.392143 23412 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:59.396080 23434 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:59.409474 23448 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:59.410229 23463 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.411791 23437 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:59.412667 23440 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.413275 23440 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:59.414228 23440 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.415592 23440 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.421173 23405 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.421746 23405 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:59.422883 23405 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.424217 23405 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.425460 23459 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.116662 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.460353 21485 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:06:59.346295 21486 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:59.330462 21489 rpcz_store.cc:269] 0709 13:06:57.868155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.873431 (+  5276us) service_pool.cc:224] Handling call
0709 13:06:59.070764 (+1197333us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b5800011198. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:59.315134 (+244370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21225728}
I20260709 13:06:59.464303 21485 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:06:59.465705 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 109720us
I20260709 13:06:59.342862 21493 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:59.467988 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1464) took 1595 ms. Trace:
I20260709 13:06:59.468545 21567 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:59.469229 21567 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:59.468493 21493 rpcz_store.cc:276] 0709 13:06:57.872775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.872923 (+   148us) service_pool.cc:224] Handling call
0709 13:06:57.922014 (+ 49091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.124020 (+1202006us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b54004720a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f59dc0 00007f98a9fe41c0 00007f98a9fe5231 00007f98a9fe1d8f 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c
0709 13:06:59.467228 (+343208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.467745 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13195136}
I20260709 13:06:59.358085 21561 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.471683 21494 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 5: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:06:59.465736 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.471426 21567 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.473599 21567 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.473693 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.476747 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.477653 21486 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:59.478060 21562 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:59.479584 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:59.480199 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 1750) took 1418 ms. Trace:
I20260709 13:06:59.480975 21568 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:59.480722 21560 rpcz_store.cc:276] 0709 13:06:58.061801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.062561 (+   760us) service_pool.cc:224] Handling call
0709 13:06:58.062912 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.040214 (+977302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.479561 (+439347us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b5400128c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:59.479942 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245229440}
I20260709 13:06:59.374629 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.487640 22247 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.482748 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.506462 22795 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.484802 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1725) took 1866 ms. Trace:
I20260709 13:06:59.511502 21493 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.512714 23067 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:59.514375 21566 raft_consensus.cc:2410] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:59.515163 22795 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.515755 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:59.516638 21568 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:06:59.518227 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:59.519064 22930 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:06:59.519551 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.520185 22245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 264) took 2615 ms. Trace:
I20260709 13:06:59.520872 23069 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:59.523532 23145 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:59.524561 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1728) took 1580 ms. Trace:
W20260709 13:06:59.522461 22246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 458) took 2020 ms (client timeout 2102 ms). Trace:
W20260709 13:06:59.525759 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.528759 23418 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:59.528671 23174 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:59.530007 23351 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:59.530473 23117 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.531198 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.532680 22242 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.528234 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:59.493831 21489 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.535938 23041 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.537030 23153 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:59.502764 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.541126 23352 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:59.554572 21565 raft_consensus.cc:2410] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:59.541800 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:59.568393 21567 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:59.551712 22246 rpcz_store.cc:269] 0709 13:06:57.501506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.504085 (+  2579us) service_pool.cc:224] Handling call
0709 13:06:58.698331 (+1194246us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:59.521886 (+823555us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400595bd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:59.522176 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340962432}
I20260709 13:06:59.550137 21635 rpcz_store.cc:276] 0709 13:06:57.943722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.944230 (+   508us) service_pool.cc:224] Handling call
0709 13:06:57.944541 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.031831 (+ 87290us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:58.472821 (+440990us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.612413 (+139592us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.672575 (+ 60162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.673749 (+  1174us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:58.674557 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.888101 (+213544us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b18003a7da0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef5522 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:06:59.067055 (+178954us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b18003a7da0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef5522 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:06:59.523361 (+456306us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b18003a7da0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419
0709 13:06:59.523954 (+   593us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b5400295c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:59.524024 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.524337 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32073,"prepare.queue_time_us":632584,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":159487,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":100543,"spinlock_wait_cycles":242214656,"thread_start_us":608834,"threads_started":3,"wal-append.queue_time_us":203603}
I20260709 13:06:59.507690 21636 rpcz_store.cc:276] 0709 13:06:57.618145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.618418 (+   273us) service_pool.cc:224] Handling call
0709 13:06:57.669568 (+ 51150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.669903 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.669950 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.670341 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.927617 (+257276us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:57.929546 (+  1929us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.339751 (+1410205us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b18003a7ec0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:06:59.410696 (+ 70945us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b18003a7ec0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef5522 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:06:59.483879 (+ 73183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.484086 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.484197 (+   111us) raft_consensus.cc:1685] finished
0709 13:06:59.484215 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.484550 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5501,"prepare.queue_time_us":1499,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":3973,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":17073,"spinlock_wait_cycles":36174592,"thread_start_us":400640,"threads_started":2,"wal-append.queue_time_us":422434}
I20260709 13:06:59.569474 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.572152 23153 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.573612 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 1746) took 1631 ms. Trace:
I20260709 13:06:59.569962 22238 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:06:59.570052 21565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1526) took 1504 ms (client timeout 1801 ms). Trace:
W20260709 13:06:59.574806 21565 rpcz_store.cc:269] 0709 13:06:58.065597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.517615 (+1452018us) service_pool.cc:224] Handling call
0709 13:06:59.569968 (+ 52353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.576149 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:06:59.576315 23416 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:06:59.577484 21565 raft_consensus.cc:2410] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:59.548846 22245 rpcz_store.cc:276] 0709 13:06:56.904756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.905497 (+   741us) service_pool.cc:224] Handling call
0709 13:06:56.905771 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.452933 (+1547162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.519538 (+1066605us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54006dd3d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:06:59.519919 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3556775168}
I20260709 13:06:59.573581 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.577226 23390 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:59.397701 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:06:59.574214 21567 rpcz_store.cc:276] 0709 13:06:57.942495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.942867 (+   372us) service_pool.cc:224] Handling call
0709 13:06:57.971586 (+ 28719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.468221 (+1496635us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54000a76a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f59dc0 00007f98a9fe41c0 00007f98a9fe5231 00007f98a9fe1d8f 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c
0709 13:06:59.573249 (+105028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.573554 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300224384}
W20260709 13:06:59.578714 21488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1456) took 1710 ms (client timeout 1740 ms). Trace:
W20260709 13:06:59.575050 21487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1466) took 1690 ms (client timeout 2182 ms). Trace:
W20260709 13:06:59.581387 21488 rpcz_store.cc:269] 0709 13:06:57.868582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.868708 (+   126us) service_pool.cc:224] Handling call
0709 13:06:59.578131 (+1709423us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540008aa54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:59.578455 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992578816}
I20260709 13:06:59.586823 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.587150 22241 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:59.588635 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.589486 21562 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:59.590214 22795 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.590857 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:06:59.582897 21487 rpcz_store.cc:269] 0709 13:06:57.873335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.931757 (+ 58422us) service_pool.cc:224] Handling call
0709 13:06:59.466495 (+1534738us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b5800011198. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:06:59.563721 (+ 97226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15401856}
I20260709 13:06:59.566751 23041 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:06:59.566179 23352 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:59.612372 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.623385 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.614423 23444 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:59.624188 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.634714 21565 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:06:59.643818 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.648200 23352 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.626705 23444 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:06:59.652788 23444 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.655833 23041 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.657545 23041 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.658429 21569 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:59.635363 21568 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:59.609390 23418 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.650478 23352 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.616374 23390 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.665937 23154 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.659844 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:59.667431 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.667339 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.668620 23305 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.670575 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.711448 21634 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:59.712437 21487 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.712625 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:59.713542 21634 raft_consensus.cc:2368] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5.
I20260709 13:06:59.714202 21489 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.715358 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.716141 21492 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
W20260709 13:06:59.717211 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 158736us
I20260709 13:06:59.670454 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.672008 21639 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:59.672222 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.673477 21637 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:59.677765 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:06:59.678556 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.683868 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.663269 21566 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:06:59.691422 23154 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.691788 23418 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:06:59.692898 23332 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.694695 21635 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:06:59.710634 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.699115 23444 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.734416 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.736189 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.738096 21639 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.700842 21636 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:59.701623 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35370 (request call id 8) took 1146 ms. Trace:
I20260709 13:06:59.705257 23302 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.714372 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.733646 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:59.688066 22244 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:59.747882 21641 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.750901 23230 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.751637 21488 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.743535 23302 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:06:59.753509 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.754242 23302 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.755666 23302 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.756050 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.756419 21561 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:59.757526 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.757586 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.759070 23332 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:59.759013 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.759558 21494 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 5: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:59.760143 21489 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:06:59.760947 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.762383 23463 consensus_queue.cc:1059] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:59.763314 23463 raft_consensus.cc:3055] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.763743 23463 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:06:59.764917 23463 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.765794 21635 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.756819 21561 pending_rounds.cc:85] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 4
I20260709 13:06:59.767642 21561 pending_rounds.cc:107] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:59.768074 21561 raft_consensus.cc:2889] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:59.769562 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.770483 21637 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:59.770861 21640 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:06:59.771123 21638 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:59.756563 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.773066 21492 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:06:59.774194 23390 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:06:59.742424 21564 rpcz_store.cc:276] 0709 13:06:58.555176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.598998 (+ 43822us) service_pool.cc:224] Handling call
0709 13:06:59.701015 (+1102017us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400128c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fdc853 00007f98aefaa60a 00007f98a85307d4 00007f98a8530762 00007f98a8530691 00007f98a853060c 00007f98a852f8c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:06:59.701285 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012293888}
I20260709 13:06:59.785607 21391 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 3, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 3 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.799553 21561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:06:59.800565 23463 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.803463 23332 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.804126 23331 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:59.806453 21390 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 232) took 7526 ms. Trace:
I20260709 13:06:59.823446 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.823940 23154 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:59.807514 21390 rpcz_store.cc:276] 0709 13:06:52.280023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.283650 (+  3627us) service_pool.cc:224] Handling call
0709 13:06:59.806177 (+7522527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:55.560345 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:55.560887 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:55.560926 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:06:55.560942 (+    16us) tablet.cc:662] Decoding operations
0709 13:06:55.561454 (+   512us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:55.561506 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:55.561539 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:55.561839 (+   300us) tablet.cc:701] Row locks acquired
0709 13:06:55.561857 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:55.562039 (+   182us) write_op.cc:270] Start()
0709 13:06:55.562146 (+   107us) write_op.cc:276] Timestamp: P: 1783602415561987 usec, L: 0
0709 13:06:55.562169 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:55.573119 (+ 10950us) log.cc:844] Serialized 1376 byte log entry
0709 13:06:56.408082 (+834963us) op_driver.cc:464] REPLICATION: finished
0709 13:06:56.530700 (+122618us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a6ed80ac 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98ada18ef0
0709 13:06:56.856640 (+325940us) write_op.cc:301] APPLY: starting
0709 13:06:56.856744 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:56.856924 (+   180us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:56.856965 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:56.857540 (+   575us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:56.857757 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:06:56.857805 (+    48us) write_op.cc:312] APPLY: finished
0709 13:06:56.858037 (+   232us) log.cc:844] Serialized 35 byte log entry
0709 13:06:56.858229 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:56.858340 (+   111us) write_op.cc:454] Released schema lock
0709 13:06:56.858393 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:56.858728 (+   335us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:56.858756 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":713726,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":448203,"apply.run_cpu_time_us":2138,"apply.run_wall_time_us":2139,"num_ops":3,"prepare.queue_time_us":456066,"prepare.run_cpu_time_us":33583,"prepare.run_wall_time_us":369113,"raft.queue_time_us":262130,"raft.run_cpu_time_us":20764,"raft.run_wall_time_us":296501,"replication_time_us":845769,"spinlock_wait_cycles":58256768,"thread_start_us":1146541,"threads_started":4,"wal-append.queue_time_us":361093,"wal-append.run_cpu_time_us":55825,"wal-append.run_wall_time_us":1918442}]]}
W20260709 13:06:59.833802 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.836663 23331 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:06:59.836951 21568 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:59.837481 23331 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:06:59.842240 23331 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:06:59.843456 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:59.844476 21567 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.844745 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.845571 21636 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:59.847908 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.849148 21634 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:59.849089 21642 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:59.851006 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.851933 21643 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:59.852241 21634 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.853232 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.854168 21643 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:06:59.851935 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.855964 21636 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:06:59.857029 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.857880 21636 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
W20260709 13:06:59.858536 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.860939 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.843531 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.862900 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.864252 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.865471 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:06:59.867892 21635 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:06:59.855329 21634 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:59.869688 21567 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:06:59.866681 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.872113 21640 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:59.897959 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:06:59.913713 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.911880 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 92294.2us
W20260709 13:06:59.881157 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.912560 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:06:59.916742 21641 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:06:59.917363 21636 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.921614 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:06:59.924791 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:06:59.927995 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.932153 21635 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 5: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:06:59.936583 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.943481 23331 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:59.944372 21643 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:59.946401 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:06:59.951586 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:06:59.953280 21642 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:59.950416 23302 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:59.910461 23123 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:06:59.911033 23483 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 13:06:59.966096 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:06:59.963231 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:06:59.979104 21639 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.964267 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:06:59.978749 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 326527us
I20260709 13:06:59.965142 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:06:59.997941 21563 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.999111 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:00.001977 21636 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:00.002264 21565 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.006950 23337 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:00.007762 23337 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:00.008219 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 55483.3us
I20260709 13:07:00.008728 23483 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.009117 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:00.009450 23483 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:00.010152 23337 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:00.011045 23069 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.011551 23069 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.011981 23069 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:00.015146 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 79139us
I20260709 13:07:00.015810 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:00.016172 23484 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.016536 21563 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:00.016646 23094 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:00.017272 23094 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.017524 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:00.016537 23484 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:00.019845 22921 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.020061 23484 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.021100 23458 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:00.021740 23484 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.022017 23458 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.025743 23458 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:00.000874 21567 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:07:00.012005 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.036383 21568 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:00.040222 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:00.041431 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:00.042239 21639 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:07:00.043972 23302 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.049979 21561 raft_consensus.cc:606] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.050606 21561 raft_consensus.cc:614] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:59.993533 23154 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:00.026755 23458 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.086977 23347 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:00.020198 23094 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:00.061245 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.060698 23153 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.088891 23153 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.090745 21563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a85b464a0e924904be2840142de89c0d"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:00.091234 23153 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:00.091670 21563 raft_consensus.cc:606] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.092180 21563 raft_consensus.cc:614] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:00.090358 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.092507 23153 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:00.092967 23416 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:00.093645 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.090420 23444 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.026886 23483 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.071142 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:00.095239 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:00.095309 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:00.055567 23154 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.097688 23041 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.098212 23041 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:00.098658 23041 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:00.099418 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.075482 23491 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:00.101701 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1035) took 1215 ms. Trace:
I20260709 13:07:00.102054 21490 rpcz_store.cc:276] 0709 13:06:58.886380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.080665 (+194285us) service_pool.cc:224] Handling call
0709 13:06:59.081028 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.087733 (+  6705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.087754 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.088083 (+   329us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.676718 (+588635us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b1800063040. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:06:59.732625 (+ 55907us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:59.732695 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.745623 (+ 12928us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.101320 (+355697us) raft_consensus.cc:1685] finished
0709 13:07:00.101340 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.101542 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11477,"raft.queue_time_us":134,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":5253,"spinlock_wait_cycles":42529664,"thread_start_us":11246,"threads_started":1,"wal-append.queue_time_us":828989}
I20260709 13:07:00.103271 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.076632 23123 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:00.083829 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:00.104969 23305 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:00.105293 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49264us
I20260709 13:07:00.063082 23163 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.097110 23486 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:00.106443 23163 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.108970 23163 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:00.109592 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:00.109862 23405 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.087361 23458 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.112099 23458 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.114661 23486 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:00.111466 23154 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:00.111428 23305 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.115660 23305 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.116066 23305 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.115958 23486 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.112996 23405 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.113813 23127 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.123440 23174 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.123934 23174 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:00.124981 23174 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.126151 23174 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.126945 23069 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.129721 23069 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:00.115972 22244 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:00.140113 21641 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:00.141958 23433 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.142504 23433 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.145407 23433 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:00.142529 21459 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:00.148000 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 54496.5us
W20260709 13:07:00.154955 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.153820 21606 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.500s (SENT)
I20260709 13:07:00.159341 21459 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:00.159385 21606 leader_election.cc:336] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.517s (SENT)
I20260709 13:07:00.161664 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:00.168927 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.171937 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:00.165305 23405 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.172931 23484 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:00.187893 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.192179 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:00.180436 23433 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.195813 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:00.185001 23405 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.197811 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:00.164178 23201 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:00.187546 23145 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:00.199546 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 278040us
I20260709 13:07:00.200969 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:00.207916 23302 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:07:00.217620 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:00.201898 23127 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:07:00.210716 23405 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.206275 22930 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.223116 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:00.204278 23484 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:00.225694 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 43813.3us
I20260709 13:07:00.202862 23458 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.229020 21561 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:07:00.227705 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:00.233141 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:00.224068 23145 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:00.240659 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:00.243261 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.243527 22210 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.244750 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:00.229238 23041 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.246498 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:00.247435 21561 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:00.244762 23463 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.262425 23484 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:00.263832 23041 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:00.265483 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.266743 23458 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:00.266865 23230 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:00.267179 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.269202 23347 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.298213 21564 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:07:00.298856 21564 pending_rounds.cc:85] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 4
I20260709 13:07:00.246248 22921 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:00.287444 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.299230 21564 pending_rounds.cc:107] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:07:00.303588 21564 raft_consensus.cc:2889] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:00.302278 22795 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.305872 23174 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.306667 23174 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.308622 21638 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:00.309651 23174 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:00.270833 23302 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.310655 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:00.311374 22244 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 2.
W20260709 13:07:00.313045 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 47693.3us
I20260709 13:07:00.315263 23145 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.316416 22795 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.315274 23041 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:07:00.319835 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.327688 22921 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:07:00.329769 23498 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:07:00.332051 23497 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:07:00.295346 23305 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:00.350893 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.298695 23463 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.358837 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:00.349581 23230 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:00.365778 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 158248us
W20260709 13:07:00.371527 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.389068 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.408344 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:00.408690 21637 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:07:00.360781 23433 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:00.411217 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 144138us
I20260709 13:07:00.420537 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:00.429641 21487 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:00.429364 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 185885us
I20260709 13:07:00.411217 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:00.437330 21606 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.740s (SENT)
W20260709 13:07:00.437389 21608 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.500s (SENT)
I20260709 13:07:00.439221 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:00.447739 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.448366 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:00.457022 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:00.457329 21488 raft_consensus.cc:2410] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:00.462896 23501 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:07:00.467212 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.468585 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.468624 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:00.472741 23153 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:00.473757 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:00.474965 23201 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.475416 23201 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:00.475868 23201 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.479969 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:00.480525 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 46505.2us
I20260709 13:07:00.481189 21489 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:00.481925 23305 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:00.482963 23502 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.483726 23463 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:00.485100 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:00.505545 21563 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.485365 23230 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:00.485638 23476 log.cc:927] Time spent T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:07:00.485800 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48431.9us
W20260709 13:07:00.490906 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 131441us
I20260709 13:07:00.491266 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:00.473299 23504 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:00.523910 21565 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
W20260709 13:07:00.527319 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.527803 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 80848.2us
I20260709 13:07:00.474684 23153 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.530139 23067 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.539209 21606 leader_election.cc:336] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 2.002s (SENT)
I20260709 13:07:00.524382 23416 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.466521 23405 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:00.542331 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 62486us
I20260709 13:07:00.552783 21488 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:07:00.554940 21488 pending_rounds.cc:85] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 4
I20260709 13:07:00.555218 21488 pending_rounds.cc:107] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:07:00.553514 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:00.555433 21488 raft_consensus.cc:2889] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:00.547605 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.559887 21457 leader_election.cc:400] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5.
I20260709 13:07:00.548246 23416 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:00.534722 23067 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.572552 21457 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.575819 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:00.576885 22212 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:07:00.577662 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47652.4us
I20260709 13:07:00.578630 23332 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.579074 23332 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.579447 23332 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.580006 23347 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.580412 23347 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.580729 23347 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.572449 23512 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.570669 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:00.569675 23416 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.598816 23444 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.599834 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:00.614120 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 43527.3us
W20260709 13:07:00.617084 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 83992us
I20260709 13:07:00.586860 23145 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:07:00.605358 23444 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:00.647469 21606 leader_election.cc:336] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.801s (SENT)
W20260709 13:07:00.648715 21606 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.812s (SENT)
I20260709 13:07:00.653115 23505 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.631743 23507 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.660025 23067 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:00.660351 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.661271 22921 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.661754 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.662704 22921 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.663229 22921 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:00.663674 22921 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.633147 23444 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:00.666739 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 96994.7us
I20260709 13:07:00.667627 21457 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.670396 23305 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.670946 23067 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.673442 21563 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
W20260709 13:07:00.675074 21606 leader_election.cc:336] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.686s (SENT)
I20260709 13:07:00.675552 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:00.681198 23521 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:07:00.681538 23502 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.686690 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.687981 23502 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.688642 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.689666 23502 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.671135 23305 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:00.694175 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:00.696355 21560 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.716054 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:00.669970 23332 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:00.717346 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.718605 23483 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.695559 23405 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:00.729600 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 54558.3us
W20260709 13:07:00.736290 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 92581.5us
I20260709 13:07:00.737673 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.738878 23533 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.739526 23463 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:00.740715 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:00.742939 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 79666us
I20260709 13:07:00.744007 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.745055 23534 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.745530 23534 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:00.745608 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.745950 23534 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.749536 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:00.751992 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:00.757934 21560 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
W20260709 13:07:00.761739 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45800.5us
I20260709 13:07:00.764087 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:00.777472 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56484.1us
I20260709 13:07:00.692711 23347 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.728663 23332 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:00.798970 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:00.802248 22244 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:07:00.721585 23201 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.726761 22921 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:00.803598 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58095.2us
I20260709 13:07:00.764856 23067 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.803781 21459 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:00.810359 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.806348 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:00.815851 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51864.6us
I20260709 13:07:00.803962 23463 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.831638 23539 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.832130 23539 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:00.832270 23405 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.832600 23539 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.849843 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.851356 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:00.852193 21562 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.835525 23524 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.835309 22921 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:00.849788 23067 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:00.859493 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:00.859877 23067 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.861188 23503 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.861634 23503 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.862085 23503 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.861524 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.828219 23416 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.866489 23444 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:00.866961 23347 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:00.869115 23507 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.871083 23332 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:00.879086 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 77752.9us
W20260709 13:07:00.872196 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.879837 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.872893 23201 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:00.873436 23539 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.871603 23502 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.881331 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:00.883738 21566 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.887648 21565 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.887909 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:00.887307 21562 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:00.875545 23524 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:00.898622 23201 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.899170 23201 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:00.899678 23201 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.893888 23230 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.911548 23230 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:00.912029 23230 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.912711 23416 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:00.913417 23416 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:00.914175 23201 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.915696 23525 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.916008 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:00.884073 22921 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:07:00.917296 23201 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:00.917420 22921 consensus_queue.cc:1243] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:00.918030 23444 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:00.918184 23201 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.918678 23201 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:00.919620 23201 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.921625 23201 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.882055 23533 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:00.924165 23507 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.924744 23507 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:00.925320 23507 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.925019 23524 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:00.931079 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44591.3us
I20260709 13:07:00.932603 23433 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.933171 23433 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:00.932986 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:00.939638 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58371.7us
I20260709 13:07:00.954330 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:00.960855 21636 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:07:00.961934 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61987.1us
I20260709 13:07:00.962252 21637 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 5: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:00.914554 23416 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:07:00.934415 23433 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:00.911312 23537 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.967579 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:00.968266 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:00.971100 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:00.955365 22921 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.975684 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:00.991360 22247 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 3 LEARNER]: Advancing to term 5
I20260709 13:07:00.991849 23433 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.992277 23405 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.970458 23539 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.003199 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:01.008625 23405 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.008322 23507 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.009192 23405 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.004555 23525 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.011445 22921 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:01.011549 23525 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:01.012010 22921 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.012450 22921 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.013195 22247 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 5 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:00.966815 23067 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:07:01.014232 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:01.014639 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 60839us
W20260709 13:07:01.015093 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46361.2us
I20260709 13:07:01.021749 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:01.023142 23069 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.023667 23069 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:01.024652 23069 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.026366 21494 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:01.026557 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.019963 23503 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.010689 23507 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.028465 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:01.012959 23525 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.033229 21491 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:01.033601 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:01.037202 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.038019 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.037385 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.004746 23463 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:01.026995 23534 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.042125 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.043388 21487 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:01.043478 21638 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 5: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:01.044370 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:01.038254 21485 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:01.079686 23550 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.078084 23534 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.075506 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.116962 21636 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:01.083490 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.127914 21493 raft_consensus.cc:2376] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5. Re-sending same reply.
I20260709 13:07:01.128538 21491 raft_consensus.cc:2410] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:01.128789 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.128844 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:01.082731 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.026974 23505 consensus_queue.cc:1059] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:07:01.041144 23405 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:01.119747 21490 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:01.130612 23549 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:01.138015 23519 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.531s	user 0.005s	sys 0.000s
W20260709 13:07:01.121299 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 77047.1us
I20260709 13:07:01.139348 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:01.139595 23540 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:01.140113 23540 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:01.140959 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:01.141172 23540 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.118072 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.119920 21489 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.130636 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:01.131186 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 54450.8us
I20260709 13:07:01.133599 23551 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:01.133893 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.142256 23537 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:01.132858 23331 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.123191 23548 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.153650 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:01.120560 23230 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.152420 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.157582 22247 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:01.159241 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:01.160141 23555 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:07:01.157104 23548 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:01.168623 21494 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:01.156188 23539 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:01.164021 23331 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:01.164317 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.170123 22212 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:01.171068 21490 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:01.171013 21492 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:01.164755 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.172588 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.152292 23537 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:01.173197 23537 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.174060 23230 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:01.175799 23501 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.178015 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:01.178583 23501 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:01.178997 23444 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.179687 23444 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:01.179945 23501 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.180632 23444 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:01.176746 21491 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:01.182040 23444 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.183146 21491 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:07:01.183749 23553 log.cc:927] Time spent T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:01.184492 23201 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:01.184891 23201 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:01.185730 23201 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.186098 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.136662 23503 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:01.191646 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.190109 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.174141 21493 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:01.197871 21485 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:07:01.200731 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.151264 23551 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:01.201889 23551 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.203547 23534 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:01.204217 23534 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.207114 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.212888 23534 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.149403 23416 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:07:01.213418 23331 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.167068 23540 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.186848 23230 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.211880 23201 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.170094 23548 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.170393 23539 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:01.267786 21494 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:01.272616 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.276041 21487 raft_consensus.cc:2410] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:01.270503 23539 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.293965 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.292337 21489 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:01.300211 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.269356 23537 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.306493 23537 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.309178 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:01.309916 21562 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:01.303932 21487 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
W20260709 13:07:01.321470 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 143548us
I20260709 13:07:01.322290 23507 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:01.323531 23507 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:01.323920 23507 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:01.323803 23565 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:01.324638 23548 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.325047 23507 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.327348 23565 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.327443 23548 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.327967 23565 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:01.328841 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.332224 23507 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.333829 23483 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:01.333976 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.334448 23483 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.336477 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:01.336853 23145 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:01.288465 23230 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:01.340317 23548 raft_consensus.cc:2764] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:01.344923 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.336850 23550 raft_consensus.cc:1064] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:07:01.337109 23551 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:01.348318 23550 raft_consensus.cc:1068] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Unable to promote non-voter 549b31ac31b6428994b45938abc223a7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:01.121080 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:01.358732 23405 raft_consensus.cc:3055] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.328979 23565 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.367316 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.378422 21487 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:07:01.382601 21560 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.383102 21565 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.384562 21565 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:01.359233 23174 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:01.346776 22921 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.359495 23549 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.366575 23127 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.391041 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.393006 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.393822 21560 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.387266 23174 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:01.395076 23230 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:01.396808 22921 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:01.396651 23539 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.382989 23542 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:01.375406 23405 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:01.427742 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:01.408591 21566 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:01.428364 21639 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.409941 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.430923 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:01.431036 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:01.431535 21634 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.431694 21638 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:01.433209 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.434351 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.435035 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.435128 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.429813 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:01.407310 23548 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:07:01.413141 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:01.439193 22247 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.406117 23127 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.411042 23174 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.416703 23416 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:01.418061 21388 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 1 to 2, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 2 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.411861 23528 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.459542 23528 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.407370 23549 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.461833 23528 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:01.465046 23540 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.465790 23540 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.403885 23551 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:01.421039 23534 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.466899 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.467327 23534 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:01.423352 21391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 140) took 8516 ms. Trace:
I20260709 13:07:01.468052 23540 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:01.419854 23566 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.077s	user 0.000s	sys 0.003s
I20260709 13:07:01.461769 22247 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:01.423722 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.471278 21494 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:01.427354 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.438082 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:01.367236 23525 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.440409 22240 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:01.436118 23543 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:01.441642 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.475834 21492 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:01.442986 23069 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.443725 21491 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:01.445140 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.446435 21641 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:01.447039 21565 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.449005 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:01.477666 21638 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.449200 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.449810 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.450325 23127 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.450120 23405 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.442623 23539 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.438524 23041 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:01.445778 23542 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.451749 23230 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:01.452355 22921 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:01.455083 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.452625 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.452394 21639 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:01.466109 23174 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.468212 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.440063 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:01.477293 21641 pending_rounds.cc:85] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 2
I20260709 13:07:01.478483 21634 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:01.435858 23565 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.480616 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:01.484200 21488 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:01.468394 21391 rpcz_store.cc:276] 0709 13:06:52.907172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.908046 (+   874us) service_pool.cc:224] Handling call
0709 13:07:01.423263 (+8515217us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:00.232083 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:00.259882 (+ 27799us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:00.259945 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:07:00.259966 (+    21us) tablet.cc:662] Decoding operations
0709 13:07:00.260382 (+   416us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:00.260468 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:00.260494 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:00.260777 (+   283us) tablet.cc:701] Row locks acquired
0709 13:07:00.260825 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:07:00.261004 (+   179us) write_op.cc:270] Start()
0709 13:07:00.261160 (+   156us) write_op.cc:276] Timestamp: P: 1783602420260938 usec, L: 0
0709 13:07:00.261195 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:07:00.261891 (+   696us) log.cc:844] Serialized 539 byte log entry
0709 13:07:00.733792 (+471901us) op_driver.cc:464] REPLICATION: finished
0709 13:07:00.918635 (+184843us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b18003065e0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:07:00.918847 (+   212us) write_op.cc:301] APPLY: starting
0709 13:07:00.918941 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:00.919080 (+   139us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:00.919116 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:00.919408 (+   292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:00.919681 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:00.919745 (+    64us) write_op.cc:312] APPLY: finished
0709 13:07:00.920032 (+   287us) log.cc:844] Serialized 23 byte log entry
0709 13:07:00.920220 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:00.920304 (+    84us) write_op.cc:454] Released schema lock
0709 13:07:00.920371 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:00.920772 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:00.920800 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2921459,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":1438,"apply.run_cpu_time_us":1911,"apply.run_wall_time_us":1911,"num_ops":1,"prepare.queue_time_us":375851,"prepare.run_cpu_time_us":33943,"prepare.run_wall_time_us":187665,"raft.queue_time_us":149129,"raft.run_cpu_time_us":1246,"raft.run_wall_time_us":1601,"replication_time_us":472432,"spinlock_wait_cycles":52834048,"thread_start_us":562128,"threads_started":4,"wal-append.queue_time_us":174644}]]}
I20260709 13:07:01.486655 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:01.487846 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.516651 21635 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:01.493311 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:01.517328 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:01.522090 21639 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:01.521970 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:01.496616 21491 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:01.497491 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.516836 21641 pending_rounds.cc:107] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:01.523206 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:01.523412 21641 raft_consensus.cc:2889] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:01.507938 22244 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:01.510599 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.496451 23405 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.493999 21638 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:01.517645 21636 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.511798 23484 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:07:01.532135 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:01.514398 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:01.537971 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:01.538542 21634 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.539487 21560 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:01.532858 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.542294 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.544305 21490 raft_consensus.cc:2376] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4. Re-sending same reply.
I20260709 13:07:01.545275 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:01.545519 21636 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:01.543555 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:01.546633 21566 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:01.544848 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:01.550338 21564 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:01.475889 23525 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.555351 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:01.551769 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:01.534533 23444 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.569334 21634 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:01.537639 23551 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.541154 23539 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.570829 21569 raft_consensus.cc:2368] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:07:01.555779 23537 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:01.587033 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.468250 23534 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.490183 23543 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.544495 23542 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:01.555066 23416 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.547569 23127 consensus_queue.cc:1059] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:07:01.592867 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:01.593426 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:01.595374 21494 raft_consensus.cc:2410] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:01.512884 23041 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.602025 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.626636 21488 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:01.604609 21568 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:01.516541 22921 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.547843 23067 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:07:01.614526 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.621004 21491 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.516479 23230 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.592536 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:01.583503 23548 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.547646 23524 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:07:01.632923 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:01.595949 23537 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:01.580740 23484 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:07:01.612634 23551 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:01.578696 23302 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:07:01.640055 21634 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:01.637292 21567 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:01.622915 23528 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.645174 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:01.646463 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:01.674103 21640 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:01.652666 23550 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:01.653899 23571 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:01.654191 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:01.654778 23556 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:01.606031 23539 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.657775 23486 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:01.659943 23524 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:01.660082 23069 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:01.667477 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.677261 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:01.722384 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45200.9us
I20260709 13:07:01.723165 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:01.724278 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:01.655411 23543 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.643570 23537 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:01.704668 21606 leader_election.cc:336] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.512s (SENT)
W20260709 13:07:01.719067 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64942.6us
I20260709 13:07:01.672566 23548 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:01.739650 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:01.731197 21608 leader_election.cc:400] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:07:01.740800 21608 leader_election.cc:403] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:01.739748 21560 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:01.681058 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.682384 23416 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.744187 21567 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:01.752315 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:01.701401 23486 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:01.760527 21562 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:01.760886 21562 pending_rounds.cc:85] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 2
I20260709 13:07:01.761093 21562 pending_rounds.cc:107] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:01.761312 21562 raft_consensus.cc:2889] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:01.758514 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.726689 23069 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:01.726490 23524 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:01.727422 23555 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.740581 23201 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.730775 23444 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.672549 23483 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.744829 23331 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.691949 23528 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.760190 23153 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:01.779888 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 55680.7us
I20260709 13:07:01.752761 23416 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.784224 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:01.794853 21492 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:01.796602 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.794006 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:01.807062 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 79370.1us
I20260709 13:07:01.816510 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:01.769925 23463 consensus_queue.cc:1059] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:07:01.795176 23573 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:07:01.838490 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45346.8us
I20260709 13:07:01.784741 23416 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.843918 23543 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.844415 23543 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.844484 23505 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:01.844918 23543 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.845237 23505 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:01.846570 23570 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:07:01.848251 23545 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 13:07:01.849372 23545 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:01.849861 23545 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:01.853348 23539 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:01.793855 23486 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.854645 23543 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.855213 23486 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.857342 23543 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:01.860494 23576 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:01.860208 23524 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.862012 23524 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.864313 23483 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.865629 23503 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:01.866196 23503 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:01.874891 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.875293 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.880429 23525 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:01.883868 22921 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:01.884586 22921 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:01.885789 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.867875 23069 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.887109 23069 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.888124 23444 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:01.846464 23505 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.850777 23545 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.889463 23505 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:01.890592 23577 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:07:01.898046 21568 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:01.889204 23444 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:01.895593 21562 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:01.900720 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 116610us
I20260709 13:07:01.905185 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:01.911755 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:01.913830 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:01.919052 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:01.921316 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:01.923120 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:01.925107 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:01.885540 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:01.784628 23551 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.901291 23201 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:01.897111 23153 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.900542 23041 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:01.959156 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.918268 23174 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.924669 23539 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.839356 23548 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.939499 23584 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:01.975538 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.967373 23573 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:01.986047 22921 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:07:01.922866 23302 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:07:01.949394 23549 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:01.973703 23153 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.014629 23174 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:02.061993 23069 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.959388 23503 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.071542 23069 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:02.042286 23584 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:02.076229 21635 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:02.078131 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 155436us
I20260709 13:07:02.079667 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:02.081424 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 143996us
I20260709 13:07:02.081912 21568 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:02.023336 23463 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:07:02.081235 23174 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:02.061795 23579 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.222s
I20260709 13:07:02.101193 23507 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:02.102886 23153 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:02.089394 23528 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:02.106926 23581 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:07:02.107306 23416 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.107494 23174 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.107707 23591 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:07:02.109519 23416 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:02.109678 23587 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.110419 23587 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:02.115694 23507 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:02.115403 23584 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.116300 23507 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:02.117393 23587 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:02.113709 21561 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:02.125322 23549 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:02.098661 23545 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:02.136292 23543 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.076125 23201 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:02.157171 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 73579.2us
I20260709 13:07:02.141608 23545 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:02.184373 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.172807 23549 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.191576 23549 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.202232 23587 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.202605 23507 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:02.202832 23405 consensus_meta.cc:287] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.002s
I20260709 13:07:02.203410 23587 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:02.203648 23549 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:02.203909 23587 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:02.152858 23543 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.186170 23545 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.224237 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.225603 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.226392 21643 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:02.229439 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 138686us
I20260709 13:07:02.230298 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.231745 21491 raft_consensus.cc:2410] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:02.230397 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.227501 23463 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.265475 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:02.220512 23587 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:02.231225 23565 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.694s	user 0.014s	sys 0.000s
I20260709 13:07:02.264264 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:02.270874 23463 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:02.290726 21489 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 5: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:02.292045 23463 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:02.232803 23483 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.292637 23543 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:02.292932 22247 raft_consensus.cc:2393] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:02.293817 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:02.294318 23587 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.295419 23483 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.297539 23483 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:02.287159 21642 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:02.289587 21640 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:02.264909 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:02.301100 22240 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
W20260709 13:07:02.307967 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.317502 21491 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.317358 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.318307 21640 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:07:02.322760 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.323740 21489 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 5: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:02.337805 21643 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:02.341926 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:02.348933 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:02.360051 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:02.364028 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:02.355490 23587 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.350224 23599 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:02.367302 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:02.369645 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:02.349925 23613 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:02.356127 23592 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.375464 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:02.366425 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:02.376610 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:02.387971 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:02.374547 23614 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:02.392659 23614 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:02.392918 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.393046 23614 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:02.394981 23537 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.003s
I20260709 13:07:02.395426 23537 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:02.396468 21567 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.397504 23537 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:02.397825 23505 consensus_meta.cc:287] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.508s	user 0.004s	sys 0.004s
I20260709 13:07:02.359338 23444 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:02.374325 23599 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.398718 23599 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.401665 23614 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.404142 23614 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:02.407627 23614 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:02.408037 23614 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:02.408933 23599 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:02.408900 23614 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.410316 23614 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.412757 23599 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:02.412401 23609 consensus_queue.cc:1175] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a87bd86b86e74aa8bb61189215b73439" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 13:07:02.413072 23069 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:02.391541 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:02.425576 21565 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.379851 23587 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.417755 23565 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:02.423349 23484 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:02.424137 23609 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:02.424701 23230 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:02.424538 23537 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:02.444550 23484 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:02.444931 23609 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.449105 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:02.464056 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:02.464336 22242 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.453908 23565 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:02.478368 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48207.4us
I20260709 13:07:02.462498 23609 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.480432 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:02.480700 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:02.481861 23230 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.482774 22930 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:02.483273 22930 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:02.483946 22930 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.484932 22930 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.486320 23534 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.466282 23565 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.488427 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:02.491340 23533 raft_consensus.cc:3055] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:02.512917 23533 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:02.513593 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.513870 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:02.513864 23533 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:02.491451 23587 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:02.482560 23540 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.515066 23533 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.515480 23540 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.517889 23540 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:02.493611 23545 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:02.518221 22240 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:02.458630 23537 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:02.496488 23484 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:02.497311 23572 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.722s	user 0.000s	sys 0.003s
I20260709 13:07:02.520761 23587 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.503203 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:02.511973 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.519048 21563 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:02.500754 22242 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:07:02.526248 21488 raft_consensus.cc:2410] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:02.526006 21606 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:02.523624 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.533716 23069 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:02.527451 23590 raft_consensus.cc:1064] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:07:02.527729 23145 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:02.542615 23590 raft_consensus.cc:1068] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Unable to promote non-voter 549b31ac31b6428994b45938abc223a7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:02.543489 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1111) took 1118 ms. Trace:
I20260709 13:07:02.548588 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.524992 23505 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:07:02.545934 23145 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:02.550549 23549 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.549264 21637 rpcz_store.cc:276] 0709 13:07:01.425096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.425208 (+   112us) service_pool.cc:224] Handling call
0709 13:07:01.441884 (+ 16676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.442279 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.442307 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.442758 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.566085 (+123327us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:01.566125 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.566188 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.496738 (+930550us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:02.543199 (+ 46461us) raft_consensus.cc:1685] finished
0709 13:07:02.543218 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.543427 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2991,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"spinlock_wait_cycles":5704576,"thread_start_us":122890,"threads_started":1,"wal-append.queue_time_us":277107}
I20260709 13:07:02.564738 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.566848 21487 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:07:02.564177 23505 consensus_queue.cc:1243] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:02.569070 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1077) took 1075 ms. Trace:
I20260709 13:07:02.557106 23145 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:02.579335 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.576198 21486 rpcz_store.cc:276] 0709 13:07:01.493852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.493986 (+   134us) service_pool.cc:224] Handling call
0709 13:07:01.512112 (+ 18126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.637923 (+125811us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:01.668744 (+ 30821us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.806972 (+138228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:01.807021 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:01.807067 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.568845 (+761778us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002783d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:02.568891 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.569006 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47218,"prepare.queue_time_us":31593,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":15095,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6629,"spinlock_wait_cycles":288761216,"thread_start_us":106797,"threads_started":1,"wal-append.queue_time_us":210198}
I20260709 13:07:02.589726 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.590349 21643 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.591583 22247 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 3 LEARNER]: Advancing to term 4
I20260709 13:07:02.598367 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.601191 21643 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:02.603758 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.605549 21639 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:02.606465 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.628566 21639 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:02.629146 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:02.636286 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.628146 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:02.639418 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.640069 21641 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:02.640198 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.635037 23609 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:02.640925 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.642357 21641 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:07:02.642547 23609 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:02.644219 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.644937 21639 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:02.646260 21639 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:02.647629 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.649871 21643 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.650285 21635 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:07:02.652720 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.656504 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:02.656720 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:02.657166 21565 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:07:02.657418 23605 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.658221 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:02.658989 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:02.663686 21565 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:02.665854 23605 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:02.648767 21639 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:07:02.671078 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.671569 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.671936 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.672086 21638 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:02.681480 21643 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
W20260709 13:07:02.636042 21606 leader_election.cc:336] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.622s (SENT)
I20260709 13:07:02.683295 21638 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:02.683519 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47517.2us
I20260709 13:07:02.686265 21643 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 13:07:02.688254 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.702824 21565 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:02.713025 21564 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:02.713907 22247 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 4 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:02.714313 22247 pending_rounds.cc:85] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 2
I20260709 13:07:02.714525 22247 pending_rounds.cc:107] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:02.714742 22247 raft_consensus.cc:2889] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.713917 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:02.684160 21606 leader_election.cc:336] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.920s (SENT)
I20260709 13:07:02.718670 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:02.602595 23145 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.719686 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:02.727082 21564 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.727909 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.730232 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:02.728534 21490 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:02.736212 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:02.737133 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.738492 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:02.739264 21643 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:02.744091 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:02.744899 21492 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.747577 21635 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:07:02.748672 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.749157 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.749912 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.750458 21641 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.751510 21486 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:02.752797 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:02.755200 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:02.740473 23486 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:02.759557 23626 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:07:02.761147 23596 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:02.766274 21488 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:02.776604 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.766862 21488 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:02.780469 21635 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:02.781646 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:02.783195 22243 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.784032 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:02.784418 22243 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.785609 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:02.786258 22245 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:07:02.781857 21635 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:02.788271 21635 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:02.788790 23549 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.789535 21640 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.800577 21640 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:02.802623 21636 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:02.804667 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.805924 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:02.806571 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.807415 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.807847 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:02.808457 21641 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:07:02.808530 21492 raft_consensus.cc:2410] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:02.808219 21636 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:02.811510 21640 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.808589 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.816316 21637 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:02.817724 21636 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:02.821866 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:02.824199 21640 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.731223 23590 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:02.827701 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:02.852547 21636 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.852537 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:02.864212 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.870551 23069 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:02.895505 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:02.896382 21640 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.762609 23596 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
W20260709 13:07:02.901417 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.922928 21636 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:02.899734 23619 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:07:02.904639 21488 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:02.883940 23605 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:02.904250 22246 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 1 LEARNER]: Advancing to term 4
I20260709 13:07:02.917505 23153 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.866966 23603 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:07:02.920895 23596 consensus_queue.cc:1243] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:02.947672 21488 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.950285 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:02.960633 21640 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:02.961395 21562 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:07:02.903410 23067 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:07:02.949697 22241 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:02.969075 23534 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.004031 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 243297us
I20260709 13:07:02.962445 23153 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.033257 23549 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:03.038661 23230 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:03.056918 23153 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:03.069921 23614 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.659s	user 0.006s	sys 0.006s
W20260709 13:07:03.079417 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 208454us
I20260709 13:07:03.080572 21488 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:07:03.066569 23533 consensus_meta.cc:287] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.000s
I20260709 13:07:03.020366 23534 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.092672 23534 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:03.093544 23484 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:03.111042 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 153738us
I20260709 13:07:03.112605 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:03.117980 22246 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 4 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:03.086359 23549 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:03.125324 23633 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.119628 23534 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.137730 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:03.138851 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58072.1us
I20260709 13:07:03.139861 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.127465 23605 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:07:03.142768 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 113076us
I20260709 13:07:03.135144 23534 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.149999 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.151003 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.156114 23069 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.156744 23069 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.159001 22930 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:03.160238 23069 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:03.161549 23484 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:03.162489 23484 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:03.162858 23484 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:03.148092 23174 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:03.163654 23484 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.164891 23484 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.166383 23505 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:03.166991 23505 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:03.152755 23534 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.168125 23505 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.170382 23505 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.171046 23614 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:03.171589 23614 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:03.172488 23614 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.172760 23593 consensus_queue.cc:1059] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:03.174510 23539 raft_consensus.cc:3055] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:03.174880 23539 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:03.175657 23539 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.185091 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:03.187963 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 159699us
I20260709 13:07:03.147653 23638 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.201324 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.156458 23600 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.185417 22242 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:03.175684 23503 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.200075 23642 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.206496 23555 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.202473 23545 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:03.209003 23600 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:03.227952 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:03.231551 23537 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
W20260709 13:07:03.233291 23636 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:03.236373 23651 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:03.239960 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.216498 23153 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:03.244130 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.137008 23633 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:03.248147 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 89739.9us
W20260709 13:07:03.250322 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 60915.6us
I20260709 13:07:03.252434 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:03.252703 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.257227 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:03.260686 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.224887 23647 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.240187 23600 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.246165 23556 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:03.261108 23145 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.003s
I20260709 13:07:03.229686 23174 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:03.211905 23605 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.260464 23638 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.271023 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:03.271140 23644 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:03.271661 23069 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:03.304816 23069 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.272271 23633 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:03.274931 23551 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.278307 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:03.261423 23486 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:03.281461 21638 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:03.264003 23651 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:03.129956 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:03.257144 23555 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.227291 23642 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.285076 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:03.298972 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 146958us
I20260709 13:07:03.305476 23069 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:03.279547 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:03.256865 23153 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.292265 23639 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:03.292013 23647 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.322448 23069 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:03.320530 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.319913 22245 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.318958 23145 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:03.325333 23145 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.306672 23644 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:03.326869 23067 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.327320 23067 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.327664 23067 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.327692 23644 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.329051 23644 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.331730 23145 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:03.332171 23539 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.334971 23653 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.335603 23653 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:03.336324 23153 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:03.336498 23653 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.338816 22244 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:03.339519 21642 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:03.339715 23642 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:03.340452 21639 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:03.340865 23638 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.341280 23638 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.341655 23638 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.341967 21492 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:03.343554 21488 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:03.344081 23534 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.335103 21634 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:03.338860 23540 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:03.350265 21485 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:03.350383 23551 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:03.352778 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.354444 21639 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:03.354951 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:03.357597 21488 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:03.352257 23534 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:03.364615 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:03.365573 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:03.367396 21638 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:03.369576 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:03.370421 23174 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.378361 22245 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:03.381644 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:03.321142 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 60569.5us
I20260709 13:07:03.382269 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:03.383179 21494 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:03.383147 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.323735 23651 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:03.386317 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 115377us
I20260709 13:07:03.387904 21642 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:03.387472 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.390336 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.391845 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:03.382189 23593 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:03.395263 23593 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.396274 23503 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.397939 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:03.398815 22239 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:03.399513 23593 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:03.402123 21492 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:03.363348 23639 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:03.404847 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:03.408613 21494 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:03.409531 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.410006 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:03.345058 23647 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.412819 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:03.414888 21488 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.418908 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:03.420214 21639 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:03.412307 23665 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:07:03.421022 23662 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.420821 23534 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:03.422129 21636 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:03.423195 23548 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:03.404683 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:03.424826 23651 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.425818 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:03.427973 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.428826 23505 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.430142 21569 raft_consensus.cc:2410] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:03.430100 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.430949 23662 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.433104 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.434690 23662 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:03.410633 23486 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.436805 23486 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:03.437155 23639 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.438050 23662 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:03.438397 23662 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:03.439193 23539 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:03.439380 23662 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.441090 23662 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.441284 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:03.441912 21642 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:03.443215 21640 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:03.444479 23647 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:03.444428 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:03.445590 23416 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.445672 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.446051 23416 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.446453 23416 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.452524 23539 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:03.464089 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 141865us
I20260709 13:07:03.463901 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.469472 21488 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:03.407671 23593 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.471345 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:03.472648 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 82403.9us
I20260709 13:07:03.477291 21492 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:03.478130 21492 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:03.477864 21606 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.479105 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:03.479962 21494 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:03.402752 23614 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:07:03.486860 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.479722 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.490195 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.465379 23590 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.479287 21492 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.452503 23600 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:03.460305 23145 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:07:03.505861 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.477758 23609 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.466310 23548 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:07:03.505076 21492 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.505862 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:03.519047 21569 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:03.515144 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:03.520835 21606 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.470391 23540 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:07:03.493710 23647 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.493245 23593 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:03.476233 23505 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:07:03.522064 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.497241 23537 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:07:03.505420 23614 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.492518 23650 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:07:03.558050 21492 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:03.559767 23639 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:03.561784 21388 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 239) took 11274 ms (client timeout 15000 ms). Trace:
W20260709 13:07:03.584842 23069 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:07:03.598726 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 119067us
I20260709 13:07:03.518674 23596 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.600129 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:03.601608 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 120434us
I20260709 13:07:03.555671 23174 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.603343 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:03.547397 23590 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:03.606441 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 84429.2us
I20260709 13:07:03.545015 23653 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:03.613144 21606 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.540520 23642 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:07:03.624154 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.556989 23201 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:07:03.601138 23551 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.599332 23230 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.629041 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:03.631371 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 116357us
I20260709 13:07:03.636652 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:03.636672 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:03.540077 23646 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:07:03.642100 23672 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.642234 23587 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.642364 23545 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:03.643322 23664 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:07:03.643230 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.611104 23660 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.646622 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.622745 23665 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.598415 23649 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:07:03.634721 23647 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.626693 23505 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:03.625196 23653 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:03.678565 23653 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.646013 23565 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:03.657374 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:03.656078 23665 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.658923 23660 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.662587 23614 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:03.663275 23548 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:03.659163 23587 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:03.650097 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 46833.2us
W20260709 13:07:03.588999 21388 rpcz_store.cc:269] 0709 13:06:52.286941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.287094 (+   153us) service_pool.cc:224] Handling call
0709 13:07:03.561699 (+11274605us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:01.535581 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:01.536174 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:01.536204 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:07:01.536221 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:01.536539 (+   318us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:01.536612 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:01.536642 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:01.536856 (+   214us) tablet.cc:701] Row locks acquired
0709 13:07:01.536874 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:07:01.537012 (+   138us) write_op.cc:270] Start()
0709 13:07:01.537132 (+   120us) write_op.cc:276] Timestamp: P: 1783602421536968 usec, L: 0
0709 13:07:01.537152 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:01.646443 (+109291us) log.cc:844] Serialized 544 byte log entry
0709 13:07:01.856844 (+210401us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fdde28 00007f98ada18581 00007f98ada17d58 00007f98ada1c9f1 00007f98ada1c9a9 00007f98ada1c939 00007f98ada1c901 00007f98ada1bb2d 000000000038f354 000000000038f199
0709 13:07:01.891080 (+ 34236us) op_driver.cc:464] REPLICATION: finished
0709 13:07:02.120930 (+229850us) write_op.cc:301] APPLY: starting
0709 13:07:02.121031 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:02.121134 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:02.121154 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:02.121424 (+   270us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:02.121589 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:02.121631 (+    42us) write_op.cc:312] APPLY: finished
0709 13:07:02.173636 (+ 52005us) log.cc:844] Serialized 23 byte log entry
0709 13:07:02.185866 (+ 12230us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:02.188343 (+  2477us) write_op.cc:454] Released schema lock
0709 13:07:02.190123 (+  1780us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:02.190583 (+   460us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:02.190626 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":529859,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":229591,"apply.run_cpu_time_us":2385,"apply.run_wall_time_us":69622,"num_ops":1,"prepare.queue_time_us":73739,"prepare.run_cpu_time_us":6719,"prepare.run_wall_time_us":321465,"replication_time_us":353762,"spinlock_wait_cycles":13864704,"thread_start_us":259955,"threads_started":2}]]}
I20260709 13:07:03.651980 23596 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.654857 23590 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:03.692745 23555 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:03.660116 23549 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:03.699361 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:03.743364 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44123.2us
I20260709 13:07:03.652663 23639 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:07:03.722892 23647 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:03.676685 23505 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:03.649976 23545 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.734083 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:03.734867 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 75380.1us
I20260709 13:07:03.697186 23665 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.646746 23551 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.698844 23230 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.744643 23590 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:03.751091 23670 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:07:03.750823 23067 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.751427 23674 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.751879 23600 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:07:03.645792 23593 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:03.755578 23671 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:07:03.702347 23548 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.757601 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:03.749446 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:03.765838 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:03.763005 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:03.768786 23416 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.775158 23501 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.781999 23660 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:03.783537 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:03.785066 23551 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:03.786100 23590 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.742620 23549 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.698089 23565 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.798914 23663 raft_consensus.cc:2764] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:03.758363 23647 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.803467 23548 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:03.829344 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 95355.2us
I20260709 13:07:03.830058 23673 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:03.836259 23067 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:03.837169 23674 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.837633 23484 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.819494 23501 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:03.751900 23555 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.895237 23681 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.916360 23677 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:03.915318 23661 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:07:03.849988 23549 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.949337 23555 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:03.944329 23484 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.951858 23501 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:03.923223 23153 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.814843 23505 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:03.925256 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 68415.6us
I20260709 13:07:03.935708 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:03.958639 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 166671us
I20260709 13:07:03.939972 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:03.943607 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:03.927166 23673 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:03.947057 23677 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:03.960064 21568 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.960958 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:03.963943 22244 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.957378 23174 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.000415 22244 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:03.939594 23674 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.969218 23686 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.963249 23153 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:03.955484 23681 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.059492 23603 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:04.079540 23174 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:04.064615 23067 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:04.068734 23484 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:04.092734 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 133376us
W20260709 13:07:04.076546 23631 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.080s	user 0.005s	sys 0.003s
I20260709 13:07:04.061923 23660 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:04.088389 23545 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.113058 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:04.114494 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:04.114634 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:04.115463 21564 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:04.113744 21560 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:04.092092 23605 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:04.115165 23660 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.090040 23174 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.119128 23416 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.119871 23550 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:04.187248 23550 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.190266 23550 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:04.102067 23067 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.090584 23673 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.192826 23067 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.192754 23665 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.162047 23689 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:04.162892 23683 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:07:04.165135 23681 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:04.079344 23686 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.128698 23647 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:04.168745 23687 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:07:04.170742 23691 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:07:04.171679 23684 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 13:07:04.172814 23690 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:04.095115 23677 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.096701 23603 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.155102 23657 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:04.126255 23605 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:04.213596 23638 consensus_meta.cc:287] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.869s	user 0.013s	sys 0.000s
W20260709 13:07:04.227663 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 113108us
I20260709 13:07:04.233201 22244 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:04.222327 23565 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:04.233532 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:04.236533 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.239624 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:04.243026 23685 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:07:04.243356 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.244598 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:04.244824 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.245146 21489 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.245857 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.225833 23638 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.251108 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:04.228469 23677 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.253631 22244 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:04.256126 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:04.254201 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.256965 21486 raft_consensus.cc:2410] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:04.257023 21490 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:04.258067 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.258697 21490 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:04.247002 23679 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.237241 23639 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.251780 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.263504 21491 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:07:04.229684 23067 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:04.265480 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.268836 21568 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:04.264680 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:04.271539 23696 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:07:04.271633 22240 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:04.275040 23605 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:04.276098 23695 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:04.252140 23596 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.224086 23657 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.254966 23647 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.257802 23660 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.283203 23067 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.372856 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:04.374272 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:04.376778 21565 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.377503 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:04.265482 23674 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.381646 23067 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.291263 23174 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.291004 23665 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.292806 23657 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.287285 23153 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.299789 23647 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.291143 23596 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:04.288430 23686 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.387113 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:04.405401 21569 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:04.406756 23067 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.282996 23639 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.416642 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:04.418107 23672 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:04.400961 23647 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.376892 23590 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:04.289808 23548 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.383713 23416 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.379456 23660 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:04.368217 23549 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.402446 23174 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:04.265293 23679 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.402006 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:04.403990 23596 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.445408 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 43525.9us
I20260709 13:07:04.451503 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.452903 21487 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:04.457526 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.463250 21643 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:04.434296 23672 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:04.466019 21487 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:04.457217 23545 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.460947 22240 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:04.487157 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:04.488713 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:04.469594 23662 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.028s	user 0.010s	sys 0.004s
I20260709 13:07:04.489661 21487 raft_consensus.cc:2368] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
W20260709 13:07:04.480010 23539 consensus_meta.cc:287] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 1.025s	user 0.011s	sys 0.002s
I20260709 13:07:04.451059 23416 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.456171 23660 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.460146 23600 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:04.481282 23603 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.450769 23590 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.484424 23545 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.457645 23174 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.518196 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.515489 23662 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.509721 23693 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:07:04.505719 23686 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.530330 23662 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.536701 23639 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.537421 23662 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.520536 23663 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.520161 23681 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.525473 23545 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.540323 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:04.515777 23638 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.507330 23539 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.544891 21487 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
W20260709 13:07:04.554019 23706 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:07:04.548708 23681 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.561170 23590 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:04.567492 21489 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:04.568025 23540 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.568527 23540 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.568995 23638 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.569514 23638 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:04.571410 23714 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:04.532231 23686 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.571683 23638 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.577652 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:04.579824 23416 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.584793 23549 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:04.543641 23672 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.577039 23686 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.674208 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 296) took 1037 ms. Trace:
I20260709 13:07:04.674746 22239 rpcz_store.cc:276] 0709 13:07:03.636717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.642628 (+  5911us) service_pool.cc:224] Handling call
0709 13:07:03.643083 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.800084 (+157001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.803706 (+  3622us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.931744 (+128038us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.148175 (+216431us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.151371 (+  3196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.673693 (+522322us) spinlock_profiling.cc:243] Waited 97.4 ms on lock 0x7b54006c0f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:04.673756 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.673836 (+    80us) raft_consensus.cc:1685] finished
0709 13:07:04.673852 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.674131 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18327,"raft.queue_time_us":26079,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6808,"spinlock_wait_cycles":224062208,"thread_start_us":96464,"threads_started":1,"wal-append.queue_time_us":255800}
I20260709 13:07:04.619343 23660 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.627537 23548 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.682350 23596 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:04.688822 23710 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:07:04.711812 23545 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.714054 23545 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:04.714597 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:04.715909 22245 raft_consensus.cc:2410] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:04.717126 23679 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:04.720920 23416 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:04.721498 23416 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.724135 23596 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:04.725082 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:04.725981 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:04.727092 23609 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.727188 23642 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:04.727555 23609 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.727721 23642 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:04.727957 23609 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.728633 23642 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.731217 23647 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:04.739246 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:04.740386 23697 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.742707 23697 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:04.743490 23697 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:04.747428 23718 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.199s	user 0.003s	sys 0.000s
I20260709 13:07:04.752365 21489 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:04.753643 23540 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:04.755052 23174 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.757022 23602 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.757681 23602 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.758340 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:04.770212 23602 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.775597 23602 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.776232 23602 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.778744 23602 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:04.779462 23697 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:04.781602 23697 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:04.720961 21485 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:04.835613 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:04.836102 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1157) took 1077 ms. Trace:
I20260709 13:07:04.840467 23647 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:04.843940 23548 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:04.844082 23609 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:04.844931 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 84633.6us
W20260709 13:07:04.847585 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 43951.7us
I20260709 13:07:04.851689 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:04.851927 23609 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.852499 21560 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:04.845503 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:04.836544 21641 rpcz_store.cc:276] 0709 13:07:03.759175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.761433 (+  2258us) service_pool.cc:224] Handling call
0709 13:07:03.761953 (+   520us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:03.790068 (+ 28115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.790117 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:03.796817 (+  6700us) log.cc:844] Serialized 78 byte log entry
0709 13:07:04.182858 (+386041us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b480021c258. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f 00007f98aeff9f37 00007f98af00e55c 00007f98af00e508 00007f98af00e488 00007f98af00e443 00007f98af00d6ec 00007f98adf37a96
0709 13:07:04.242558 (+ 59700us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.320221 (+ 77663us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.835150 (+514929us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b18000dfae0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:07:04.835550 (+   400us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.835743 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.835838 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.835882 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:04.835893 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.836041 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131500,"prepare.queue_time_us":116931,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":537415,"raft.run_cpu_time_us":2888,"raft.run_wall_time_us":395548,"spinlock_wait_cycles":81970688,"thread_start_us":385543,"threads_started":1,"wal-append.queue_time_us":464389}
I20260709 13:07:04.971567 21636 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:04.853394 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:04.974210 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:04.955627 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 105181us
I20260709 13:07:05.222419 21639 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:04.932871 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:04.975472 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.224809 21635 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:05.226120 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.227066 21635 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:05.028693 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:05.227746 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:05.028167 21637 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:04.987145 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.228986 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.229835 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:05.235534 21640 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.955870 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 106587us
I20260709 13:07:04.959892 21565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24789f7f25d44609b76928ec55894739"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:05.236232 21642 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.236555 21565 raft_consensus.cc:606] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:05.236902 21565 raft_consensus.cc:614] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:05.240335 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 394876us
I20260709 13:07:05.241533 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.242187 21636 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:05.242447 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:05.243070 21490 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:05.243240 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.243590 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:05.244283 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.244896 21638 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:05.244992 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.246743 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.247112 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.247459 21637 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:05.248450 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:05.248922 21639 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:05.110976 23727 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.408s	user 0.000s	sys 0.007s
I20260709 13:07:05.269416 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:05.271914 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:05.268932 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:04.846169 23230 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:05.379743 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:05.253902 23660 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.385263 23416 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:05.251065 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:05.253875 21565 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:05.385702 23660 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:05.341924 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.387271 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:05.388720 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:05.389359 21489 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.391705 23705 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.392021 23674 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:05.392297 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:05.392551 23067 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:05.393061 23067 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:05.393831 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:05.394436 22243 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.395851 23067 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:05.396325 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:05.396456 23674 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:05.397003 22241 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:07:04.986351 23503 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.398274 23503 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:05.398594 23674 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:05.249856 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.400664 23503 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:05.401293 21635 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:05.383147 21569 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:05.402910 21489 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:05.392274 23705 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:05.404317 21562 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:05.402204 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:05.405414 21635 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.405520 23705 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:05.400218 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.403053 21569 pending_rounds.cc:85] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 5
I20260709 13:07:05.408761 21569 pending_rounds.cc:107] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:05.410604 23660 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:04.857853 23550 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:05.410121 21569 raft_consensus.cc:2889] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.411823 23550 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:05.412153 23681 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:05.413220 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.414120 23550 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:05.414264 23416 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.414732 23416 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.411332 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:05.415139 23416 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.419727 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:05.420544 23689 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.421037 23689 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:05.420893 23705 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:05.421943 23689 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:05.423163 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:05.423774 21562 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:05.424691 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:05.425529 23728 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.676s	user 0.000s	sys 0.010s
I20260709 13:07:05.425834 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:05.426656 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1122) took 1168 ms. Trace:
I20260709 13:07:05.426868 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:05.428146 22240 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:05.427112 21491 rpcz_store.cc:276] 0709 13:07:04.257873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.579023 (+321150us) service_pool.cc:224] Handling call
0709 13:07:04.579339 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.582489 (+  3150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.582517 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.612239 (+ 29722us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.833269 (+221030us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.833329 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.833435 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.424937 (+591502us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:05.426353 (+  1416us) raft_consensus.cc:1685] finished
0709 13:07:05.426374 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.426595 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175308,"raft.queue_time_us":2881,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":29267,"spinlock_wait_cycles":205459840,"thread_start_us":215566,"threads_started":1,"wal-append.queue_time_us":132206}
I20260709 13:07:05.429320 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:05.434099 21635 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:05.436570 21490 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.332362 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:05.252631 23069 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.437990 23069 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:05.438019 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:05.439306 21642 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:05.443480 21640 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:05.444780 21639 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:04.848399 23600 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.466s
I20260709 13:07:05.447679 22212 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:05.380134 23662 raft_consensus.cc:1064] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:07:05.332019 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:05.449604 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:05.462966 22246 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:05.108187 21389 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 3, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:05.197312 23633 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:05.469736 23633 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:05.470873 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:05.471302 21561 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:05.471926 23633 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:05.472162 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:05.472455 23633 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:05.473409 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:05.475487 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:05.476328 21560 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:05.477626 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:05.478394 21560 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:07:04.976928 23647 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.492529 21560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:05.281663 23587 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.531137 23069 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:05.528934 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:05.472944 23633 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:05.233237 23596 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.233843 23642 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.430114 23416 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:05.464867 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:05.465837 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1127) took 1061 ms. Trace:
I20260709 13:07:05.465936 23503 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:05.466171 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:05.543789 21487 rpcz_store.cc:276] 0709 13:07:04.404039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.584011 (+179972us) service_pool.cc:224] Handling call
0709 13:07:04.615020 (+ 31009us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.786478 (+171458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.786506 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.787072 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.230757 (+443685us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.230857 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.230953 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.465646 (+234693us) raft_consensus.cc:1685] finished
0709 13:07:05.465666 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.465783 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":642978,"raft.queue_time_us":222920,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":11183,"thread_start_us":443270,"threads_started":1,"wal-append.queue_time_us":676853}
I20260709 13:07:05.545248 21568 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.446715 23153 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:05.324877 23590 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.142s
I20260709 13:07:05.466725 23331 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.467180 23507 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:05.557544 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:05.558815 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:05.559574 21488 raft_consensus.cc:2410] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:05.022711 23549 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:05.468562 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:05.446503 23540 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:05.479820 21564 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:05.481424 23730 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.744s	user 0.006s	sys 0.000s
I20260709 13:07:05.484632 23677 raft_consensus.cc:1064] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:07:05.459657 23551 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:04.856671 23686 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:05.324981 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:05.503216 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:05.452800 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:05.454219 21640 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:04.848577 23661 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:05.461472 23545 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:05.488626 23681 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:05.539438 21389 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:05.543851 21486 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:07:05.526489 23587 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:05.459062 23230 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:05.547435 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:05.196413 23174 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:05.562070 21562 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:05.570943 23600 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.571357 23549 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:05.572497 23729 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.821s	user 0.003s	sys 0.008s
I20260709 13:07:05.573381 23416 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:05.557574 23331 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.541910 23596 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:05.545797 23642 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:05.575861 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1789) took 1643 ms. Trace:
I20260709 13:07:05.526160 23647 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:05.588063 21490 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:05.592252 21564 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:05.603199 21568 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:05.554921 23503 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:05.806030 22244 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.005s	sys 0.031s
I20260709 13:07:05.821300 21566 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:06.013434 22210 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.534s (SENT) [suppressed 27 similar messages]
I20260709 13:07:06.109532 21560 raft_consensus.cc:606] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:06.104696 21635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.013s
W20260709 13:07:06.110209 21635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.000s	sys 0.013s
I20260709 13:07:06.110144 21560 raft_consensus.cc:614] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:06.105531 21532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.008s	sys 0.004s
W20260709 13:07:06.110991 21532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.008s	sys 0.004s
W20260709 13:07:05.882805 21608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.027s	sys 0.014s
W20260709 13:07:06.111740 21608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.028s	sys 0.017s
W20260709 13:07:06.111936 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 583037us
W20260709 13:07:06.109071 22244 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.008s	sys 0.040s
I20260709 13:07:06.113387 21487 raft_consensus.cc:2410] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:07:06.105043 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.609694 21640 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:05.802121 23069 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:06.116017 23069 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:06.107470 21643 rpcz_store.cc:276] 0709 13:07:03.932850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.933388 (+   538us) service_pool.cc:224] Handling call
0709 13:07:03.933808 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.463654 (+529846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.575622 (+1111968us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b540024e5d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:05.575801 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217021184}
I20260709 13:07:05.608692 21561 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:06.108453 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:06.112175 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 831895us
W20260709 13:07:06.119719 21494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.015s	sys 0.018s
W20260709 13:07:06.140465 21494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.016s	sys 0.019s
I20260709 13:07:06.139909 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1600) took 1261 ms. Trace:
I20260709 13:07:06.144706 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:07:06.096643 23590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.005s
W20260709 13:07:06.099138 21485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.009s	sys 0.004s
I20260709 13:07:06.144132 21568 rpcz_store.cc:276] 0709 13:07:04.851840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.853568 (+  1728us) service_pool.cc:224] Handling call
0709 13:07:05.466030 (+612462us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:06.112789 (+646759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17389440}
W20260709 13:07:06.106339 23722 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.366s	user 0.000s	sys 0.016s
I20260709 13:07:06.172824 21563 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.029983 23689 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.118552 22243 consensus_meta.cc:287] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.646s	user 0.005s	sys 0.005s
I20260709 13:07:05.594882 23540 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:05.941334 23602 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.557407 23153 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:05.694470 22242 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.287545 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:06.119402 23587 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.309711 23069 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:06.310261 21488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.018s	sys 0.013s
I20260709 13:07:05.939976 23686 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:05.667016 23661 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:06.203480 21487 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:06.339711 21487 pending_rounds.cc:85] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 2
I20260709 13:07:06.340071 21487 pending_rounds.cc:107] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:06.340325 21487 raft_consensus.cc:2889] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:06.258965 21636 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:06.119150 23331 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.187021 21567 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:06.299433 21563 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:06.187477 21642 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:06.172304 23416 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:06.139477 23545 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:06.302104 23642 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:06.245316 23600 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:06.303180 23689 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:06.172380 23590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.007s	sys 0.006s
I20260709 13:07:06.142226 23174 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:06.274221 21389 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 3, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:06.305466 21637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.013s	sys 0.025s
I20260709 13:07:06.099912 23737 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:05.693185 23486 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:06.099402 23740 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:06.310881 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1540) took 2069 ms. Trace:
W20260709 13:07:06.311071 21488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.018s	sys 0.013s
W20260709 13:07:06.173916 21485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.009s	sys 0.004s
I20260709 13:07:06.150590 23751 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:05.611479 23551 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:06.350648 23600 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:06.293848 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:06.419412 21389 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.347952 22245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 302) took 1098 ms. Trace:
I20260709 13:07:06.421713 22245 rpcz_store.cc:276] 0709 13:07:05.249227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.249346 (+   119us) service_pool.cc:224] Handling call
0709 13:07:05.249604 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.249809 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:05.882504 (+632695us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.347587 (+465083us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.347638 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.347684 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.347752 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.347864 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36773,"prepare.queue_time_us":1108946,"raft.queue_time_us":41257,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7303,"thread_start_us":706157,"threads_started":2}
I20260709 13:07:06.356880 23590 consensus_queue.cc:1243] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:06.351933 23540 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:06.433082 23549 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:06.347565 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 1869) took 1255 ms. Trace:
I20260709 13:07:06.354640 23642 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:06.448875 21567 rpcz_store.cc:276] 0709 13:07:05.092646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.093757 (+  1111us) service_pool.cc:224] Handling call
0709 13:07:06.186564 (+1092807us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:07:06.186774 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.343764 (+156990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.347505 (+  3741us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18389248}
I20260709 13:07:06.453047 22245 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:06.338631 23593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.626s	user 0.040s	sys 0.077s
I20260709 13:07:06.311717 23633 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:06.139550 23681 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:06.339555 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:06.354089 21637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.014s	sys 0.025s
I20260709 13:07:06.470175 21389 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 4, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 4 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.297859 22243 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:06.345698 23686 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:06.308490 23602 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:06.360567 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1142) took 1048 ms. Trace:
W20260709 13:07:06.493173 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 348522us
I20260709 13:07:06.352201 23416 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:06.358155 21492 rpcz_store.cc:276] 0709 13:07:04.241381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.273323 (+ 31942us) service_pool.cc:224] Handling call
0709 13:07:04.273647 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.300339 (+ 26692us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:04.478297 (+177958us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.576207 (+ 97910us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.579779 (+  3572us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.579909 (+   130us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.580135 (+   226us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.785859 (+205724us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b18003d86a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:07:04.786056 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.786123 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.821085 (+1034962us) spinlock_profiling.cc:243] Waited 97.5 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:06.310616 (+489531us) raft_consensus.cc:1685] finished
0709 13:07:06.310638 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.310813 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":657652,"prepare.queue_time_us":91502,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":215559,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":6397,"spinlock_wait_cycles":289742976,"thread_start_us":190810,"threads_started":2,"wal-append.queue_time_us":253208}
I20260709 13:07:06.292564 23677 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:06.476372 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 367938us
W20260709 13:07:06.362859 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.514685 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.502835 21488 rpcz_store.cc:276] 0709 13:07:05.312068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.567645 (+255577us) service_pool.cc:224] Handling call
0709 13:07:05.567918 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.568109 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:05.585353 (+ 17244us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.360133 (+774780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.360197 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:06.360259 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.360340 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.360501 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17511,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":172,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":774086,"threads_started":1,"wal-append.queue_time_us":887429}
I20260709 13:07:06.478768 22246 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:06.479601 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1183) took 1085 ms. Trace:
I20260709 13:07:06.462724 22241 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:06.434840 23600 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:06.503948 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 363399us
W20260709 13:07:06.470561 23593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.758s	user 0.041s	sys 0.077s
I20260709 13:07:06.531055 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:06.359326 23486 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:06.353739 23662 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:06.477828 23590 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:06.502576 23750 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:06.547132 22247 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:06.358163 23737 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:06.556408 23549 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:07:06.572783 23486 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:06.574223 23230 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:06.463001 23739 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:06.488113 23642 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:06.508847 22243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 304) took 1184 ms. Trace:
I20260709 13:07:06.504602 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:06.559655 21607 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.007s	sys 0.013s
I20260709 13:07:06.408353 23740 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:06.580646 23545 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:06.623103 23545 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.588238 23742 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:07:06.588663 23633 raft_consensus.cc:2764] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:07:06.607074 21389 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 4, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 4 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.546483 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1145) took 1166 ms. Trace:
I20260709 13:07:06.545958 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1177) took 1265 ms. Trace:
I20260709 13:07:06.472472 23751 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:06.513588 23686 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:06.596473 22243 rpcz_store.cc:276] 0709 13:07:05.324145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.393563 (+ 69418us) service_pool.cc:224] Handling call
0709 13:07:06.505244 (+1111681us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.608549 23748 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:06.594614 23739 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:06.676059 21389 catalog_manager.cc:5697] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:07:06.607532 21607 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.007s	sys 0.017s
I20260709 13:07:06.730984 21389 catalog_manager.cc:5697] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 3, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.677539 21635 rpcz_store.cc:276] 0709 13:07:05.280142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.489405 (+209263us) service_pool.cc:224] Handling call
0709 13:07:05.489688 (+   283us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:05.525779 (+ 36091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.525817 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:05.538276 (+ 12459us) log.cc:844] Serialized 78 byte log entry
0709 13:07:06.110660 (+572384us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:06.519675 (+409015us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.545415 (+ 25740us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.545640 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.545714 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.545750 (+    36us) raft_consensus.cc:1685] finished
0709 13:07:06.545764 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.545897 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23481,"raft.queue_time_us":656299,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":33280,"thread_start_us":887589,"threads_started":2,"wal-append.queue_time_us":516142}
I20260709 13:07:06.734143 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:06.736650 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:06.738335 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:06.743369 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:06.744271 21635 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:06.752072 21389 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 3, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.596473 23153 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:06.758903 23486 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:06.759505 23486 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:06.760260 23331 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:06.762089 23686 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:06.553288 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 539866us
I20260709 13:07:06.931592 21389 catalog_manager.cc:5697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 3, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:06.933750 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 92812.5us
I20260709 13:07:06.934437 21389 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 3, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.957214 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:06.762585 23331 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:06.576654 23750 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:06.623804 23545 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:06.980489 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:06.982358 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:06.993458 21389 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:06.996531 21635 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 2.
I20260709 13:07:06.990890 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1164) took 2011 ms. Trace:
I20260709 13:07:06.937547 23738 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.997690 21638 rpcz_store.cc:276] 0709 13:07:04.979258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.278657 (+299399us) service_pool.cc:224] Handling call
0709 13:07:05.340645 (+ 61988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.352034 (+1011389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.352062 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.352104 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:06.352138 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.990507 (+638369us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540029f254. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:06.990576 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.990776 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2325701760}
I20260709 13:07:07.001744 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.002903 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:06.967546 23503 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.004318 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:07.021865 21389 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:07.017454 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 486464us
I20260709 13:07:07.018113 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.035977 23593 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:07.036652 23593 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:07.036755 23505 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.978193 23174 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:07.039551 23743 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.476s	user 0.000s	sys 0.001s
I20260709 13:07:07.041324 23751 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.043088 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.043551 23740 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.044049 23740 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.044384 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.044472 23740 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.044998 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:07.045558 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.046278 21640 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:07.046634 23755 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:07.047276 23633 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.047206 23755 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.048053 23633 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:07.048550 23633 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.049443 23755 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.049966 23755 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:07.051057 23416 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:07.051335 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:07.051934 21643 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.052121 23737 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.006626 23757 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.052481 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:07.054920 23750 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.050500 23633 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.056341 21635 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.993299 23681 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:07.073869 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 116726us
I20260709 13:07:07.056849 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.050401 23755 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.096550 21389 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 2 to 4, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 4 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.097024 21640 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:07.101382 21635 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:07.099679 21389 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 3 to 4, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 4 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:07.107731 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35370 (request call id 12) took 1638 ms. Trace:
I20260709 13:07:07.108232 21560 rpcz_store.cc:276] 0709 13:07:05.468858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.492281 (+ 23423us) service_pool.cc:224] Handling call
0709 13:07:07.107546 (+1615265us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400128c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fdc853 00007f98aefaa60a 00007f98a85307d4 00007f98a8530762 00007f98a8530691 00007f98a853060c 00007f98a852f8c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:07.107664 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417190784}
I20260709 13:07:07.053367 23737 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:07.110925 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:07.062832 21643 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
W20260709 13:07:07.115794 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.117100 21606 leader_election.cc:400] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
W20260709 13:07:07.117301 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.069621 23230 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:07.069407 23764 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.121194 21643 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:07.122074 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.070225 23486 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:07.135317 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 173636us
I20260709 13:07:07.056572 23740 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.142324 21640 raft_consensus.cc:2376] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5. Re-sending same reply.
I20260709 13:07:07.083474 23602 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.067634 23757 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.135895 23633 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:07.170238 22244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 300) took 1922 ms. Trace:
I20260709 13:07:07.162470 21560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:07.172010 21560 raft_consensus.cc:606] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:07.172410 21560 raft_consensus.cc:614] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:07.162941 23731 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 2.401s	user 0.004s	sys 0.031s
I20260709 13:07:06.677465 21485 rpcz_store.cc:276] 0709 13:07:05.380285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.574518 (+194233us) service_pool.cc:224] Handling call
0709 13:07:05.575022 (+   504us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:05.575461 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.575492 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:05.576152 (+   660us) log.cc:844] Serialized 52 byte log entry
0709 13:07:06.463356 (+887204us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:06.468461 (+  5105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.502518 (+ 34057us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.507234 (+  4716us) raft_consensus.cc:1685] finished
0709 13:07:06.513523 (+  6289us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.539218 (+ 25695us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9850,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":287012,"thread_start_us":832294,"threads_started":1,"wal-append.queue_time_us":523106}
I20260709 13:07:07.164197 23545 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:07.164611 21493 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:07.168706 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 1885) took 1737 ms. Trace:
I20260709 13:07:07.169554 23689 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:07.170234 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:07.171187 22244 rpcz_store.cc:276] 0709 13:07:05.248074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.248189 (+   115us) service_pool.cc:224] Handling call
0709 13:07:05.248471 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.113179 (+864708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.113207 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.154593 (+ 41386us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.958318 (+803725us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.958397 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.958518 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.170025 (+211507us) raft_consensus.cc:1685] finished
0709 13:07:07.170043 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.170177 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5272,"raft.queue_time_us":76735,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":1093253,"threads_started":2,"wal-append.queue_time_us":905798}
I20260709 13:07:07.181749 21493 pending_rounds.cc:85] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 2
I20260709 13:07:07.185334 21493 pending_rounds.cc:107] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 5.3
W20260709 13:07:07.184055 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 179855us
I20260709 13:07:07.185792 21493 raft_consensus.cc:2889] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.020242 23738 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:07.181833 21564 rpcz_store.cc:276] 0709 13:07:05.431518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.146812 (+715294us) service_pool.cc:224] Handling call
0709 13:07:06.197837 (+ 51025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.198273 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.198311 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.297391 (+ 99080us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.612151 (+314760us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:06.612211 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.612312 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.168506 (+556194us) raft_consensus.cc:1685] finished
0709 13:07:07.168523 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.168649 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28062,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":81,"thread_start_us":260792,"threads_started":1,"wal-append.queue_time_us":826615}
I20260709 13:07:07.153540 23331 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:07.120194 23737 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.153659 23230 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:07.169548 23600 consensus_meta.cc:287] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.618s	user 0.002s	sys 0.006s
I20260709 13:07:07.186517 22930 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.193751 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:07.174721 23593 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:07.171109 23633 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:07.195297 21560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:07.241062 21560 raft_consensus.cc:606] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:07.229193 22242 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.887s	user 0.009s	sys 0.000s
I20260709 13:07:07.257754 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.226290 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:07.225870 23587 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.881s	user 0.007s	sys 0.002s
W20260709 13:07:07.242547 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51152.9us
I20260709 13:07:07.261179 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.261595 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.261868 21567 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:07.225570 23745 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.189349 23331 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.239717 23633 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:07.264091 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.226172 23755 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.153534 23764 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:07.231729 23737 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.222954 23642 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:07.266566 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 244) took 1324 ms. Trace:
I20260709 13:07:07.270301 21568 rpcz_store.cc:276] 0709 13:07:05.942696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.341655 (+398959us) service_pool.cc:224] Handling call
0709 13:07:06.349566 (+  7911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.507419 (+157853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.507459 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.507938 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.967781 (+459843us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.967851 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.967949 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.266327 (+298378us) raft_consensus.cc:1685] finished
0709 13:07:07.266351 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.266504 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":463361,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":27313,"spinlock_wait_cycles":16607872,"thread_start_us":609852,"threads_started":2,"wal-append.queue_time_us":645259}
I20260709 13:07:07.263058 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.262213 21564 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:07.277352 21567 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:07:07.238847 22930 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.261088 22242 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:07.281334 21561 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:07.281111 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.237519 23600 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:07.221294 23230 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.268708 23331 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.283573 21567 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:07:07.296446 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:07.296734 21642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 1179) took 1958 ms (client timeout 2581 ms). Trace:
I20260709 13:07:07.285746 21639 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.297386 21639 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:07.297183 21642 rpcz_store.cc:269] 0709 13:07:05.329149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.452491 (+123342us) service_pool.cc:224] Handling call
0709 13:07:07.286968 (+1834477us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400144e54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:07.287098 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362411776}
I20260709 13:07:07.265976 23587 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.289883 21564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a85b464a0e924904be2840142de89c0d"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:07.270303 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.307727 21564 raft_consensus.cc:606] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:07.308471 21560 raft_consensus.cc:2410] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:07.287357 23660 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.311115 23660 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:07.295842 22242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 301) took 2041 ms (client timeout 1754 ms). Trace:
W20260709 13:07:07.312959 22242 rpcz_store.cc:269] 0709 13:07:05.248947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.250118 (+  1171us) service_pool.cc:224] Handling call
0709 13:07:07.290589 (+2040471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59520}
I20260709 13:07:07.317952 23600 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:07.290405 23757 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:07.320077 23749 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.781s	user 0.001s	sys 0.001s
I20260709 13:07:07.321405 23739 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.323273 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 330) took 1998 ms. Trace:
I20260709 13:07:07.323704 22238 rpcz_store.cc:276] 0709 13:07:05.324690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.326498 (+  1808us) service_pool.cc:224] Handling call
0709 13:07:07.322457 (+1995959us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:07:07.322692 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.322912 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.322939 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.322990 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.323022 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.323085 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.323208 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111870848}
I20260709 13:07:07.325358 23661 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:07.326571 21562 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 1876) took 1909 ms (client timeout 1778 ms). Trace:
W20260709 13:07:07.327021 21562 rpcz_store.cc:269] 0709 13:07:05.417311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.425583 (+  8272us) service_pool.cc:224] Handling call
0709 13:07:07.326338 (+1900755us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54003246d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:07.326476 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311640448}
I20260709 13:07:07.331506 23738 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.332449 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.334180 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1117) took 3102 ms. Trace:
I20260709 13:07:07.334307 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:07.335348 23764 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:07:07.336207 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:07.337026 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1169) took 2356 ms. Trace:
I20260709 13:07:07.337378 21634 rpcz_store.cc:276] 0709 13:07:04.980671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.272875 (+292204us) service_pool.cc:224] Handling call
0709 13:07:07.336296 (+2063421us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:07:07.336498 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.336693 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.336725 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.336763 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:07.336799 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.336851 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.336956 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8925952}
I20260709 13:07:07.334578 21493 rpcz_store.cc:276] 0709 13:07:04.232164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.232304 (+   140us) service_pool.cc:224] Handling call
0709 13:07:04.234769 (+  2465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.186321 (+2951552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.333929 (+147608us) spinlock_profiling.cc:243] Waited 2.93 s on lock 0x7b540005c3d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:07.334091 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6735310720}
I20260709 13:07:07.349088 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.350903 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:07.353606 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.355782 21564 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:07.365012 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 239) took 2053 ms. Trace:
I20260709 13:07:07.365617 21565 rpcz_store.cc:276] 0709 13:07:05.311954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.386709 (+ 74755us) service_pool.cc:224] Handling call
0709 13:07:07.364029 (+1977320us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:07:07.364298 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.364559 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.364597 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.364657 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:07.364705 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.364777 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.364923 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45415296}
I20260709 13:07:07.298448 21639 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.369300 21639 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.373039 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.374191 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.384317 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.385133 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.268515 23745 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:07.388373 23745 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:07.390367 22930 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:07.391182 22930 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:07.391765 22930 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:07.393186 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 212232us
I20260709 13:07:07.394229 23587 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.394470 23596 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.368496 23600 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.401419 22930 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:07.402424 23660 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.403896 23739 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:07.404511 23739 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.405126 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 488) took 1289 ms. Trace:
I20260709 13:07:07.405179 23331 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:07.405630 22247 rpcz_store.cc:276] 0709 13:07:06.115397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.115678 (+   281us) service_pool.cc:224] Handling call
0709 13:07:06.115968 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.558051 (+442083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.404890 (+846839us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54006dc754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:07.405067 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990843648}
I20260709 13:07:07.407137 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 213) took 2006 ms. Trace:
I20260709 13:07:07.407305 23739 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.407538 21486 rpcz_store.cc:276] 0709 13:07:05.400227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.162270 (+762043us) service_pool.cc:224] Handling call
0709 13:07:06.162667 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.573648 (+410981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.573705 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.573752 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.573791 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.406915 (+833124us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54002765d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:07.406962 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.407081 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944670592}
I20260709 13:07:07.399428 21638 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:07.400662 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.403971 23551 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.410734 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:07.412976 21606 connection.cc:256] RPC call timeout handler was delayed by -1.6973125770000479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 13:07:07.482964 21606 connection.cc:256] RPC call timeout handler was delayed by -1.3292149719999315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20260709 13:07:07.483438 21606 connection.cc:256] RPC call timeout handler was delayed by -1.0100230389999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
I20260709 13:07:07.409547 23633 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.486065 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:07.496790 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.499701 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.500120 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.500560 21568 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:07:07.503451 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:07.411687 23600 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.510118 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.512468 21639 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:07.512363 21563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 1875) took 2095 ms (client timeout 2059 ms). Trace:
I20260709 13:07:07.513230 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1175) took 2262 ms. Trace:
I20260709 13:07:07.513609 21639 rpcz_store.cc:276] 0709 13:07:05.250555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.455139 (+204584us) service_pool.cc:224] Handling call
0709 13:07:05.456233 (+  1094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.285646 (+1829413us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b540041b7a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f59dc0 00007f98a9fe41c0 00007f98a9fe5231 00007f98a9fe1d8f 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c
0709 13:07:07.512978 (+227332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.513178 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2243870976}
I20260709 13:07:07.515532 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:07.513404 21563 rpcz_store.cc:269] 0709 13:07:05.416996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.475257 (+ 58261us) service_pool.cc:224] Handling call
0709 13:07:07.512187 (+2036930us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54000181d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:07.512294 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602379520}
I20260709 13:07:07.504165 23596 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.524359 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.525204 21563 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
W20260709 13:07:07.512437 23662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.018s	sys 0.013s
I20260709 13:07:07.509653 23505 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.512296 23737 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:07.521385 23746 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 13:07:07.536720 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.532248 23662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.018s	sys 0.015s
I20260709 13:07:07.521478 23551 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:07:07.536026 23505 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.550132 23505 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:07.551777 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 273065us
W20260709 13:07:07.553180 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 185124us
I20260709 13:07:07.526891 23331 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:07.556190 21565 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:07:07.556869 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.557205 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.558056 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:07.558281 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.558995 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.554551 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.559947 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:07.560068 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.555975 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.560796 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:07.555318 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.521903 23750 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.561771 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.558228 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.563642 21563 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:07.535461 23737 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:07.564250 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:07.564796 21567 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.565706 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.566799 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.562485 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.567390 21560 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:07.568130 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.568584 22212 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:07.568964 21639 raft_consensus.cc:2410] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:07.569142 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:07.569497 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:07.569681 21640 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.567404 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.570855 21562 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:07.562809 23548 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:07.572561 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.574502 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:07.618614 21563 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:07.621438 21567 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
W20260709 13:07:07.606719 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.622453 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:07.624634 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:07.620182 22212 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:07.630888 21640 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:07.631302 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:07.554430 23603 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:07.634133 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:07.636361 23763 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.636920 23763 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:07.638150 23676 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:07.567397 23540 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:07.646035 21566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 1871) took 2535 ms (client timeout 1854 ms). Trace:
I20260709 13:07:07.571641 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:07.571710 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:07.644260 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:07.573374 23737 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:07.646540 21566 rpcz_store.cc:269] 0709 13:07:05.103805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.104480 (+   675us) service_pool.cc:224] Handling call
0709 13:07:07.639301 (+2534821us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400128c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:07.639432 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711636864}
I20260709 13:07:07.571874 23548 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:07.637296 23763 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.651366 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:07.639190 23677 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:07.664078 22212 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:07.639415 23662 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.640511 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:07.618507 23689 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:07:07.638760 23676 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:07.618364 23681 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:07:07.652724 23331 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.647907 23761 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:07.641484 23770 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:07:07.668679 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 103722us
I20260709 13:07:07.664862 23548 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:07.676205 23783 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:07:07.667706 23505 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:07.682479 23540 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:07.722949 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:07.720057 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.717720 23761 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:07.717087 23770 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:07.729959 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:07.730453 23761 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.732051 23770 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:07.732582 23770 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:07.733038 23770 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.704367 23798 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:07.734526 23798 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:07.675143 23662 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.734947 23789 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.717471 23545 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:07:07.720329 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.729404 21638 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:07.700344 23331 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.725529 21640 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:07.675935 23796 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.709528 23633 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:07.669246 23677 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.737824 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:07.878024 23753 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.068s	user 0.006s	sys 0.002s
W20260709 13:07:07.855903 21636 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 1188) took 2444 ms (client timeout 2131 ms). Trace:
I20260709 13:07:07.729031 23540 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:07.911356 23662 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:07.911553 23540 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:07.873044 23794 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.003s
I20260709 13:07:07.913125 23677 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:07.806257 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1186) took 2410 ms. Trace:
I20260709 13:07:07.780637 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.808158 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 489) took 1691 ms. Trace:
I20260709 13:07:07.913825 21641 rpcz_store.cc:276] 0709 13:07:05.395279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.541226 (+145947us) service_pool.cc:224] Handling call
0709 13:07:05.541475 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.478173 (+936698us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:06.721160 (+242987us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.392625 (+671465us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b1800329ce0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:07:07.392778 (+   153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.392828 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:07.392872 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.804808 (+411936us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b1800329ce0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419
0709 13:07:07.805888 (+  1080us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b5400143f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:07.805940 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.806130 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53763,"prepare.queue_time_us":641685,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":6831,"raft.queue_time_us":233188,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":2163999744,"thread_start_us":680734,"threads_started":2,"wal-append.queue_time_us":469633}
I20260709 13:07:07.915028 22246 rpcz_store.cc:276] 0709 13:07:06.116404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.116543 (+   139us) service_pool.cc:224] Handling call
0709 13:07:06.478508 (+361965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.516111 (+ 37603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.807931 (+1291820us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54006c02d0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:07.808094 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831697152}
I20260709 13:07:07.711205 23790 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.807533 23539 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:07.916251 23790 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:07.917058 23539 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:07.910449 21636 rpcz_store.cc:269] 0709 13:07:05.395812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.412995 (+ 17183us) service_pool.cc:224] Handling call
0709 13:07:07.839513 (+2426518us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b540029e854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:07.839684 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776637312}
I20260709 13:07:07.699455 23787 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.909152 23798 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:07.711428 23600 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:07.782730 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.910871 23331 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.739573 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:07.927435 21488 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:07.716470 23795 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:07.962288 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 283323us
I20260709 13:07:07.918592 23790 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:07.802971 23788 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.182s	user 0.002s	sys 0.000s
I20260709 13:07:07.711902 23793 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:07.800974 23791 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 13:07:07.965073 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:07.967636 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:07.971968 21638 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 5: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:07.968544 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 304593us
I20260709 13:07:07.973822 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:07.969357 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:07.991732 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:07.998880 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 259415us
I20260709 13:07:07.933766 23787 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.717665 23686 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.249s
I20260709 13:07:07.999765 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:07.945075 23593 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:08.030129 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.029114 23539 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:08.032261 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:08.043190 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:07.725939 23505 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.046053 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:08.046432 23757 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:08.047048 23757 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:08.047546 23757 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.034389 23686 consensus_queue.cc:1243] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:07.997714 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:08.050181 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:08.050724 21485 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.051044 23550 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:08.030962 23787 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.051652 23550 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:08.052253 23550 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:07.964432 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:08.056373 21489 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.059937 23633 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:08.060441 23633 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:08.060809 23633 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.062158 23602 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:08.062762 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.984797 23793 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.042126 23768 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:07.966940 23770 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:08.033437 23587 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.073757 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.043334 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:08.062726 23602 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:08.082628 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.084038 21488 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:07.944713 23796 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.070895 23768 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:08.087141 22930 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:07.962930 23676 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.070571 23793 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.045931 23593 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.087813 22930 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:08.088925 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 176465us
W20260709 13:07:08.089226 21565 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.001s
I20260709 13:07:08.093921 21565 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:08.072109 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:08.094247 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.069061 23540 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:07.985366 23789 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:08.095999 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:08.088124 23768 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:08.115583 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.088655 23799 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.116842 22930 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:08.085338 23770 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:08.108984 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:08.124583 22930 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:08.125090 22930 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:08.125521 22930 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.142273 23796 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:08.143750 23602 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.150576 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.100008 23638 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:07:08.159967 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.160640 21493 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
W20260709 13:07:08.162032 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 192749us
I20260709 13:07:08.142279 21485 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:08.167842 22930 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.171355 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.172160 21485 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:08.154315 23633 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.133751 23764 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:07:08.171015 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:08.132542 23539 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:07:08.178256 22930 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:08.121321 23799 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.128190 23770 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.182435 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.187193 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:08.166905 23790 raft_consensus.cc:2764] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:08.188658 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.188796 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:08.189497 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 143569us
I20260709 13:07:08.156286 23796 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:07:08.191949 23796 consensus_queue.cc:1243] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:08.192744 23796 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:08.193187 23796 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:08.194020 23796 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:08.196024 23763 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.000s
I20260709 13:07:08.189687 23677 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.191265 21485 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:08.197613 22930 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:08.208720 22930 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:08.210286 22930 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.217344 22930 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.214713 21488 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:08.214761 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.177542 23505 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:08.202370 23540 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:08.203722 23662 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.219502 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:08.185305 23809 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.171939 23807 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.225776 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:08.228618 23768 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.233796 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:08.234305 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 104810us
I20260709 13:07:08.235463 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.200567 23633 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:08.241420 21608 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:08.242995 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.243666 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.244304 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.218627 23550 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.244962 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.244326 21489 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:08.245540 23153 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.196275 23548 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.247383 23593 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:08.171659 23789 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.196496 23763 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:07:08.251904 23737 consensus_meta.cc:287] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.003s
I20260709 13:07:08.234573 23587 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:08.253144 23797 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 13:07:08.259649 23596 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:08.257349 23647 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:08.231976 23662 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:08.274559 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:08.276947 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:08.302073 21569 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.266642 23798 raft_consensus.cc:2764] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:08.254843 23768 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:08.262974 23807 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:08.305708 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:08.329164 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:08.268239 23633 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:08.307180 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:08.310464 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:08.305310 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:08.311790 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:08.251936 23757 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.340602 23548 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:08.342546 23763 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:08.295747 23596 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:08.285305 23587 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:08.310921 23662 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.335620 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:08.344796 23768 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:08.347909 21639 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:08.321388 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 136657us
I20260709 13:07:08.266772 23505 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:07:08.331472 21491 raft_consensus.cc:2376] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6. Re-sending same reply.
I20260709 13:07:08.355881 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:08.356653 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1605) took 1120 ms. Trace:
I20260709 13:07:08.321916 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:08.355176 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:08.358222 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 63151.5us
I20260709 13:07:06.518540 21637 rpcz_store.cc:276] 0709 13:07:05.394416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.468434 (+ 74018us) service_pool.cc:224] Handling call
0709 13:07:05.468669 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.476098 (+  7429us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:05.476435 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.479137 (+1002702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.479208 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:06.479273 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.479362 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.479527 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5418,"prepare.queue_time_us":179,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":31544,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9014,"thread_start_us":996829,"threads_started":1,"wal-append.queue_time_us":1027553}
I20260709 13:07:08.359545 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:08.358237 21636 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.360914 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:08.294934 23737 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.357089 21561 rpcz_store.cc:276] 0709 13:07:07.236781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.238170 (+  1389us) service_pool.cc:224] Handling call
0709 13:07:08.356479 (+1118309us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b54001d8154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:08.356599 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33400064}
I20260709 13:07:08.370827 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:08.371985 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.332937 23633 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:08.391788 23633 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.237813 23809 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.400341 23809 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:08.401015 22244 raft_consensus.cc:2376] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5. Re-sending same reply.
I20260709 13:07:08.404860 23633 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:08.390112 21639 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:08.407356 23686 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.409047 23761 raft_consensus.cc:993] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:07:08.411710 23761 raft_consensus.cc:1081] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:07:08.410028 23540 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:08.414327 21639 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:08.348403 23768 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:08.423533 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:08.410564 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.424106 23768 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.425172 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:08.417991 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 43845.6us
I20260709 13:07:08.418982 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:08.346803 23596 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.420310 23633 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:08.427839 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.419130 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:08.434260 21494 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:08.426189 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.346190 23807 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:08.346980 23587 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.429072 21634 pending_rounds.cc:85] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 1
I20260709 13:07:08.434312 21643 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:08.428628 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:08.379436 23609 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.436681 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.435788 21561 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:08.435205 21634 pending_rounds.cc:107] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:07:08.441483 21634 raft_consensus.cc:2889] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.436937 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.429260 23505 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:08.438063 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.415361 23763 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:07:08.443300 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.439908 23609 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.451416 23609 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.457468 21563 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:08.449909 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.462766 21635 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:08.462446 23807 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.464043 21635 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:08.467885 23801 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:07:08.469306 23550 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:08.472112 23642 raft_consensus.cc:993] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:07:08.478852 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.493089 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.494060 21494 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
W20260709 13:07:08.497920 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.445075 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.500578 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.500962 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.502141 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.503491 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.469210 23737 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:08.521173 23787 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.523649 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.516813 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.438956 23331 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.475252 23799 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:08.476215 23505 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.527221 22247 raft_consensus.cc:2368] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7.
I20260709 13:07:08.527181 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.426124 23676 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.538321 22246 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 5: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:08.536852 21492 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:08.511773 23827 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.516019 23642 raft_consensus.cc:1081] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:07:08.547843 21494 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:08.542074 23799 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:08.556298 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 145823us
I20260709 13:07:08.549449 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.559939 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.561115 22930 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:08.561592 22930 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.561968 22930 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.539031 23662 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.578755 22930 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.548148 23486 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:08.614969 22930 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:08.545475 23827 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.558670 23757 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:08.649828 21569 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:08.600063 23763 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:08.652014 21493 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:08.660249 21487 raft_consensus.cc:2410] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:08.652029 23793 consensus_meta.cc:287] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.005s
I20260709 13:07:08.708894 23763 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.722003 23662 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:08.725453 23587 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.782833 23505 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:08.788618 23609 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.790952 23596 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.670923 23793 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:08.792024 21491 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:08.819741 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 270362us
I20260709 13:07:08.721594 23763 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:08.873890 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51559.8us
I20260709 13:07:08.871021 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:08.872298 23755 raft_consensus.cc:1064] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:07:08.882385 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:08.883095 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 323236us
I20260709 13:07:08.883944 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.885296 23505 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:08.887219 23676 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.888855 23793 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:08.704492 23827 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:08.891319 22238 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 5: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:08.891465 23486 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:08.891407 23662 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:08.894979 23737 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:08.895582 23596 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:08.895540 23737 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.895963 23763 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:08.897043 23609 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:08.897480 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.898088 23746 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.898505 23814 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:08.898620 23746 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.899351 23814 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:08.900933 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:08.901117 23746 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:08.901862 23550 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.901983 23814 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:08.917250 21492 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:08.917084 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:08.920166 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.893817 23587 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:08.902383 23550 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:08.970367 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 44598.9us
I20260709 13:07:08.966054 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.873211 23787 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:08.902736 23814 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.980675 21562 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.981712 21567 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:08.982695 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:08.989880 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:08.991019 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:08.993465 21567 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:08.994817 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:08.995128 21562 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:08.966135 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 46092.6us
I20260709 13:07:08.986735 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.997804 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.934381 23746 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.000288 21492 raft_consensus.cc:2410] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:09.000604 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:09.005838 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:08.970499 23537 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:09.001693 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.003132 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:08.967381 23681 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:09.001549 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.016700 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:08.883745 23755 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.023156 23763 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.027158 23763 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:09.027570 23763 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.015677 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:08.988657 22240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 337) took 1404 ms. Trace:
I20260709 13:07:09.023566 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:09.024724 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 147445us
I20260709 13:07:09.005625 23609 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.003214 23768 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:09.042171 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:09.042461 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 144558us
I20260709 13:07:09.035399 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.038502 21561 raft_consensus.cc:2410] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:09.040132 21638 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.012084 23681 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:09.034403 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.044278 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:08.999254 23814 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.049335 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.049979 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.053267 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.053931 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.056491 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.057351 21492 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:09.039619 23689 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.065788 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.039999 23609 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:09.068976 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.071446 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.072142 21492 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:09.072685 21638 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:09.055405 23660 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:09.047510 23681 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.067229 23806 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.054859 23793 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.059974 23676 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.055900 23537 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.082257 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.084043 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:09.086100 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.074342 23609 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.046232 23768 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.092099 21490 raft_consensus.cc:2410] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:09.088754 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.092957 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.107827 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:09.126608 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:09.089927 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.109728 23763 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.133607 23763 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:09.037966 22240 rpcz_store.cc:276] 0709 13:07:07.571688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.571804 (+   116us) service_pool.cc:224] Handling call
0709 13:07:07.639094 (+ 67290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.098114 (+459020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.106924 (+  8810us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.166400 (+ 59476us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.427063 (+260663us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:08.789244 (+362181us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.873457 (+ 84213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.903166 (+ 29709us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.933804 (+ 30638us) raft_consensus.cc:1685] finished
0709 13:07:08.933854 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.976089 (+ 42235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47534,"prepare.queue_time_us":585686,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":7872,"raft.queue_time_us":367604,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":5054,"thread_start_us":867332,"threads_started":3,"wal-append.queue_time_us":265606}
I20260709 13:07:09.112659 21562 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:07:09.136188 23837 log.cc:927] Time spent T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:07:09.087253 23793 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:07:09.147195 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 89345.2us
I20260709 13:07:09.157933 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.163473 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.165865 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.168464 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.170744 21642 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.171310 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.171619 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.172328 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.173082 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.173450 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.174347 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.179052 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.179854 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.179215 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.181802 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.182528 21640 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:09.174125 21638 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:09.182403 21635 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:09.183456 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:09.183974 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:09.173702 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:09.193929 23846 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:07:09.199707 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.201766 22247 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 4 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:09.204294 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.195051 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:09.159193 23793 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.206696 23768 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.182432 23807 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:09.208127 23814 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.210420 23505 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:09.218250 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.215101 23587 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.158506 23828 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
W20260709 13:07:09.215247 23840 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:07:09.218950 22241 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 4 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:09.301573 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:09.302742 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:09.221153 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:09.308145 21637 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.216912 23145 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:09.222649 21642 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:09.311437 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 111599us
I20260709 13:07:09.224632 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:09.226186 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1165) took 1099 ms. Trace:
I20260709 13:07:09.226617 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.220360 21606 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.218923 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:09.232306 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:09.312657 21638 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:09.312922 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.313544 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:09.313820 21638 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:09.235587 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.237087 23600 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:09.240782 23737 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.242892 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:09.244273 21457 connection.cc:256] RPC call timeout handler was delayed by -1.6510069160000285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 13:07:09.321779 21457 connection.cc:256] RPC call timeout handler was delayed by -1.3945069160000685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 13:07:09.322142 21457 connection.cc:256] RPC call timeout handler was delayed by -1.3117069160000483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:07:09.322431 21457 connection.cc:256] RPC call timeout handler was delayed by -1.2415069160000485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
I20260709 13:07:09.322973 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:09.245677 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.200131 23827 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:09.280594 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.324185 21492 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:09.220494 23661 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.307082 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.309676 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.311707 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:09.223649 21635 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:09.236867 23790 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:09.314530 21568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1622) took 1758 ms (client timeout 1659 ms). Trace:
I20260709 13:07:09.315034 21638 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:09.329106 21568 rpcz_store.cc:269] 0709 13:07:07.555642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.557029 (+  1387us) service_pool.cc:224] Handling call
0709 13:07:09.235435 (+1678406us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:09.314462 (+ 79027us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6024448}
I20260709 13:07:09.312328 21488 rpcz_store.cc:276] 0709 13:07:08.130420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.130550 (+   130us) service_pool.cc:224] Handling call
0709 13:07:08.130919 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.220827 (+ 89908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.225943 (+1005116us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b54000b7054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:09.226125 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191803264}
W20260709 13:07:09.317879 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 97617.1us
I20260709 13:07:09.302982 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:09.328501 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:09.329579 21637 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:09.330922 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.335659 21635 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.337038 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:09.337703 22210 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.534s (SENT)
I20260709 13:07:09.338130 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.272119 23768 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:09.332991 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.342368 21642 raft_consensus.cc:2368] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7.
I20260709 13:07:09.332947 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:09.334723 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:09.311456 23846 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.330989 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.337925 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.347069 21638 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 5: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:09.347342 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.351039 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.352509 21487 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:09.353080 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.353516 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.354242 21487 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:09.355585 21488 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.348270 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:09.348274 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.361136 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:09.325632 23587 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.246464 23609 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:09.364064 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.335698 23827 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.312367 23811 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:07:09.375528 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:09.375968 23858 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.376924 23827 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:09.371241 21635 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:09.369925 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:09.372695 21642 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:09.375041 23661 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:09.376735 23858 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:09.365093 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.339636 23660 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.378250 23647 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:09.326882 23145 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:09.316016 23789 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:09.360014 21638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58388
I20260709 13:07:09.446502 21638 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:09.446939 21638 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.390455 23737 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.328991 23790 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:09.451005 23737 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:09.451499 23737 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.451946 23790 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.453352 23790 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:09.387293 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.358033 21637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a85b464a0e924904be2840142de89c0d"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58388
I20260709 13:07:09.454804 21637 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:07:09.455034 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 67827.1us
I20260709 13:07:09.455586 23596 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.455849 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.456579 23596 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.457048 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.457840 23596 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.458318 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.395295 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.459700 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.349953 23846 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:09.397198 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.376811 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:09.461632 23846 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.391968 23660 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.463061 23660 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.463152 23846 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.403443 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1170) took 1184 ms. Trace:
I20260709 13:07:09.400418 23661 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:09.467458 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.468303 23746 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.468766 23596 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.468458 23661 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.399384 23828 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:09.470649 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:09.471060 23828 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:09.471664 23828 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.471988 23746 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.473750 21638 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.387084 21488 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:09.475696 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.476408 21488 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.478302 23737 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.326996 23600 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.341461 23803 consensus_queue.cc:1059] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:09.479908 23803 raft_consensus.cc:3055] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.480252 23803 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:09.481051 23803 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.372789 23854 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.481953 23486 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.482190 23854 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:09.382884 23805 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.336974 23681 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.466988 21493 rpcz_store.cc:276] 0709 13:07:08.219093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.220943 (+  1850us) service_pool.cc:224] Handling call
0709 13:07:08.222120 (+  1177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.656626 (+434506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.403093 (+746467us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b540013bad4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:09.403347 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988117248}
I20260709 13:07:09.484737 23681 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:09.430958 23550 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.436044 23609 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:09.436800 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.486402 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.486727 21638 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.486984 21485 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.360338 23768 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.455168 21637 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.393282 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.460772 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.463106 23757 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.481367 23600 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:09.396652 22239 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:09.484587 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.498402 21493 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:09.439092 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 78071.2us
I20260709 13:07:09.499747 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:09.438755 23676 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.502915 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.482704 23854 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.499764 23737 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:09.444536 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 106850us
I20260709 13:07:09.507745 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.508424 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.508957 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.547178 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.547572 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.547885 21567 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.510171 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.547261 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.548698 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:09.548874 22210 leader_election.cc:336] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Timed out: RequestConsensusVote RPC to 127.19.231.131:41367 timed out after 1.649s (SENT)
I20260709 13:07:09.549157 21560 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:09.549333 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.549974 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.550541 21560 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
W20260709 13:07:09.550879 22210 leader_election.cc:336] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.714s (SENT)
I20260709 13:07:09.551275 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.552000 21564 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:09.550462 23805 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:09.552728 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.551059 21637 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.551692 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.552731 21492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:07:09.559863 21485 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
W20260709 13:07:09.555802 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 56389.1us
I20260709 13:07:09.509236 21488 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:09.560214 21492 raft_consensus.cc:606] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:09.555420 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 50463.7us
I20260709 13:07:09.561688 21492 raft_consensus.cc:614] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:09.559341 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.553381 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.563117 21561 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.563982 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.564391 21485 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:09.559427 21637 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.559293 21569 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.565182 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1549) took 1146 ms. Trace:
I20260709 13:07:09.564421 21488 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.565524 21485 rpcz_store.cc:276] 0709 13:07:08.419102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.563978 (+1144876us) service_pool.cc:224] Handling call
0709 13:07:09.564278 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.564963 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.565134 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61952}
I20260709 13:07:09.565867 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.566640 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 214) took 1100 ms. Trace:
I20260709 13:07:09.567513 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:09.568941 23863 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:09.567055 21488 rpcz_store.cc:276] 0709 13:07:08.466054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.563969 (+1097915us) service_pool.cc:224] Handling call
0709 13:07:09.564246 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.566412 (+  2166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.566589 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.572522 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 215) took 1106 ms. Trace:
I20260709 13:07:09.572892 21488 rpcz_store.cc:276] 0709 13:07:08.466396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.571802 (+1105406us) service_pool.cc:224] Handling call
0709 13:07:09.572079 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.572236 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.572261 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.572298 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:09.572330 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.572378 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.572474 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.573444 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:09.574563 21561 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:09.574707 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 227) took 1051 ms. Trace:
I20260709 13:07:09.567245 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.575196 21488 rpcz_store.cc:276] 0709 13:07:08.523103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.573949 (+1050846us) service_pool.cc:224] Handling call
0709 13:07:09.574220 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.574412 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.574437 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.574474 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:09.574507 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.574563 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.574660 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.559204 21567 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:09.580977 21638 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:09.581729 21642 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:09.582641 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:09.584084 21635 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:09.587311 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:09.588253 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.554136 23800 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:09.589164 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.505601 23793 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.556835 23505 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:09.502216 23145 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.615737 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.612001 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.584398 23596 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.584499 23647 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.583884 23757 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.616717 21492 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:09.623531 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.624006 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.624344 21492 raft_consensus.cc:2410] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:09.624616 21561 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.624938 21561 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:09.586753 23846 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:07:09.625665 21561 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:09.629166 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.627259 21492 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:09.629783 21492 pending_rounds.cc:85] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 2
I20260709 13:07:09.626585 21561 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.630072 21492 pending_rounds.cc:107] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:09.622210 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.630565 21492 raft_consensus.cc:2889] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.631778 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.643692 21493 raft_consensus.cc:2410] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:09.644701 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 226) took 1121 ms. Trace:
I20260709 13:07:09.645025 21493 rpcz_store.cc:276] 0709 13:07:08.522822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.484220 (+961398us) service_pool.cc:224] Handling call
0709 13:07:09.644643 (+160423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.626340 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:09.628180 23768 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:09.651134 22243 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.655841 21561 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:09.630362 23647 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:09.663493 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.665402 21560 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.665815 21560 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:09.662482 23793 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:09.668823 23647 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.662360 23854 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.676715 23828 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.680687 22247 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.682669 23828 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:09.666700 21560 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.714428 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1569) took 1140 ms. Trace:
I20260709 13:07:09.791579 21485 rpcz_store.cc:276] 0709 13:07:08.573743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.585767 (+1012024us) service_pool.cc:224] Handling call
0709 13:07:09.586066 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.586300 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:09.612178 (+ 25878us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.713432 (+101254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.713543 (+   111us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.713680 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.713806 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.714127 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47020,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"thread_start_us":100460,"threads_started":1,"wal-append.queue_time_us":57472}
I20260709 13:07:09.796370 23660 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.769829 21639 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:09.720422 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1566) took 1174 ms. Trace:
I20260709 13:07:09.794427 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.762008 22244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 318) took 1391 ms. Trace:
W20260709 13:07:09.727960 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.745415 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1545) took 1327 ms. Trace:
W20260709 13:07:09.769553 21643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 196) took 2214 ms (client timeout 1649 ms). Trace:
W20260709 13:07:09.725379 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.722244 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.724010 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.727125 21487 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
W20260709 13:07:09.763125 22246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 309) took 1789 ms (client timeout 1873 ms). Trace:
I20260709 13:07:09.760396 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:09.753166 21494 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 217) took 1270 ms (client timeout 1534 ms). Trace:
I20260709 13:07:09.733116 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.781844 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:09.810400 21494 rpcz_store.cc:269] 0709 13:07:08.482294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.495602 (+ 13308us) service_pool.cc:224] Handling call
0709 13:07:09.752682 (+1257080us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b540008aa54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:09.752938 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106872192}
I20260709 13:07:09.731660 21560 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.764209 22241 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 5 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:09.811626 21486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1159) took 1844 ms (client timeout 2086 ms). Trace:
W20260709 13:07:09.808576 21643 rpcz_store.cc:269] 0709 13:07:07.554867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.555087 (+   220us) service_pool.cc:224] Handling call
0709 13:07:09.768933 (+2213846us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54002e1654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:09.769238 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2002597248}
W20260709 13:07:09.812232 21486 rpcz_store.cc:269] 0709 13:07:07.967569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.967746 (+   177us) service_pool.cc:224] Handling call
0709 13:07:09.759949 (+1792203us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5800011198. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:09.811552 (+ 51603us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52988288}
I20260709 13:07:09.812863 23796 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.813553 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.813789 23796 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.814337 21486 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.759526 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:09.805024 22244 rpcz_store.cc:276] 0709 13:07:08.370435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.370560 (+   125us) service_pool.cc:224] Handling call
0709 13:07:09.761414 (+1390854us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b54006c02d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:09.761660 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46730624}
I20260709 13:07:09.759826 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.764353 22240 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:09.763250 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:09.817962 21561 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
W20260709 13:07:09.782624 22242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 312) took 1805 ms (client timeout 1586 ms). Trace:
I20260709 13:07:09.726948 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:09.819289 21489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 219) took 1298 ms (client timeout 1714 ms). Trace:
I20260709 13:07:09.819973 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.808461 21491 rpcz_store.cc:276] 0709 13:07:08.417732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.422740 (+  5008us) service_pool.cc:224] Handling call
0709 13:07:08.791810 (+369070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.801577 (+  9767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.744844 (+943267us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54003f9150. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:09.745163 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847789312}
I20260709 13:07:09.820263 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:09.810148 22246 rpcz_store.cc:269] 0709 13:07:07.973346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.973511 (+   165us) service_pool.cc:224] Handling call
0709 13:07:09.762656 (+1789145us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b540045fbd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:09.762932 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295915392}
I20260709 13:07:09.821738 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.823033 21485 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.782636 23551 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:07:09.823421 23796 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:09.823890 23863 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.859243 23863 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.862170 23863 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:09.826234 22930 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:09.779811 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44868.9us
I20260709 13:07:09.687215 23854 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:09.831584 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 313) took 1854 ms. Trace:
W20260709 13:07:09.837776 22242 rpcz_store.cc:269] 0709 13:07:07.976659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.984580 (+  7921us) service_pool.cc:224] Handling call
0709 13:07:09.782088 (+1797508us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54003c00d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:09.782355 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107249408}
W20260709 13:07:09.832835 21489 rpcz_store.cc:269] 0709 13:07:08.520745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.759222 (+1238477us) service_pool.cc:224] Handling call
0709 13:07:09.819195 (+ 59973us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.846690 21492 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:09.847046 21494 raft_consensus.cc:2410] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:07:09.848279 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 125891us
I20260709 13:07:09.848942 23796 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.808853 23793 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:09.852455 21568 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.853157 21563 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:09.853971 21566 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:09.684731 23647 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.855931 21565 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:09.858439 23537 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:09.864926 21486 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:09.867568 21567 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.802850 21488 rpcz_store.cc:276] 0709 13:07:08.546331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.586443 (+1040112us) service_pool.cc:224] Handling call
0709 13:07:09.587097 (+   654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.587275 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:09.631799 (+ 44524us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.719653 (+ 87854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.719766 (+   113us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:09.719895 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.720006 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.720221 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24600,"prepare.queue_time_us":46114,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":678,"raft.queue_time_us":73816,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":162,"thread_start_us":87172,"threads_started":1,"wal-append.queue_time_us":49897}
I20260709 13:07:09.854629 21493 raft_consensus.cc:2368] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6.
I20260709 13:07:09.863744 22930 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:09.873001 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.879710 23503 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:09.882437 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.883857 23486 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.883733 23537 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.886204 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.887152 23793 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.890316 23793 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.890386 23768 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:09.927459 21567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:09.928414 21567 raft_consensus.cc:606] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.928758 23331 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.928385 23768 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:09.931674 23768 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.896469 23647 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.933799 21486 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:09.898667 23820 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.900111 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.935045 23820 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:09.935324 21489 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.936561 23820 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.937319 23770 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:09.868266 22238 rpcz_store.cc:276] 0709 13:07:07.977069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.984630 (+  7561us) service_pool.cc:224] Handling call
0709 13:07:09.831096 (+1846466us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54006dc754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:09.831367 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1860370816}
I20260709 13:07:09.938689 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:09.939219 23799 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.939702 23799 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:09.937970 23820 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.901733 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:09.940999 23799 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.942328 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.944041 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.944573 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.945307 21561 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
W20260709 13:07:09.902187 23823 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.437s	user 0.015s	sys 0.000s
W20260709 13:07:09.903815 23845 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.844s	user 0.000s	sys 0.002s
W20260709 13:07:09.912410 23856 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.592s	user 0.002s	sys 0.000s
I20260709 13:07:09.914013 22930 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:09.914767 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:09.916591 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.916869 21488 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:09.920071 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 207) took 1755 ms. Trace:
I20260709 13:07:09.921265 21565 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:09.923902 23660 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:09.925010 23537 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:09.925385 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:09.926313 23661 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:09.944108 21567 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:09.942642 23799 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.973723 21560 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:09.974196 21485 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:09.975790 21490 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.961092 21636 rpcz_store.cc:276] 0709 13:07:08.164211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.164351 (+   140us) service_pool.cc:224] Handling call
0709 13:07:08.167186 (+  2835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.360625 (+193439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.919578 (+1558953us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540021af54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:09.919857 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438955264}
I20260709 13:07:09.978678 21568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:09.982133 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:09.983847 21485 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.992566 21568 raft_consensus.cc:606] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:09.972968 23770 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.999131 21568 raft_consensus.cc:614] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:10.014076 21491 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
W20260709 13:07:10.021166 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 135107us
I20260709 13:07:10.021534 22930 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.020277 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:09.997157 23793 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:10.025745 21566 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:10.031701 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 115277us
I20260709 13:07:09.982929 23661 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.033052 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.033958 23537 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:10.041854 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.041942 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 103490us
I20260709 13:07:10.044823 21566 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.047161 23540 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:10.048236 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.053452 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:10.055609 21565 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.057466 21569 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.060173 21561 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:10.059191 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:10.064270 23537 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:10.064806 23537 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:10.066423 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.058495 22212 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:10.069741 21489 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:10.065919 23537 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.076742 21563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:10.039084 23793 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:10.079020 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:10.077409 21563 raft_consensus.cc:606] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:07:10.080718 21563 raft_consensus.cc:614] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:10.083056 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1220) took 1778 ms. Trace:
I20260709 13:07:10.083128 23770 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:10.084337 23787 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.085142 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:10.089996 21569 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.092666 23793 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.095292 23677 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:10.095701 23677 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:10.096889 23677 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.098418 23677 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.083618 21634 rpcz_store.cc:276] 0709 13:07:08.304304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.380638 (+ 76334us) service_pool.cc:224] Handling call
0709 13:07:08.428870 (+ 48232us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:08.571393 (+142523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.571431 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:08.594456 (+ 23025us) log.cc:844] Serialized 52 byte log entry
0709 13:07:08.894823 (+300367us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:08.894866 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.896621 (+  1755us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.903006 (+1006385us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:10.066245 (+163239us) raft_consensus.cc:1685] finished
0709 13:07:10.066265 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.082881 (+ 16616us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":422212,"raft.queue_time_us":153579,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":11959,"spinlock_wait_cycles":10720512,"thread_start_us":299890,"threads_started":1,"wal-append.queue_time_us":438151}
I20260709 13:07:10.101498 23660 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:10.104219 23660 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.104636 23660 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:07:10.108196 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.108357 23873 log.cc:927] Time spent T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.494s	user 0.002s	sys 0.000s
W20260709 13:07:10.109302 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 71606.5us
W20260709 13:07:10.110364 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.110674 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:10.111497 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1224) took 1804 ms. Trace:
I20260709 13:07:10.111711 23638 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:10.112241 23638 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:10.112737 23638 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.114409 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.111951 21639 rpcz_store.cc:276] 0709 13:07:08.306638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.432525 (+125887us) service_pool.cc:224] Handling call
0709 13:07:09.769218 (+1336693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.809409 (+ 40191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.111267 (+301858us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002e1650. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:10.111437 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2788584192}
I20260709 13:07:10.112195 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.120391 21560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:10.121129 21560 raft_consensus.cc:606] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.121476 21560 raft_consensus.cc:614] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:10.131423 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:10.132171 23602 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:10.133448 23602 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.133517 23787 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.133894 23602 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:10.116039 23863 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:07:10.135133 23790 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.147228 23800 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.145097 23602 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.148696 21567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:10.149413 21567 raft_consensus.cc:606] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.150735 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.135231 23661 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:10.163936 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:10.169663 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:10.155757 23800 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.154587 23858 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:10.173230 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55832.9us
I20260709 13:07:10.179296 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:10.140915 23660 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.174127 23602 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.179754 23863 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:10.194311 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 70458.3us
I20260709 13:07:10.197247 23770 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:10.203459 22930 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:10.203997 22930 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:10.204972 22930 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.206271 22930 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.216928 23689 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:10.217548 21532 leader_election.cc:400] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7.
I20260709 13:07:10.219587 23689 raft_consensus.cc:993] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:07:10.220090 23689 raft_consensus.cc:1081] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:07:10.220506 23812 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:10.220942 23808 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:10.221158 23812 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.222244 23808 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:10.223235 23806 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.223628 23806 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:07:10.220976 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.194092 23853 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:07:10.224751 23806 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.226279 23806 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.226320 23853 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:10.198658 23750 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.192443 23798 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:07:10.240000 23770 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:10.244156 23770 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.244616 23770 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:10.244925 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.244925 23661 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:10.246222 23661 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.246591 23661 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:10.246753 23853 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.247679 23661 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.248211 23853 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.249907 23853 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.249668 23661 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.240948 23750 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:10.238524 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 59306.7us
I20260709 13:07:10.251884 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.251770 23750 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.190972 23863 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.241950 23803 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.253276 23750 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.253131 23863 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.245751 23770 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.281678 21569 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:10.283231 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:10.284279 23808 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:10.284878 23808 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:10.285903 23808 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.287168 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:10.287798 22245 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:10.290310 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:10.291424 23230 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.291956 23230 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:10.292424 23230 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.200054 23858 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:10.250862 23888 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:10.280947 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:10.238386 23812 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:10.312041 22930 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.273725 23798 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.311450 23858 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:10.317047 23858 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:10.318835 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 67093.9us
W20260709 13:07:10.311411 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 55459us
I20260709 13:07:10.321260 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:10.345199 22930 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.359674 22930 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:10.369067 21639 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:10.371562 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.374856 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.327687 23638 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:10.377701 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46504.9us
I20260709 13:07:10.367261 23770 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.383008 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:10.383535 21489 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.385006 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:10.387336 21488 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:10.387058 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.357178 23230 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.389272 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:10.393822 21492 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:07:10.393810 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.395681 21640 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:10.394378 21492 pending_rounds.cc:85] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 5
I20260709 13:07:10.397083 21492 pending_rounds.cc:107] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:10.397368 21492 raft_consensus.cc:2889] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:10.400658 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 66075.9us
W20260709 13:07:10.402057 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.402711 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:10.406555 23230 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:10.407220 23230 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.407701 23230 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.409521 23230 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:10.417416 21639 raft_consensus.cc:2393] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:10.422967 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:10.429754 21642 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:10.430637 23798 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:10.437760 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58096.3us
W20260709 13:07:10.441967 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46739.9us
W20260709 13:07:10.469722 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.487963 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.444590 23660 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.495736 23537 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:10.498135 23537 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:10.500150 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:10.501061 21640 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 5: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:10.502609 23537 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:10.503087 23537 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.505411 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:10.507473 21488 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:10.508628 23593 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:10.505380 23537 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.509030 21457 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.509251 23593 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.510941 23677 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:10.511253 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:10.511901 23537 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.512648 21490 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:10.510516 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:10.524982 23331 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:07:10.527984 23798 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.528416 23798 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.533478 21489 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:10.538133 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.535161 23798 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.546381 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:10.541764 23793 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.510480 23593 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.535542 23806 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:07:10.554520 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:10.555455 22243 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:10.548870 21391 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 5, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 5 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:10.535149 23858 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.554493 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:07:10.559100 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.563541 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:10.565651 23661 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:10.567778 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.567891 23863 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.569451 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.571048 22930 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:10.575688 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.576140 23863 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:10.576764 23863 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.572358 23677 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:07:10.615372 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45985.5us
I20260709 13:07:10.622746 23858 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:10.636106 21493 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:10.638365 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0957377000000861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 13:07:10.639024 21493 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:10.640096 21490 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:10.649289 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.660445 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.664382 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:10.668638 21634 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:10.672803 22245 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:10.674688 21642 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:10.674949 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:10.678804 21637 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:10.688951 22244 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:10.692611 21640 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.694131 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:10.695554 21638 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:10.699458 23756 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:10.674674 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:10.711769 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.717346 23790 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:10.717643 21638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58388
I20260709 13:07:10.718142 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.718240 23790 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:10.718739 23661 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.719223 23661 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.719584 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:10.720943 23859 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.721717 23859 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.719599 23790 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.722431 23859 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:10.722945 23859 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.719605 23661 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.726691 21636 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:10.727013 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:10.724058 23859 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.728173 21492 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:10.729063 23756 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:10.732254 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.733276 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:10.724215 23540 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:07:10.734103 22238 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:10.749689 23540 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:10.750149 23540 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.751173 23540 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.751219 23798 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.752480 23540 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.753428 23750 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.753991 23750 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.754441 23750 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.755447 23865 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:10.756747 23153 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:10.757757 23153 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:10.758132 23153 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.754652 23145 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:07:10.759454 23145 consensus_queue.cc:1243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:10.760027 23145 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.760469 23145 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.761871 23145 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.759029 23153 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.766520 23153 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:10.770177 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 76128.1us
I20260709 13:07:10.771345 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:10.773541 23677 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:10.775142 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:10.775787 23770 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:10.776284 23770 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:10.777377 23770 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:10.776552 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.778439 23906 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:10.779421 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.780372 23230 consensus_queue.cc:1059] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.781512 23587 raft_consensus.cc:3055] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:10.781888 23587 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:10.782721 23587 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.784950 23800 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:10.789247 22238 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:10.789794 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:10.763697 22930 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:10.774959 23677 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.792230 22930 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:10.795791 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:10.799082 21567 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.802147 23737 raft_consensus.cc:2764] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:10.802194 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:10.804411 21565 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.804786 21565 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.804941 21639 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:07:10.803244 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.805533 21565 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:10.806481 21565 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:10.807245 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.807454 23770 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:10.807714 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:10.790726 23145 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.808398 21636 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:10.807169 22930 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:10.816090 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 99111.2us
I20260709 13:07:10.821914 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:10.746282 23756 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.826427 22930 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.827922 21567 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
W20260709 13:07:10.830633 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.813309 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:10.807097 23638 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:10.847698 23756 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.854632 23793 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.861753 23661 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.867558 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:10.885977 21565 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 13:07:10.888268 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 86499.6us
W20260709 13:07:10.890534 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 95982.1us
I20260709 13:07:10.889691 21565 pending_rounds.cc:85] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 7
I20260709 13:07:10.894284 21565 pending_rounds.cc:107] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:10.894583 21565 raft_consensus.cc:2889] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:10.897199 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 141445us
I20260709 13:07:10.904111 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:10.904961 21639 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:10.905968 23798 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:10.925209 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:10.933528 22930 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:10.934520 22930 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:10.927352 23540 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:07:10.940871 23916 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.941360 23916 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.942479 23916 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.945083 23916 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.945861 23906 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.946820 22243 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:10.951004 23145 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:10.952451 23540 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.952813 23540 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:10.953614 23540 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.942615 23750 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.954942 23540 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.955056 21634 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.957027 23750 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:10.959661 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:10.960400 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:10.960511 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:10.970278 23793 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:10.961099 23926 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.971320 21637 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.962167 21635 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:10.963616 23661 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:10.963701 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:10.964982 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 59274.3us
W20260709 13:07:10.969310 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.979285 22930 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:10.982580 21565 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:10.982995 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 156665us
I20260709 13:07:10.978755 21637 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:10.991608 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:10.991523 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:10.992244 23677 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:10.999380 21638 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:10.999871 21638 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.000309 23593 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:07:11.002610 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:11.003017 23230 raft_consensus.cc:2764] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:11.000154 23808 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:07:11.003506 23927 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.004917 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:10.960433 23587 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.013248 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:11.010602 21638 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.023142 21493 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:11.025784 23806 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:11.040657 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.043174 21391 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 4, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 4 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:11.044345 21606 leader_election.cc:400] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6.
I20260709 13:07:11.044646 23927 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:11.045737 21389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 244) took 12914 ms (client timeout 15000 ms). Trace:
I20260709 13:07:11.045115 21391 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 4, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 4 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:07:11.046363 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:11.047336 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 51120us
I20260709 13:07:11.047809 23661 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:11.048377 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:11.048415 23661 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:11.049808 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:11.050150 23661 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.044267 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:11.045539 23927 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:11.053629 23858 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.054035 23750 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:11.063436 21561 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.061787 21391 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 5, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 5 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:11.081527 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:11.069223 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:11.127702 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 62368.8us
I20260709 13:07:11.066382 23153 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:11.108206 23926 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:11.132539 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 70434.8us
I20260709 13:07:11.139300 21560 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:11.136008 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:11.143347 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 99201.4us
I20260709 13:07:11.139700 21606 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:11.146016 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.146653 21569 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:11.132390 21391 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 4, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 4 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.150676 21563 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:11.128242 23677 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.124724 23750 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:11.150640 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:11.132575 23905 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:11.158704 21638 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:11.138947 23906 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.127836 23793 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:11.177529 23921 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:11.178009 23921 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:11.168242 23926 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:11.180023 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:11.182165 21391 catalog_manager.cc:5697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.183882 23230 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:11.184314 21391 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 4, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 4 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:11.187230 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:11.187384 23750 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.191715 23927 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:11.191519 23793 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.192382 23927 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:11.152186 23922 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:07:11.129943 23770 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:11.167963 23153 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:11.174680 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 105548us
I20260709 13:07:11.175194 21566 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:11.207132 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 54106.6us
I20260709 13:07:11.179729 23926 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.210847 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:11.211251 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.144202 23858 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.167199 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:11.193452 23927 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:11.214303 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.204944 21567 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:07:11.186656 21532 leader_election.cc:400] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7.
I20260709 13:07:11.214474 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.217589 21560 raft_consensus.cc:2376] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5. Re-sending same reply.
I20260709 13:07:11.234222 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:11.239068 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:11.194628 23793 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:11.184350 23230 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:11.233690 21391 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.248066 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:11.248344 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 61828.2us
W20260709 13:07:11.046209 21389 rpcz_store.cc:269] 0709 13:06:58.131386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.131540 (+   154us) service_pool.cc:224] Handling call
0709 13:07:11.045473 (+12913933us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:07.536261 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:07.539464 (+  3203us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:07.539502 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:07.539522 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:07.541114 (+  1592us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:07.541179 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:07.541209 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:07:07.542379 (+  1170us) tablet.cc:701] Row locks acquired
0709 13:07:07.542398 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:07:07.542552 (+   154us) write_op.cc:270] Start()
0709 13:07:07.542672 (+   120us) write_op.cc:276] Timestamp: P: 1783602427542500 usec, L: 0
0709 13:07:07.542695 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:07.545284 (+  2589us) log.cc:844] Serialized 6000 byte log entry
0709 13:07:08.643070 (+1097786us) op_driver.cc:464] REPLICATION: finished
0709 13:07:09.011504 (+368434us) write_op.cc:301] APPLY: starting
0709 13:07:09.011608 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:09.019482 (+  7874us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:09.019683 (+   201us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:09.211868 (+192185us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:09.212167 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:07:09.212217 (+    50us) write_op.cc:312] APPLY: finished
0709 13:07:09.212566 (+   349us) log.cc:844] Serialized 107 byte log entry
0709 13:07:09.212753 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:09.212930 (+   177us) write_op.cc:454] Released schema lock
0709 13:07:09.212992 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:09.213348 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:09.213378 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1019730,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":357083,"apply.run_cpu_time_us":5411,"apply.run_wall_time_us":201839,"num_ops":15,"prepare.queue_time_us":228263,"prepare.run_cpu_time_us":52027,"prepare.run_wall_time_us":474152,"raft.queue_time_us":217247,"raft.run_cpu_time_us":16509,"raft.run_wall_time_us":404024,"replication_time_us":1056955,"thread_start_us":1101510,"threads_started":4,"wal-append.queue_time_us":564392,"wal-append.run_cpu_time_us":42894,"wal-append.run_wall_time_us":2101502}]]}
I20260709 13:07:11.219413 23661 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:11.207854 23906 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.251945 23230 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.217674 23905 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:11.338986 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.417831 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.388037 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 149458us
I20260709 13:07:11.392596 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.394098 23153 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.286742 23858 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:11.401746 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 101936us
W20260709 13:07:11.402405 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 144118us
I20260709 13:07:11.250353 23331 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:11.416472 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.401398 23929 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.164s	user 0.002s	sys 0.003s
I20260709 13:07:11.398031 21391 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.257117 23770 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:11.418455 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 205825us
I20260709 13:07:11.301669 23661 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.530325 23661 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:11.423964 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.532764 23931 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.167s	user 0.009s	sys 0.000s
I20260709 13:07:11.424722 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:11.429702 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:11.534396 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 109759us
I20260709 13:07:11.432693 21391 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.535187 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:11.536386 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:11.437223 23809 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.428458 23750 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.537042 23809 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.447197 23770 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:11.537602 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.538223 23770 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.538908 23770 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:11.430063 23737 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.539369 23809 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:11.539516 23919 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.442411 23921 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.539716 23737 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.540752 23921 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.541846 23737 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:11.419047 23806 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:11.543085 23806 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.458967 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:11.469588 22930 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.545027 22930 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.545707 23806 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.477680 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:11.547320 23853 raft_consensus.cc:2764] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:07:11.547502 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 81772.2us
I20260709 13:07:11.548413 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:11.549188 23853 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.549791 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:11.432808 23331 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.478909 23936 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.551234 23936 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:11.552793 23935 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:07:11.553437 23936 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:11.500761 23928 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:07:11.554209 22930 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.507293 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:11.555009 21634 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:11.490890 23905 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:11.515996 23934 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:07:11.556321 23331 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.535727 21391 catalog_manager.cc:5697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 3, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:11.568498 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 111337us
I20260709 13:07:11.504179 23906 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.471226 23790 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:11.553468 23540 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.556981 23941 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:11.557765 23853 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.559607 23677 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:11.560377 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.561447 21564 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:11.571051 23677 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.562013 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.572150 21568 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:11.562510 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.572925 21569 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:11.573127 23677 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:11.567011 23587 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.569516 23790 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.574029 21560 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.574030 23587 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.575913 21492 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:07:11.577108 23790 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:11.577656 23587 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:11.532711 23916 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.578727 23916 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.581283 23916 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:11.586732 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 50423.8us
I20260709 13:07:11.587859 23790 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:11.588671 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.589148 22930 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:11.589727 22930 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:11.590432 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.590531 22930 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.568320 23936 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:11.569862 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:11.569487 21391 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:11.470286 23858 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.592178 22930 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.592653 23858 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.569895 23941 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.561738 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.595156 21563 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:11.595237 23936 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:11.595727 23936 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:11.596213 23936 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.597360 21391 catalog_manager.cc:5697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 1 to 4, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 4 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:11.599411 23858 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:11.596424 23941 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:11.599921 23922 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.600695 23922 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.601069 23858 consensus_queue.cc:1059] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:11.602136 23677 raft_consensus.cc:3055] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:11.602531 23677 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:11.602733 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:11.603727 23858 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:11.603413 23677 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.603832 23737 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:11.604666 23677 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.605334 23587 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.604436 23737 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.606079 23587 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:11.607322 21391 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:07:11.612378 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.620608 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.621829 21569 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 6: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:11.623526 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:11.630386 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:11.636087 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.609298 21391 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.639489 22930 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:11.639810 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.640746 21569 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:11.638494 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:11.644393 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.644393 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:11.645365 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.527906 23230 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.643147 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:11.643848 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:11.643851 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.649581 22930 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:11.650233 22930 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.650563 21492 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:11.650610 22930 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.652067 21642 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:11.647964 21490 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.649648 21564 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:11.650040 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:11.654232 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.648239 21489 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:11.657250 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:11.658129 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:11.661255 21488 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:11.661988 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:11.657480 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.663513 21486 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:11.640961 23858 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:11.642159 23602 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:11.668880 21491 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:11.642441 23820 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:11.672197 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 62207.9us
I20260709 13:07:11.675237 21485 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:07:11.682307 23230 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:11.659119 23905 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:11.692883 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.693037 22930 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.698194 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:11.691326 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.617s (SENT) [suppressed 40 similar messages]
I20260709 13:07:11.674232 23602 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.674957 23820 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:11.696106 23853 raft_consensus.cc:2764] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:11.721941 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:11.726449 21494 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:11.727298 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 48242us
I20260709 13:07:11.728032 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:11.734884 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:11.735602 21487 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:11.736534 23916 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:11.737355 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:11.738633 23927 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:11.739099 23537 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.738976 23926 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:11.739379 23230 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.739563 23537 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:11.700263 23905 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:11.740322 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.704898 23770 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.740674 21608 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:11.747622 21492 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:11.699421 23922 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:11.760392 21489 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:11.761407 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:11.766064 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.760764 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:11.768199 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 115781us
I20260709 13:07:11.769189 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:11.721621 23602 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.721095 23919 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.770925 21493 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:11.769311 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.775344 21487 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:11.739866 23230 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:11.723407 23820 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.773173 22244 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:11.695394 23858 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.773567 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.774096 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:11.763758 23931 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:11.779047 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:11.780228 23943 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:11.781149 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:11.748188 23537 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.782378 23922 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.783252 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:11.784495 22240 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:11.739909 23926 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:07:11.784427 23153 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:11.786082 23953 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.786303 23737 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:11.746476 23916 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:11.789572 22930 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.768898 22245 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:11.796972 21490 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:11.797165 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:11.759987 23921 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:11.762151 23905 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.819291 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.848635 21494 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:11.814098 22246 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:11.825742 23956 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.853786 23921 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:11.858351 23956 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.828070 21492 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:11.859088 23921 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.860267 23921 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.861761 21492 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.861583 23537 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.828637 21485 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:11.863408 23946 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.770711 23770 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.863920 23946 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.844628 21563 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.865131 21489 raft_consensus.cc:2410] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:11.866051 21492 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:11.868233 23153 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.869604 21492 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:11.870265 23153 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.834681 23540 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.871425 21561 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.873159 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.874475 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.875067 21563 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:11.875280 23916 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:11.878196 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.832577 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 141198us
I20260709 13:07:11.843595 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:11.843590 23927 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:11.901677 23927 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:11.901945 23790 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.902392 23790 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:11.902765 23790 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.902699 23927 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:11.904038 23951 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:07:11.851369 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 54314.6us
I20260709 13:07:11.905369 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:11.852085 21490 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.907841 23540 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.908027 23957 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.908471 23957 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.908353 23540 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.908828 23957 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.833626 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:11.819962 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:11.844484 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 63412.1us
I20260709 13:07:11.913540 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:11.792887 23919 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.914760 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:11.916036 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:11.814834 23230 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.917084 23919 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.917742 21638 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:11.918903 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:11.919504 21637 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.924371 23737 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:11.924714 23661 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.925024 23737 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:11.925406 23661 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.925962 23737 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.870468 23858 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.929133 23941 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.917109 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:11.929725 23602 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.931191 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:11.932281 21642 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:11.947718 21634 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:11.933252 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:11.910550 23540 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.935860 23946 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:11.957880 21637 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:11.939386 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:11.943760 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.944829 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.945719 23926 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.948655 21638 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:11.935232 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:11.949942 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:11.965420 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.901703 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58194.8us
I20260709 13:07:11.967506 21457 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:11.856979 23945 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.971457 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:11.974215 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:11.976240 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:11.979367 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.981221 21568 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:11.982563 21635 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:07:11.983029 21635 pending_rounds.cc:85] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 2
I20260709 13:07:11.983282 21635 pending_rounds.cc:107] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:11.983505 21635 raft_consensus.cc:2889] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.983781 21635 pending_rounds.cc:107] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:11.982187 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:11.984053 21635 raft_consensus.cc:2889] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.984432 21637 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:11.987732 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:11.988721 22930 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:11.989178 22930 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:11.995263 22930 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:11.976970 23793 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.978936 23153 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.985581 23946 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.879913 23936 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.985257 23922 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.007002 22238 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:12.026330 23153 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.026454 23230 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.027251 23919 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:11.957791 23941 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:11.856761 23953 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.029800 23905 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.033010 23937 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:12.033785 21642 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:12.062176 23930 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:12.035115 21643 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:12.035403 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:12.035917 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.050380 23922 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:12.086524 21634 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:11.985414 23661 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:07:12.038195 21638 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:12.041996 23956 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.044037 23540 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.047322 23537 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:12.048399 23587 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:12.053483 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:11.977919 23926 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:12.117497 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82201.5us
I20260709 13:07:12.118764 21486 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.976476 23820 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.111070 21638 pending_rounds.cc:85] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 3
I20260709 13:07:12.120558 21638 pending_rounds.cc:107] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:12.120817 21638 raft_consensus.cc:2889] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.034143 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.036098 23602 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.058101 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.082137 23853 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.140403 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:12.141187 21642 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.140344 21637 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.146217 21641 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:07:12.085943 23812 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.092772 23922 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:12.157743 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 164256us
I20260709 13:07:12.120330 23956 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.165165 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.166007 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.067153 23957 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.173975 22930 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:12.174962 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:12.175583 21641 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.137128 23958 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.174697 22930 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.182050 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:12.183625 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 197558us
I20260709 13:07:12.183645 21640 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:12.182699 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.184837 21636 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:12.182940 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.129925 23540 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.172772 23677 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.145664 23853 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.160380 23537 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:12.165567 23812 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.181411 23331 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.166458 23790 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.211743 22242 raft_consensus.cc:2393] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 4: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:12.231922 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:12.179230 23956 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.227743 23921 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:12.347019 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.240064 23955 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.358263 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 126434us
I20260709 13:07:12.361683 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:12.361917 23916 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.362353 23916 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:12.363107 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:12.363312 23661 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:12.363435 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.363144 23916 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.362069 23859 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:12.365621 23916 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.365391 23859 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.367084 23968 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:12.367604 23859 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.368047 23966 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.367671 23968 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.368463 23966 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.239859 23858 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:07:12.364573 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 181083us
W20260709 13:07:12.336717 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 157440us
I20260709 13:07:12.397069 23949 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.397667 23949 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.435503 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:12.439416 23677 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.440199 23677 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.368820 23966 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:12.446403 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 83374.9us
I20260709 13:07:12.447430 23153 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.357396 23230 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:12.448206 23970 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:12.369177 23587 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:12.451536 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.358184 23812 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:12.447480 23858 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:12.400607 23750 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.364622 23537 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:12.236138 23958 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.208s
I20260709 13:07:12.488440 21561 raft_consensus.cc:2410] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:12.500910 23770 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.336045 23331 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:12.511770 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 76483us
I20260709 13:07:12.513331 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:12.516528 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:12.450889 23661 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:12.361500 23921 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.360435 23737 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 13:07:12.534749 21569 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:12.538089 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:12.497498 23905 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.560972 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.500607 23750 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:12.502931 23230 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:12.520031 23812 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.569411 21569 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:12.518762 23587 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:12.537186 23770 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.573109 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.573834 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.444511 23955 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.537324 23806 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.582726 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.581956 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.539273 23941 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:12.564270 23926 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:12.569144 23677 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.519316 23537 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.544881 23946 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:12.593232 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 93263.1us
I20260709 13:07:12.616761 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:12.593081 23905 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.597474 23820 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:12.598153 23965 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.631629 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.583737 23230 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.615123 23957 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:12.596287 23958 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:12.614003 23790 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.604911 23806 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.620530 23946 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:12.646677 21569 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:12.632123 23926 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.599929 23770 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.650935 22930 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.669533 21560 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:12.639758 23905 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.628922 23677 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:12.657718 23985 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.657591 23977 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:12.658228 23537 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.659085 23331 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.659255 23946 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.659543 23990 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:07:12.660457 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.647933 23968 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.661125 23587 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.662017 23956 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.638113 23853 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.620256 23812 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.634958 23153 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:12.692000 23927 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:12.647913 23953 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:12.648694 23750 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:12.679533 23971 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:07:12.679842 23987 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.680940 23770 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:12.683622 23980 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:07:12.684039 23963 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:07:12.684937 23995 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.685204 23806 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.684047 23540 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:12.671326 23793 consensus_meta.cc:287] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.001s
I20260709 13:07:12.691881 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:12.633251 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:12.694468 21569 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:12.702389 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:12.719550 23992 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:12.648475 23965 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.653877 23661 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.737818 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:12.729975 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.671438 23926 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.745749 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.745448 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:12.755674 21563 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:07:12.742300 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 50493.3us
I20260709 13:07:12.770435 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:12.690292 23677 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.768368 22246 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
W20260709 13:07:12.742640 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 113157us
I20260709 13:07:12.773609 21569 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:12.745476 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1212) took 1008 ms. Trace:
I20260709 13:07:12.741685 23793 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.701725 23858 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:12.742709 23945 consensus_meta.cc:287] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.765s	user 0.006s	sys 0.003s
I20260709 13:07:12.786512 23945 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.739421 23949 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:12.778034 23975 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.779247 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:12.791237 23975 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.791668 23975 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.791853 23965 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:12.792382 22245 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.792944 23919 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.793401 23919 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.793761 23919 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.793974 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.773074 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:12.794865 21489 raft_consensus.cc:2410] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:12.795706 23959 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.736297 23955 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.796455 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.796768 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.797113 21563 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:12.797596 21485 raft_consensus.cc:2410] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:12.783155 22246 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.779898 23968 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:12.784399 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.784612 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:12.799957 21488 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:12.778559 23956 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:12.801342 23956 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.801728 23956 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:12.736244 23991 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:12.802601 23956 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.804150 23956 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.742710 23993 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.770941 23750 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.807181 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.766443 23946 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.692272 23985 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.808023 21485 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:12.781407 23677 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:12.809312 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.741078 23995 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.809775 23230 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:12.810061 21489 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:07:12.810468 23921 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:12.811188 23981 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.811599 23981 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:12.812474 23981 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.813715 23981 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.802624 21567 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:12.814535 22242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 510) took 1070 ms. Trace:
I20260709 13:07:12.739055 23987 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:12.814998 22242 rpcz_store.cc:276] 0709 13:07:11.744496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.764796 (+ 20300us) service_pool.cc:224] Handling call
0709 13:07:12.814315 (+1049519us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54005ffd54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:12.814470 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755892608}
I20260709 13:07:12.815647 23987 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.817003 23987 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.742825 23770 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:12.724308 23809 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:12.818101 23770 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:12.737521 23927 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.819276 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.819556 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.819883 21634 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:12.820048 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:12.820803 21643 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:12.744190 23992 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.823518 21637 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:12.825023 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:12.825608 23972 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 13:07:12.826053 21636 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:12.827129 21565 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.827517 21565 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:12.828132 23936 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:12.785610 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:12.803107 23991 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.830499 23991 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:12.831382 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.832075 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.828179 21565 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.832660 21487 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:12.832859 21565 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.834582 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:12.838457 21485 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:12.841416 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55908.4us
I20260709 13:07:12.841905 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:12.844739 21642 consensus_meta.cc:287] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.000s
I20260709 13:07:12.846192 21642 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:12.774842 21491 rpcz_store.cc:276] 0709 13:07:11.737338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.849325 (+111987us) service_pool.cc:224] Handling call
0709 13:07:11.937799 (+ 88474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.945394 (+  7595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.945442 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.946112 (+   670us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.167225 (+221113us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:12.167268 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.167326 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.738418 (+571092us) raft_consensus.cc:1685] finished
0709 13:07:12.745285 (+  6867us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.745417 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":183769,"threads_started":1,"wal-append.queue_time_us":684968}
W20260709 13:07:12.848518 21641 consensus_meta.cc:287] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.672s	user 0.006s	sys 0.005s
W20260709 13:07:12.848893 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.853853 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:12.849865 21641 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:12.857537 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:12.860306 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.860628 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.861733 21637 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:12.861788 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:12.863941 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:12.865267 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.867980 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.868341 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.869163 21642 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:12.871750 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:12.874121 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:12.878402 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.879582 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.880259 21486 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:12.861018 21634 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:12.881699 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:12.864856 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.883001 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:12.886394 21485 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:12.882956 21488 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:12.892586 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:12.894157 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:12.894629 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:12.895404 21489 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.897804 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:12.899436 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:12.880239 21568 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:12.901187 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.902050 21567 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:12.903600 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.904448 21493 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:12.850659 23936 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.892619 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.908128 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:12.914623 21641 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:12.908653 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:12.917202 22930 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:12.917204 22212 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:12.917760 22930 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:12.921657 23941 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:07:12.930075 23999 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:07:12.930908 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:12.949221 21490 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:12.950084 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.931072 23983 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.931806 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:12.901782 23968 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.932826 23997 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.933290 23976 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.933446 23996 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.931824 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.925987 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.966615 21492 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:12.918304 23737 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.935093 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:12.938300 23967 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.447s	user 0.005s	sys 0.000s
I20260709 13:07:12.892839 23812 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.944583 23853 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:12.879114 23965 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.950866 21489 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:12.902870 23942 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.954142 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:12.932323 24000 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.844100 23809 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:12.907181 23790 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.913702 23677 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:12.915181 23982 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.934739 22930 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:12.971539 21493 raft_consensus.cc:2410] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:12.950979 23859 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.972095 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.984212 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:12.983778 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 91270.8us
I20260709 13:07:12.987222 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:12.987761 22244 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:12.988235 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:12.930925 23994 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.959642 23936 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.960819 23968 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.015640 23968 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.992514 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:13.019132 22930 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.019125 23996 consensus_queue.cc:1059] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:13.019846 22930 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.021977 22930 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:12.997977 22245 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:13.002343 23677 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:13.023137 23677 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.024603 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:13.025214 22245 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:13.022508 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.029465 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.030011 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.033105 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.033929 21561 raft_consensus.cc:2410] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:12.996192 21565 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:13.036955 21564 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:07:13.034802 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 126205us
I20260709 13:07:12.979444 23853 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:13.040261 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:12.990412 23927 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:13.032819 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:13.040969 21567 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:13.006834 21491 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:12.919481 23770 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.013550 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.014218 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:13.014384 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:13.044409 21493 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:12.966315 23976 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.044610 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:13.039162 22930 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.045895 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:13.046017 22930 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.046042 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.046597 22930 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.046944 21567 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:13.040088 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.042441 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.044082 21489 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
W20260709 13:07:13.005227 23916 consensus_meta.cc:287] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.005s
I20260709 13:07:13.048084 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:12.998653 23965 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:13.048712 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.007570 23985 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:13.003439 23995 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.008488 23926 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:13.054494 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.054912 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.027037 23790 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.028195 23996 raft_consensus.cc:3055] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:13.059624 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.057555 21563 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:13.059077 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.034806 23992 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:13.064297 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.064939 21568 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:07:13.066151 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.048362 23976 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.048225 23986 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.052997 23602 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:13.054597 23927 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:12.970285 23997 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:13.066197 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 51976.3us
I20260709 13:07:13.051049 23808 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.068027 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.026580 23977 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:13.066463 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:12.995602 23942 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.066833 21492 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:13.062862 23994 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:13.026331 23859 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:13.078161 23922 consensus_meta.cc:287] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.000s
I20260709 13:07:13.102914 23922 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.105010 23922 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:13.078687 23927 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.105777 23927 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.105502 23975 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.106997 21636 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.107548 23997 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.098465 23737 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:13.060812 23965 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.111294 23905 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.112360 23965 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:13.113698 23942 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:13.096273 23987 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:07:13.094094 23602 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:13.114837 23995 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:13.081929 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.083495 23809 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.126986 22930 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:13.070120 23966 consensus_meta.cc:287] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 13:07:13.128296 23966 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.115701 23602 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.128909 23677 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.130502 23966 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:13.048512 23587 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:07:13.068387 23983 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:07:13.096127 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:13.140763 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44728.6us
I20260709 13:07:13.068601 23945 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.062876 23996 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:13.066653 23926 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.099864 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:13.102378 23859 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:13.106964 23853 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.080513 23991 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.116086 21640 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.117830 21492 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:13.143276 23996 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.093930 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.076326 24000 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.094283 23793 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:13.131770 23973 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.630s	user 0.000s	sys 0.004s
I20260709 13:07:13.094389 23790 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:07:13.134678 23994 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:13.144630 21490 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
W20260709 13:07:13.147460 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47703.6us
I20260709 13:07:13.115761 23993 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:13.159505 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 65641us
I20260709 13:07:13.186204 22930 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:13.155479 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:13.159271 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.116220 22238 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:13.097769 24008 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.194073 21492 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:13.198001 23919 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.203480 21491 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:13.208426 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.209331 23991 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.209438 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.210042 23991 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.210448 23991 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.210531 23997 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:13.210984 23991 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.211194 23997 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:13.211798 23997 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.199514 24008 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.146895 23983 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.149111 23587 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:13.218847 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.094517 23808 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.115721 23927 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.150000 23986 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.226163 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:13.230710 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 75343.3us
I20260709 13:07:13.231410 22930 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:13.127267 23916 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:07:13.151644 23677 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:13.228859 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.192644 23905 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.149247 22240 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:13.237766 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.241590 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.237615 21487 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:13.206327 23999 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:13.226852 23587 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.224822 24001 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.243794 22930 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.235594 23996 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.256630 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.265916 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:13.205854 23919 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.152477 24004 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:07:13.229322 24008 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.238440 23945 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.266539 22245 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.241814 23956 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.244210 23905 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.276675 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.248339 23990 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:13.192932 24000 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.257310 23986 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.247285 23966 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:07:13.258908 23587 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.261940 23677 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:13.258232 23949 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.239465 23983 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.306092 21565 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:13.310858 21563 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:13.295248 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.305190 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.287621 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.288123 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.287318 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:13.252971 23926 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:07:13.319733 21636 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.323318 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.269992 23153 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:13.330058 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:13.364965 22930 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:13.340420 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.387039 21560 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:13.316906 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:13.306596 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.334122 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.273299 23945 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.390714 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 57915.7us
I20260709 13:07:13.398057 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.398408 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.283550 23990 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:13.399032 21494 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:13.399324 23990 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.399938 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.392282 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.282189 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:13.258538 23999 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.282769 23905 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.397485 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:13.400517 21494 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:13.460431 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.400990 21635 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 13:07:13.285401 24009 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.440831 22245 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:13.401561 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:13.462337 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.465790 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.469732 21641 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:13.466063 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.385673 23153 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:13.398066 23945 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.470956 21639 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:13.480453 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.314942 23986 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.263898 24001 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.478134 22930 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:13.482981 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:13.489614 22245 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:07:13.489550 22930 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.485388 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:13.485258 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.477842 23153 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.490875 22246 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:13.496517 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:13.497192 21485 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.499119 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:13.499848 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.500298 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:13.500442 21564 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:13.500939 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.501289 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:13.501405 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.501869 21564 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.309795 23982 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.192s
I20260709 13:07:13.493702 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:13.424122 23941 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:07:13.492138 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:13.508600 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.511739 21488 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:13.518198 21635 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.468431 24009 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.499348 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.525094 21485 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:13.526340 21485 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:13.517882 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.527522 21485 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.516559 22244 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:13.333515 23661 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.165s
I20260709 13:07:13.272905 23537 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.180s
I20260709 13:07:13.461443 23987 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:13.332405 23677 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.394017 23956 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:13.494484 23986 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.529110 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:13.602018 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 73028.1us
I20260709 13:07:13.530762 21568 raft_consensus.cc:2368] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4.
I20260709 13:07:13.422855 23922 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:07:13.532073 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.481801 24000 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:13.525378 23812 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.516788 21569 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
W20260709 13:07:13.547554 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.393352 23950 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:07:13.602100 22930 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.603081 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.529798 22243 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:13.518100 23809 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:13.513399 23993 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:13.600788 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 199285us
I20260709 13:07:13.605700 23926 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.622392 23976 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:07:13.538215 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:13.613336 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 221150us
I20260709 13:07:13.614356 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:13.519438 23793 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.530138 24009 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.524570 24002 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:13.638125 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.639329 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:13.666230 21569 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:13.666352 21563 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.597453 23540 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.602850 23989 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.636816 21634 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:13.646624 23921 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:13.646165 23993 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:13.610008 23790 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.530009 23750 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:07:13.653687 21459 leader_election.cc:400] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4.
I20260709 13:07:13.679239 21459 leader_election.cc:403] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.603816 23677 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.653223 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:13.656371 23602 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.615993 23812 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.422042 23994 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:13.656164 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 147654us
I20260709 13:07:13.656692 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.660353 21561 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:13.660638 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:13.686414 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:13.607666 23987 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.618258 23737 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:13.646649 24010 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 13:07:13.518855 23919 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.604202 23956 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.654340 23927 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:13.680986 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:13.661594 23770 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.681077 22247 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:13.664873 23926 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:13.689881 24013 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
W20260709 13:07:13.707000 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.667809 23540 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.687709 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.687748 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.678035 23790 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.674031 23921 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:13.713248 21563 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
W20260709 13:07:13.714020 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.710557 23540 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.715924 23949 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.716372 23949 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.698745 23919 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.717805 23919 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:13.719357 24014 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
W20260709 13:07:13.720148 24016 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:07:13.725824 23968 consensus_meta.cc:287] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.710s	user 0.006s	sys 0.002s
I20260709 13:07:13.726382 23993 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:13.729182 23991 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.000s
I20260709 13:07:13.697256 24008 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.729622 23991 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.730520 21641 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:13.730638 21566 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:13.731611 24008 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:13.735836 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.668991 24002 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:13.665205 23976 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.656273 23808 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.682955 24000 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4.
I20260709 13:07:13.523672 23230 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.709528 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.748333 21634 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 5: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:13.690320 23812 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.737092 21564 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:13.696132 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.743134 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:13.744074 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.726269 23968 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.747295 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:13.748780 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 59282.1us
I20260709 13:07:13.712088 23790 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.755162 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:13.755611 24015 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:07:13.710358 23977 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.756552 23977 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.759274 23921 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.760371 23921 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.673875 23989 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:13.761713 23919 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:13.762633 23997 consensus_meta.cc:287] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 13:07:13.762805 21568 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.763096 23997 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.764133 21567 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:07:13.764197 23989 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.765076 23997 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:13.765888 24017 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:07:13.766588 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.750613 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 54605.6us
I20260709 13:07:13.743872 24002 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.747704 24022 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.768435 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.769192 21487 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:13.771517 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:13.736266 23999 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:13.776576 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:13.780568 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.703925 23737 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.784315 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.712826 23770 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.785992 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.786899 21488 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:13.785127 21636 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:13.789768 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.790621 21486 raft_consensus.cc:2410] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:13.753315 24008 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.706700 24018 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:07:13.758652 23977 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.788821 23981 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:07:13.749696 23983 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:13.784811 23927 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.781148 23537 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:07:13.775106 24022 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.794721 24024 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.799918 23956 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:13.800222 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:13.778617 23989 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:13.783277 24025 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.823858 23793 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:13.810180 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.795763 23941 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.825080 21643 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:13.820513 21568 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:13.825305 23793 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.826191 23941 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.826838 23941 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:13.827782 23941 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.780663 23997 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:13.781625 24001 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:13.788391 23990 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.784634 23995 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:13.837303 23537 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.848111 21635 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:13.853013 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.829669 24024 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.854626 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:13.854475 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 69283.2us
I20260709 13:07:13.829617 24022 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.856372 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:13.859649 21643 raft_consensus.cc:2368] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4.
I20260709 13:07:13.859499 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:13.863461 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:13.868716 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:13.841526 23537 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:13.869689 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.871249 21492 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:13.877907 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:13.878614 21492 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.860790 23995 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:13.862871 24020 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.863071 23956 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.868162 23977 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.906404 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:13.885260 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:13.888909 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.904031 21457 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:13.903883 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:13.858057 24024 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.916589 21489 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:13.918998 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.884315 23987 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:13.880046 24018 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:13.884821 23995 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:13.931314 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:13.913185 24020 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:13.909207 23853 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.904263 24023 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.932708 24018 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.936066 23737 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:13.938189 24039 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.943141 23537 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:13.918704 23999 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.883221 23981 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:07:13.922737 23809 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:13.960347 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1631) took 1033 ms. Trace:
I20260709 13:07:13.958065 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:13.942294 23905 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.987802 21490 rpcz_store.cc:276] 0709 13:07:12.927284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.949821 (+ 22537us) service_pool.cc:224] Handling call
0709 13:07:13.960144 (+1010323us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54002c9f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:13.960280 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446023424}
I20260709 13:07:13.929127 23994 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:13.922143 23956 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.956212 24023 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.933908 23977 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:13.991765 23587 consensus_meta.cc:287] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.001s
I20260709 13:07:13.979964 24018 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.944680 24020 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.009908 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:14.012537 21643 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:14.008059 23537 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.013577 23153 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:13.934216 23976 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.018677 21562 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:14.019109 21486 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:13.946381 23968 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.002437 23737 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:14.005772 24011 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.016s	sys 0.019s
I20260709 13:07:14.001758 23770 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.008747 24023 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.007671 22242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 366) took 1149 ms. Trace:
I20260709 13:07:14.024999 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:14.021680 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 115356us
I20260709 13:07:14.029837 23905 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.030115 23153 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:14.028116 24011 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.017s	sys 0.019s
W20260709 13:07:14.033864 23996 consensus_meta.cc:287] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.766s	user 0.008s	sys 0.000s
I20260709 13:07:14.023265 23919 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:14.034938 22238 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:14.047428 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:14.048089 23949 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.049156 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:14.049722 22245 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.041769 21643 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:14.042670 22242 rpcz_store.cc:276] 0709 13:07:12.851557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.856727 (+  5170us) service_pool.cc:224] Handling call
0709 13:07:12.957870 (+101143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.049263 (+ 91393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.050485 (+  1222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.056414 (+  5929us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:13.057917 (+  1503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.982316 (+924399us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b54005a2b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:13.985623 (+  3307us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.999897 (+ 14274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168532352}
I20260709 13:07:14.044682 23990 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.021885 23995 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.055212 23926 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:14.055840 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.050454 23949 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.059942 22245 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:14.006040 23994 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.024749 24020 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.064810 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:14.065364 23809 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.025190 23540 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.027909 23737 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.067374 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.069433 21491 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:07:14.071422 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1633) took 1143 ms. Trace:
I20260709 13:07:14.072094 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:14.086171 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.072767 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:14.087875 21485 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:14.073491 23945 consensus_meta.cc:287] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.578s	user 0.004s	sys 0.004s
I20260709 13:07:14.038410 23677 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.084584 21492 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:14.014290 23587 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.088757 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.108596 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.055980 23995 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:14.085556 21493 rpcz_store.cc:276] 0709 13:07:12.927744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.232056 (+304312us) service_pool.cc:224] Handling call
0709 13:07:13.232464 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.266602 (+ 34138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.266633 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.266675 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:13.266706 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.071193 (+804487us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b540008aa54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:14.071241 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.071363 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78043392}
I20260709 13:07:14.109982 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:14.120064 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.129525 21489 raft_consensus.cc:2368] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5.
I20260709 13:07:14.133332 21640 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:14.134413 21635 raft_consensus.cc:2368] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4.
I20260709 13:07:14.110405 23926 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:14.143934 24041 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:14.153013 23540 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.130883 23988 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.160912 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:14.161577 21493 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.107350 23790 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:14.162235 23986 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.003s
I20260709 13:07:14.154826 23926 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:14.161026 23988 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:14.123737 23977 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.110615 23945 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.187943 23956 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.149917 23812 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.188571 23994 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:14.183173 24009 consensus_meta.cc:287] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.003s
I20260709 13:07:14.198915 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.202380 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:14.203224 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:14.186774 23988 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.204824 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:14.207662 21492 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.206459 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:14.208173 22246 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.208585 21491 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:14.209532 22244 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:14.210196 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:14.211092 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:14.212709 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.179219 24023 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.213973 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.217358 21457 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.218263 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.196554 23790 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:14.219619 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.222328 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:14.221038 23926 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.223410 23737 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:14.223582 21563 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:14.224001 24043 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:07:14.225119 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1636) took 1269 ms. Trace:
I20260709 13:07:14.225235 21563 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:14.225468 21494 rpcz_store.cc:276] 0709 13:07:12.956329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.482733 (+526404us) service_pool.cc:224] Handling call
0709 13:07:13.518441 (+ 35708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.518768 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.518825 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.532603 (+ 13778us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.983022 (+450419us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:13.983087 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.983208 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.224921 (+241713us) raft_consensus.cc:1685] finished
0709 13:07:14.224942 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.225065 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":635,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":6902,"thread_start_us":333056,"threads_started":1,"wal-append.queue_time_us":440025}
I20260709 13:07:14.180899 23986 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:14.228749 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 123676us
I20260709 13:07:14.230683 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:14.232606 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:14.240083 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.241080 21485 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:14.216620 23956 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.219013 23919 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.240427 23994 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:07:14.221276 23968 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.241433 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:14.242067 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.243855 21485 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:14.244221 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:14.253485 21494 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.245216 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.228850 23770 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.255406 23976 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.255898 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:14.256472 23950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.010s	sys 0.005s
W20260709 13:07:14.257121 23950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.010s	sys 0.005s
I20260709 13:07:14.258015 23921 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.258733 21491 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:14.260210 21492 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:14.254304 23153 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:14.263377 24048 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:14.267046 23905 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.239455 23737 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:07:14.257288 21457 leader_election.cc:400] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4.
I20260709 13:07:14.271505 21492 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:14.271405 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:14.274530 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.275277 21493 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:14.204531 24009 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:14.249095 23790 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.278239 21493 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:14.281204 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:14.281914 21493 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:14.270707 23677 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.292093 21638 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:14.277510 23919 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:14.296604 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.299171 21493 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:14.294611 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:14.301973 21494 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:14.268829 24018 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.290361 23587 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:14.309336 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.310195 21561 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:14.311126 24052 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:14.303339 23976 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.313839 24023 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.319217 23812 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.331244 21564 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:14.335069 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:14.335601 21492 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.340816 24009 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:14.332851 24002 consensus_meta.cc:287] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.002s
I20260709 13:07:14.305765 24022 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.352478 21492 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
W20260709 13:07:14.353518 24049 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:07:14.365235 23991 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.488137 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.380335 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1235) took 1097 ms. Trace:
I20260709 13:07:14.381767 21561 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:14.477209 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.477878 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1699) took 1075 ms. Trace:
I20260709 13:07:14.498950 21488 rpcz_store.cc:276] 0709 13:07:13.283158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.518951 (+235793us) service_pool.cc:224] Handling call
0709 13:07:13.519244 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.787517 (+268273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.380064 (+592547us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b540030ded4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:14.380276 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614708480}
I20260709 13:07:14.366557 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1698) took 1032 ms. Trace:
I20260709 13:07:14.499713 21566 rpcz_store.cc:276] 0709 13:07:13.390003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.390121 (+   118us) service_pool.cc:224] Handling call
0709 13:07:13.390454 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.731061 (+340607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.465525 (+734464us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54003eb054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:14.465826 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781854080}
I20260709 13:07:14.370476 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.506217 21568 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.480530 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:14.504141 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.377853 21565 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:14.504855 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.450771 24022 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:14.500259 21560 rpcz_store.cc:276] 0709 13:07:13.389673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.428056 (+ 38383us) service_pool.cc:224] Handling call
0709 13:07:13.428532 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.461559 (+ 33027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.461593 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.124619 (+663026us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b2c00010da8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:07:14.133612 (+  8993us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.253391 (+119779us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.253423 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.253476 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.366158 (+112682us) raft_consensus.cc:1685] finished
0709 13:07:14.366188 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.366469 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2542,"raft.queue_time_us":56192,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6041,"spinlock_wait_cycles":19586944,"thread_start_us":79528,"threads_started":1,"wal-append.queue_time_us":134256}
I20260709 13:07:14.518126 21561 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:14.384910 23790 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.524283 21532 leader_election.cc:400] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4.
I20260709 13:07:14.524590 21532 leader_election.cc:403] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:07:14.379597 23922 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:14.525867 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.463330 23853 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.371371 24050 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:14.477512 24004 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:14.467703 23987 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.530256 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.526957 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.511633 23770 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:14.543311 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.545034 21567 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.522583 23977 raft_consensus.cc:2764] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:14.546330 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:14.511842 23989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.006s	sys 0.008s
I20260709 13:07:14.533617 21568 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:14.546947 21566 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:14.549908 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.347158 24002 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.520642 24020 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.549505 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.453931 23858 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.551309 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.529369 23922 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:14.554464 21560 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:14.547401 24022 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4.
I20260709 13:07:14.547995 23770 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:14.549381 23989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.013s	sys 0.011s
W20260709 13:07:14.557513 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.544111 23987 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.558184 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.559051 21569 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:14.565945 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.568260 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.562186 21567 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:14.552240 23975 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:14.566606 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.543668 23853 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.573172 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.556632 23858 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.573971 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.577080 21641 raft_consensus.cc:2368] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5.
I20260709 13:07:14.556982 24020 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:14.574565 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:14.574707 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:14.574018 23922 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.592751 23922 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.593755 23858 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.593943 24018 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:14.580485 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.594911 21491 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:14.595743 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.596815 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.597234 24020 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.597862 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.598206 21563 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:14.599123 23853 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.599665 21639 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:14.600416 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:14.600416 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.601490 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:14.601805 21563 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:14.602847 21563 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:14.581880 21635 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:14.603965 21563 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:14.583024 23988 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.604789 21635 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:14.604627 23770 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.605763 23988 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:14.583808 24024 consensus_meta.cc:287] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.004s
I20260709 13:07:14.582091 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.585292 23987 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.612511 21640 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:14.612774 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:14.585633 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:14.586572 23540 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.591136 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.548339 24004 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.606702 24024 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.617537 24004 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:14.603842 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:14.584277 23945 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.608871 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:14.561901 23989 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:14.619946 21634 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:14.620489 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.622427 21642 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:14.619513 23540 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.629149 23540 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.609186 24002 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.625957 23987 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:14.633908 24024 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:14.639218 21563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:14.640879 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.642246 24000 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.643363 21563 raft_consensus.cc:606] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.643852 21563 raft_consensus.cc:614] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:14.647097 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:14.620484 23988 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:07:14.644800 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.650660 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.652233 24000 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.645641 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:14.647708 23987 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:14.654076 21639 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:14.648132 21563 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:14.660473 21563 pending_rounds.cc:85] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:07:14.644168 21566 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:14.661056 21563 pending_rounds.cc:107] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:14.661450 21563 raft_consensus.cc:2889] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.660422 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.664098 23770 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.664669 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.666087 23956 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:14.638384 21642 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:14.653082 24000 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.671777 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:14.674152 21532 leader_election.cc:400] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5.
I20260709 13:07:14.674619 21532 leader_election.cc:403] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:14.675630 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:14.680150 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.675909 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:14.753185 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 77344.9us
I20260709 13:07:14.755270 21532 leader_election.cc:400] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5.
I20260709 13:07:14.755739 21532 leader_election.cc:403] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:14.669751 23936 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.677389 23997 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:14.676394 23985 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:14.691272 23853 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5.
I20260709 13:07:14.776000 23958 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:14.783394 23927 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.789565 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 338) took 1080 ms. Trace:
I20260709 13:07:14.669490 23858 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:07:14.769423 23988 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.769876 24000 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.670835 23975 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 13:07:14.776464 24022 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:14.792685 22240 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:14.752107 23537 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:07:14.818852 24000 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.826031 24065 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:14.792053 23936 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.822531 23988 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.829787 24000 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.807579 23997 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:14.822115 24022 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:14.802486 23927 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:14.828703 24068 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:07:14.798840 23989 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.834062 23985 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:14.849086 23853 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:14.802601 22238 rpcz_store.cc:276] 0709 13:07:13.709209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.710627 (+  1418us) service_pool.cc:224] Handling call
0709 13:07:13.726085 (+ 15458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.047035 (+320950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.789283 (+742248us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400603454. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:14.789500 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676765440}
I20260709 13:07:14.802969 23987 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.897763 23853 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:14.898799 23853 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.900110 23853 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:14.887787 24042 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:14.855762 24022 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.902833 23602 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.903347 24066 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:14.903470 23602 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:14.906167 23602 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:14.861572 23922 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.907173 23922 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.909336 23922 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:14.833927 24065 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.895763 23927 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:14.896050 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.896723 23985 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.921667 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:14.914557 23922 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:14.932754 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1881) took 1134 ms. Trace:
I20260709 13:07:14.933223 21636 rpcz_store.cc:276] 0709 13:07:13.798524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.798664 (+   140us) service_pool.cc:224] Handling call
0709 13:07:13.803455 (+  4791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.825119 (+ 21664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.825152 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.825195 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:13.825228 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.932534 (+1107306us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b540009d654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:14.932576 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.932700 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49367936}
I20260709 13:07:14.938567 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.940596 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:14.941665 21491 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:14.948307 21636 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:14.950392 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1873) took 1243 ms. Trace:
I20260709 13:07:14.954630 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.955724 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:14.956369 21635 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:14.955744 21561 raft_consensus.cc:2410] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:14.950992 21638 rpcz_store.cc:276] 0709 13:07:13.687360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.687489 (+   129us) service_pool.cc:224] Handling call
0709 13:07:14.930870 (+1243381us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001149d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:14.931070 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339229440}
I20260709 13:07:14.957868 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:14.958711 21490 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:14.961189 21487 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:14.961951 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:14.962576 21637 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:14.962656 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:14.964260 21569 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
W20260709 13:07:14.965943 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 55076.7us
I20260709 13:07:14.966661 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:14.971648 21561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:15.001406 21561 raft_consensus.cc:606] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:15.001797 21561 raft_consensus.cc:614] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:14.960206 23858 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.957628 23975 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:14.971961 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:15.003468 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:14.932909 23922 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.005502 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:15.006104 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:15.007347 23809 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:14.969242 23988 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:14.930496 23997 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:14.971097 23968 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.045897 22240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 335) took 1689 ms. Trace:
I20260709 13:07:15.046640 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:15.007618 23770 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:15.062129 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.008051 23956 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.034017 23809 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.041800 23812 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.035499 24065 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:15.076172 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 60930.2us
I20260709 13:07:15.046959 23989 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:15.057092 22240 rpcz_store.cc:276] 0709 13:07:13.356830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.386581 (+ 29751us) service_pool.cc:224] Handling call
0709 13:07:13.498435 (+111854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.828293 (+1329858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.045615 (+217322us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54005ffd54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:15.045835 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2904771328}
I20260709 13:07:15.091210 23989 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:15.092674 23936 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:15.093972 23989 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:15.094519 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:15.095250 21561 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:15.002467 23858 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:15.006870 23975 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.086236 23968 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:15.078665 23809 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.115666 23922 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:15.116235 23858 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:15.062739 24037 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:15.138370 21560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:15.139091 21560 raft_consensus.cc:606] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:15.141341 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:15.142360 21639 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:15.146850 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:15.152215 21561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:15.152806 21561 raft_consensus.cc:606] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:07:15.153138 21561 raft_consensus.cc:614] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:15.154835 23955 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.154352 24022 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.155393 23955 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:15.155825 21561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:15.156500 23955 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:15.157261 24022 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:15.157965 23955 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.156548 21561 raft_consensus.cc:606] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:15.161338 21561 raft_consensus.cc:614] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:15.163437 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.140340 23916 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:15.169082 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 160971us
I20260709 13:07:15.172313 23958 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5.
I20260709 13:07:15.173393 23975 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:15.172310 24000 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.176798 24000 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:15.178243 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.180415 21568 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:15.182966 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:15.167328 23916 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:15.183548 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:15.189914 21563 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.190114 21639 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:15.190594 21639 pending_rounds.cc:85] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 3
I20260709 13:07:15.190946 21639 pending_rounds.cc:107] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:15.191286 21639 raft_consensus.cc:2889] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:15.192811 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.194685 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:15.195286 21637 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.199193 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:15.199471 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:15.200073 21560 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:15.201215 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:15.202293 21488 raft_consensus.cc:2410] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:15.202414 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:15.201335 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:15.204123 21560 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.209184 21490 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:15.212304 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:15.211330 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:15.212165 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:15.211987 23956 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:15.214017 23956 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.214159 21487 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:15.214412 23956 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.219101 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:15.219748 21486 raft_consensus.cc:2376] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6. Re-sending same reply.
I20260709 13:07:15.221294 23922 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.219100 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:15.223223 21561 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:15.196406 23927 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.224474 23927 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.194388 24065 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:15.230688 21637 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:15.232336 21560 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:15.234519 21487 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:15.236049 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:15.235215 23927 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:15.237859 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 154085us
I20260709 13:07:15.229713 23770 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:15.238767 21490 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.244107 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:15.244899 21486 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:15.218299 23809 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:15.244189 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:15.250334 21569 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:15.254292 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 1983) took 1756 ms. Trace:
I20260709 13:07:15.254729 21565 rpcz_store.cc:276] 0709 13:07:13.498025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.499574 (+  1549us) service_pool.cc:224] Handling call
0709 13:07:13.529651 (+ 30077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.518414 (+988763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.254089 (+735675us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540028aad4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:15.254238 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949782912}
I20260709 13:07:15.258241 21487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:07:15.189774 23916 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.263533 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:15.237809 24065 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:15.265887 21562 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1695) took 1950 ms (client timeout 1572 ms). Trace:
I20260709 13:07:15.271402 23916 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.272115 24065 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.258767 21487 raft_consensus.cc:606] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:15.275337 21487 raft_consensus.cc:614] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:15.259573 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:15.278230 22244 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:15.278724 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:15.279064 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:15.279461 21634 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:15.279681 21490 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:15.280501 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:15.280994 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:15.281164 21488 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.280858 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:15.282020 21634 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:15.282402 21490 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:15.283507 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:15.283919 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:15.284996 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:15.285895 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:15.287374 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.287935 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:15.288727 21635 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:15.288564 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:15.290052 21486 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:15.266378 21562 rpcz_store.cc:269] 0709 13:07:13.305784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.458251 (+152467us) service_pool.cc:224] Handling call
0709 13:07:15.256238 (+1797987us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54000a0854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:15.256320 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1259733248}
I20260709 13:07:15.291603 21493 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:07:15.295957 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 84748.9us
I20260709 13:07:15.296404 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:15.297220 21485 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.299046 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:15.277482 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:15.297498 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:15.257575 23956 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:15.306912 23936 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:15.311597 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:15.318085 21488 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:15.320878 21492 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:15.348244 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:15.349125 22244 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.363402 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:15.364234 21494 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.370085 21636 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.370949 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:15.375368 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:15.373466 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:15.377830 21636 raft_consensus.cc:2393] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 4: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:15.380159 21485 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:15.376101 22247 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:15.367167 22242 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:07:15.371897 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.385115 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:15.386889 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:15.387080 21562 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:15.370366 23986 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:15.313414 24079 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:07:15.446493 21637 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.392160 22244 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:15.461894 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:15.462096 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:15.461941 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 72247.5us
I20260709 13:07:15.463049 22247 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 4 LEARNER]: Advancing to term 6
I20260709 13:07:15.429942 21494 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
W20260709 13:07:15.422916 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 122458us
I20260709 13:07:15.465327 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:15.467304 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:15.390662 23750 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:07:15.471043 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:15.472636 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:15.373581 23936 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:15.474507 22240 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:15.480225 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:15.482547 22244 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 4 LEARNER]: Advancing to term 6
I20260709 13:07:15.477989 23922 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:15.379752 23770 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:15.489023 21562 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:15.489598 21562 pending_rounds.cc:85] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:07:15.489895 21562 pending_rounds.cc:107] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:15.490206 21562 raft_consensus.cc:2889] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.496925 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:15.393477 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:15.464607 23905 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:15.502593 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:15.508841 24084 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:15.476732 23955 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.510115 23983 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.509737 23936 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.510746 24088 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:15.497172 23808 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:07:15.515265 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:15.523123 22244 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 6 LEARNER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:15.584543 21562 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:15.608328 23808 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:15.609854 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 94687.3us
I20260709 13:07:15.514834 23958 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:15.516908 24000 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.636734 22247 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 6 LEARNER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:15.516613 23975 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
W20260709 13:07:15.646071 24072 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.568s	user 0.003s	sys 0.000s
I20260709 13:07:15.647178 24000 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.525807 24088 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:15.517110 23905 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.518554 23750 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:07:15.620594 23858 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.620093 23808 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:15.616218 23985 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:15.819213 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.641916 23809 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:15.517891 24084 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.639724 23958 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:15.848843 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 352009us
I20260709 13:07:15.732707 24079 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.857120 24079 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:15.871160 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 260509us
W20260709 13:07:15.873782 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 375212us
I20260709 13:07:15.854626 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:15.878909 23983 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:15.880580 23958 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:15.882851 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.880393 23983 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:07:15.881637 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 371991us
W20260709 13:07:15.882154 21606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.002s	sys 0.013s
W20260709 13:07:15.885334 21606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.003s	sys 0.013s
I20260709 13:07:15.837004 24090 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:15.882272 24079 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:15.886000 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 588535us
I20260709 13:07:15.902146 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:15.902675 23230 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.903405 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:15.903241 23230 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.887676 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:15.731809 24000 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.911985 23230 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:15.908649 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:15.839635 23808 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:15.845676 23985 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.924700 23230 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:15.926745 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 375) took 1879 ms. Trace:
I20260709 13:07:15.927225 22246 rpcz_store.cc:276] 0709 13:07:14.047161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.048225 (+  1064us) service_pool.cc:224] Handling call
0709 13:07:14.048471 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.208611 (+160140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.926487 (+1717876us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54006301d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:15.926675 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362951936}
I20260709 13:07:15.960064 23230 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.885856 24088 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.970145 24099 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.970708 24099 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:15.971202 24099 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.971496 24084 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:15.972110 24084 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.972151 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:15.973035 24084 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:15.913301 24090 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.961629 24101 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.975797 24090 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:15.977895 24098 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:15.978286 24098 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:15.979506 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1702) took 1911 ms. Trace:
W20260709 13:07:15.980037 24089 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 13:07:15.979938 21564 rpcz_store.cc:276] 0709 13:07:14.067667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.132204 (+ 64537us) service_pool.cc:224] Handling call
0709 13:07:14.132528 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.331767 (+199239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.979188 (+1647421us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54001464d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:15.979401 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455132544}
I20260709 13:07:15.980670 23905 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:15.965952 24092 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:15.982450 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1718) took 1375 ms. Trace:
I20260709 13:07:15.982666 23985 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:15.979084 24098 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:15.948385 23858 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:15.992004 23230 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:15.997082 23230 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:16.001017 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.993865 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:15.982959 21568 rpcz_store.cc:276] 0709 13:07:14.607362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.969604 (+362242us) service_pool.cc:224] Handling call
0709 13:07:15.002938 (+ 33334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.180928 (+177990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.982170 (+801242us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400017cd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:15.982364 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407575424}
I20260709 13:07:15.958701 24097 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.983928 24065 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.982702 24088 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.010967 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:15.997915 23230 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:16.011420 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 123812us
I20260709 13:07:15.998274 24101 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:16.018714 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:16.079110 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1717) took 1504 ms. Trace:
W20260709 13:07:16.050652 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 149627us
I20260709 13:07:16.020102 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:16.093633 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:16.087071 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:16.093084 21563 rpcz_store.cc:276] 0709 13:07:14.574263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.675013 (+100750us) service_pool.cc:224] Handling call
0709 13:07:14.684663 (+  9650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.190450 (+505787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.078870 (+888420us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b5400128254. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:16.079041 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160453504}
W20260709 13:07:16.095470 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 76803.3us
I20260709 13:07:16.007580 24097 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.100445 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:16.066658 24108 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:07:16.014490 24102 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:16.107470 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 87461.7us
I20260709 13:07:16.010162 24110 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.081244 23956 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:16.119132 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:16.119463 24115 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.119794 21636 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:16.120020 23916 consensus_meta.cc:287] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.848s	user 0.011s	sys 0.000s
I20260709 13:07:16.107131 24112 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.121095 24115 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:16.121369 24112 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.121824 24112 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.121657 24115 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:16.122956 24095 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.170s	user 0.003s	sys 0.000s
I20260709 13:07:16.119176 24087 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:16.123833 24087 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:16.099066 23602 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.010223 24111 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.106583 23808 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:16.046274 24098 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.018630 23750 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.104236 24097 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.133857 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:16.150375 21563 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.110390 24000 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:16.105819 24096 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.141443 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:16.172574 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:16.017331 24065 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.142505 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:16.051857 24084 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:07:16.016289 24090 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 13:07:16.097363 24101 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:16.185034 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49283.3us
I20260709 13:07:16.165285 21562 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:16.171123 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.186720 21565 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:16.122963 23986 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:16.183924 21563 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:16.163291 23956 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:16.163537 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.074512 23858 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.134308 24102 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:16.204085 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 95902.2us
I20260709 13:07:16.128749 23927 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:07:16.165804 24114 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:16.224884 24114 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.185986 23922 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.227311 23922 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.168236 24075 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:16.174816 24120 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:16.231268 24120 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.234133 24120 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:16.205847 23956 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.165604 23677 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:16.222909 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.139789 24111 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.168923 23790 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:16.220840 24065 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:16.261593 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.284046 21564 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
W20260709 13:07:16.362752 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 156163us
I20260709 13:07:16.191262 24000 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.372097 23790 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.372869 24000 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.374359 23790 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:16.374835 24111 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:16.375872 23540 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.371104 21636 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:16.372259 23750 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:16.376323 23540 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:16.376652 23750 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.377209 23540 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.378108 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.378319 23540 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.374917 24000 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:16.378827 21564 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:16.379199 23750 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:16.371395 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:16.365373 23770 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:16.375921 23927 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:16.381348 23770 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.381712 24116 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:16.382443 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:16.381183 23750 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.382624 23230 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.134992 24110 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:16.384955 21485 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:16.384864 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:16.390476 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:16.383425 24119 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.391914 23230 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:16.401165 21494 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:16.405893 21643 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.406332 24110 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:16.230232 24112 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.407907 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:16.391352 24121 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:07:16.416819 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.408836 23230 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.418473 23230 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.203941 23986 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.421362 23945 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.421851 23945 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:16.422292 23945 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.425482 22246 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:16.428493 21643 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:16.429771 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:16.203276 24099 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.426970 24125 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.428766 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:16.402498 23790 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.430637 22246 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:16.230386 24075 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.366158 23677 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.410823 24119 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:16.432825 24116 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.432160 23993 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:16.455649 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.452180 23956 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:16.411334 24120 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:07:16.469403 24115 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:16.463238 23945 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.472478 23945 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:16.474740 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:16.475435 21490 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.479239 24119 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.483289 24101 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:16.448139 24102 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.445885 23790 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.442870 24125 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.466997 23993 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.506142 23790 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:16.505940 24127 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:16.506676 23993 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:16.508114 24099 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:16.504581 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.509984 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:16.510175 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.510841 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.495973 23677 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:16.511641 21490 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:16.454196 24116 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.519120 24116 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.520099 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:16.520802 22239 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.512686 23540 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:16.510149 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:16.513250 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:16.459885 23750 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.512082 23977 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:16.524281 21560 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.515436 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.492684 23986 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:16.535045 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:16.539361 21560 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:16.503857 24112 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:16.552407 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:16.496279 24114 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:16.555457 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.494978 24075 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:16.506011 23955 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:07:16.559201 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:16.536522 24081 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.562976 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:16.563290 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.564432 21562 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:16.523308 23540 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.557235 24118 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.581476 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.578992 24111 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.582213 24111 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.581655 24118 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:16.582803 24118 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.558775 24000 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:16.566283 24081 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:16.584296 24081 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.582952 24111 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.587697 24104 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.587864 24065 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.588212 24104 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.588371 24065 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.590221 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:16.540313 24113 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:16.580701 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:16.581007 24125 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:16.607507 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:16.632802 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:16.636569 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:16.622673 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:16.603413 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:16.637993 21641 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:07:16.637636 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 208930us
I20260709 13:07:16.623288 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:16.638854 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:16.639262 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:16.603951 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:16.640302 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:16.640565 21642 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:16.640866 22244 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:16.639866 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:16.591361 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:16.634721 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:16.642953 21490 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:16.643543 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:16.598193 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.644590 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 65706.5us
I20260709 13:07:16.644889 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:16.625870 22245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 519) took 1260 ms (client timeout 1534 ms). Trace:
I20260709 13:07:16.535827 23977 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.643630 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:16.637748 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 145858us
I20260709 13:07:16.646145 21634 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:16.636746 21635 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:16.559520 24114 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:07:16.647653 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:16.645495 22245 rpcz_store.cc:269] 0709 13:07:15.365322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.370866 (+  5544us) service_pool.cc:224] Handling call
0709 13:07:16.590069 (+1219203us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:16.625808 (+ 35739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4564224}
I20260709 13:07:16.648689 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:16.650345 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.651050 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:16.590323 24104 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:16.645495 21640 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:16.650315 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:16.590549 24065 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:16.531832 24087 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.590647 24109 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.591079 23986 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.651666 21566 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:16.659523 21639 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.661170 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:16.639746 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 266) took 1397 ms. Trace:
I20260709 13:07:16.667824 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:16.666355 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:16.670945 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:16.600543 24074 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:16.781740 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 118279us
I20260709 13:07:16.800323 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:16.801132 21485 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:16.591208 24000 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:16.650589 23905 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.667119 23808 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:16.665418 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:16.810613 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:16.811139 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:16.811612 21493 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:16.812618 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:16.813004 23153 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.787031 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:16.813315 21493 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:16.820858 21493 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:16.823621 21493 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:16.796191 21636 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:16.794394 21638 rpcz_store.cc:276] 0709 13:07:15.242129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.242321 (+   192us) service_pool.cc:224] Handling call
0709 13:07:15.243042 (+   721us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:15.252320 (+  9278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.252342 (+    22us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:15.289893 (+ 37551us) log.cc:844] Serialized 52 byte log entry
0709 13:07:15.701455 (+411562us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:15.849650 (+148195us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.509015 (+659365us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b18002b80a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:07:16.639194 (+130179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.639305 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.639366 (+    61us) raft_consensus.cc:1685] finished
0709 13:07:16.639489 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.639665 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84066,"prepare.queue_time_us":147502,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2232,"raft.queue_time_us":85357,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":16523,"spinlock_wait_cycles":13626624,"thread_start_us":463786,"threads_started":2,"wal-append.queue_time_us":573987}
I20260709 13:07:16.592589 24097 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:16.804132 24133 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:07:16.804369 23905 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:16.805842 24122 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.690s	user 0.006s	sys 0.012s
I20260709 13:07:16.789431 24125 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:07:16.807041 24123 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.687s	user 0.011s	sys 0.006s
I20260709 13:07:16.806749 24000 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:16.807824 23540 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:16.780861 22243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 343) took 1433 ms (client timeout 1582 ms). Trace:
I20260709 13:07:16.782372 24065 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.846932 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 46721.3us
I20260709 13:07:16.716078 24098 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:07:16.797832 24109 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:16.985471 21493 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:07:16.952975 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.987762 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 316954us
I20260709 13:07:16.853379 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:16.989315 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:16.824038 24087 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.919790 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:16.989337 21492 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
W20260709 13:07:16.991444 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 71788us
I20260709 13:07:16.813438 23153 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:16.956291 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 51160.1us
I20260709 13:07:16.819237 24074 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.996898 21562 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:16.820509 23975 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:17.016237 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 228487us
W20260709 13:07:17.022182 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 209894us
I20260709 13:07:16.939400 24119 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:17.024264 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:17.025183 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:16.842856 23808 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:07:16.852934 24128 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:16.984761 22239 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:16.798233 23986 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:16.986760 22243 rpcz_store.cc:269] 0709 13:07:15.347384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.372601 (+ 25217us) service_pool.cc:224] Handling call
0709 13:07:16.580601 (+1208000us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdf8c 00007f98a6ebdef6 0000000000375939 00007f98aef311e0 00007f98aeffa0c4 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:16.765676 (+185075us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14719872}
W20260709 13:07:17.047464 24093 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:17.027801 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:16.856434 23750 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:16.938714 23942 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:07:17.045347 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.923038 24113 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.017493 24078 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.059069 24125 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.001241 23153 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.856621 24132 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:17.017527 23919 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:16.844177 24076 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.877271 24024 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:17.025504 24089 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:07:17.080780 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53032.6us
I20260709 13:07:17.023844 24119 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:17.002525 24074 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.085469 23942 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:17.085642 23750 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.086839 23905 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:17.003389 24065 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.049937 23975 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.095502 24135 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.096149 23977 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:17.209991 24134 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
W20260709 13:07:17.210698 24140 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:07:17.046037 24090 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:17.097936 24116 consensus_meta.cc:287] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.000s
I20260709 13:07:17.098835 23808 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:17.100382 24111 consensus_meta.cc:287] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.005s
I20260709 13:07:17.100744 24109 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:17.082875 22239 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 522) took 1683 ms (client timeout 1957 ms). Trace:
W20260709 13:07:17.109467 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.846282 22240 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
W20260709 13:07:17.122438 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.116053 24132 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:17.191768 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.150672 23919 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.115753 23968 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:17.208940 24076 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:17.131702 24113 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.115260 24078 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.334560 22245 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:17.333905 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:17.388849 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 388021us
W20260709 13:07:17.402554 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 68711.8us
I20260709 13:07:17.433590 21492 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:07:17.333422 24118 consensus_meta.cc:287] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.003s
I20260709 13:07:17.151134 24125 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.435402 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:17.336294 24132 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.211318 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:17.437539 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 344453us
I20260709 13:07:17.202181 23858 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.336005 23968 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.337181 23919 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.470541 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:17.526727 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 92128.9us
I20260709 13:07:17.527704 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:17.529245 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:17.310037 24115 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:17.215978 23975 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:17.336696 23936 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.436244 24109 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:17.334276 22239 rpcz_store.cc:269] 0709 13:07:15.390220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.391914 (+  1694us) service_pool.cc:224] Handling call
0709 13:07:16.519789 (+1127875us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebde9c 00007f98a6ebda5b 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:17.073088 (+553299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6975616}
I20260709 13:07:17.211328 24090 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:17.337255 23750 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:17.220172 24119 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:17.439009 24065 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:17.538290 24098 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:17.525520 23968 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.402344 24116 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:17.538463 24136 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.551498 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:17.555197 23942 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:17.559283 24097 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:17.546546 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 280) took 1380 ms. Trace:
I20260709 13:07:17.405498 24099 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:17.195415 24024 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.525631 24000 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.340178 24111 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.559587 23770 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:17.547053 23905 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 13:07:17.500772 24118 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.533514 23858 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.543757 24145 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 1, Time since last communication: 0.152s
W20260709 13:07:17.707599 21643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1890) took 3137 ms (client timeout 2203 ms). Trace:
I20260709 13:07:17.740300 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1670) took 1103 ms. Trace:
W20260709 13:07:17.880211 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 350992us
I20260709 13:07:18.077301 21485 rpcz_store.cc:276] 0709 13:07:16.636780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.637096 (+   316us) service_pool.cc:224] Handling call
0709 13:07:17.740051 (+1102955us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400299854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:17.740215 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360673664}
W20260709 13:07:17.880398 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.711539 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.079514 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:18.077925 21491 rpcz_store.cc:276] 0709 13:07:16.165787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.170551 (+  4764us) service_pool.cc:224] Handling call
0709 13:07:16.170914 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.458529 (+287615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.458573 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.458632 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:16.458705 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.546317 (+1087612us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54002765d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:17.546362 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.546482 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660826496}
W20260709 13:07:18.074376 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.610s (SENT) [suppressed 3 similar messages]
I20260709 13:07:18.086769 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2032) took 1180 ms. Trace:
W20260709 13:07:18.076942 21643 rpcz_store.cc:269] 0709 13:07:14.570035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.598733 (+ 28698us) service_pool.cc:224] Handling call
0709 13:07:16.086917 (+1488184us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:17.707308 (+1620391us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540024c054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:17.707503 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734389504}
I20260709 13:07:17.560112 24109 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:17.549779 23922 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:18.087308 21566 rpcz_store.cc:276] 0709 13:07:16.905924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.906112 (+   188us) service_pool.cc:224] Handling call
0709 13:07:16.990266 (+ 84154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.303422 (+313156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.303471 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.433108 (+129637us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.076531 (+643423us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:18.076581 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.076663 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.086533 (+  9870us) raft_consensus.cc:1685] finished
0709 13:07:18.086554 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.086704 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":710785,"threads_started":2,"wal-append.queue_time_us":641679}
I20260709 13:07:17.547106 24113 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:17.544766 23986 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:18.076089 23955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.008s	sys 0.008s
W20260709 13:07:17.637049 24081 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.052s	user 0.012s	sys 0.000s
W20260709 13:07:17.939692 23153 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.762s	user 0.001s	sys 0.009s
W20260709 13:07:17.673887 24143 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:07:18.039404 24087 consensus_meta.cc:287] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.014s	user 0.011s	sys 0.000s
I20260709 13:07:17.638126 23976 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.063023 24159 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.711828 24124 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:17.683522 23975 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.120265 21490 raft_consensus.cc:2368] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:17.740149 24135 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.754288 24078 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:17.580542 24119 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:17.668306 24148 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.561s
I20260709 13:07:17.755426 24125 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:17.709760 24090 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:18.169337 24024 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:18.175208 23975 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.176170 23975 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.176759 23975 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.136143 24081 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.179509 22242 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:18.106863 24109 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.108983 23942 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.118853 23922 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.128578 23955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.008s	sys 0.008s
I20260709 13:07:17.677068 23919 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.193198 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1680) took 1438 ms. Trace:
I20260709 13:07:18.193625 21493 rpcz_store.cc:276] 0709 13:07:16.755345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.987362 (+232017us) service_pool.cc:224] Handling call
0709 13:07:16.987730 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.988182 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.988227 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.553296 (+565069us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b2c000014c8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:07:17.553890 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.867099 (+313209us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.867155 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.867256 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.192879 (+325623us) raft_consensus.cc:1685] finished
0709 13:07:18.192900 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.193131 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1335,"raft.queue_time_us":94,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":26866,"spinlock_wait_cycles":14670080,"thread_start_us":312739,"threads_started":1,"wal-append.queue_time_us":627912}
I20260709 13:07:17.638616 24098 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:17.573935 23936 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.125447 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:18.097815 24099 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.123124 24168 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:18.155740 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 81377.9us
I20260709 13:07:17.560778 24115 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:18.140518 24074 consensus_meta.cc:287] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.932s	user 0.011s	sys 0.000s
I20260709 13:07:18.135690 24165 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.142874 23976 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:18.179656 21487 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:18.132498 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 53080.3us
I20260709 13:07:18.181087 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1913) took 1580 ms. Trace:
I20260709 13:07:18.137126 24113 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:18.224889 21637 rpcz_store.cc:276] 0709 13:07:16.600745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.602913 (+  2168us) service_pool.cc:224] Handling call
0709 13:07:16.649167 (+ 46254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.781716 (+132549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.781746 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.784937 (+  3191us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.951941 (+167004us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:16.951977 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.952124 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.180827 (+1228703us) raft_consensus.cc:1685] finished
0709 13:07:18.180854 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.181018 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154329,"raft.queue_time_us":132784,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8397,"thread_start_us":166636,"threads_started":1,"wal-append.queue_time_us":655780}
I20260709 13:07:18.161811 24119 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.139230 24124 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:18.156878 24132 consensus_meta.cc:287] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
W20260709 13:07:18.149708 22241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 520) took 2764 ms (client timeout 2241 ms). Trace:
I20260709 13:07:18.191334 24087 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:18.136446 23153 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.185904 24024 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.187969 24125 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.145082 24159 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:18.222163 24169 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:18.222004 24090 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:18.263309 24090 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.264997 22246 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:18.265359 24090 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:18.225198 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:18.098117 24136 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.208407 24170 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.267014 24159 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.267089 24170 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.265918 24090 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:18.268417 24090 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.269508 24170 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.270661 24090 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:18.195441 23922 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.195847 23942 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.229951 23919 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.260826 24125 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.262215 24118 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.271291 24136 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:18.271272 24090 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:18.276619 22245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 391) took 1227 ms. Trace:
W20260709 13:07:18.311400 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 86298.1us
I20260709 13:07:18.310083 22245 rpcz_store.cc:276] 0709 13:07:17.048846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.048968 (+   122us) service_pool.cc:224] Handling call
0709 13:07:17.334238 (+285270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.334974 (+   736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.276341 (+941367us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540016f150. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:18.276534 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655306112}
I20260709 13:07:18.284356 23153 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.285837 24099 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:18.286266 21391 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 233) took 15086 ms (client timeout 15000 ms). Trace:
I20260709 13:07:18.287294 23936 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:17.690711 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:18.320040 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:18.293560 23975 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.289901 24116 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:18.294095 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.290634 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 292) took 1371 ms. Trace:
I20260709 13:07:18.290509 23540 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:18.307583 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.316133 24170 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.220520 24168 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.331010 24170 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:18.331503 24170 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.314515 23916 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.241786 24113 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.323849 21492 rpcz_store.cc:276] 0709 13:07:16.919417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.992063 (+ 72646us) service_pool.cc:224] Handling call
0709 13:07:17.046678 (+ 54615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.434191 (+387513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.290296 (+856105us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540013abd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:18.290557 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889022336}
I20260709 13:07:18.215888 24074 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:18.326105 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.326399 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2034) took 1408 ms. Trace:
I20260709 13:07:18.249655 24132 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.230499 24165 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.330103 24125 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:18.330708 21594 heartbeater.cc:646] Failed to heartbeat to 127.19.231.190:34603 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.231.190:34603 timed out after 15.000s (SENT)
I20260709 13:07:18.258880 24081 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.291553 21388 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:07:18.334446 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:18.336195 24168 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:18.336782 23153 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.337842 23540 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:18.338645 24115 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:18.310648 23858 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.271965 24024 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.345052 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:18.345515 22244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 392) took 1287 ms. Trace:
I20260709 13:07:18.381601 22244 rpcz_store.cc:276] 0709 13:07:17.058263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.058408 (+   145us) service_pool.cc:224] Handling call
0709 13:07:17.058753 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.335578 (+276825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.335623 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.335682 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.335743 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.345288 (+1009545us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000d0554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:18.345334 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.345449 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368285568}
I20260709 13:07:18.344354 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:18.245594 22241 rpcz_store.cc:269] 0709 13:07:15.372810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.376867 (+  4057us) service_pool.cc:224] Handling call
0709 13:07:17.551361 (+2174494us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebdeee 0000000000375939 00007f98aef311e0 00007f98aeffa0c4 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:18.136603 (+585242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44946176}
I20260709 13:07:18.388218 21640 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:18.388850 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:18.256222 24087 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.392092 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1668) took 1757 ms. Trace:
I20260709 13:07:18.310159 24147 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.317027 24111 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.364279 24154 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:18.351208 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.350747 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:18.351959 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 128473us
I20260709 13:07:18.398018 21569 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.352092 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:18.352473 21560 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:07:18.315188 21391 rpcz_store.cc:269] 0709 13:07:03.216793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.216920 (+   127us) service_pool.cc:224] Handling call
0709 13:07:18.286186 (+15069266us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:12.443564 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:12.660187 (+216623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:12.660240 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:07:12.660253 (+    13us) tablet.cc:662] Decoding operations
0709 13:07:12.661833 (+  1580us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:12.661927 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:12.661961 (+    34us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:07:12.740267 (+ 78306us) tablet.cc:701] Row locks acquired
0709 13:07:12.740320 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:07:12.740513 (+   193us) write_op.cc:270] Start()
0709 13:07:12.740665 (+   152us) write_op.cc:276] Timestamp: P: 1783602432740448 usec, L: 0
0709 13:07:12.740688 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:12.741477 (+   789us) log.cc:844] Serialized 6049 byte log entry
0709 13:07:13.258109 (+516632us) op_driver.cc:464] REPLICATION: finished
0709 13:07:13.747573 (+489464us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a6ed80ac 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98ada18ef0
0709 13:07:14.101491 (+353918us) write_op.cc:301] APPLY: starting
0709 13:07:14.123001 (+ 21510us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:14.212840 (+ 89839us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:14.219782 (+  6942us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:14.341170 (+121388us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:14.341501 (+   331us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:07:14.341551 (+    50us) write_op.cc:312] APPLY: finished
0709 13:07:14.341978 (+   427us) log.cc:844] Serialized 107 byte log entry
0709 13:07:14.557216 (+215238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:14.573590 (+ 16374us) write_op.cc:454] Released schema lock
0709 13:07:14.596686 (+ 23096us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:14.597111 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:14.597144 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":947504,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":754275,"apply.run_cpu_time_us":29144,"apply.run_wall_time_us":534297,"num_ops":15,"prepare.queue_time_us":466044,"prepare.run_cpu_time_us":34548,"prepare.run_wall_time_us":645671,"raft.queue_time_us":137843,"raft.run_cpu_time_us":37549,"raft.run_wall_time_us":831652,"replication_time_us":473253,"spinlock_wait_cycles":68001408,"thread_start_us":1583654,"threads_started":5,"wal-append.queue_time_us":530856,"wal-append.run_cpu_time_us":72249,"wal-append.run_wall_time_us":2201545}]]}
I20260709 13:07:18.340817 23942 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.377777 23153 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.365213 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:18.366271 21564 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:18.368742 21637 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:18.362588 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:18.332602 23986 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:18.368871 21388 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 3 to 5, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 5 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.376246 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2031) took 1472 ms. Trace:
I20260709 13:07:18.411626 21636 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:18.290845 23976 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:18.379424 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 1.35421e+06us
I20260709 13:07:18.431391 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:18.316641 24090 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.389797 21561 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:18.392511 21487 rpcz_store.cc:276] 0709 13:07:16.634867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.635022 (+   155us) service_pool.cc:224] Handling call
0709 13:07:16.657561 (+ 22539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.230010 (+1572449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.391853 (+161843us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54000e15d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:18.392031 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3500046080}
I20260709 13:07:18.347316 21567 rpcz_store.cc:276] 0709 13:07:16.917867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.918046 (+   179us) service_pool.cc:224] Handling call
0709 13:07:16.969623 (+ 51577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.130986 (+161363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.131032 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.192764 (+ 61732us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.567033 (+374269us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.701627 (+134594us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.325949 (+624322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.326059 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.326119 (+    60us) raft_consensus.cc:1685] finished
0709 13:07:18.326140 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.326317 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":635361,"prepare.queue_time_us":134369,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":1928492,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"thread_start_us":444223,"threads_started":2,"wal-append.queue_time_us":432270}
I20260709 13:07:18.369973 24148 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:18.396934 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:18.349653 23916 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.391379 24125 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.317278 24124 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.458946 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:18.408443 24022 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.415077 21568 rpcz_store.cc:276] 0709 13:07:16.903809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.904010 (+   201us) service_pool.cc:224] Handling call
0709 13:07:16.904398 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.904688 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:16.952602 (+ 47914us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.017418 (+ 64816us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.282363 (+1264945us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b18002f0560. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:07:18.375897 (+ 93534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.375965 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:18.376015 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.376079 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.376186 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8114,"prepare.queue_time_us":57232,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":2613458,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":13235,"spinlock_wait_cycles":51901696,"thread_start_us":157383,"threads_started":2}
I20260709 13:07:18.398110 24098 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:18.436583 21459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.011s	sys 0.044s
W20260709 13:07:18.465253 21459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.015s	sys 0.048s
I20260709 13:07:18.452900 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:18.457849 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 95378.6us
I20260709 13:07:18.458837 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:18.393273 24076 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.333225 23975 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.406535 24147 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:18.404562 24151 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.520184 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 54004.3us
I20260709 13:07:18.520529 21569 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:18.410872 23942 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:18.521824 24090 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:18.522500 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:18.411164 24115 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:07:18.432413 24111 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.468202 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:18.477399 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.519254 23922 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:18.429275 24178 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 13:07:18.432288 24075 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.525118 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:18.529856 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:18.407153 24154 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.462432 23977 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:18.532647 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:18.533789 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:18.535054 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:18.535487 24109 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.535987 22240 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:18.536217 22241 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:18.536423 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:18.538123 21485 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:18.538636 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:18.519599 24124 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:18.540285 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.454938 24096 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 13:07:18.463053 24119 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.462168 24177 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:18.433707 23986 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.465065 24125 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.466859 24076 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.462636 23540 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.540604 21492 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:18.696187 23602 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.801116 24180 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.549486 23968 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.617842 24099 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.207s
I20260709 13:07:18.468024 23927 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:18.597740 21388 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 3 to 4, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 4 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:18.597620 23809 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:18.545627 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:18.539291 24151 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.760084 24024 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:18.745265 23942 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:18.524036 24182 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:18.766672 24132 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:18.617699 24111 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:18.811424 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.633693 24184 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:07:18.801317 23602 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.813413 21486 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:18.812522 21494 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:18.813978 24177 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.817303 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 327) took 2148 ms. Trace:
I20260709 13:07:18.465561 24022 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.817569 24125 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:18.817731 21563 rpcz_store.cc:276] 0709 13:07:16.668510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.668681 (+   171us) service_pool.cc:224] Handling call
0709 13:07:16.669134 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.294073 (+1624939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.294105 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.294704 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.350742 (+ 56038us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:18.396858 (+ 46116us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.407169 (+ 10311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.816905 (+409736us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54000a1c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:18.816958 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.817002 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:18.817095 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.817223 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1208167,"prepare.queue_time_us":186368,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":36,"raft.queue_time_us":1205766,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":11828,"spinlock_wait_cycles":1018755456,"thread_start_us":82637,"threads_started":2,"wal-append.queue_time_us":163423}
I20260709 13:07:18.806118 23927 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:18.629041 23858 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.820642 23858 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.820704 23927 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.811852 23986 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:18.802083 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 335445us
I20260709 13:07:18.815629 24178 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.865070 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.806942 22244 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:18.802901 21491 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:18.809938 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:18.868793 21485 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:18.802685 24075 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.872074 24075 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.873476 23927 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.823312 21493 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:18.819582 24022 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.885673 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:18.887540 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:18.888895 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:18.893509 21487 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:18.890201 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.535075 24165 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.528795 24087 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:18.879354 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:18.540141 24152 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.551246 23916 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.906725 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 389) took 1891 ms. Trace:
I20260709 13:07:18.906873 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:18.925397 21489 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.809983 23977 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:18.806574 23809 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:18.806815 21388 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 3 to 4, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 4 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:18.902559 23975 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.903313 24076 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:18.910995 23997 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.808842 23942 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.911752 24022 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.940629 24022 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.913546 23922 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:18.810338 24113 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:18.810364 24182 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:18.817682 24177 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:18.803771 24154 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.888545 23153 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.922313 21487 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:18.923236 24190 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.905563 23986 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:18.935909 21388 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 5, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 5 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:18.886127 24178 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.923596 24181 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:18.925961 23916 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.938524 23540 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:18.948297 23977 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.635226 24147 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.919622 24125 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:07:18.943872 23809 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.926169 24132 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:07:18.924386 24152 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.948760 24182 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.964516 24078 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:18.964666 23942 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.966351 23858 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:18.971977 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.961798 23986 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:18.979543 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.998909 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 93018.5us
I20260709 13:07:18.980943 21488 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:18.982969 21388 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 1 to 4, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 4 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.942629 23997 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:18.973481 23916 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:18.993919 24170 consensus_meta.cc:287] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.662s	user 0.005s	sys 0.005s
I20260709 13:07:18.966885 24181 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:18.984161 23922 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:18.961776 21489 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:19.007083 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:19.032407 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.033385 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:18.987828 23809 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.959131 24190 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.010226 21388 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:18.925174 22238 rpcz_store.cc:276] 0709 13:07:17.015110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.015312 (+   202us) service_pool.cc:224] Handling call
0709 13:07:17.015818 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.219547 (+203729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.219580 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.219641 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.219686 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.879586 (+1659900us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54005a2b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:18.888570 (+  8984us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.906651 (+ 18081us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467993984}
I20260709 13:07:19.045168 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:19.045755 21560 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.043638 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.028373 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:18.995679 24178 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:19.046872 21569 raft_consensus.cc:2410] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:19.047672 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:19.048171 21569 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.029096 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.049487 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:18.985834 24152 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:18.986804 24078 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:19.009035 23858 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:19.038019 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:18.975211 23540 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.078095 21388 catalog_manager.cc:5697] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 5, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 5 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.079665 21561 raft_consensus.cc:2410] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:19.079802 21388 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 3 to 4, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 4 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:19.072690 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.038686 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.031661 23922 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:19.043628 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.084298 21568 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:19.044286 21564 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:19.088644 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.044513 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.050470 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:19.052696 21490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1672) took 2392 ms (client timeout 1610 ms). Trace:
I20260709 13:07:19.090016 21566 raft_consensus.cc:2410] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:19.007803 23936 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:19.065905 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:19.012795 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:19.013476 24154 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.099561 21564 raft_consensus.cc:2410] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:19.071790 21569 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:19.009071 23153 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:19.072889 22245 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:19.038160 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.100833 21489 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:19.102015 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:19.103539 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:19.073307 21532 connection.cc:256] RPC call timeout handler was delayed by -1.7815395459999763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 13:07:19.104923 21532 connection.cc:256] RPC call timeout handler was delayed by -1.7815395459999763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 13:07:19.105404 21532 connection.cc:256] RPC call timeout handler was delayed by -1.7752395459999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 13:07:19.105865 21532 connection.cc:256] RPC call timeout handler was delayed by -1.6285395459999563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:07:19.106251 21532 connection.cc:256] RPC call timeout handler was delayed by -1.6159395460000496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:07:19.106635 21532 connection.cc:256] RPC call timeout handler was delayed by -1.6114395460000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
I20260709 13:07:19.076011 21560 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:19.076824 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:19.090258 21490 rpcz_store.cc:269] 0709 13:07:16.660701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.660851 (+   150us) service_pool.cc:224] Handling call
0709 13:07:19.052483 (+2391632us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54003f9b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:19.052628 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3048771968}
I20260709 13:07:19.091387 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.093482 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:19.094439 23540 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:19.095961 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.038203 23975 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.009208 24132 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:19.029036 24170 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:19.106868 22246 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 6 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:19.380198 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 303431us
I20260709 13:07:19.127631 21489 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:19.382728 21532 connection.cc:256] RPC call timeout handler was delayed by -1.6114395460000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:07:19.383134 21532 connection.cc:256] RPC call timeout handler was delayed by -1.5736395459999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:07:19.383189 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 89120.2us
W20260709 13:07:19.383464 21532 connection.cc:256] RPC call timeout handler was delayed by -1.5736395459999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:07:19.383850 21532 connection.cc:256] RPC call timeout handler was delayed by -1.5016395459999785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 13:07:19.384133 21532 connection.cc:256] RPC call timeout handler was delayed by -1.3252395460000344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:07:19.384406 21532 connection.cc:256] RPC call timeout handler was delayed by -1.3081395460000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 13:07:19.384696 21532 connection.cc:256] RPC call timeout handler was delayed by -1.2424395460000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
W20260709 13:07:19.384972 21532 connection.cc:256] RPC call timeout handler was delayed by -1.2289395459999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
W20260709 13:07:19.384992 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 71136.1us
W20260709 13:07:19.279985 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.386278 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:19.387622 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.079087 24022 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:19.107246 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51484.4us
I20260709 13:07:19.154771 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:19.405251 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.399801 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.400516 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.401582 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:19.406606 21490 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:19.407275 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:19.408155 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.083473 24152 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.408738 21566 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:19.414248 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.415169 21566 raft_consensus.cc:2368] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:19.073118 24196 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.412376 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.427122 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.427752 21485 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:19.426589 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.428913 21490 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:19.440287 21564 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:19.440462 21489 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:19.393421 24079 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.127890 24178 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.460923 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.461747 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.462412 21485 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:19.463554 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.464172 21490 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
W20260709 13:07:19.439726 24124 consensus_meta.cc:287] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 13:07:19.423836 23942 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.087337 23858 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.501493 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.487991 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:19.503157 21564 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.504230 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.105252 23936 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:19.127231 23153 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.454217 24079 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:19.417322 24132 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:19.417030 23975 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.128113 24154 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:19.179371 24078 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.280431 23922 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.466359 24112 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.465811 23997 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:19.615667 24125 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:19.616202 24125 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:19.616890 24109 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:19.617259 24125 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.620867 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.621742 21565 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:19.624068 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:19.625099 21492 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:19.626109 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.540145 24190 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:19.628711 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.629650 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.638662 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.433046 24152 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:19.639611 21494 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:19.640259 21562 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:19.640733 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.642133 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.644163 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:19.562898 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.645989 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:19.529652 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.520249 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.516867 21490 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:19.533891 24124 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.479262 23986 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:19.482383 24076 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.609993 21567 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.432618 24196 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.503918 23942 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:19.535967 24170 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:19.478900 24178 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.613658 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.614924 24112 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:19.541039 24181 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:19.536844 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:19.685046 22247 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.649338 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:19.661968 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.663255 21492 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:19.686594 21490 raft_consensus.cc:2410] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:19.648418 21561 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:19.587785 24079 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.672945 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:19.535540 24090 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:19.664387 21494 raft_consensus.cc:2410] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 9 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:19.670995 24124 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:19.668129 24076 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:19.709806 24076 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.709967 24111 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:19.689118 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.713301 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.714190 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 296) took 1189 ms. Trace:
I20260709 13:07:19.714707 21487 rpcz_store.cc:276] 0709 13:07:18.524453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.525632 (+  1179us) service_pool.cc:224] Handling call
0709 13:07:19.713974 (+1188342us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b5400396cd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:19.714109 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201705728}
I20260709 13:07:19.714622 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.725415 21562 raft_consensus.cc:2410] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:19.618685 24125 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.725997 21485 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:19.684330 23942 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.702425 21565 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:19.701794 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.771190 21561 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:19.747362 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.771811 21490 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:19.772341 21566 raft_consensus.cc:2410] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:19.775413 21640 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:19.775828 23916 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:19.778556 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.780491 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.782169 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.782612 21568 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:19.789887 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.790588 21566 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:19.791431 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.792790 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.793409 21561 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:07:19.793938 22247 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:19.794273 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.795950 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.796511 21635 raft_consensus.cc:2410] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:19.796656 21565 raft_consensus.cc:2368] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:19.782966 21638 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
I20260709 13:07:19.797358 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.797961 21565 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:19.798907 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.798904 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.799674 21561 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:19.800912 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.752435 21567 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:19.802937 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:19.804582 21485 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:19.805538 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.806386 21636 raft_consensus.cc:2410] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:19.808061 24178 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:19.701072 24090 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:19.809219 24090 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:19.810777 24112 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:19.813997 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.814726 21566 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:19.815564 21564 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:19.825650 21490 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:19.827955 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:19.830065 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.831131 21640 raft_consensus.cc:2410] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:19.833864 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.834255 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.834663 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:19.834918 21562 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:07:19.836162 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.826067 21490 pending_rounds.cc:85] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 3
I20260709 13:07:19.841823 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.842406 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.845971 21485 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.847002 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:19.847692 21640 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:19.851415 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.852752 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.855652 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.856837 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.844790 21561 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:19.864939 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.865877 21636 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:19.867710 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.868566 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:19.872476 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.892395 21566 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
W20260709 13:07:19.873757 22244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.009s	sys 0.019s
I20260709 13:07:19.893244 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:19.893498 22244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.009s	sys 0.019s
I20260709 13:07:19.893803 21566 raft_consensus.cc:2376] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8. Re-sending same reply.
I20260709 13:07:19.894665 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:19.839803 23936 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:19.848227 22243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.000s	sys 0.021s
W20260709 13:07:19.878841 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.840713 21490 pending_rounds.cc:107] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.4
I20260709 13:07:19.881680 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:19.905633 21490 raft_consensus.cc:2917] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Aborting config change with OpId 4.4: Aborted: Op aborted by new leader
I20260709 13:07:19.905877 21638 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.906347 21490 raft_consensus.cc:2889] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.882126 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.907722 21642 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:19.908617 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.909621 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.910076 21642 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:19.882411 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:19.884245 24075 consensus_meta.cc:287] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.012s	user 0.006s	sys 0.011s
I20260709 13:07:19.885018 21639 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.886070 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:19.887156 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.888167 21634 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:19.891085 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.910784 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.895754 21566 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:19.772800 24173 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:19.913821 21640 raft_consensus.cc:2410] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:19.913622 24173 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:19.840432 24124 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:19.914083 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.086846 21566 raft_consensus.cc:2410] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:20.087725 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.088376 21566 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:20.089143 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.089419 21638 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:20.090193 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.093972 24154 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:20.094527 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.098385 24200 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:07:20.085700 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:20.100087 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:20.100873 21639 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:20.090580 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:19.866334 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 459099us
W20260709 13:07:19.944053 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.131613 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.131922 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.133910 21606 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.610s (SENT)
I20260709 13:07:19.899528 22212 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:07:19.993858 22213 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.19.231.190:34603, user_credentials={real_user=slave}} blocked reactor thread for 88692.5us
I20260709 13:07:20.087750 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:19.912761 21635 raft_consensus.cc:2410] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:19.911604 21636 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:07:20.149745 21608 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.610s (SENT)
I20260709 13:07:20.150367 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:20.111353 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.163496 21639 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:07:20.163908 21639 pending_rounds.cc:85] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 4
I20260709 13:07:20.164181 21639 pending_rounds.cc:107] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:20.164433 21639 raft_consensus.cc:2889] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.165071 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:20.166131 21566 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:20.166641 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:19.902740 22243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.000s	sys 0.021s
W20260709 13:07:20.168287 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 268813us
I20260709 13:07:19.905632 23975 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:19.903266 24151 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:20.174281 21640 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:20.108431 24132 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:19.906945 23153 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:20.012794 24196 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:20.173292 24112 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:20.173797 24152 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:07:20.183823 24209 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.993645 24075 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.168656 24098 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:07:20.179598 24159 raft_consensus.cc:2764] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:20.169471 24124 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:20.210922 23809 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 1.165s	user 0.015s	sys 0.003s
I20260709 13:07:20.210453 24112 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:20.242341 24076 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 13:07:20.220597 24155 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:07:20.243769 24112 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.278486 24076 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.304512 24076 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:20.268373 24173 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:20.296190 24079 consensus_meta.cc:287] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 13:07:20.305768 24079 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.270526 24075 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:20.316627 24079 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:20.368582 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.373127 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:20.375294 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:19.899171 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:20.383373 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1710) took 1163 ms. Trace:
I20260709 13:07:20.384070 21490 rpcz_store.cc:276] 0709 13:07:19.219574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.775448 (+555874us) service_pool.cc:224] Handling call
0709 13:07:19.825305 (+ 49857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.382570 (+557265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.383121 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.384179 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:20.386308 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:20.387775 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1682) took 1373 ms. Trace:
I20260709 13:07:20.388371 21488 rpcz_store.cc:276] 0709 13:07:19.013866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.014228 (+   362us) service_pool.cc:224] Handling call
0709 13:07:19.014562 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.035691 (+ 21129us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:19.082614 (+ 46923us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.215680 (+133066us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.411689 (+196009us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.413077 (+  1388us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:19.849790 (+436713us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.850046 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.850143 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.387016 (+536873us) raft_consensus.cc:1685] finished
0709 13:07:20.387070 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.387451 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48838,"prepare.queue_time_us":142689,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":93,"raft.queue_time_us":246452,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":25517,"spinlock_wait_cycles":16128,"thread_start_us":575706,"threads_started":3,"wal-append.queue_time_us":613957}
I20260709 13:07:20.394382 21488 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.386188 21485 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:20.387811 21490 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:20.398562 21492 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.400523 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:20.401857 21493 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:20.426873 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:20.429920 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:20.431571 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.432008 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.434103 21560 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.891778 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.476451 21561 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:20.477923 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:19.912176 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.431805 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:20.445936 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.479612 21562 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:20.479962 21566 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:07:20.480504 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1734) took 1070 ms. Trace:
I20260709 13:07:20.480865 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:20.451341 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.451910 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.480819 21566 rpcz_store.cc:276] 0709 13:07:19.409967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.445091 (+1035124us) service_pool.cc:224] Handling call
0709 13:07:20.480431 (+ 35340us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:20.449378 21606 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.502s (SENT)
W20260709 13:07:20.483946 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.478673 21561 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:20.486055 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.482563 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.487685 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.494613 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:20.490610 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1748) took 1042 ms. Trace:
I20260709 13:07:20.498360 21562 rpcz_store.cc:276] 0709 13:07:19.447934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.482110 (+1034176us) service_pool.cc:224] Handling call
0709 13:07:20.490509 (+  8399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.499508 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.501580 21562 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:20.483978 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:20.506227 21566 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.512105 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1733) took 1102 ms. Trace:
W20260709 13:07:20.512398 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.520232 21562 rpcz_store.cc:276] 0709 13:07:19.409737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.500633 (+1090896us) service_pool.cc:224] Handling call
0709 13:07:20.501198 (+   565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.511026 (+  9828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.512000 (+   974us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:20.524645 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.525246 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1271) took 1998 ms. Trace:
I20260709 13:07:20.525792 21491 rpcz_store.cc:276] 0709 13:07:18.526555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.526664 (+   109us) service_pool.cc:224] Handling call
0709 13:07:18.526940 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.866332 (+339392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.524628 (+1658296us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540030d4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:20.525033 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634228992}
W20260709 13:07:20.529305 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 99697.2us
I20260709 13:07:20.504240 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1737) took 1093 ms. Trace:
I20260709 13:07:20.534401 22242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 535) took 1522 ms. Trace:
I20260709 13:07:20.535089 22241 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:20.535221 22243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 402) took 1487 ms. Trace:
W20260709 13:07:20.535872 21643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.019s	sys 0.034s
I20260709 13:07:20.539990 24182 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.540221 23976 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.541038 24000 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:20.542135 23975 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:07:20.612344 24152 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:20.613878 21606 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.599s (SENT)
I20260709 13:07:20.614877 24111 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:20.620257 21566 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:20.621999 24065 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.624817 24113 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:20.627084 21561 rpcz_store.cc:276] 0709 13:07:19.410659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.503023 (+1092364us) service_pool.cc:224] Handling call
0709 13:07:20.503493 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.503835 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.503856 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.503915 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:20.503969 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.504026 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.504154 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.648056 24000 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.648464 23976 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:20.649237 21608 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.502s (SENT)
I20260709 13:07:20.633266 22242 rpcz_store.cc:276] 0709 13:07:19.011631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.013643 (+  2012us) service_pool.cc:224] Handling call
0709 13:07:19.541040 (+527397us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:07:19.567373 (+ 26333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:19.797858 (+230485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.807094 (+  9236us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:19.807799 (+   705us) log.cc:844] Serialized 52 byte log entry
0709 13:07:19.937843 (+130044us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.170699 (+232856us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.200565 (+ 29866us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.533396 (+332831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.533574 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.533792 (+   218us) raft_consensus.cc:1685] finished
0709 13:07:20.533811 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.534146 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1655,"prepare.queue_time_us":226100,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":2858,"raft.queue_time_us":66920,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":56380,"spinlock_wait_cycles":24650496,"thread_start_us":129480,"threads_started":1,"wal-append.queue_time_us":298549}
I20260709 13:07:20.657444 21637 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:20.660599 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1728) took 1257 ms. Trace:
I20260709 13:07:20.661091 21560 rpcz_store.cc:276] 0709 13:07:19.403532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.539190 (+135658us) service_pool.cc:224] Handling call
0709 13:07:19.539600 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.475404 (+935804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.660231 (+184827us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b54001f90d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:20.660511 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055540992}
W20260709 13:07:20.664168 21643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.020s	sys 0.034s
I20260709 13:07:20.671417 21564 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:20.672461 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1744) took 1225 ms. Trace:
I20260709 13:07:20.673084 21564 rpcz_store.cc:276] 0709 13:07:19.446889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.663253 (+1216364us) service_pool.cc:224] Handling call
0709 13:07:20.663720 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.671973 (+  8253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.672362 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.676880 24079 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.639590 22243 rpcz_store.cc:276] 0709 13:07:19.048028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.050704 (+  2676us) service_pool.cc:224] Handling call
0709 13:07:19.094206 (+ 43502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.094633 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.094667 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.095224 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.178961 (+1083737us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:20.180311 (+  1350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.183374 (+  3063us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.198994 (+ 15620us) raft_consensus.cc:1685] finished
0709 13:07:20.199020 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.534998 (+335978us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":295,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":1073304,"threads_started":1,"wal-append.queue_time_us":978685}
I20260709 13:07:20.678092 24079 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.681964 24079 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:20.683645 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.664179 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:20.729197 23942 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.917s	user 0.014s	sys 0.000s
W20260709 13:07:20.737540 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.664887 24113 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.650619 24111 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:20.744280 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 312651us
I20260709 13:07:20.674472 24076 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.724131 22241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 536) took 1712 ms. Trace:
I20260709 13:07:20.729862 23942 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.741482 24113 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.744283 24111 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.753111 21561 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:20.753404 23602 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:20.754128 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1745) took 1306 ms. Trace:
I20260709 13:07:20.756913 24000 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:20.758878 21567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2046) took 1714 ms (client timeout 2104 ms). Trace:
W20260709 13:07:20.759706 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 120144us
I20260709 13:07:20.761341 21563 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.762991 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1727) took 1377 ms. Trace:
I20260709 13:07:20.763082 24098 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.763962 21562 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:20.764721 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1740) took 1346 ms. Trace:
I20260709 13:07:20.765110 21562 rpcz_store.cc:276] 0709 13:07:19.418841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.624046 (+1205205us) service_pool.cc:224] Handling call
0709 13:07:20.738284 (+114238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.764421 (+ 26137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.764641 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.754693 21561 rpcz_store.cc:276] 0709 13:07:19.447161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.724640 (+1277479us) service_pool.cc:224] Handling call
0709 13:07:20.741260 (+ 16620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.753711 (+ 12451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.754009 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.763413 21563 rpcz_store.cc:276] 0709 13:07:19.385668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.540356 (+154688us) service_pool.cc:224] Handling call
0709 13:07:20.760930 (+1220574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.761823 (+   893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.762723 (+   900us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000186d0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:20.762919 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2805919616}
W20260709 13:07:20.759377 21567 rpcz_store.cc:269] 0709 13:07:19.043880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.046696 (+  2816us) service_pool.cc:224] Handling call
0709 13:07:20.758497 (+1711801us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000186d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:20.758678 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483038976}
W20260709 13:07:20.772173 22210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.021s
W20260709 13:07:20.772617 22210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.005s	sys 0.021s
W20260709 13:07:20.772958 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 594572us
I20260709 13:07:20.776863 23968 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:20.777007 24112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.000s	sys 0.019s
I20260709 13:07:20.778579 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:20.779585 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 346) took 1102 ms. Trace:
W20260709 13:07:20.779889 22239 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 537) took 1767 ms (client timeout 1779 ms). Trace:
I20260709 13:07:20.780191 21563 rpcz_store.cc:276] 0709 13:07:19.676909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.777895 (+1100986us) service_pool.cc:224] Handling call
0709 13:07:20.778626 (+   731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.779078 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.779114 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.779169 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.779237 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.779334 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.779491 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.777709 23602 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:20.782953 24076 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.784096 23602 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.770671 23976 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:20.790447 24076 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:20.791842 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:20.792588 21568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2050) took 1742 ms (client timeout 1573 ms). Trace:
I20260709 13:07:20.793274 24152 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:20.793226 21568 rpcz_store.cc:269] 0709 13:07:19.050451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.085084 (+ 34633us) service_pool.cc:224] Handling call
0709 13:07:20.792026 (+1706942us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54003246d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:20.792291 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678339456}
I20260709 13:07:20.781587 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 347) took 1097 ms. Trace:
I20260709 13:07:20.796693 21567 rpcz_store.cc:276] 0709 13:07:19.683927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.773156 (+1089229us) service_pool.cc:224] Handling call
0709 13:07:20.773749 (+   593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.775039 (+  1290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.775112 (+    73us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.775268 (+   156us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:20.775396 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.781424 (+  6028us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.781529 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.796890 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:20.799777 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.796535 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:20.807891 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.780504 22239 rpcz_store.cc:269] 0709 13:07:19.012164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.013576 (+  1412us) service_pool.cc:224] Handling call
0709 13:07:20.778077 (+1764501us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:20.779748 (+  1671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17507712}
I20260709 13:07:20.810480 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.750672 22241 rpcz_store.cc:276] 0709 13:07:19.011911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.013724 (+  1813us) service_pool.cc:224] Handling call
0709 13:07:20.533794 (+1520070us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebde9c 00007f98a6ebda5b 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:07:20.534284 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.639490 (+105206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.684938 (+ 45448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17991936}
W20260709 13:07:20.815171 21608 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.072s (SENT)
I20260709 13:07:20.819334 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.820309 24090 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.821709 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:20.836584 24079 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:20.837267 24079 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.837687 24079 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.837949 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 348) took 1139 ms. Trace:
I20260709 13:07:20.838577 21564 rpcz_store.cc:276] 0709 13:07:19.727652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.836466 (+1108814us) service_pool.cc:224] Handling call
0709 13:07:20.837054 (+   588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.837337 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.837386 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.837471 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:20.837558 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.837641 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.837823 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.844540 24074 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:20.845646 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2060) took 1035 ms. Trace:
I20260709 13:07:20.846212 21564 rpcz_store.cc:276] 0709 13:07:19.810445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.844138 (+1033693us) service_pool.cc:224] Handling call
0709 13:07:20.844701 (+   563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.845098 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.845148 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.845225 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.845327 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.845407 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.845571 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.817898 23602 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:20.851761 21569 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
W20260709 13:07:20.854375 24206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.018s	sys 0.018s
I20260709 13:07:20.854847 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:20.857003 24152 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:20.890651 24182 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:20.891151 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 117377us
I20260709 13:07:20.891306 24182 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:20.893046 24182 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.895267 23922 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:20.899528 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.887027 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.902966 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1320) took 1016 ms. Trace:
I20260709 13:07:20.903393 21639 rpcz_store.cc:276] 0709 13:07:19.886532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.101488 (+214956us) service_pool.cc:224] Handling call
0709 13:07:20.145576 (+ 44088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.164857 (+ 19281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.902525 (+737668us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b540021b950. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:20.902775 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100565760}
I20260709 13:07:20.907191 21568 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:20.887445 21561 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:20.888243 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 1944) took 1047 ms. Trace:
I20260709 13:07:20.899477 23858 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:20.875679 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.912093 21637 rpcz_store.cc:276] 0709 13:07:19.841157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.841271 (+   114us) service_pool.cc:224] Handling call
0709 13:07:20.867552 (+1026281us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540005d7d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:20.888181 (+ 20629us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301891328}
I20260709 13:07:20.918870 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:20.919668 21560 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.920483 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:20.921748 24127 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.922194 24127 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.922607 24127 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.926282 21569 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:20.926928 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.927646 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.928170 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:20.926985 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2063) took 1083 ms. Trace:
I20260709 13:07:20.929178 23153 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.929674 23153 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:20.930151 23153 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.929770 23540 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:20.926985 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2062) took 1115 ms. Trace:
I20260709 13:07:20.935163 21569 rpcz_store.cc:276] 0709 13:07:19.811159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.911173 (+1100014us) service_pool.cc:224] Handling call
0709 13:07:20.925863 (+ 14690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.926696 (+   833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.926917 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.937126 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1689) took 1921 ms. Trace:
I20260709 13:07:20.937469 23942 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:20.937572 21492 rpcz_store.cc:276] 0709 13:07:19.016130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.687074 (+670944us) service_pool.cc:224] Handling call
0709 13:07:19.688104 (+  1030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.399329 (+711225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.936801 (+537472us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54000f5854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:20.937053 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1632328576}
I20260709 13:07:20.938210 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:20.939363 23942 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:20.939805 23942 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.940213 23942 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.941007 21567 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:20.941371 21567 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:20.938372 24182 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.943575 21563 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:20.944464 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2061) took 1133 ms. Trace:
I20260709 13:07:20.944977 21563 rpcz_store.cc:276] 0709 13:07:19.810843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.853561 (+1042718us) service_pool.cc:224] Handling call
0709 13:07:20.943185 (+ 89624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.944124 (+   939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.944391 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.942188 21567 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:20.947276 21567 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.929205 21566 rpcz_store.cc:276] 0709 13:07:19.843649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.926111 (+1082462us) service_pool.cc:224] Handling call
0709 13:07:20.926420 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.926670 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.926696 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.926734 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.926769 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.926838 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.926917 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.951862 24127 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:20.959391 21608 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.143s (SENT)
W20260709 13:07:20.961995 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 152966us
I20260709 13:07:20.963503 21560 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
W20260709 13:07:20.969252 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56312us
I20260709 13:07:20.975144 24165 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.975800 24165 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.976318 24165 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.977187 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:20.978380 23858 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:20.978914 23858 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:20.979918 23858 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:20.984328 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:20.985363 22241 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:20.970978 24113 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:20.913662 24206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.021s	sys 0.022s
I20260709 13:07:20.993942 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 349) took 1088 ms. Trace:
I20260709 13:07:20.995046 21567 rpcz_store.cc:276] 0709 13:07:19.899034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.940428 (+1041394us) service_pool.cc:224] Handling call
0709 13:07:20.940828 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.986708 (+ 45880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.986734 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.986771 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:20.986828 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.986887 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.986996 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7678}
I20260709 13:07:20.997334 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 345) took 1326 ms. Trace:
W20260709 13:07:20.997851 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 67285.9us
I20260709 13:07:20.997771 21561 rpcz_store.cc:276] 0709 13:07:19.670656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.770999 (+1100343us) service_pool.cc:224] Handling call
0709 13:07:20.870159 (+ 99160us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.912628 (+ 42469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.997130 (+ 84502us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b54001e0350. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:20.997271 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139834240}
I20260709 13:07:21.001500 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:21.002674 24164 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.005298 24113 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:21.008782 24173 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.009557 24173 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:20.953866 24111 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:21.023293 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:21.029953 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:21.028208 23153 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.033883 24078 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.037448 24173 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:21.039335 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:21.040199 21489 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.050239 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:21.055341 24111 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:21.067863 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:21.079221 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:21.083906 24225 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:07:21.085101 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:21.085721 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.083608 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.088840 21494 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.089123 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:21.090193 21492 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:21.091096 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.093928 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 66324.4us
W20260709 13:07:21.102401 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.108423 21489 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:21.112250 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.112525 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.113297 21642 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:21.113755 21486 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:21.115489 22242 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:21.108214 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:21.115935 21486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1686) took 2100 ms (client timeout 1502 ms). Trace:
W20260709 13:07:21.116389 21486 rpcz_store.cc:269] 0709 13:07:19.015228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.031309 (+ 16081us) service_pool.cc:224] Handling call
0709 13:07:21.115697 (+2084388us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001824d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:21.115850 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4542541056}
I20260709 13:07:21.117543 22244 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.109639 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.122772 23153 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:21.127300 22247 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:21.108642 24111 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.129102 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.124178 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.133879 23977 raft_consensus.cc:2764] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:21.107527 24079 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.146265 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:21.147557 24079 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:21.149034 24226 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:07:21.149240 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.152941 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 344) took 1499 ms. Trace:
I20260709 13:07:21.150696 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:21.157578 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:21.158819 21606 leader_election.cc:336] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 2.047s (SENT)
W20260709 13:07:21.159739 21606 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 2.072s (SENT)
I20260709 13:07:21.160200 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:21.161015 24173 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:21.161391 21606 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 2.120s (SENT)
W20260709 13:07:21.161981 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.163516 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:21.164211 21563 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.166978 24127 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:21.168946 23942 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.171475 22241 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 5. Ops: []
I20260709 13:07:21.153450 21562 rpcz_store.cc:276] 0709 13:07:19.653948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.771035 (+1117087us) service_pool.cc:224] Handling call
0709 13:07:20.808419 (+ 37384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.826350 (+ 17931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.826392 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.888506 (+ 62114us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.964334 (+ 75828us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.968482 (+  4148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.968564 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.150345 (+181781us) raft_consensus.cc:1685] finished
0709 13:07:21.150365 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.152853 (+  2488us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10523,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":242,"thread_start_us":38866,"threads_started":1,"wal-append.queue_time_us":74378}
I20260709 13:07:21.173496 21563 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:21.146433 24165 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:21.171429 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.175351 21492 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:21.206871 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.184728 21564 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.186098 24111 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.210361 24165 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:21.187465 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 65618.6us
I20260709 13:07:21.215487 21459 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.216385 24165 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:21.224951 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:21.227937 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:21.229318 24182 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:21.229660 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 99415.7us
I20260709 13:07:21.222646 24111 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.234962 24127 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:21.236788 24127 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:21.241498 21562 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.237980 24111 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:21.266659 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.239614 24078 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.251631 23942 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:21.281450 24112 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:07:21.297734 24112 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:21.298203 24112 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:21.299355 24112 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.253523 24173 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:21.293946 24177 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:21.305578 24177 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:21.301190 23942 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:21.305955 24112 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.307343 23942 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.309924 23942 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:21.310062 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:21.310811 22241 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.306030 24177 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:21.312551 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.312959 24173 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:21.313413 24173 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:21.313975 22247 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 6 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:21.314386 23977 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.315106 21563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:21.315891 21563 raft_consensus.cc:606] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.316386 21563 raft_consensus.cc:614] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:21.315797 24177 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.317627 24177 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.314011 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.318743 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:21.320894 24173 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.251390 24127 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:21.324036 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.347708 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.348371 21637 raft_consensus.cc:2376] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6. Re-sending same reply.
I20260709 13:07:21.349776 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.350589 21634 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:21.350937 23922 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.351311 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.350960 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.351995 23977 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.352891 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.353245 24173 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.353597 21640 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.351229 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.350664 21639 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:21.358596 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:21.359314 22244 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:21.359561 22241 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:21.360298 22243 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.360231 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.361116 21492 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:21.359592 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.362353 21489 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.362985 21639 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.365653 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.368083 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.368535 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.369865 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.339210 21563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:21.370735 21639 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:21.371176 21563 raft_consensus.cc:606] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.341029 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:21.373051 21561 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
W20260709 13:07:21.341826 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.343096 22247 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:21.374714 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.375511 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.375985 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:21.376343 21489 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:21.376865 23809 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:21.377198 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.378067 23809 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.378419 23809 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:21.378778 23809 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.378720 21561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:21.379693 21561 raft_consensus.cc:606] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.382726 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.386046 21561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:21.386823 21561 raft_consensus.cc:606] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.387310 21561 raft_consensus.cc:614] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:21.327646 21564 raft_consensus.cc:2410] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:21.389592 24177 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:21.391050 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.391829 21634 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:21.391990 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.393006 24111 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:21.399359 24111 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:21.386294 24173 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:21.400920 23922 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:21.401767 24125 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:21.402891 24125 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:21.403334 24125 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:21.404795 24125 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:21.406384 24125 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.407683 21640 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:21.409232 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:21.410320 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:21.455493 22247 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:21.410442 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.411046 23922 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:21.411772 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.411907 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:21.458492 22244 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:21.413046 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.419219 24090 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:21.420042 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:07:21.423921 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.423826 21562 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:21.425578 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.430886 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:21.432742 23809 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.435528 21642 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:21.440248 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.441980 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.442217 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.442566 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.443696 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.443974 21636 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:21.443710 21639 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:07:21.466269 21639 pending_rounds.cc:85] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 4
I20260709 13:07:21.455605 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2065) took 1586 ms. Trace:
W20260709 13:07:21.462663 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.469571 21487 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 5: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.463788 21642 pending_rounds.cc:85] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 4
I20260709 13:07:21.470932 21643 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:21.472355 21642 pending_rounds.cc:107] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:21.482422 21642 raft_consensus.cc:2889] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.483990 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.466637 21639 pending_rounds.cc:107] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:21.484630 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:21.483382 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 79427.7us
I20260709 13:07:21.485309 21639 raft_consensus.cc:2889] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:21.492583 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.495226 21487 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:21.497300 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:21.471686 21569 rpcz_store.cc:276] 0709 13:07:19.868869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.936192 (+1067323us) service_pool.cc:224] Handling call
0709 13:07:20.936626 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.936996 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:20.997763 (+ 60767us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.455173 (+457410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.455242 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:21.455299 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.455385 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.455542 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":92565,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":39,"raft.queue_time_us":131,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":94,"thread_start_us":426878,"threads_started":2,"wal-append.queue_time_us":402194}
I20260709 13:07:21.499716 21637 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.493381 21641 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
I20260709 13:07:21.491732 21634 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:21.501360 24078 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.501569 21492 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:21.502008 24078 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:21.502738 21606 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:21.503751 24165 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:21.504272 24078 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:21.503839 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:21.505064 21489 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.505734 24173 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.506177 24173 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:21.506644 24173 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.512426 23809 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:21.512429 24113 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:21.525126 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.526826 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:21.527474 21562 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.531486 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.532660 21635 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:21.535387 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.523649 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:21.538842 21562 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:21.498225 24111 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.540512 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:07:21.539805 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 114344us
I20260709 13:07:21.543637 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:21.552055 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:21.547536 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.522122 24079 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:21.574574 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 61207.9us
I20260709 13:07:21.576115 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.524641 24125 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.580196 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.581519 21638 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:21.580123 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.580123 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.582830 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:21.582298 21635 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:21.589897 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.589946 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.596294 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.589087 21640 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.580281 23602 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:21.581254 24164 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.603430 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:21.605713 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.599035 24079 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:21.612090 24177 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.612546 24177 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:21.613457 24177 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.607674 21642 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:21.617147 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.601835 24113 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:21.619266 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.600824 24165 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:21.623958 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.624809 21494 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.619158 21492 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:21.617300 23858 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.646330 21489 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.615638 24177 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.615653 24164 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:21.651262 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.656044 21641 raft_consensus.cc:2410] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:21.652733 21487 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:21.654358 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.620522 23602 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:21.658926 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.666077 21489 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.671159 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.671195 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.607786 24247 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:07:21.679309 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.680181 21491 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.681214 24078 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:21.682963 21637 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:21.683084 24248 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:07:21.687260 24125 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.687752 24125 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.695420 23602 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:21.677078 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 75224.9us
I20260709 13:07:21.655339 23858 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.722396 21640 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:21.723628 21637 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:21.725687 24113 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:21.727190 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:21.728259 21493 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:21.728587 21492 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.737838 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.740056 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.740437 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.746253 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.734316 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.753796 21489 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:21.754933 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.727938 23858 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.730460 24165 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:21.761935 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:21.757355 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:21.759016 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.763139 21641 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:21.769040 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.769727 21493 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:07:21.759402 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 108792us
I20260709 13:07:21.756953 21494 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:21.756878 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:21.771785 21459 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.772716 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.776237 24164 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.771173 21490 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:21.804008 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.807598 21564 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:07:21.809397 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.825985 21486 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:21.755044 24079 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.814352 24173 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.820427 22240 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:21.821672 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:21.823166 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 167597us
I20260709 13:07:21.833341 22238 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.834815 24256 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.835546 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.836189 21490 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:21.837493 24173 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:21.839138 23942 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:21.839186 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 67528us
I20260709 13:07:21.842423 21459 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:21.843253 24256 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.844981 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:21.846204 21459 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:21.831506 21491 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.851410 21642 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.748584 24113 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.859154 24258 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.860558 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:21.861408 24173 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.861878 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:21.862736 24173 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.863168 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.863948 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.864418 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.864712 21489 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:21.865145 21486 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.866034 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:21.866736 22240 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:21.850749 24256 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.868654 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.869493 21491 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.874094 22240 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.874120 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.876035 21638 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:21.885195 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.854295 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.884831 23858 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.891901 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.895704 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.896274 21640 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.897519 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.898138 21642 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.898304 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.898919 21636 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:21.899080 23922 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.899345 24078 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.899535 23922 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:21.899772 24078 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.900080 21636 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:21.900151 24078 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.900432 23922 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.901713 23922 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.901924 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.902522 21638 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.903045 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:21.903916 21635 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:21.906975 21639 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.895980 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.909765 21640 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
W20260709 13:07:21.894192 21532 connection.cc:256] RPC call timeout handler was delayed by -1.5306865879999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 13:07:21.912561 21532 connection.cc:256] RPC call timeout handler was delayed by -1.2759865880000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 13:07:21.912869 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0599865880000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 13:07:21.913149 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0545865880000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 13:07:21.913422 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0005865880000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 13:07:21.913709 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0005865880000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 13:07:21.914324 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.915462 21637 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:21.919484 24125 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:21.921859 24125 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:21.926139 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 71963.7us
I20260709 13:07:21.926276 21638 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:21.927062 21634 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.929169 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:21.932847 24113 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:21.933118 24259 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:21.933974 24113 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.928702 24079 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:07:21.908761 24165 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:21.936173 24076 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.936578 24076 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:21.939476 21486 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:21.943239 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:21.937938 24252 raft_consensus.cc:1064] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:07:21.936513 24113 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:21.947366 24076 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:21.959474 24078 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:21.922706 24112 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:07:21.952394 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:21.962287 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.963188 24256 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:21.963727 24256 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:21.964999 24113 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:21.964615 24256 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:21.965555 24113 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:21.967876 24258 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:21.968222 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:21.948093 23858 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:21.972630 21639 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:21.966499 24113 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:21.984644 21635 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.987591 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:21.988708 21641 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
W20260709 13:07:21.992810 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.000600 21642 raft_consensus.cc:2410] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:21.982749 24258 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:07:22.004338 21491 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:22.004742 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 89773.3us
I20260709 13:07:22.021080 24254 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:22.022225 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 49555.5us
I20260709 13:07:22.013677 23977 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.030815 24076 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:22.032898 24252 raft_consensus.cc:1068] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Unable to promote non-voter 549b31ac31b6428994b45938abc223a7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:22.036193 24078 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:22.024080 23809 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.037117 23809 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.034507 23977 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:07:22.024055 24254 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:22.056483 23809 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:22.057636 24254 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:22.056061 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:22.062956 21564 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:22.069046 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:22.069298 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 100291us
W20260709 13:07:22.056509 24263 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:22.072464 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:22.075153 21635 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:07:22.075754 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 351106us
W20260709 13:07:22.089601 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.101332 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:22.104631 21389 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 2 to 3, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:22.109478 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:22.101337 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 75636.3us
I20260709 13:07:22.106209 21389 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:22.134105 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:22.134327 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:22.135478 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:22.136598 21491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:07:22.137230 21491 raft_consensus.cc:606] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.134105 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:22.138533 21486 raft_consensus.cc:2376] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7. Re-sending same reply.
W20260709 13:07:22.139379 21388 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 141) took 17169 ms (client timeout 15000 ms). Trace:
I20260709 13:07:22.143929 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:22.146865 23922 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.100140 24111 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:22.139780 21388 rpcz_store.cc:269] 0709 13:07:05.067937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.072146 (+  4209us) service_pool.cc:224] Handling call
0709 13:07:22.139135 (+17066989us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:20.107342 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:20.107969 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:20.108016 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:07:20.108033 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:20.259149 (+151116us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:20.259229 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:20.259270 (+    41us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:20.260237 (+   967us) tablet.cc:701] Row locks acquired
0709 13:07:20.260263 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:07:20.260470 (+   207us) write_op.cc:270] Start()
0709 13:07:20.260605 (+   135us) write_op.cc:276] Timestamp: P: 1783602440260407 usec, L: 0
0709 13:07:20.260641 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:07:20.261474 (+   833us) log.cc:844] Serialized 3692 byte log entry
0709 13:07:21.299612 (+1038138us) op_driver.cc:464] REPLICATION: finished
0709 13:07:21.435693 (+136081us) write_op.cc:301] APPLY: starting
0709 13:07:21.435822 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:21.436157 (+   335us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:21.436336 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:21.506315 (+ 69979us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:21.506730 (+   415us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:07:21.506814 (+    84us) write_op.cc:312] APPLY: finished
0709 13:07:21.507319 (+   505us) log.cc:844] Serialized 71 byte log entry
0709 13:07:21.507531 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:21.507767 (+   236us) write_op.cc:454] Released schema lock
0709 13:07:21.507837 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:21.508374 (+   537us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:21.508412 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":575059,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":135685,"apply.run_cpu_time_us":5349,"apply.run_wall_time_us":72652,"num_ops":9,"prepare.queue_time_us":687528,"prepare.run_cpu_time_us":49584,"prepare.run_wall_time_us":980905,"raft.queue_time_us":306419,"raft.run_cpu_time_us":1463,"raft.run_wall_time_us":154261,"replication_time_us":1038543,"thread_start_us":1526276,"threads_started":4,"wal-append.queue_time_us":556509}]]}
W20260709 13:07:22.192412 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 169521us
I20260709 13:07:22.201584 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:22.203016 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:22.206635 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.211935 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:22.133993 21389 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 5 to 6, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 6 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:22.204752 24264 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:07:22.221659 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:22.222174 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 112770us
I20260709 13:07:22.222822 21560 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:22.224934 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:22.225639 21562 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.226352 21486 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:22.226715 21486 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:22.228437 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.217017 23942 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.229992 21389 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 4 to 5, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 5 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.230753 21566 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:22.240283 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:22.252573 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:22.256768 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:22.257490 21566 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.261439 21486 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.266593 21486 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.267870 24165 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:22.270467 21565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "549b31ac31b6428994b45938abc223a7"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:22.272293 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.273418 21564 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:22.273801 24258 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.274858 24164 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:22.280151 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.277015 21389 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:22.281423 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.279670 24127 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:22.284305 24166 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.287549 21389 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 5 to 6, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 6 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.298360 21566 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:22.302218 22242 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:22.308681 24164 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:22.308933 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 177115us
I20260709 13:07:22.309696 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.327844 21389 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 3 to 4, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 4 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.329485 21561 raft_consensus.cc:1217] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 13:07:22.334275 21486 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:22.325958 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:22.335274 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47232.3us
W20260709 13:07:22.336279 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 78851.7us
I20260709 13:07:22.348065 24111 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.348698 24111 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:22.348907 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:22.349785 24250 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:22.350001 24111 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:22.350939 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:22.351825 24250 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.351926 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:22.352809 24250 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.353336 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:22.354303 24260 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.344177 21566 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:22.354876 24260 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.355223 24260 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.356634 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.354292 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:22.357611 23922 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.357738 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:22.360749 21561 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:22.340732 21562 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:22.353510 24250 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:22.351121 21389 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 3 to 5, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 5 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:22.363029 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:22.365041 24256 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.365224 24076 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:22.365628 24256 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:22.368649 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 59058.9us
I20260709 13:07:22.375172 24251 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:22.376034 24251 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:22.377424 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.376842 21389 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 2 to 7, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 7 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:07:22.380580 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 92308.2us
I20260709 13:07:22.383211 24251 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.387465 24112 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.387769 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:22.388259 24271 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.389029 24271 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.383888 21389 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 3 to 5, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 5 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:22.360618 23977 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:22.389747 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:22.369665 24250 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.387920 24112 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.363840 23922 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:22.391058 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.364041 24164 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:22.392182 21565 raft_consensus.cc:606] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Received request to transfer leadership to TS 549b31ac31b6428994b45938abc223a7
I20260709 13:07:22.393101 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.390167 21389 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 3 to 4, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 4 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.360523 24258 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 13:07:22.381503 21608 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.599s (SENT)
I20260709 13:07:22.404338 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:22.404927 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:22.400167 23922 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.389748 24113 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.390772 24166 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.416072 24078 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.390169 24271 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:07:22.418118 24257 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.420125 24271 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:22.416193 24277 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.421979 24277 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:22.423991 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:22.394455 24112 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.423349 24277 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:22.430209 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48734.1us
I20260709 13:07:22.431237 23809 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.431797 23809 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:22.432816 23809 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.439747 24260 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:22.366865 24256 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:22.442348 24260 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:22.443136 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:22.444672 24257 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.445227 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:22.446316 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:22.406618 24252 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.451020 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 49132.3us
I20260709 13:07:22.458971 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.447240 24257 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.414376 24255 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:22.456637 24113 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.474021 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:22.475766 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.466022 24260 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.476897 24113 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.465127 24252 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:22.433583 24164 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.488214 23977 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:22.503839 24280 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:07:22.517122 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 70874.8us
I20260709 13:07:22.477744 24165 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:22.504973 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 135387us
I20260709 13:07:22.514379 21389 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 4 to 6, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 6 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.489980 24260 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.470465 24257 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:22.497262 24254 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.533190 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:22.535846 21639 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:22.504653 24113 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.517953 23977 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:22.538954 21608 leader_election.cc:336] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.566s (SENT)
I20260709 13:07:22.544055 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:22.530189 24260 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:22.548415 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 59781.5us
I20260709 13:07:22.555418 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:22.479223 24255 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.536381 24279 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.560123 24279 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:22.558559 24281 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:07:22.549250 24291 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.535652 23602 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:07:22.537038 24277 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:07:22.543751 24286 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.580771 21564 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:22.581403 24295 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.606204 21389 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 3 to 4, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 4 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:22.560585 24279 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.617046 21563 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:22.625316 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 86388.7us
I20260709 13:07:22.630182 21389 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:22.632315 21491 raft_consensus.cc:3055] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:22.632835 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 87212.7us
I20260709 13:07:22.635818 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:22.632683 21491 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:22.608220 23602 consensus_queue.cc:1243] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:22.624589 23977 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:22.662978 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:22.627703 24165 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:07:22.646277 24277 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.669484 24277 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.669888 24277 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.664055 21491 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.674204 24296 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:22.674866 24296 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.676043 21491 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.624053 24286 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:22.684285 24303 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:22.685461 24287 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:07:22.691043 24252 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:22.691983 24255 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:22.667770 24270 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:07:22.695079 24288 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:07:22.705094 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 125646us
I20260709 13:07:22.697717 24252 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.734740 21635 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:22.735695 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:22.727582 24291 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:22.734017 24257 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:22.742139 24079 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:22.778864 24291 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.740247 24252 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:22.810483 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 155366us
I20260709 13:07:22.813005 21562 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:22.813494 21562 pending_rounds.cc:85] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 7
I20260709 13:07:22.813733 21562 pending_rounds.cc:107] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:22.813983 21562 raft_consensus.cc:2889] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.799569 24250 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:22.798542 24256 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:22.798992 24257 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.812964 24255 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:22.854765 24250 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:22.838301 24112 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:22.843348 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 106451us
W20260709 13:07:22.865036 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 121687us
I20260709 13:07:22.874477 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:22.878562 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.845526 24079 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:22.910003 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:22.873026 24256 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:22.913416 24078 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.914290 24308 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.914731 24308 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:22.915103 24308 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:22.920065 23922 consensus_meta.cc:287] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:07:22.845932 24257 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.923630 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:22.932262 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 284191us
I20260709 13:07:22.911755 24306 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.941991 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:22.946302 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:22.949122 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:22.949680 21639 raft_consensus.cc:2376] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7. Re-sending same reply.
I20260709 13:07:22.922098 24250 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.942823 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:22.920519 23922 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:22.976538 21491 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:22.978598 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:22.973664 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:22.995076 21638 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:22.981326 21635 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:22.995594 21638 pending_rounds.cc:85] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 3
I20260709 13:07:22.997434 21638 pending_rounds.cc:107] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:22.997761 21638 raft_consensus.cc:2889] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.999768 21643 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:23.000154 21643 pending_rounds.cc:85] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 2
I20260709 13:07:23.000348 21643 pending_rounds.cc:107] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:23.000553 21643 raft_consensus.cc:2889] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.003350 21634 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:23.003681 24309 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:22.975535 24260 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.008322 24301 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.020138 21637 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:07:22.970619 24310 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:22.942454 24296 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:23.021876 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 157541us
W20260709 13:07:23.022455 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 203323us
I20260709 13:07:22.962839 24313 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.924961 24279 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:22.973141 24257 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:23.030692 21491 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:07:23.034125 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.047757 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 62536.7us
I20260709 13:07:22.996184 24286 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:23.053360 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.056314 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:22.974171 24250 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:22.969722 24305 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:07:23.065587 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:23.068173 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:23.068987 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:23.069223 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:23.069646 21487 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:23.068991 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:23.069700 21485 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.080902 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:23.081604 21494 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.035555 24078 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:23.049754 24252 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:23.083822 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:23.084014 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:23.050767 24309 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:22.971482 24256 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.061546 24270 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.107442 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:23.108840 21638 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:23.183873 21638 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:23.083439 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:23.167119 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:22.976270 24306 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:23.197875 24315 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.198561 24315 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:23.200306 24309 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.201246 24294 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:23.201766 24307 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:07:23.202874 24331 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.140s
I20260709 13:07:23.167131 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:23.204854 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 92860.6us
I20260709 13:07:23.065488 24313 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:23.174360 21487 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.200841 24315 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:23.183095 21489 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.195464 21638 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:23.216248 21485 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:23.105561 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:23.108186 24112 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:23.049907 24301 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.166899 24252 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:23.241359 21638 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.218525 24257 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:23.215960 22239 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.105978 24078 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.217900 24165 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:23.221765 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:23.241036 24324 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:07:23.215587 22238 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
W20260709 13:07:23.275292 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 224248us
I20260709 13:07:23.280786 21638 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:23.285983 21638 pending_rounds.cc:85] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 3
I20260709 13:07:23.284446 21642 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:23.286844 21638 pending_rounds.cc:107] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 13:07:23.289177 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 181784us
I20260709 13:07:23.188463 24270 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.273229 24112 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.274895 24252 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:23.279256 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 230313us
I20260709 13:07:23.274574 24257 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.288832 21638 raft_consensus.cc:2889] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:23.700811 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 415414us
W20260709 13:07:23.580459 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.689318 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.620196 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:23.713128 21533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.000s	sys 0.014s
W20260709 13:07:23.844115 21533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.001s	sys 0.017s
W20260709 13:07:23.657523 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 349323us
I20260709 13:07:23.450474 21487 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:23.273976 24165 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:07:23.620514 21494 consensus_meta.cc:287] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 13:07:23.859898 21494 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
W20260709 13:07:23.653090 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.665550 21489 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:23.855943 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:23.276996 24286 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.743420 24308 consensus_meta.cc:287] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.828s	user 0.008s	sys 0.003s
W20260709 13:07:23.315313 24113 consensus_meta.cc:287] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.772s	user 0.012s	sys 0.000s
I20260709 13:07:23.280818 23922 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:23.277094 24323 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:23.722359 24277 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 1.052s	user 0.011s	sys 0.002s
I20260709 13:07:23.740906 24301 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:23.881829 24277 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.314392 23858 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.560s
W20260709 13:07:23.682353 24333 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.479s	user 0.001s	sys 0.000s
W20260709 13:07:23.866816 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.661398 24303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.013s	sys 0.000s
I20260709 13:07:23.312341 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:23.842322 22242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.002s	sys 0.014s
I20260709 13:07:23.381453 24260 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:23.748893 24343 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.317482 24250 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:23.842144 24078 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:23.393019 24279 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:23.883030 24270 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:23.882652 24301 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.916476 24339 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:23.916407 24301 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:23.917133 24339 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.918883 24332 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.885188 24323 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:23.857647 24294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.004s	sys 0.018s
I20260709 13:07:23.845939 24257 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:23.862422 24291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.011s	sys 0.011s
W20260709 13:07:23.888266 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44656.7us
I20260709 13:07:23.844528 24112 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:23.863925 24165 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.320914 24296 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.560s
I20260709 13:07:23.898538 23922 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.755347 24335 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:23.875129 24286 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:23.316524 24304 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.579s
I20260709 13:07:23.328063 24314 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.559s
I20260709 13:07:23.863651 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:23.893304 24303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.018s	sys 0.000s
I20260709 13:07:23.919198 24279 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:23.964407 21638 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:23.964800 24279 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.964910 24297 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:23.965271 24279 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.965330 24297 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:23.966940 24302 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:23.968461 24356 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:23.925823 24323 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.968997 24356 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:23.972540 22247 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:07:23.973585 22239 consensus_meta.cc:287] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.001s
I20260709 13:07:23.973959 22239 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:23.925963 24277 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:23.919680 24250 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.926947 24301 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:23.920972 24343 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:07:23.921813 21639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.024s
W20260709 13:07:23.903465 22242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.002s	sys 0.014s
I20260709 13:07:23.932334 24339 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:23.940506 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:23.992210 21487 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.992818 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:23.941992 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:23.994170 21489 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:23.880326 24113 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:23.928246 24294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.005s	sys 0.018s
I20260709 13:07:23.874032 24308 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.960412 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:23.960664 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:23.960412 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:23.979954 22244 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:24.000006 21485 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:24.000038 21490 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:24.000788 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:23.982543 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.985792 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 85129.2us
I20260709 13:07:23.960173 23922 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.388499 24313 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:23.990072 21639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.010s	sys 0.025s
I20260709 13:07:23.919492 24332 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:23.966256 24297 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.987812 24250 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:23.981163 24317 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:07:23.989403 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:24.040634 21492 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:24.025914 24327 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.824s	user 0.004s	sys 0.007s
I20260709 13:07:23.975327 24335 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:24.022432 24343 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:24.017449 24339 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:24.023644 24286 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:24.062062 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 80148.7us
I20260709 13:07:24.081650 21567 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:24.076269 24252 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:24.065299 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64603us
I20260709 13:07:23.996611 24277 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:07:23.999981 24294 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:24.062887 24256 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:24.103982 24297 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.085286 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1981) took 1122 ms. Trace:
I20260709 13:07:24.026525 24308 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:24.117551 21639 rpcz_store.cc:276] 0709 13:07:22.957357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.959950 (+  2593us) service_pool.cc:224] Handling call
0709 13:07:22.960249 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.996773 (+ 36524us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:23.263419 (+266646us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.079825 (+816406us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.079882 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:24.079936 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.080006 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.080137 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28904,"prepare.queue_time_us":244872,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":45235,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":21626,"thread_start_us":905478,"threads_started":2}
I20260709 13:07:24.024971 22242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 419) took 1320 ms. Trace:
I20260709 13:07:24.123813 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.017149 24353 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:07:24.083658 21487 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:24.106338 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.109163 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.126124 24362 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:24.110131 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:24.112742 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.109493 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.131493 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:24.024566 24112 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:24.077302 24166 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.076049 23922 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:24.135231 24332 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:24.147080 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.138093 24257 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:24.109885 24339 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:24.085168 24302 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:24.140841 21638 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:24.141105 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.131995 21566 raft_consensus.cc:2410] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:24.116663 24256 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:24.158133 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.173060 24323 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:24.175068 24366 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:07:24.177387 24335 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:24.177807 24356 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:24.179571 24353 consensus_queue.cc:1243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:24.143005 24252 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.151352 24362 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:24.180716 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.181245 24362 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:24.181800 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.179863 24250 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:24.180842 24113 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:24.182843 21567 raft_consensus.cc:2368] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:24.161588 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:24.148509 24166 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:24.186254 24260 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.175213 24294 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:24.188839 24252 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:24.190408 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.191418 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.193307 24339 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:24.196650 21562 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:24.199555 21568 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:24.203858 21459 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:24.206213 24302 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:24.208671 21634 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
W20260709 13:07:24.213194 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 94099.8us
I20260709 13:07:24.230540 21566 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:24.202165 24256 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.251250 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:24.241217 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:24.253600 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:24.254447 21568 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:24.237567 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.241031 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:24.257786 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.255945 21564 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:24.265426 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.271554 21489 pending_rounds.cc:85] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 6
I20260709 13:07:24.272037 21489 pending_rounds.cc:107] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:24.272333 21489 raft_consensus.cc:2889] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.195504 24279 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:24.279923 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.281350 21566 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:24.275959 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.278143 21487 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:24.233764 24260 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:24.291683 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 320) took 1668 ms. Trace:
I20260709 13:07:24.287729 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.294016 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.292250 21486 rpcz_store.cc:276] 0709 13:07:22.623208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.623377 (+   169us) service_pool.cc:224] Handling call
0709 13:07:22.627401 (+  4024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.627646 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:22.639236 (+ 11590us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.865669 (+226433us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.103754 (+1238085us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b2c000014c8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:07:24.104250 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.205384 (+101134us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.278085 (+ 72701us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.278375 (+   290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.278450 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.291405 (+ 12955us) raft_consensus.cc:1685] finished
0709 13:07:24.291431 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.291611 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10068,"prepare.queue_time_us":12620,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":1494,"raft.queue_time_us":44121,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":11103,"spinlock_wait_cycles":19325184,"thread_start_us":397957,"threads_started":4,"wal-append.queue_time_us":342327,"wal-append.run_cpu_time_us":1521,"wal-append.run_wall_time_us":1089321}
I20260709 13:07:24.261931 24335 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:07:24.295819 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.296274 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.574666 21564 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:24.575647 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.576320 21564 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:24.577253 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.577986 21564 raft_consensus.cc:2368] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
W20260709 13:07:24.578605 24330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.004s	sys 0.012s
I20260709 13:07:24.578845 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:24.398394 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:24.575630 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:24.349303 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:24.400296 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.394577 21608 leader_election.cc:336] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.607s (SENT)
W20260709 13:07:24.377686 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 2.249s (SENT) [suppressed 64 similar messages]
I20260709 13:07:24.581838 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:24.582669 24291 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:24.583568 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 189044us
I20260709 13:07:24.391445 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:24.429230 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.328233 21563 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:24.327522 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:24.580185 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 220007us
I20260709 13:07:24.505064 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:24.579022 24330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.004s	sys 0.012s
I20260709 13:07:24.579084 24322 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.295907 21568 raft_consensus.cc:2410] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:24.124305 22242 rpcz_store.cc:276] 0709 13:07:22.704477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.707943 (+  3466us) service_pool.cc:224] Handling call
0709 13:07:22.738908 (+ 30965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.759923 (+ 21015us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:22.779605 (+ 19682us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.996184 (+1216579us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.999312 (+  3128us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:24.002134 (+  2822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.024759 (+ 22625us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.024899 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26227,"prepare.queue_time_us":16062,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":140720,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":19210,"thread_start_us":1192315,"threads_started":2,"wal-append.queue_time_us":267669,"wal-append.run_cpu_time_us":1059,"wal-append.run_wall_time_us":1014990}
W20260709 13:07:24.351451 24374 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:24.392786 24313 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:24.283425 24113 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.718961 21639 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:24.719112 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:24.297891 24345 raft_consensus.cc:2955] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:24.720808 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:24.354743 24257 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:24.327730 24323 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:24.556548 24250 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:24.353873 24373 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.332782 24363 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:24.680961 24353 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.721616 22246 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:24.695020 24354 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.353888 24165 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:24.694849 24166 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:24.351868 24252 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:24.784816 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:24.621798 24260 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:24.695835 24322 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:24.857045 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 458712us
I20260709 13:07:24.763139 24313 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:24.885562 21608 connection.cc:256] RPC call timeout handler was delayed by -1.9509149740000566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:07:24.886811 21608 connection.cc:256] RPC call timeout handler was delayed by -1.9157995329999267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
W20260709 13:07:24.889559 21608 connection.cc:256] RPC call timeout handler was delayed by -1.9122149739999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:07:24.891995 21608 leader_election.cc:336] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.732s (SENT)
W20260709 13:07:24.895184 21641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.000s	sys 0.021s
W20260709 13:07:24.895630 21641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.000s	sys 0.021s
I20260709 13:07:24.895434 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:24.901659 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:24.901732 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.792518 24250 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:24.938436 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46477.5us
W20260709 13:07:24.939175 21608 connection.cc:256] RPC call timeout handler was delayed by -1.8708149740000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
I20260709 13:07:24.896333 21639 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:24.945930 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:24.948014 21560 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:24.952289 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:24.952615 24375 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:07:24.952807 21564 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:24.800428 24354 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:24.955473 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:24.971719 21566 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:24.957893 22240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 420) took 2253 ms. Trace:
W20260709 13:07:24.963585 24383 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:07:24.856875 24279 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:24.775820 24373 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:24.854303 22239 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.785202 24363 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:24.968130 21569 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:24.969856 21568 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:07:24.944897 21608 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.896s (SENT)
I20260709 13:07:24.996172 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:24.997493 21564 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:24.976965 21563 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:24.981333 24355 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.807s	user 0.005s	sys 0.003s
I20260709 13:07:24.982239 21560 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:24.975410 22240 rpcz_store.cc:276] 0709 13:07:22.704875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.705053 (+   178us) service_pool.cc:224] Handling call
0709 13:07:24.957020 (+2251967us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:07:24.957238 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.957470 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:24.957505 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.957553 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:24.957593 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.957650 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.957796 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8515968}
W20260709 13:07:25.000370 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 622697us
I20260709 13:07:25.005179 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:25.004985 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 60138.3us
W20260709 13:07:25.006062 21608 connection.cc:256] RPC call timeout handler was delayed by -1.8240149739999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 13:07:25.006517 21608 connection.cc:256] RPC call timeout handler was delayed by -1.8213149739999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 13:07:25.006995 21608 connection.cc:256] RPC call timeout handler was delayed by -1.8159725949999483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:07:25.007426 21608 connection.cc:256] RPC call timeout handler was delayed by -1.7913618279999355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:07:25.007855 21608 connection.cc:256] RPC call timeout handler was delayed by -1.7835149740000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 13:07:25.008296 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.008879 21608 leader_election.cc:336] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.990s (SENT)
I20260709 13:07:25.009334 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:25.010533 24291 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:25.012017 21608 leader_election.cc:336] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.047s (SENT)
I20260709 13:07:25.012936 21608 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:25.000195 24300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.008s	sys 0.011s
W20260709 13:07:25.012275 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.015957 22244 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:25.012171 24291 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.017132 21608 connection.cc:256] RPC call timeout handler was delayed by -1.6989149739999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 13:07:25.022841 21608 connection.cc:256] RPC call timeout handler was delayed by -1.6868603139998868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 13:07:25.024335 21608 connection.cc:256] RPC call timeout handler was delayed by -1.5900149740000415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 13:07:25.004930 24332 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.026857 24332 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.027427 24332 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:25.031145 24363 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:24.973374 22238 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
W20260709 13:07:25.043319 24384 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:07:25.043952 24386 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:07:25.018749 24300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.008s	sys 0.012s
I20260709 13:07:25.045838 24165 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:25.052855 24303 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.053138 24297 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.933s	user 0.011s	sys 0.000s
I20260709 13:07:25.053789 21565 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:25.053508 24303 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:25.051049 24291 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:25.022045 24279 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:25.056516 24256 consensus_meta.cc:287] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.000s
I20260709 13:07:25.019731 24302 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:25.021770 24257 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.022467 24361 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:25.089454 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1982) took 2115 ms. Trace:
W20260709 13:07:25.095125 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 126206us
I20260709 13:07:25.091957 21641 rpcz_store.cc:276] 0709 13:07:22.974534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.974888 (+   354us) service_pool.cc:224] Handling call
0709 13:07:22.975389 (+   501us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:24.194015 (+1218626us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b18002ccce0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98a9fda060 00007f98a9fdabfb 00007f98a9fe564b
0709 13:07:24.194158 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.194184 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:24.214838 (+ 20654us) log.cc:844] Serialized 598 byte log entry
0709 13:07:24.896048 (+681210us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:24.896142 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.896212 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.089077 (+192865us) raft_consensus.cc:1685] finished
0709 13:07:25.089098 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.089361 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5390,"raft.queue_time_us":62636,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":17184,"spinlock_wait_cycles":7515008,"thread_start_us":664716,"threads_started":2,"wal-append.queue_time_us":834412}
W20260709 13:07:25.097749 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.115618 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:25.079485 24256 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:25.120273 24256 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:25.123862 24322 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:25.124981 24332 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:25.126034 24313 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:25.127815 24373 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:25.127955 24354 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:25.128394 24361 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:25.129230 21491 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:25.129892 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1747) took 2075 ms. Trace:
I20260709 13:07:25.130188 21491 rpcz_store.cc:276] 0709 13:07:23.054030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.054256 (+   226us) service_pool.cc:224] Handling call
0709 13:07:23.072163 (+ 17907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.128995 (+2056832us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b54001b15a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f59dc0 00007f98a9fe41c0 00007f98a9fe5231 00007f98a9fe1d8f 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c
0709 13:07:25.129628 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.129834 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22359808}
W20260709 13:07:25.136830 21489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.010s	sys 0.024s
W20260709 13:07:25.137215 21489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.010s	sys 0.024s
I20260709 13:07:25.084867 24250 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:25.130749 24361 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:25.137151 24373 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:07:25.154050 21608 connection.cc:256] RPC call timeout handler was delayed by -1.4909049479999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:07:25.139319 24331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.936s	user 0.003s	sys 0.039s
I20260709 13:07:25.143149 24293 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:25.155850 21608 connection.cc:256] RPC call timeout handler was delayed by -1.2678149739999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26070000000000004s for a response
I20260709 13:07:25.158085 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:25.159680 21608 connection.cc:256] RPC call timeout handler was delayed by -1.1559410009999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:07:25.161063 21608 connection.cc:256] RPC call timeout handler was delayed by -1.1283149739999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2762s for a response
W20260709 13:07:25.162699 21608 connection.cc:256] RPC call timeout handler was delayed by -1.09681497400004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2797s for a response
W20260709 13:07:25.157137 24331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.953s	user 0.003s	sys 0.040s
W20260709 13:07:25.164968 21608 leader_election.cc:336] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.651s (SENT)
I20260709 13:07:25.162050 24363 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:25.165835 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:25.152873 24279 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:07:25.159509 24293 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:25.186653 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.216391 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49545.9us
W20260709 13:07:25.217080 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52080.3us
W20260709 13:07:25.219707 21608 leader_election.cc:336] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.661s (SENT)
I20260709 13:07:25.157474 24373 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:25.167482 24363 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:25.280007 24363 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:25.281213 21492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1749) took 2200 ms (client timeout 2249 ms). Trace:
I20260709 13:07:25.223196 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:25.281679 21492 rpcz_store.cc:269] 0709 13:07:23.054657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.054809 (+   152us) service_pool.cc:224] Handling call
0709 13:07:25.254984 (+2200175us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54000f4954. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:25.255205 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239908096}
I20260709 13:07:25.241313 24394 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:25.219858 24396 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.272228 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:25.207952 24293 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.514568 24373 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:25.586876 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.344678 24331 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:25.622170 24331 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:25.623955 24331 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:25.629261 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 409556us
W20260709 13:07:25.630148 21608 leader_election.cc:336] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.829s (SENT)
W20260709 13:07:25.577112 22239 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.571s	user 0.012s	sys 0.000s
I20260709 13:07:25.365672 24252 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.631075 22239 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
W20260709 13:07:25.495057 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.630574 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:25.632805 24250 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.632684 24293 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:25.633186 21608 leader_election.cc:336] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.848s (SENT)
W20260709 13:07:25.634560 21608 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.884s (SENT)
I20260709 13:07:25.634974 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:25.635769 24293 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:25.637434 24291 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:25.640012 24291 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.645043 24271 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:25.645653 24271 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:25.646759 24271 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:25.375152 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 152036us
I20260709 13:07:25.651563 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:25.652133 21562 raft_consensus.cc:2376] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5. Re-sending same reply.
I20260709 13:07:25.652036 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:25.652554 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1801) took 1375 ms. Trace:
I20260709 13:07:25.652953 24336 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:25.652833 21562 rpcz_store.cc:276] 0709 13:07:24.277420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.589103 (+311683us) service_pool.cc:224] Handling call
0709 13:07:25.651382 (+1062279us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:25.652511 (+  1129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39736192}
I20260709 13:07:25.653469 24336 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:25.653846 24336 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.654142 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:25.407398 24396 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:25.655098 24396 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:25.657415 24396 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:25.658341 21640 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:25.715647 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 1984) took 2739 ms. Trace:
I20260709 13:07:25.716003 21640 rpcz_store.cc:276] 0709 13:07:22.976215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.976373 (+   158us) service_pool.cc:224] Handling call
0709 13:07:25.658003 (+2681630us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebdeee 0000000000375939 00007f98aef311e0 00007f98aeffa0c4 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:07:25.658159 (+   156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.715366 (+ 57207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.715591 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6136064}
I20260709 13:07:25.717322 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:25.659231 21567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1780) took 1513 ms (client timeout 1989 ms). Trace:
I20260709 13:07:25.659762 24271 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.719018 24394 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:25.719825 24306 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:25.720930 24394 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:25.719082 21567 rpcz_store.cc:269] 0709 13:07:24.145800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.157855 (+ 12055us) service_pool.cc:224] Handling call
0709 13:07:25.659031 (+1501176us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b54001fa4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:25.659174 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21340544}
I20260709 13:07:25.723399 24297 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:25.663302 21608 leader_election.cc:336] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.891s (SENT)
I20260709 13:07:25.723980 24297 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:25.724350 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:25.725247 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 61984.8us
W20260709 13:07:25.725804 21608 leader_election.cc:336] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.937s (SENT)
I20260709 13:07:25.718634 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:25.726207 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:25.664192 24336 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:25.664676 24331 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:25.740204 24331 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:25.667639 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:25.741285 21561 raft_consensus.cc:2376] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5. Re-sending same reply.
I20260709 13:07:25.742007 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1783) took 1560 ms. Trace:
I20260709 13:07:25.742394 21561 rpcz_store.cc:276] 0709 13:07:24.181765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.621497 (+439732us) service_pool.cc:224] Handling call
0709 13:07:25.667472 (+1045975us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:25.741930 (+ 74458us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39757184}
I20260709 13:07:25.672907 22243 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 6 LEARNER]: Advancing to term 7
I20260709 13:07:25.673209 24308 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:25.684151 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:25.744594 24308 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:25.744988 22239 raft_consensus.cc:2368] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6.
I20260709 13:07:25.684435 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:25.685721 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:25.687321 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:25.746621 21642 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:25.746567 21639 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.688036 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:25.751345 21643 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:25.688138 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:25.692621 24398 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
I20260709 13:07:25.699723 24299 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:25.752912 24396 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.753759 21636 raft_consensus.cc:2368] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6.
I20260709 13:07:25.707707 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:25.754491 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46888.7us
I20260709 13:07:25.710189 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:25.712891 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:25.757061 21641 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:25.625969 24363 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:25.726845 21640 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:25.727193 24306 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:25.727588 21608 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.977s (SENT)
I20260709 13:07:25.728394 24297 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:25.726045 21567 raft_consensus.cc:2955] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:07:25.731913 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.736210 24403 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 13:07:25.745570 24308 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:25.767385 24308 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.755867 24079 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:25.758204 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:25.771667 24306 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:25.758962 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.774925 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 120849us
I20260709 13:07:25.775991 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:25.776156 24297 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:25.776762 24297 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:25.764343 24336 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:25.784789 24399 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.272s	user 0.009s	sys 0.000s
W20260709 13:07:25.786140 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 58574.7us
W20260709 13:07:25.787052 21608 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.989s (SENT)
W20260709 13:07:25.787191 21565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1777) took 1662 ms (client timeout 2120 ms). Trace:
I20260709 13:07:25.787575 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:25.787631 21565 rpcz_store.cc:269] 0709 13:07:24.124428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.150490 (+ 26062us) service_pool.cc:224] Handling call
0709 13:07:25.787022 (+1636532us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b5400289bd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:25.787137 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006165760}
I20260709 13:07:25.785250 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:25.757771 21639 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
W20260709 13:07:25.799692 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.763060 24340 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:25.765151 24363 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:25.802662 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:25.802105 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:25.805200 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:25.807413 21566 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:25.806892 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:25.805796 21608 leader_election.cc:336] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.992s (SENT)
I20260709 13:07:25.808125 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:25.808434 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:25.809010 21566 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:25.811311 24367 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.811646 24361 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.811887 24367 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.812160 24361 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:25.812511 24367 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.811033 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:25.821316 21569 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:25.823102 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:25.812600 24361 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.788883 24271 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:25.804231 24315 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.868036 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:25.875313 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:25.877961 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 72185.6us
W20260709 13:07:25.878647 21608 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.034s (SENT)
I20260709 13:07:25.879137 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:25.880004 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 71139.6us
I20260709 13:07:25.810284 24352 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.815029 24252 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:25.886751 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:25.826560 24402 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.854434 24291 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.820405 24396 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.900988 21640 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:07:25.890615 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.903508 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:25.867061 24315 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:25.895244 24306 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:25.815737 24336 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:07:25.891419 24352 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.881568 24297 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:25.909971 24291 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:25.916569 24362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.014s	sys 0.053s
W20260709 13:07:25.954712 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.877770 24271 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:25.962752 21560 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:25.934113 22243 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 7 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:25.962769 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:25.966704 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:25.968817 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1805) took 1637 ms. Trace:
I20260709 13:07:25.956864 24297 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.969126 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:25.996369 21566 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:25.954322 24291 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.971408 23977 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.946199 24305 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:07:25.973569 24404 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.297s	user 0.002s	sys 0.000s
I20260709 13:07:25.974553 24271 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:25.950187 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46801us
I20260709 13:07:25.967947 21565 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:07:25.981686 24400 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.362s	user 0.000s	sys 0.005s
I20260709 13:07:25.967206 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:25.989717 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 111080us
W20260709 13:07:26.038113 21608 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.120s (SENT)
I20260709 13:07:25.928591 24315 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.945804 24352 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.928150 24306 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.044068 24306 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.993500 21564 rpcz_store.cc:276] 0709 13:07:24.331592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.970018 (+638426us) service_pool.cc:224] Handling call
0709 13:07:24.997161 (+ 27143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.000000 (+  2839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.968669 (+968669us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b54001d8150. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:25.968774 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61586688}
I20260709 13:07:25.997283 21568 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:25.933990 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:25.913300 24252 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.049997 24252 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.050551 24252 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:25.954335 24362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.015s	sys 0.054s
I20260709 13:07:26.052079 24294 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.051930 24164 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:26.052675 24294 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.053241 24164 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:26.053777 24164 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:25.999642 24165 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.054972 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51773.6us
I20260709 13:07:26.055080 24165 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.056214 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:26.057524 24165 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.057643 24373 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:25.999984 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.000092 24078 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.037976 21561 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:26.001690 24313 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.002158 24256 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:26.071969 22212 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:26.014384 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.990185 22243 pending_rounds.cc:85] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 3
I20260709 13:07:26.028607 24346 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:26.088035 24352 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.038589 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:26.089757 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51677.2us
W20260709 13:07:26.090423 21608 leader_election.cc:336] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.128s (SENT)
W20260709 13:07:26.061245 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.065878 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 242691us
I20260709 13:07:26.025867 24304 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.074261 24294 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.033214 24111 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:26.092535 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:26.035486 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:26.100589 21608 leader_election.cc:336] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.195s (SENT)
I20260709 13:07:26.069440 24078 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.107476 24294 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:26.108029 24294 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.108592 24078 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.110061 24294 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.106702 24418 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.093807 24127 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:26.110919 24418 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:26.111411 24127 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:26.111872 24127 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.112195 24418 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:26.116159 21608 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.249s (SENT)
I20260709 13:07:26.116667 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:26.118168 24362 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.118860 24415 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.101507 24346 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:26.119867 21608 leader_election.cc:336] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.580s (SENT)
I20260709 13:07:26.120406 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:26.121196 24415 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.121512 24346 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.075310 24313 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:26.122280 21608 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.607s (SENT)
I20260709 13:07:26.122699 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:26.122840 24304 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.123911 24313 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.124578 24352 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.106709 24111 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.125499 24304 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.127965 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:26.129056 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 94401.8us
I20260709 13:07:26.129355 24315 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.130985 24308 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.130364 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:26.069384 24341 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:26.083668 22243 pending_rounds.cc:107] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:26.068082 24164 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:26.136225 21608 leader_election.cc:336] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.635s (SENT)
I20260709 13:07:26.143131 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 332) took 1851 ms. Trace:
I20260709 13:07:26.143708 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:26.143606 21487 rpcz_store.cc:276] 0709 13:07:24.291638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.295058 (+  3420us) service_pool.cc:224] Handling call
0709 13:07:24.295382 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.306040 (+ 10658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.306090 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.506830 (+200740us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.765455 (+258625us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:24.780536 (+ 15081us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.967500 (+1186964us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b180024d180. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:07:26.133034 (+165534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.133157 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.133213 (+    56us) raft_consensus.cc:1685] finished
0709 13:07:26.142881 (+  9668us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.143070 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14174,"prepare.queue_time_us":17210,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":3269,"raft.queue_time_us":1227952,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":5329,"spinlock_wait_cycles":18806016,"thread_start_us":414770,"threads_started":2,"wal-append.queue_time_us":437387,"wal-append.run_cpu_time_us":2253,"wal-append.run_wall_time_us":1061647}
I20260709 13:07:26.145694 24111 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:26.143990 21608 leader_election.cc:336] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.762s (SENT)
W20260709 13:07:26.129283 24413 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:07:26.149562 22243 raft_consensus.cc:2889] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 7 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.189275 24297 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:26.190275 24315 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:26.191061 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47093.6us
I20260709 13:07:26.191570 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:26.135618 24165 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:26.190606 24296 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:26.082396 24335 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 13:07:26.191711 21608 leader_election.cc:336] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.797s (SENT)
I20260709 13:07:26.151108 24336 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.153048 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:26.081611 24256 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:26.275894 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 122957us
I20260709 13:07:26.210917 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 330) took 1957 ms. Trace:
W20260709 13:07:26.279152 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.216276 22212 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:26.280354 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64219.1us
I20260709 13:07:26.142983 24308 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.146620 24252 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.281383 24315 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.199447 24313 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:07:26.194944 24254 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.197583 24297 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:26.195158 24294 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:26.290578 24350 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.289986 24367 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.150002 24415 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.286156 24127 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.328361 24350 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:26.195052 24304 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.195340 24346 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.195374 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:26.304134 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:26.196485 24303 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:26.201771 24396 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.201022 24336 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:26.282115 24164 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:26.304563 24260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.003s	sys 0.019s
W20260709 13:07:26.315132 24416 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.336s	user 0.002s	sys 0.000s
I20260709 13:07:26.198288 24111 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:07:26.303388 24252 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.278635 21489 rpcz_store.cc:276] 0709 13:07:24.253456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.253575 (+   119us) service_pool.cc:224] Handling call
0709 13:07:24.271315 (+ 17740us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:24.273097 (+  1782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.273140 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:24.277441 (+  4301us) log.cc:844] Serialized 52 byte log entry
0709 13:07:25.137707 (+860266us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:25.153682 (+ 15975us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.669770 (+516088us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b4800080358. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f 00007f98aeff9f37 00007f98af00e55c 00007f98af00e508 00007f98af00e488 00007f98af00e443 00007f98af00d6ec 00007f98adf37a96
0709 13:07:26.147084 (+477314us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.151049 (+  3965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.160859 (+  9810us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.209906 (+ 49047us) raft_consensus.cc:1685] finished
0709 13:07:26.210579 (+   673us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.210835 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1198621,"prepare.queue_time_us":319426,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":869547,"raft.run_cpu_time_us":19313,"raft.run_wall_time_us":1403443,"spinlock_wait_cycles":7792000,"thread_start_us":1000945,"threads_started":2,"wal-append.queue_time_us":867175}
W20260709 13:07:26.362277 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.317557 24271 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:07:26.314924 24349 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.204869 24291 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.331729 24294 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.195722 24165 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.317226 24254 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.328104 24315 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:26.195750 24341 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.155692 24306 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.314688 24297 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:26.194734 24361 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:26.377606 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 183149us
I20260709 13:07:26.371475 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:26.195983 24296 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:26.380317 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 76255.7us
I20260709 13:07:26.386194 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:26.445631 24256 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.446336 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:26.446642 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:26.383848 24304 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.351143 24350 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.449186 24304 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.449254 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:26.450021 24419 consensus_queue.cc:1059] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:26.428658 24396 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:26.451149 24396 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.439400 24271 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.452678 24271 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.377967 24346 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:26.395517 24260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.004s	sys 0.019s
I20260709 13:07:26.386103 24336 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.382269 24113 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:26.419116 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:26.432284 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:26.423802 24252 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.487836 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:26.439344 22240 raft_consensus.cc:2393] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:26.488634 21488 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.421758 21487 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:26.453217 24396 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:26.489054 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.425663 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:26.459362 21492 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:26.427091 24349 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.465055 21486 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:26.467232 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:26.469293 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.472723 21490 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:26.472633 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.473647 21485 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:26.479282 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:26.488463 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:26.456193 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:26.507987 21491 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.492255 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:26.509337 21640 raft_consensus.cc:2410] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:26.465966 24346 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.459923 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:26.512851 21568 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.513216 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.512022 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.475356 24362 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.470399 24304 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:07:26.471635 24419 consensus_queue.cc:1059] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:07:26.473963 24111 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:07:26.514984 24127 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.647284 21491 raft_consensus.cc:2410] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:26.647869 24296 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.648562 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:26.594936 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.601897 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:26.593868 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:26.590008 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.599009 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:26.626078 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:26.635288 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.653679 21642 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.545410 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:26.655033 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 166669us
I20260709 13:07:26.655321 21487 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:26.547379 21489 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:26.597806 21568 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:26.645732 21490 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 13:07:26.633811 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:26.661389 21493 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.620628 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:26.550879 21532 connection.cc:256] RPC call timeout handler was delayed by -3.5307723299999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 13:07:26.662989 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:26.664166 21486 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:26.523118 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.650756 21639 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:07:26.520141 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64038.6us
I20260709 13:07:26.663451 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:26.662245 21532 connection.cc:256] RPC call timeout handler was delayed by -3.4704723299998932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:07:26.666002 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:26.665948 21532 connection.cc:256] RPC call timeout handler was delayed by -3.25537233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:07:26.667274 21532 connection.cc:256] RPC call timeout handler was delayed by -3.1473723299999392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
W20260709 13:07:26.667805 21532 connection.cc:256] RPC call timeout handler was delayed by -2.9754723300000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 13:07:26.668731 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:26.673748 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 232026us
I20260709 13:07:26.512140 24396 raft_consensus.cc:3055] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:26.554759 24424 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:26.682559 21635 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.517902 24297 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.677856 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.678072 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:26.686105 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.687060 21643 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.687563 21636 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:07:26.676628 21608 leader_election.cc:336] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.554s (SENT)
I20260709 13:07:26.553408 24422 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.667582 24331 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:26.680853 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.681094 21639 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:26.546739 24420 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:26.706372 24420 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:26.707309 24420 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.711112 24306 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.684649 23977 raft_consensus.cc:2764] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:26.683791 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:26.687574 21640 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:26.500499 24309 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.180s
I20260709 13:07:26.500126 24260 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.180s
I20260709 13:07:26.677311 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.716778 21490 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:26.693475 21634 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:26.699100 24436 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:26.717653 24436 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.718220 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.719870 24436 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.720486 24436 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.720880 24436 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:26.721271 24436 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.724143 21486 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:26.725172 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.725764 21639 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.678598 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:26.692718 24422 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:26.703975 24291 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.612142 24315 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.704861 24331 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.684214 24396 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:26.711292 24254 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.703001 22243 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:26.738983 21635 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:26.740455 21642 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:26.742046 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:26.679571 24431 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.757117 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.749092 21639 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:26.684737 24430 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 13:07:26.750846 24435 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:26.683561 24271 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.768772 24349 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.769274 21643 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:26.749569 24422 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.780319 24436 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.755028 24294 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.783888 24331 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.784775 24341 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.757594 24431 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.785665 24431 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:26.761431 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 85255.4us
I20260709 13:07:26.763624 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:26.793535 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.795181 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.795341 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:26.795876 21640 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.799312 24436 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.806015 21486 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:26.799489 21636 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:26.807539 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.809667 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.810310 21490 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:26.781673 24396 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.811367 24396 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.804623 21493 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:26.758850 21642 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:26.702339 24336 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:26.824275 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.803938 21488 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:26.822414 21640 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:26.834501 22212 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:07:26.836314 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 167582us
I20260709 13:07:26.754189 24367 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.865549 21457 leader_election.cc:400] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6.
I20260709 13:07:26.865962 21457 leader_election.cc:403] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.865795 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.867599 21488 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
W20260709 13:07:26.870159 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 192146us
I20260709 13:07:26.870937 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:26.857993 24436 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.863162 24325 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:26.878909 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.757234 24252 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.777632 24422 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.886062 21638 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:26.886348 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:26.887458 21492 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:07:26.873104 24309 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.892192 21487 raft_consensus.cc:2393] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:26.894253 24422 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.885722 24436 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.898263 24436 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:26.898725 24325 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:26.899681 24325 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.903533 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:26.904383 21488 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.892143 24293 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.908875 24336 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:26.916150 21566 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:26.916736 21566 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:26.918128 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.918403 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.918989 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.917709 21566 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.919981 21561 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:26.920078 21566 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.921073 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.922106 21569 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:26.923063 21565 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:26.923521 21565 pending_rounds.cc:85] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 2
I20260709 13:07:26.923846 21565 pending_rounds.cc:107] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:26.924118 21565 raft_consensus.cc:2889] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.925907 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:26.926380 24111 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:26.926870 24113 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.927738 21457 leader_election.cc:400] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6.
I20260709 13:07:26.928506 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:26.929195 24113 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:26.929661 24113 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:26.930244 22242 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:26.930621 24113 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:26.933893 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.934495 21566 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:26.935292 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.935514 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.936913 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.926016 21567 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:26.936609 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:26.938586 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.939306 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:26.939851 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.940686 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.940893 21564 raft_consensus.cc:2410] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:26.875655 24439 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.943177 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.943614 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:26.943841 21566 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:26.944895 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.944939 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.946468 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.926807 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.947906 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.948294 21561 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:26.948460 21568 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:26.950901 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:26.952338 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:26.953370 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.949398 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.955027 21561 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:26.859915 24350 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:26.875372 24430 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:07:26.875507 24341 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:07:26.956049 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:26.991498 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:26.959168 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.962940 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:26.993268 21640 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:26.965939 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:26.994474 21642 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:26.967352 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:26.970129 21637 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:26.973006 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.948460 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:26.986833 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:27.016494 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:27.019083 21561 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:26.986837 21488 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:26.988668 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:26.987941 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:27.142397 24350 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:27.690646 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:27.692056 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:27.692505 24439 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:27.693055 24439 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:27.031381 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 151626us
I20260709 13:07:27.693075 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:27.146941 24431 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:27.694478 21491 raft_consensus.cc:2376] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8. Re-sending same reply.
I20260709 13:07:27.695452 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:27.696074 24431 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:27.696558 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:27.443488 24420 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.002s	sys 0.014s
I20260709 13:07:27.142493 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:27.697666 24420 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.006s	sys 0.015s
I20260709 13:07:27.697600 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:27.698979 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:27.699193 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:27.699793 24439 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:27.699807 21491 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:27.700444 21567 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:27.321313 23602 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.701428 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:27.108377 24354 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.594s
I20260709 13:07:27.510426 24260 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.697034 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:27.144832 24346 consensus_meta.cc:287] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.624s	user 0.003s	sys 0.007s
I20260709 13:07:27.727738 21564 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:27.735065 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:27.702518 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:27.020308 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:27.098028 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.743670 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.705987 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:27.693373 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:27.727650 21488 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:27.703372 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:27.701622 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:27.071573 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44187.1us
I20260709 13:07:27.119187 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:27.711362 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:27.044147 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:27.035866 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:27.220803 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.039824 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:27.746739 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.747885 21564 raft_consensus.cc:2410] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:27.800464 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:27.801697 21491 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:27.832163 21489 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:27.832458 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:27.833299 21489 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:27.803377 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:27.835947 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:27.836659 21562 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:27.837646 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:27.748158 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:27.800940 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:27.858839 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:27.859826 21564 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:27.690896 24113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.013s	sys 0.005s
W20260709 13:07:27.901890 24113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.016s	sys 0.008s
I20260709 13:07:27.902477 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:27.904450 21642 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:27.910750 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.916465 21563 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:27.917109 21563 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:27.321234 24336 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:27.921025 21561 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:27.916488 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:27.926925 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:27.747997 24309 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.004s
I20260709 13:07:27.940253 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:27.045291 24252 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:27.931384 21564 pending_rounds.cc:85] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 3
I20260709 13:07:27.930001 21642 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:27.918056 21563 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:27.375834 24437 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:27.802819 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:27.800966 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:27.802009 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:27.950745 21563 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.943905 21564 pending_rounds.cc:107] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:27.951367 21564 raft_consensus.cc:2889] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:27.910583 24439 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.946920 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1821) took 1010 ms. Trace:
I20260709 13:07:27.955022 21562 rpcz_store.cc:276] 0709 13:07:26.936273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.926471 (+990198us) service_pool.cc:224] Handling call
0709 13:07:27.946859 (+ 20388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:27.747923 24346 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:27.943343 24309 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6.
I20260709 13:07:27.747213 21566 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:27.993736 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1782) took 1044 ms. Trace:
I20260709 13:07:27.985049 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1318) took 1424 ms. Trace:
I20260709 13:07:27.986088 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 345) took 2115 ms. Trace:
I20260709 13:07:27.215643 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:28.003683 21566 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:27.780735 24260 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:27.992902 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1786) took 1031 ms. Trace:
I20260709 13:07:27.984525 21565 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:27.995162 22243 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:28.002985 21486 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:27.940975 24350 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:27.701557 23602 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:28.005746 22240 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:07:28.014618 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1832) took 1027 ms. Trace:
I20260709 13:07:28.015113 21494 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:28.015025 21566 rpcz_store.cc:276] 0709 13:07:26.987552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.992914 (+1005362us) service_pool.cc:224] Handling call
0709 13:07:28.003091 (+ 10177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.014319 (+ 11228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.014573 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:27.942484 24336 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.003683 21493 rpcz_store.cc:276] 0709 13:07:26.949282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.017085 (+ 67803us) service_pool.cc:224] Handling call
0709 13:07:27.993655 (+976570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.019368 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:28.003958 21492 rpcz_store.cc:276] 0709 13:07:26.560396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.603539 (+ 43143us) service_pool.cc:224] Handling call
0709 13:07:26.604021 (+   482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:26.887906 (+283885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.984706 (+1096800us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540029a4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:27.984962 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651178752}
I20260709 13:07:28.012841 21488 rpcz_store.cc:276] 0709 13:07:26.961441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.696822 (+735381us) service_pool.cc:224] Handling call
0709 13:07:27.992839 (+296017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.021055 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2146) took 1032 ms. Trace:
I20260709 13:07:28.021703 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:28.013617 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2138) took 1050 ms. Trace:
I20260709 13:07:28.011214 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:28.022501 21565 rpcz_store.cc:276] 0709 13:07:26.973574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.041262 (+ 67688us) service_pool.cc:224] Handling call
0709 13:07:28.013558 (+972296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.021461 21566 rpcz_store.cc:276] 0709 13:07:26.988968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.015917 (+1026949us) service_pool.cc:224] Handling call
0709 13:07:28.020571 (+  4654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.020748 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.020772 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.020813 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:28.020845 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.020894 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.020998 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.024011 21565 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:28.024266 22240 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:28.025759 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1833) took 1036 ms. Trace:
I20260709 13:07:28.026279 21565 rpcz_store.cc:276] 0709 13:07:26.988941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.023273 (+1034332us) service_pool.cc:224] Handling call
0709 13:07:28.023605 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.025363 (+  1758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.025673 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.029834 21642 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:28.004303 21641 rpcz_store.cc:276] 0709 13:07:25.871074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.871700 (+   626us) service_pool.cc:224] Handling call
0709 13:07:25.872066 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.635258 (+763192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.635294 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.635336 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:26.635378 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.985815 (+1350437us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b540009b354. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:27.985868 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.986020 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754641792}
I20260709 13:07:28.031227 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:28.032074 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.032894 21634 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:28.033313 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2018) took 1057 ms. Trace:
I20260709 13:07:28.033604 21634 rpcz_store.cc:276] 0709 13:07:26.975671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.379334 (+403663us) service_pool.cc:224] Handling call
0709 13:07:28.031909 (+652575us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:28.033257 (+  1348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14962432}
W20260709 13:07:28.034152 24363 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:07:27.952307 24437 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.035919 21566 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.034231 23602 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:28.038147 24336 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:28.005324 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:28.016919 24350 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:27.983789 24439 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:28.051585 24456 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:07:28.053794 24455 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:28.059674 24336 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.060462 24336 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.065342 24297 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.084875 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1769) took 1140 ms. Trace:
I20260709 13:07:28.085503 21486 rpcz_store.cc:276] 0709 13:07:26.943990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.698467 (+754477us) service_pool.cc:224] Handling call
0709 13:07:28.084558 (+386091us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54000b8454. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:28.084778 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666396928}
W20260709 13:07:28.087419 22242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 360) took 1670 ms (client timeout 1763 ms). Trace:
W20260709 13:07:28.093421 22242 rpcz_store.cc:269] 0709 13:07:26.417066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.427364 (+ 10298us) service_pool.cc:224] Handling call
0709 13:07:28.087168 (+1659804us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54003c00d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:28.087333 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734578432}
I20260709 13:07:28.091252 21560 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:28.095387 21560 pending_rounds.cc:85] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 3
I20260709 13:07:28.095726 21560 pending_rounds.cc:107] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:28.096021 21560 raft_consensus.cc:2889] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.097007 24363 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.097662 24363 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.071950 22245 raft_consensus.cc:2955] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:07:28.091843 24454 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:28.109519 24437 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:28.112396 24426 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 1.541s	user 0.014s	sys 0.011s
I20260709 13:07:28.115898 24313 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:28.120174 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:28.121356 21569 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:28.121840 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2134) took 1198 ms. Trace:
I20260709 13:07:28.123360 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 1354) took 1656 ms. Trace:
I20260709 13:07:28.123889 21638 rpcz_store.cc:276] 0709 13:07:26.466834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.466977 (+   143us) service_pool.cc:224] Handling call
0709 13:07:28.123076 (+1656099us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540024e5d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:28.123256 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881270656}
I20260709 13:07:28.122219 21569 rpcz_store.cc:276] 0709 13:07:26.923615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.931613 (+  7998us) service_pool.cc:224] Handling call
0709 13:07:28.119938 (+1188325us) spinlock_profiling.cc:243] Waited 982 us on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:28.121781 (+  1843us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257664}
I20260709 13:07:28.133118 21485 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:28.133088 21487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1320) took 1571 ms (client timeout 1916 ms). Trace:
W20260709 13:07:28.134431 21487 rpcz_store.cc:269] 0709 13:07:26.561177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.666591 (+105414us) service_pool.cc:224] Handling call
0709 13:07:28.132768 (+1466177us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54002cb854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:28.132999 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462304128}
I20260709 13:07:28.136767 24350 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:28.139042 24439 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:28.145670 24165 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:28.146303 24165 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:28.140527 24260 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:28.147840 24453 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:07:28.148151 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.148794 21636 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:28.149276 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2023) took 1164 ms. Trace:
I20260709 13:07:28.149595 21636 rpcz_store.cc:276] 0709 13:07:26.984756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.995826 (+ 11070us) service_pool.cc:224] Handling call
0709 13:07:28.148008 (+1152182us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:28.149215 (+  1207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3894656}
I20260709 13:07:28.150985 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.151369 24346 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:28.151762 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2024) took 1165 ms. Trace:
I20260709 13:07:28.152114 21637 rpcz_store.cc:276] 0709 13:07:26.986490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.996472 (+  9982us) service_pool.cc:224] Handling call
0709 13:07:28.150843 (+1154371us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:28.151698 (+   855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26889600}
I20260709 13:07:28.152076 24346 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:28.153234 24346 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:28.154130 24346 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.159346 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.160079 21640 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 3.
W20260709 13:07:28.160575 21640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2017) took 1187 ms (client timeout 1527 ms). Trace:
W20260709 13:07:28.160939 21640 rpcz_store.cc:269] 0709 13:07:26.972791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.019524 (+ 46733us) service_pool.cc:224] Handling call
0709 13:07:28.159181 (+1139657us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:28.160502 (+  1321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30985088}
I20260709 13:07:28.163357 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1308) took 1705 ms. Trace:
I20260709 13:07:28.163748 21494 rpcz_store.cc:276] 0709 13:07:26.458365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.458489 (+   124us) service_pool.cc:224] Handling call
0709 13:07:28.163160 (+1704671us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001824d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:28.163297 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3467579776}
I20260709 13:07:28.169142 24336 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:28.166575 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:28.171569 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 1819) took 1236 ms. Trace:
I20260709 13:07:28.171912 21568 rpcz_store.cc:276] 0709 13:07:26.935098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.957049 (+ 21951us) service_pool.cc:224] Handling call
0709 13:07:28.166430 (+1209381us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:28.171498 (+  5068us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3425536}
I20260709 13:07:28.172501 24425 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:28.172899 24425 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:28.180051 22210 connection.cc:256] RPC call timeout handler was delayed by -1.1660601699999233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2526s for a response
W20260709 13:07:28.180491 22210 connection.cc:256] RPC call timeout handler was delayed by -1.0715175469999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:07:28.180645 24361 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:28.181070 22210 connection.cc:256] RPC call timeout handler was delayed by -1.0454175469999427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:07:28.182972 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.183589 21639 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:28.184016 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2020) took 1204 ms. Trace:
I20260709 13:07:28.184298 21639 rpcz_store.cc:276] 0709 13:07:26.979953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.444034 (+464081us) service_pool.cc:224] Handling call
0709 13:07:28.182828 (+738794us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:28.183962 (+  1134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24981760}
I20260709 13:07:28.194391 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:28.196537 22247 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:28.173693 24425 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.197561 24425 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.197846 24402 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:28.198347 24402 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:28.199405 24402 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.200667 24402 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.203259 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:28.204085 22238 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.209581 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2133) took 1288 ms. Trace:
I20260709 13:07:28.211494 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 334) took 1410 ms. Trace:
I20260709 13:07:28.211977 21485 rpcz_store.cc:276] 0709 13:07:26.800796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.800922 (+   126us) service_pool.cc:224] Handling call
0709 13:07:28.132932 (+1332010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.133892 (+   960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.211230 (+ 77338us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54002cb850. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:28.211414 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3062409088}
W20260709 13:07:28.213299 21635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 1357) took 1718 ms (client timeout 1744 ms). Trace:
W20260709 13:07:28.213749 21635 rpcz_store.cc:269] 0709 13:07:26.494766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.494915 (+   149us) service_pool.cc:224] Handling call
0709 13:07:28.213128 (+1718213us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540009c254. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:28.213244 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387509632}
I20260709 13:07:28.210114 21560 rpcz_store.cc:276] 0709 13:07:26.921583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.922936 (+  1353us) service_pool.cc:224] Handling call
0709 13:07:26.923217 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.096596 (+1173379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.209266 (+112670us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400152054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:28.209500 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2685054720}
I20260709 13:07:28.216940 24363 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:28.219991 21607 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.048s	sys 0.047s
W20260709 13:07:28.220369 21607 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.048s	sys 0.047s
W20260709 13:07:28.220750 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.222087 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 236554us
W20260709 13:07:28.223325 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.223476 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:28.227028 24252 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:28.231364 24252 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:28.232134 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.233122 21642 raft_consensus.cc:2410] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:28.235085 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.235899 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:28.237612 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:28.234469 24252 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:28.239377 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.239369 24363 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.241080 24363 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.241708 24363 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.242311 24363 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:28.243389 24363 consensus_queue.cc:1243] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:28.243857 24363 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:28.244163 24363 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:28.245956 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.227131 21606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.014s
W20260709 13:07:28.246750 21606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.000s	sys 0.014s
W20260709 13:07:28.247884 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.227661 24458 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:28.228471 24291 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.230542 21643 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:28.260643 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:28.261636 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:28.262527 21643 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.249341 21637 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.249807 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1771) took 1305 ms. Trace:
I20260709 13:07:28.247535 21639 raft_consensus.cc:2955] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:28.263927 21489 rpcz_store.cc:276] 0709 13:07:26.944514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.833960 (+889446us) service_pool.cc:224] Handling call
0709 13:07:27.834185 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.221685 (+387500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.221714 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.249491 (+ 27777us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:28.249539 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.249611 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.249752 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155078,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4453,"thread_start_us":387119,"threads_started":1}
I20260709 13:07:28.245998 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:28.221710 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1779) took 1275 ms. Trace:
I20260709 13:07:28.242357 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:28.266829 21490 rpcz_store.cc:276] 0709 13:07:26.946370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.858243 (+911873us) service_pool.cc:224] Handling call
0709 13:07:27.902056 (+ 43813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.221373 (+319317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.221407 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.221452 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:28.221500 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.221559 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.221661 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":213282,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":318940,"threads_started":1}
I20260709 13:07:28.271759 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:28.275422 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:28.281101 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:28.281978 21566 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:28.284198 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:28.284526 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:28.285405 21568 raft_consensus.cc:2410] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:28.285629 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:28.286219 21458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.009s
W20260709 13:07:28.286580 21458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.005s	sys 0.009s
W20260709 13:07:28.287237 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.287952 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1827) took 1340 ms. Trace:
I20260709 13:07:28.287601 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:28.289963 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:28.291201 21489 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:28.292331 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.251540 24361 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:28.249629 24252 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:28.303028 21490 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:28.303417 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:28.304212 21637 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 8: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:28.305707 21637 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:28.306025 21637 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:28.307097 21637 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:28.308635 21637 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:28.307582 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 54561.2us
I20260709 13:07:28.310853 24346 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.312726 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:28.303066 21643 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:28.315284 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:28.318544 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.293769 21563 rpcz_store.cc:276] 0709 13:07:26.947097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.915996 (+968899us) service_pool.cc:224] Handling call
0709 13:07:27.916347 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.287588 (+371241us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:28.287622 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.287667 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:28.287711 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.287777 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.287896 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101303,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":236894,"threads_started":1}
W20260709 13:07:28.320408 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.264353 24458 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.266355 24341 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:07:28.252506 24358 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:07:28.383147 21608 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.001s	sys 0.046s
I20260709 13:07:28.289140 24418 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.290729 24474 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:28.289250 24466 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.426657 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:28.318322 24325 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:28.415328 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:28.420347 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 174426us
W20260709 13:07:28.418238 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 132672us
W20260709 13:07:28.419600 21608 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.001s	sys 0.046s
I20260709 13:07:28.414811 21637 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:28.299108 24303 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:28.295379 24469 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.270418 24291 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.420662 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:28.295010 24463 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:28.473250 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:28.460768 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.471887 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 765400us
I20260709 13:07:28.484143 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.485834 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:28.486873 21637 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:07:28.490293 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.492216 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.493011 21637 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
W20260709 13:07:28.491205 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 199776us
I20260709 13:07:28.475036 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:28.324817 24354 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.019s
I20260709 13:07:28.321532 24423 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.508957 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:28.510071 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 198760us
I20260709 13:07:28.510185 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.509460 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:28.414650 24477 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.321154 24396 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:28.302211 24361 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:28.418479 24475 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:28.302409 24252 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:28.498507 21608 connection.cc:256] RPC call timeout handler was delayed by -1.3350286190000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28500000000000003s for a response
I20260709 13:07:28.400501 24431 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:07:28.514655 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:28.515627 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 100360us
I20260709 13:07:28.486397 24325 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:28.535202 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:28.555202 21637 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:28.556161 21643 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.556749 21637 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:28.557832 21643 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:28.558310 21637 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:28.509460 24354 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.012s	sys 0.032s
W20260709 13:07:28.546146 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.469924 24474 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:28.484021 24315 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:28.551664 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:28.298082 24472 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.192s
I20260709 13:07:28.550015 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:28.553398 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:28.302517 24363 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.491480 24303 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:28.568295 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:28.509809 24465 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.513365 24463 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:28.592420 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:28.542759 24461 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.586305 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:28.600310 24394 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:28.600912 24394 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:28.601392 24394 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.586560 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:28.546522 24439 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:07:28.564466 24325 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.573685 24418 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:28.562741 24423 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.590408 24471 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:28.630170 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2141) took 1652 ms. Trace:
I20260709 13:07:28.630550 21564 rpcz_store.cc:276] 0709 13:07:26.977722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.930716 (+952994us) service_pool.cc:224] Handling call
0709 13:07:27.931132 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.952906 (+ 21774us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:27.952945 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.953397 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.248049 (+294652us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:28.248091 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.248159 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.629981 (+381822us) raft_consensus.cc:1685] finished
0709 13:07:28.630000 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.630114 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":294294,"threads_started":1,"wal-append.queue_time_us":466295}
I20260709 13:07:28.631505 24459 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:28.631983 24423 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.633092 24361 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:28.634486 24474 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.636113 24291 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:28.636209 21569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:28.636891 21569 raft_consensus.cc:606] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:28.641048 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.641722 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.643260 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:28.545809 24396 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:28.562971 24336 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:28.608554 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 56990.6us
I20260709 13:07:28.676633 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:28.584887 24462 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:28.563220 24464 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.560741 24475 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:28.584575 24415 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:28.573427 24349 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:28.621582 24463 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:28.695076 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 222690us
I20260709 13:07:28.696326 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:28.697098 21566 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:28.623685 24481 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:28.624361 24113 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:28.541994 24477 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:28.704344 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:28.711287 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:28.631994 24459 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:28.626922 24309 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.627101 24303 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.643836 21564 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.600333 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:28.596688 24469 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:28.676697 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 109033us
I20260709 13:07:28.617022 24260 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.585297 24315 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.684767 21563 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.638099 24363 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.543895 24473 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:07:28.675869 24460 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:28.677553 24462 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:28.688040 24336 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:28.726715 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:28.734396 21566 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:07:28.737142 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 136882us
I20260709 13:07:28.672876 24418 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.738415 24352 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:28.701716 24113 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:28.736795 24423 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:28.743430 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.720325 24313 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:28.747398 21560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d086ed254594401ae567a7d3681c987"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:28.764514 21560 raft_consensus.cc:606] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:28.764923 21560 raft_consensus.cc:614] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:28.741170 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 64627.3us
I20260709 13:07:28.736373 24260 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:28.745260 24468 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.677851 24461 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:28.771670 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:28.760115 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:28.772944 21564 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:28.742951 24469 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:28.762295 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:28.808348 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48340us
I20260709 13:07:28.809247 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:28.703614 24415 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:28.810886 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:28.814112 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:28.814004 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:28.756906 24402 consensus_meta.cc:287] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.006s
I20260709 13:07:28.752812 24297 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:28.823249 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 114728us
W20260709 13:07:28.752499 22238 consensus_meta.cc:287] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.004s
W20260709 13:07:28.912603 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.750560 24493 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.772611 24352 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:07:28.898942 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 134423us
W20260709 13:07:28.900792 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 72437.3us
I20260709 13:07:28.895942 24431 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:28.899511 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 133779us
I20260709 13:07:28.894972 21642 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:28.946247 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:28.774560 24260 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:28.923257 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 109323us
I20260709 13:07:28.972383 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:28.755781 24488 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.803923 24468 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:28.760835 24439 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.146s
I20260709 13:07:28.763552 24473 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.138s
W20260709 13:07:28.937451 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 170988us
I20260709 13:07:28.752372 24496 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.180s
I20260709 13:07:28.812557 24423 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.819988 24291 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.820750 24361 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.970129 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:29.134709 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 164702us
I20260709 13:07:29.135535 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:28.929004 24425 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.136s
I20260709 13:07:28.924712 24402 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.991048 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:28.775293 24313 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.073992 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:29.074468 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:28.923671 24297 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:29.080282 24477 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:29.080937 24303 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:29.081645 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.928310 22238 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:29.136747 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:28.745903 24460 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:29.137331 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 199252us
I20260709 13:07:29.008157 24468 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:29.141979 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 151052us
W20260709 13:07:29.157366 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 82969.9us
I20260709 13:07:29.158499 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:29.159909 21608 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.649s (SENT)
I20260709 13:07:29.160336 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:29.161307 21608 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.807s (SENT)
I20260709 13:07:29.161691 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:29.008262 24482 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.954315 24458 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:29.073661 24493 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.985569 24508 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:29.144318 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 70407.2us
I20260709 13:07:28.771459 24459 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.153352 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:29.153352 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:28.801299 24475 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.089689 24396 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:29.162606 21608 leader_election.cc:336] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.833s (SENT)
I20260709 13:07:29.141427 24488 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.985396 24431 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.139220 24467 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.926470 24113 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.178385 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:29.194439 24315 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:28.833904 24462 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.194123 21391 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 6, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 6 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:07:29.197178 24431 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:29.197623 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.149941 24303 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.985069 24336 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.167725 24466 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.156284 24425 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:29.178711 24423 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.186946 24490 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:07:29.203845 24486 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:29.214586 21640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.003s
W20260709 13:07:29.221143 21640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.003s
I20260709 13:07:29.222060 24488 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:29.222463 24488 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:29.222592 24494 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:07:29.223459 24415 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:29.224211 24489 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:07:29.224609 24523 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.212466 24303 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:29.225140 24499 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
W20260709 13:07:29.226555 24495 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:07:29.227763 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2142) took 2249 ms. Trace:
I20260709 13:07:29.216382 24431 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:29.228101 21562 rpcz_store.cc:276] 0709 13:07:26.979017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.956241 (+977224us) service_pool.cc:224] Handling call
0709 13:07:27.956658 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.243966 (+287308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.244001 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.244447 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.681540 (+437093us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:28.681645 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.692895 (+ 11250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.227558 (+534663us) raft_consensus.cc:1685] finished
0709 13:07:29.227577 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.227711 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":174590,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":657795,"threads_started":2,"wal-append.queue_time_us":517416}
I20260709 13:07:29.229360 24431 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:29.144050 24469 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.230902 24437 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.230971 24418 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:29.232089 24484 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.468s	user 0.001s	sys 0.001s
I20260709 13:07:29.232398 24252 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:29.233187 24465 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.233424 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2140) took 2257 ms. Trace:
I20260709 13:07:29.233548 24465 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:29.172776 24501 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:07:29.233945 21561 rpcz_store.cc:276] 0709 13:07:26.976605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.922013 (+945408us) service_pool.cc:224] Handling call
0709 13:07:27.922348 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.222373 (+300025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.222403 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.250531 (+ 28128us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.563811 (+313280us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:28.563866 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.563964 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.233210 (+669246us) raft_consensus.cc:1685] finished
0709 13:07:29.233231 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.233367 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":180278,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":569788,"threads_started":2,"wal-append.queue_time_us":451594}
I20260709 13:07:29.235399 24501 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.236096 24501 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:29.214998 22213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.002s	sys 0.001s
I20260709 13:07:29.147753 24402 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.192499 24493 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.192700 24491 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:29.219835 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.218691 21564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
W20260709 13:07:29.230558 24507 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:07:29.165094 24474 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:07:29.200009 24313 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:29.171947 24477 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:07:29.214123 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 271626us
I20260709 13:07:29.240823 21564 raft_consensus.cc:606] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:29.265946 21564 raft_consensus.cc:614] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.241308 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:29.247685 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.268656 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.256646 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 103344us
W20260709 13:07:29.238420 22213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.002s	sys 0.002s
W20260709 13:07:29.263147 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.273404 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:29.230320 24431 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.295794 21489 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:29.256712 22242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.003s	sys 0.000s
I20260709 13:07:29.298712 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:29.241815 24425 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:29.259011 24394 consensus_meta.cc:287] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.003s
W20260709 13:07:29.312151 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.240085 24402 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:29.301098 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:29.237970 24325 consensus_meta.cc:287] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.607s	user 0.007s	sys 0.002s
I20260709 13:07:29.187618 24352 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.298592 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.326299 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:29.339262 21492 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 2.
I20260709 13:07:29.339386 21491 raft_consensus.cc:2376] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6. Re-sending same reply.
I20260709 13:07:29.325558 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:29.310443 22242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.003s	sys 0.000s
I20260709 13:07:29.252336 24350 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:07:29.213008 24297 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.340878 21493 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:29.349864 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.299804 24423 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:29.339916 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 93221.8us
I20260709 13:07:29.350835 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:29.356714 21608 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.975s (SENT)
I20260709 13:07:29.357278 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:29.223454 24488 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.360071 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.360888 24488 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.361327 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.343407 24325 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.363155 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.363791 21493 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:29.364750 24325 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:29.365038 21493 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:07:29.358624 21608 leader_election.cc:336] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.991s (SENT)
I20260709 13:07:29.337908 24394 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.366423 21493 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:29.366878 21608 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.012s (SENT)
I20260709 13:07:29.367607 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:29.368109 24394 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:29.365986 24303 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.388326 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.391732 21568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:29.392570 21568 raft_consensus.cc:606] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:29.393041 21568 raft_consensus.cc:614] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.370687 24523 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.411904 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.384058 24402 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:29.423275 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 264888us
I20260709 13:07:29.424559 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.425297 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:29.426357 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.428342 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.413239 21639 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:29.370620 24260 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.404399 24510 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:29.436298 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.609s (SENT) [suppressed 23 similar messages]
W20260709 13:07:29.437050 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 70190.8us
I20260709 13:07:29.454015 21568 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:29.454599 21608 leader_election.cc:336] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.020s (SENT)
I20260709 13:07:29.430855 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2030) took 1185 ms. Trace:
I20260709 13:07:29.411303 24439 consensus_queue.cc:1243] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:29.412613 24461 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:29.456837 24418 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.430567 24519 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.435999 24394 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.459858 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:29.470454 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 171366us
W20260709 13:07:29.445588 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.456630 21635 rpcz_store.cc:276] 0709 13:07:28.245425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.246239 (+   814us) service_pool.cc:224] Handling call
0709 13:07:28.251889 (+  5650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.252083 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:28.691805 (+439722us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.430330 (+738525us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18003f0f40. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287
0709 13:07:29.430437 (+   107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.430492 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:29.430545 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.430639 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.430769 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64907,"prepare.queue_time_us":374012,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":200671,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7677,"spinlock_wait_cycles":27757824,"thread_start_us":815998,"threads_started":3,"wal-append.queue_time_us":679238}
I20260709 13:07:29.458688 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.432034 24361 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.458169 24402 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.451699 24510 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:29.484071 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47801.3us
I20260709 13:07:29.466533 24501 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.482143 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:29.465718 24423 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:29.457412 24493 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:29.449837 24425 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.515733 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.470191 24313 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:29.522876 24394 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.523474 24394 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:29.523902 24394 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.525087 24350 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.525612 24350 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.524870 24496 raft_consensus.cc:2955] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:29.485635 24486 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:07:29.508683 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2145) took 2523 ms. Trace:
I20260709 13:07:29.529021 21567 rpcz_store.cc:276] 0709 13:07:26.985965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.987322 (+1001357us) service_pool.cc:224] Handling call
0709 13:07:28.000987 (+ 13665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.296482 (+295495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.296528 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.297079 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.571438 (+274359us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:28.571473 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.571556 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.249527 (+677971us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:29.250755 (+  1228us) raft_consensus.cc:1685] finished
0709 13:07:29.250774 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.508490 (+257716us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b54001f9ad0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:29.508618 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130535,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":75986560,"thread_start_us":444206,"threads_started":2,"wal-append.queue_time_us":806403}
W20260709 13:07:29.533291 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.488844 24363 consensus_meta.cc:287] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.748s	user 0.001s	sys 0.011s
I20260709 13:07:29.474128 24439 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:07:29.497943 24516 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:07:29.495461 24513 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:07:29.486469 24474 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:29.497224 24511 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:29.484858 24510 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.553179 24510 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.504106 24303 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:29.500751 24260 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:29.540357 24501 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:29.551925 24439 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:29.552145 24165 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:29.555958 24501 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:29.557077 24501 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.552280 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:29.555365 24349 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.559161 24349 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.559749 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.561192 24349 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:29.561717 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.561956 24363 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.562884 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.499508 24256 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:29.565511 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 78280.6us
I20260709 13:07:29.545420 24486 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.571673 21489 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:29.565567 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.497330 24252 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:07:29.489519 24402 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.573535 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:29.550295 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 63124us
I20260709 13:07:29.549515 24477 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.578550 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.605683 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:29.608047 22247 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:07:29.566643 24256 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:29.617573 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.621914 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.567770 24439 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.571949 24486 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:29.543907 24313 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:29.626331 21532 connection.cc:256] RPC call timeout handler was delayed by -1.6614153390000865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
I20260709 13:07:29.626200 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:29.627820 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.567682 24520 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.616901 24260 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.569180 24349 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:07:29.622303 24493 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.587193 24474 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.623271 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.656183 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:29.643110 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:29.631496 24423 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.663997 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:29.665057 22243 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:29.667927 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.810817 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.836719 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.737879 24468 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.000s
I20260709 13:07:29.837244 24468 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.839426 24468 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:29.754913 24394 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.839841 21561 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:29.841573 24394 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:29.724720 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:29.842847 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.842924 24550 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.843346 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:29.843568 24550 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.844822 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:29.845713 24550 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:29.741349 21565 raft_consensus.cc:2955] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:29.846271 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:29.671540 24260 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.724726 24521 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.849808 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:29.714072 24514 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:29.727720 24534 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.850561 21569 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:29.804412 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 227813us
I20260709 13:07:29.730969 24402 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:29.754739 24506 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:29.757036 24532 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.258s	user 0.002s	sys 0.000s
I20260709 13:07:29.851442 24260 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:29.851523 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.726315 24313 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:29.852676 24313 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.852847 21457 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:29.853964 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.854059 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:29.854833 24557 raft_consensus.cc:2764] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:29.855216 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:29.855752 24557 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:29.817409 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.815771 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.751039 24350 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:29.856721 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:29.851372 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:29.858918 24341 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.789834 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:29.859288 24341 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:29.658715 24439 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.859777 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:29.859885 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 70179.1us
I20260709 13:07:29.860555 24350 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.616390 24477 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.860954 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:29.762524 24486 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.820521 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.862056 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:29.851599 24506 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:29.863179 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:29.863449 21491 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:29.861693 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:29.821864 24363 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.823017 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:29.673990 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:29.656270 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:29.706691 22244 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:29.855284 24534 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.855885 21488 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.819878 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.825143 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:29.879894 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 54862.4us
I20260709 13:07:29.864210 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:29.862190 24486 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.895787 22247 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:29.874742 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:29.896951 22246 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:29.859714 24341 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.875864 21491 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.898590 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:29.865737 21562 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:29.863660 24506 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.870646 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.887378 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:29.900111 21493 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.878422 24313 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:29.887560 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:07:29.889879 24515 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.656s	user 0.000s	sys 0.002s
I20260709 13:07:29.876526 22239 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:29.893551 24363 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.894544 21488 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:29.900740 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:29.902719 22244 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.905344 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:29.908739 21491 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:29.909870 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:29.911052 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:29.918215 21493 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:29.901844 24313 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:29.920706 24313 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:29.924623 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.927809 24418 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.928376 24418 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:29.931192 24506 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.911851 21569 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:29.939317 24358 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:29.939766 24358 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:29.939807 24363 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:29.940727 24358 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:29.904322 24260 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.941797 24358 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.880102 24425 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:29.943127 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:29.944989 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:29.946581 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:29.947237 21637 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:29.955389 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:29.957914 21634 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:29.959764 21635 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:29.960929 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 90384.4us
I20260709 13:07:29.961725 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:29.965354 24560 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:29.968518 21488 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.931164 24418 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:29.978396 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:29.980629 21634 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:30.009948 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:30.012377 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.012451 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.013177 21637 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:30.013556 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.018115 21635 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:30.018143 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.010848 21569 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:29.970363 24557 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.019083 21634 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:30.021586 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.025090 21634 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:29.970350 24461 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:07:30.033394 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:30.034018 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.034845 21569 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:30.015161 24534 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:30.053073 21639 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:30.055838 24477 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:30.058811 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.060154 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:30.060904 21569 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:30.034768 24530 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.064096 21639 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:30.062745 24462 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.077299 24113 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.083698 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.084995 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.086563 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.087931 21561 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:30.089251 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.090240 21561 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:30.091737 21634 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:30.093427 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.109403 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:30.111771 24500 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:30.112228 22245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 566) took 2169 ms. Trace:
I20260709 13:07:30.113963 24460 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:30.114729 24461 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:30.115162 24461 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:30.115993 24461 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:30.117132 24461 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.119323 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.119948 21634 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 2.
I20260709 13:07:30.112627 22245 rpcz_store.cc:276] 0709 13:07:27.950762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.952749 (+  1987us) service_pool.cc:224] Handling call
0709 13:07:27.953204 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.071776 (+118572us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:28.245871 (+174095us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.934634 (+688763us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.934950 (+   316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.935016 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:28.935084 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.112003 (+1176919us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540059ecd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:30.112048 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.112170 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9446,"prepare.queue_time_us":490411,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1889,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":20735,"spinlock_wait_cycles":271918336,"thread_start_us":635728,"threads_started":2,"wal-append.queue_time_us":505748}
I20260709 13:07:30.113883 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:30.123320 24349 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:30.123871 24349 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.124302 24349 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.129628 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.130125 21634 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:30.130391 21639 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
W20260709 13:07:30.131526 24526 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.903s	user 0.004s	sys 0.005s
I20260709 13:07:30.132587 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2160) took 1369 ms. Trace:
I20260709 13:07:30.110708 24341 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:30.132963 21563 rpcz_store.cc:276] 0709 13:07:28.763170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.896650 (+133480us) service_pool.cc:224] Handling call
0709 13:07:28.896879 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.074679 (+177800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.074706 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.075193 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.759139 (+683946us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b180032bb40. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1
0709 13:07:29.759337 (+   198us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:29.759385 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.759482 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.128550 (+369068us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:30.132368 (+  3818us) raft_consensus.cc:1685] finished
0709 13:07:30.132395 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.132530 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":286644,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":23452,"spinlock_wait_cycles":29012608,"thread_start_us":262591,"threads_started":2,"wal-append.queue_time_us":150737}
I20260709 13:07:30.135284 24341 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:30.135396 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.136185 24313 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:30.136070 21391 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 6, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 6 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.137225 21491 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:30.138324 21563 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.140205 21563 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:30.140753 24313 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:30.142494 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.143899 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:30.150561 21642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2028) took 1916 ms (client timeout 2144 ms). Trace:
I20260709 13:07:30.138307 21391 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:30.154943 21391 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 5 to 7, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 7 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.093423 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:30.152117 21642 rpcz_store.cc:269] 0709 13:07:28.234131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.234850 (+   719us) service_pool.cc:224] Handling call
0709 13:07:30.150336 (+1915486us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54000f4454. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:30.150489 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495466880}
I20260709 13:07:30.162119 21564 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:30.150288 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:30.157178 21391 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.165726 21569 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:30.165741 21563 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:30.166999 21563 pending_rounds.cc:85] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 4
I20260709 13:07:30.167273 21563 pending_rounds.cc:107] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:30.167582 21563 raft_consensus.cc:2889] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.168347 21391 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 7, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 7 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.176234 21391 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.066498 24477 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:30.211496 21391 catalog_manager.cc:5697] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:30.212500 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46734.2us
I20260709 13:07:30.213227 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:30.216665 21391 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:30.217994 21391 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 3 to 6, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 6 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:30.223333 21569 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:30.233947 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 89084.3us
I20260709 13:07:30.226859 24477 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:30.236601 24463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.020s	sys 0.036s
I20260709 13:07:30.256959 24479 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:07:30.262635 21389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 240) took 16612 ms (client timeout 15000 ms). Trace:
I20260709 13:07:30.264945 21564 pending_rounds.cc:85] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 4
I20260709 13:07:30.265306 21564 pending_rounds.cc:107] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:30.265540 21564 raft_consensus.cc:2889] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:30.264415 24463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.020s	sys 0.036s
W20260709 13:07:30.263181 21389 rpcz_store.cc:269] 0709 13:07:13.646471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.664828 (+ 18357us) service_pool.cc:224] Handling call
0709 13:07:14.356280 (+691452us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4c090 00007f98a9feaf3a 00007f98afda11cc 00007f98afe9f37e 00007f98ae3602a4 00007f98ae360232 00007f98ae360161 00007f98ae3600dc 00007f98ae35f392 00007f98a831d48c 00007f98a831c8c6
0709 13:07:30.258267 (+15901987us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:23.085785 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:23.086637 (+   852us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:23.086879 (+   242us) write_op.cc:435] Acquired schema lock
0709 13:07:23.086911 (+    32us) tablet.cc:662] Decoding operations
0709 13:07:23.657246 (+570335us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:23.689324 (+ 32078us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:23.701410 (+ 12086us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:07:23.737954 (+ 36544us) tablet.cc:701] Row locks acquired
0709 13:07:23.738022 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:07:23.738224 (+   202us) write_op.cc:270] Start()
0709 13:07:23.738385 (+   161us) write_op.cc:276] Timestamp: P: 1783602443738149 usec, L: 0
0709 13:07:23.738404 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:07:23.739188 (+   784us) log.cc:844] Serialized 5613 byte log entry
0709 13:07:24.399048 (+659860us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a6ed80ac 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b
0709 13:07:25.512664 (+1113616us) op_driver.cc:464] REPLICATION: finished
0709 13:07:25.700667 (+188003us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a6ed80ac 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98ada18ef0
0709 13:07:25.898427 (+197760us) write_op.cc:301] APPLY: starting
0709 13:07:25.917398 (+ 18971us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:25.970928 (+ 53530us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:25.970959 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:25.972398 (+  1439us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:25.972683 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:07:25.972728 (+    45us) write_op.cc:312] APPLY: finished
0709 13:07:25.973068 (+   340us) log.cc:844] Serialized 101 byte log entry
0709 13:07:25.973277 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.973432 (+   155us) write_op.cc:454] Released schema lock
0709 13:07:25.973484 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:25.973885 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.973912 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2385,"reported_tablets":45,"spinlock_wait_cycles":640724352,"child_traces":[["op",{"apply.queue_time_us":351462,"apply.run_cpu_time_us":3620,"apply.run_wall_time_us":86581,"num_ops":14,"prepare.queue_time_us":145237,"prepare.run_cpu_time_us":24244,"prepare.run_wall_time_us":1623531,"raft.queue_time_us":331648,"raft.run_cpu_time_us":10428,"raft.run_wall_time_us":373566,"replication_time_us":1671823,"spinlock_wait_cycles":200768640,"thread_start_us":1424429,"threads_started":4,"wal-append.queue_time_us":1106485,"wal-append.run_cpu_time_us":72941,"wal-append.run_wall_time_us":2118005}]]}
W20260709 13:07:30.281844 24336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.007s	sys 0.004s
I20260709 13:07:30.372721 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:30.374963 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.368269 24463 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:30.379854 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:30.380800 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 292142us
W20260709 13:07:30.384254 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.385242 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:30.372754 24336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.008s	sys 0.005s
I20260709 13:07:30.287206 24460 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.372879 24252 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.402061 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:30.409170 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.410285 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:30.413569 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.399781 24361 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.419273 21566 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.391194 24486 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.397570 24303 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:30.431991 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.419281 21565 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.399595 24260 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:30.445729 24260 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:30.448057 24260 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:30.389932 24556 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.427942 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:30.452106 24349 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:30.453068 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:30.453852 24352 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:30.454241 24352 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.419849 24460 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:30.455354 24480 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:30.455919 24480 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:30.456815 24460 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:30.456764 24480 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:30.422152 24252 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:30.432260 24486 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:30.459229 24252 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:30.459399 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.459486 24325 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:30.461027 24486 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:30.427886 24336 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.464206 21642 raft_consensus.cc:2955] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:30.454563 24352 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.399461 24423 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:07:30.390652 24463 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:30.400749 24521 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:07:30.426719 24553 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:30.431212 24303 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:30.505906 21486 raft_consensus.cc:2955] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:30.507797 21565 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:07:30.541325 21565 pending_rounds.cc:85] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 7
I20260709 13:07:30.541721 21565 pending_rounds.cc:107] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:07:30.542057 21565 raft_consensus.cc:2889] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:30.548655 24567 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:07:30.541165 24303 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:30.570242 24572 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:30.576216 24463 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:30.532764 24349 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:30.541818 24477 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:30.589021 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:30.587599 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.592197 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.605780 21641 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:30.593412 21639 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:30.533522 24553 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:30.602114 21565 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:30.608759 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:30.610092 21641 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.607306 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:30.610719 21639 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:30.569142 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 110508us
I20260709 13:07:30.616647 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.615015 24553 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.620143 24568 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:30.626144 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:30.629223 24553 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:30.630424 21565 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.631464 24496 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.632114 24496 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.634227 24496 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:30.635267 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.639178 24491 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:30.614271 24113 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:07:30.674132 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:30.674906 21494 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:30.675071 21562 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.678735 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:30.682971 21639 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 4.
I20260709 13:07:30.687913 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.688776 21636 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:07:30.666832 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 256611us
I20260709 13:07:30.693338 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:30.702157 21491 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:30.699486 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:30.676278 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:30.678263 24477 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:30.700487 24475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.471s	user 0.012s	sys 0.046s
I20260709 13:07:30.721916 21562 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:30.738955 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:30.739354 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.739694 21639 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.741806 21634 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:30.737950 24553 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:30.738092 24475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.509s	user 0.012s	sys 0.046s
I20260709 13:07:30.750309 21639 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:30.695139 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:30.770447 24363 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:30.770633 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 75586.2us
I20260709 13:07:30.773357 24556 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:30.698297 24521 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 13:07:30.781389 24574 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:30.783602 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:30.787976 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2168) took 1204 ms. Trace:
I20260709 13:07:30.789319 24459 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:30.756858 22243 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:30.791762 21490 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:30.753602 24461 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:30.745108 24477 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:30.799379 24496 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:30.799746 24303 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:30.803882 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1801) took 1494 ms. Trace:
I20260709 13:07:30.829319 24461 consensus_queue.cc:1243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:30.820662 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2157) took 2131 ms. Trace:
I20260709 13:07:30.843436 21566 rpcz_store.cc:276] 0709 13:07:28.689723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.748727 (+ 59004us) service_pool.cc:224] Handling call
0709 13:07:28.749126 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.422535 (+1673409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.820421 (+397886us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540031f1d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:30.820598 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840575744}
I20260709 13:07:30.821627 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:30.822834 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.823572 21567 rpcz_store.cc:276] 0709 13:07:29.583386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.590153 (+  6767us) service_pool.cc:224] Handling call
0709 13:07:29.591117 (+   964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.591387 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:29.627134 (+ 35747us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.787513 (+1160379us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b18001b0940. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287
0709 13:07:30.787613 (+   100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.787667 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:30.787716 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.787784 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.787904 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53146,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":98047,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":20706688,"thread_start_us":77352,"threads_started":1}
I20260709 13:07:30.840384 21489 rpcz_store.cc:276] 0709 13:07:29.309161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.361055 (+ 51894us) service_pool.cc:224] Handling call
0709 13:07:30.803679 (+1442624us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003f9654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:30.803811 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482248576}
I20260709 13:07:30.745358 24530 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:07:30.845193 21563 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
W20260709 13:07:30.846647 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.851293 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:30.853130 21491 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:07:30.798708 24462 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.005s
I20260709 13:07:30.852137 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.856032 21563 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
W20260709 13:07:30.861734 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.832789 24313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.007s	sys 0.012s
I20260709 13:07:30.865435 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:30.866130 21494 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:30.855046 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:30.867486 21566 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:30.871197 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.871359 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:30.871953 21491 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:30.876055 21491 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:30.876192 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:30.877961 21485 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:30.879254 21567 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:30.879743 21567 pending_rounds.cc:85] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:07:30.880008 21567 pending_rounds.cc:107] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:30.880509 21567 raft_consensus.cc:2889] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.884214 21494 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:30.884395 24466 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.887102 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:30.842957 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 573) took 1237 ms. Trace:
W20260709 13:07:30.877916 24313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.007s	sys 0.012s
I20260709 13:07:30.890373 21636 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:30.887609 24580 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:30.947628 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 249681us
W20260709 13:07:30.922854 24346 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.781s	user 0.010s	sys 0.018s
I20260709 13:07:30.972002 24303 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:30.972502 24346 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.833s	user 0.011s	sys 0.018s
I20260709 13:07:30.973704 24496 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:30.945932 24469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.713s	user 0.013s	sys 0.028s
I20260709 13:07:30.923164 24506 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:30.924840 24580 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.975267 24580 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.977046 24477 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:30.865080 24465 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:30.960523 24352 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:30.967293 24420 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:30.956041 24473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.799s	user 0.016s	sys 0.016s
I20260709 13:07:30.887452 24466 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:30.978355 24469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.745s	user 0.013s	sys 0.028s
I20260709 13:07:30.891527 22238 rpcz_store.cc:276] 0709 13:07:29.603208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.622170 (+ 18962us) service_pool.cc:224] Handling call
0709 13:07:30.783470 (+1161300us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebdeee 0000000000375939 00007f98aef311e0 00007f98aeffa0c4 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:30.840108 (+ 56638us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8782592}
W20260709 13:07:30.991466 24473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.839s	user 0.017s	sys 0.017s
I20260709 13:07:31.005887 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:31.010310 24465 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.011543 24352 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:31.019038 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:31.020005 22240 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
W20260709 13:07:31.020643 22240 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 368) took 1356 ms (client timeout 1672 ms). Trace:
W20260709 13:07:31.021163 22240 rpcz_store.cc:269] 0709 13:07:29.664002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.671474 (+  7472us) service_pool.cc:224] Handling call
0709 13:07:31.018812 (+1347338us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:31.020563 (+  1751us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5310208}
I20260709 13:07:31.023488 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 437) took 1400 ms. Trace:
I20260709 13:07:31.024055 22247 rpcz_store.cc:276] 0709 13:07:29.623498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.623657 (+   159us) service_pool.cc:224] Handling call
0709 13:07:29.624021 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.896197 (+272176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.023139 (+1126942us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54000d0554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:31.023401 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624196480}
I20260709 13:07:31.025002 24463 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.025683 24463 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.029258 24358 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.029848 24358 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:30.990661 24420 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:31.031924 24420 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.032802 24256 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.033902 24256 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.137799 24519 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:31.162076 24519 consensus_queue.cc:1243] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:31.183979 24466 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:31.255470 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:31.262629 21457 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.015s	sys 0.012s
W20260709 13:07:31.263504 21457 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.016s	sys 0.012s
W20260709 13:07:31.264362 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 671940us
W20260709 13:07:31.268656 21459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.005s
W20260709 13:07:31.269295 21459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.002s	sys 0.005s
W20260709 13:07:31.270105 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.277348 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.276955 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:31.279959 21492 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:31.280714 21494 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:31.279073 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:31.306161 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.002451 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 304173us
I20260709 13:07:31.308166 21562 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:07:31.463624 21563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.012s	sys 0.013s
W20260709 13:07:31.466068 21563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.012s	sys 0.013s
W20260709 13:07:31.345263 22211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.021s	sys 0.011s
W20260709 13:07:31.479954 21634 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.028s
W20260709 13:07:31.480839 21634 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.004s	sys 0.028s
I20260709 13:07:31.434271 24303 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:07:31.432508 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 162579us
W20260709 13:07:31.322403 21642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.011s	sys 0.019s
W20260709 13:07:31.484958 22211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.029s	sys 0.019s
I20260709 13:07:31.434850 24418 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:31.485715 21642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.017s	sys 0.029s
I20260709 13:07:31.343544 22238 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.505800 24418 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:31.510541 21637 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.019s	sys 0.011s
W20260709 13:07:31.511287 21637 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.020s	sys 0.011s
I20260709 13:07:31.511046 24553 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:31.308167 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:31.510336 24459 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.313555 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:31.509850 24418 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:31.510385 21485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 350) took 2748 ms (client timeout 1931 ms). Trace:
I20260709 13:07:31.534325 24473 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:31.535313 24473 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.538296 24473 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:31.510622 24477 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:31.522039 21485 rpcz_store.cc:269] 0709 13:07:28.761793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.762385 (+   592us) service_pool.cc:224] Handling call
0709 13:07:31.509827 (+2747442us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54000b7554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:31.510124 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4736651520}
I20260709 13:07:31.551466 21566 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:31.568784 24462 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:31.569428 24614 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.553612 24472 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:31.569923 24462 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:31.570995 24591 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:31.570919 24472 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.547695 24466 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:31.572927 24466 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.573237 24462 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:31.573314 24466 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:31.574681 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.577309 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:31.556808 24464 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:31.580235 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:31.581323 24482 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:31.582412 24482 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.583200 24477 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.585096 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:31.585386 24482 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:31.586114 24477 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:31.570477 24614 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.587728 24486 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.586354 24256 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.586819 24553 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.617774 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:31.625722 21485 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:31.606292 24472 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:31.053400 24358 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.557747 24459 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:31.641085 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 327940us
I20260709 13:07:31.613806 24464 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:31.644992 24556 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.645968 24556 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.646404 24464 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.647467 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:31.649502 21566 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:31.649236 24256 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.650118 24612 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:31.651069 24612 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.651947 24463 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:31.655469 24597 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:07:31.656862 24620 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:31.658010 24459 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:31.657836 24620 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:31.659251 24590 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:07:31.590263 24461 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:31.659960 24581 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.660954 24556 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:31.661993 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2055) took 1054 ms. Trace:
I20260709 13:07:31.663514 24256 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:31.663671 24358 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.663849 24615 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.671057 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:31.671379 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 94495.8us
I20260709 13:07:31.671933 24613 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:31.675446 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 84159.4us
I20260709 13:07:31.679013 24523 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.688699 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:31.666018 24612 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:31.680961 24297 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.715108 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:31.723156 24418 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.723644 24418 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.724004 24418 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.724598 24620 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:31.725255 24620 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:31.727229 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:31.727448 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:31.728991 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:31.730453 24523 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.731194 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:07:31.736897 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.730690 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:31.628113 24466 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.726022 24620 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.696270 24615 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:31.758252 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:31.759311 24615 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.760892 24612 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:31.787220 21489 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:31.790180 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:31.779711 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:31.714555 24613 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.768296 24461 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.689738 21635 rpcz_store.cc:276] 0709 13:07:30.589984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.594983 (+  4999us) service_pool.cc:224] Handling call
0709 13:07:30.595306 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.595646 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.595673 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.596110 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.939822 (+343712us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:31.431427 (+491605us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.612020 (+180593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.620947 (+  8927us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.625609 (+  4662us) raft_consensus.cc:1685] finished
0709 13:07:31.625625 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.644462 (+ 18837us) inbound_call.cc:177] Queueing success response
0709 13:07:31.671973 (+ 27511us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b480021c258. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f 00007f98aeff9f37 00007f98af00e55c 00007f98af00e508 00007f98af00e488 00007f98af00e443 00007f98af00d6ec 00007f98adf37a96
Metrics: {"mutex_wait_us":57937,"prepare.queue_time_us":607382,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":109882,"raft.run_cpu_time_us":3389,"raft.run_wall_time_us":129980,"spinlock_wait_cycles":8421632,"thread_start_us":533482,"threads_started":3,"wal-append.queue_time_us":575818}
I20260709 13:07:31.762691 24556 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:31.812340 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:31.815234 24612 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:31.826931 24619 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:07:31.827193 24612 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.830356 21485 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:31.831733 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:31.824206 24461 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.834290 24461 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:31.834965 24556 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:07:31.835656 24523 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:31.828689 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 372) took 1365 ms. Trace:
I20260709 13:07:31.845464 21489 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 4: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:31.847296 21606 connection.cc:256] RPC call timeout handler was delayed by -1.8421141110001145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:07:31.848363 21606 leader_election.cc:336] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 2.209s (SENT)
I20260709 13:07:31.848618 24466 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:31.849824 21606 connection.cc:256] RPC call timeout handler was delayed by -1.6450141110000231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 13:07:31.850308 21606 connection.cc:256] RPC call timeout handler was delayed by -1.601007678999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:07:31.856662 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1349) took 1003 ms. Trace:
I20260709 13:07:31.857110 21486 rpcz_store.cc:276] 0709 13:07:30.852636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.853791 (+  1155us) service_pool.cc:224] Handling call
0709 13:07:31.538904 (+685113us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:31.579513 (+ 40609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.579540 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:31.580332 (+   792us) log.cc:844] Serialized 52 byte log entry
0709 13:07:31.705298 (+124966us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:31.813516 (+108218us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.813731 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.814201 (+   470us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.856289 (+ 42088us) raft_consensus.cc:1685] finished
0709 13:07:31.856316 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.856470 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39845,"raft.queue_time_us":47749,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":5135,"thread_start_us":178211,"threads_started":2,"wal-append.queue_time_us":187191}
I20260709 13:07:31.862004 24527 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:31.863969 24556 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
W20260709 13:07:31.864861 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 133896us
I20260709 13:07:31.867587 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:31.868528 24506 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:31.869216 24506 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.868479 21638 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:31.874317 24613 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:31.876322 21492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1800) took 2567 ms (client timeout 1723 ms). Trace:
W20260709 13:07:31.876974 21492 rpcz_store.cc:269] 0709 13:07:29.308637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.349627 (+ 40990us) service_pool.cc:224] Handling call
0709 13:07:31.876087 (+2526460us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b540030d9d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:31.876254 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4435749760}
I20260709 13:07:31.879547 24506 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.881858 24506 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:31.883132 24614 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:31.826640 24623 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:31.884071 24623 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.886317 24623 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:31.891278 21485 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:31.892095 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2184) took 1206 ms. Trace:
I20260709 13:07:31.892534 21562 rpcz_store.cc:276] 0709 13:07:30.686098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.739047 (+ 52949us) service_pool.cc:224] Handling call
0709 13:07:31.891847 (+1152800us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b5400017cd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:31.892022 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304100224}
W20260709 13:07:31.883165 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.897220 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:31.898099 22240 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:31.900657 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:31.901201 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:31.901618 22238 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:31.902034 21566 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:31.903208 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:31.903414 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:31.903610 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:31.904178 21640 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:31.905016 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:31.867654 24336 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:07:31.906294 24523 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.907553 24544 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:31.909001 24544 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:31.909407 24544 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:07:31.911026 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.901721 21490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 348) took 3140 ms (client timeout 1974 ms). Trace:
W20260709 13:07:31.850731 21606 connection.cc:256] RPC call timeout handler was delayed by -1.4030076789999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 13:07:31.922052 21606 connection.cc:256] RPC call timeout handler was delayed by -1.3426027790000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2843s for a response
I20260709 13:07:31.923280 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1409) took 1042 ms. Trace:
I20260709 13:07:31.923780 21634 rpcz_store.cc:276] 0709 13:07:30.881012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.881414 (+   402us) service_pool.cc:224] Handling call
0709 13:07:30.881822 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.882277 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:31.481818 (+599541us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.793502 (+311684us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.800393 (+  6891us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.838063 (+ 37670us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.840924 (+  2861us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:31.840977 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.847718 (+  6741us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.911497 (+ 63779us) raft_consensus.cc:1685] finished
0709 13:07:31.911515 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.923194 (+ 11679us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40134,"prepare.queue_time_us":682213,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":3169,"raft.queue_time_us":108178,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":21286,"thread_start_us":768706,"threads_started":3,"wal-append.queue_time_us":169373}
W20260709 13:07:31.912092 21490 rpcz_store.cc:269] 0709 13:07:28.761123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.771368 (+ 10245us) service_pool.cc:224] Handling call
0709 13:07:31.901366 (+3129998us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b5400276fd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:31.901525 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4299574528}
I20260709 13:07:31.927300 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:31.910573 24544 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.928252 21566 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:31.929195 24544 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.929406 24600 raft_consensus.cc:1064] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:07:31.930339 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:31.838470 21642 rpcz_store.cc:276] 0709 13:07:30.463388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.463580 (+   192us) service_pool.cc:224] Handling call
0709 13:07:30.463845 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.464038 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:30.651578 (+187540us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.620778 (+969200us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.787886 (+167108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.793168 (+  5282us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:31.810734 (+ 17566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.818958 (+  8224us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.828615 (+  9657us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27855,"prepare.queue_time_us":504,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":68,"raft.queue_time_us":178955,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":178,"thread_start_us":1068286,"threads_started":3,"wal-append.queue_time_us":828822}
I20260709 13:07:31.924963 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:31.932435 24350 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.932861 24350 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.933249 24350 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.933748 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2185) took 1247 ms. Trace:
W20260709 13:07:31.935716 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 69040.1us
I20260709 13:07:31.936651 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:31.938045 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:31.938938 24556 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:31.939355 24556 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.939787 24556 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:31.944417 24580 consensus_meta.cc:287] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.969s	user 0.003s	sys 0.016s
I20260709 13:07:31.944072 24600 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.944919 24580 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:31.946504 21567 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: [5.7-9.8]
I20260709 13:07:31.947530 24620 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:31.945348 21560 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:31.950744 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.968696 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.951200 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:31.969429 21492 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:31.934093 21564 rpcz_store.cc:276] 0709 13:07:30.686370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.785281 (+ 98911us) service_pool.cc:224] Handling call
0709 13:07:30.785602 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.840623 (+ 55021us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:30.849240 (+  8617us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.309001 (+459761us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.309124 (+   123us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:31.309236 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.933332 (+624096us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b54001f9ad4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:31.933382 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.933559 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58771,"prepare.queue_time_us":14368,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":213988,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":11594,"spinlock_wait_cycles":126000896,"thread_start_us":459127,"threads_started":1,"wal-append.queue_time_us":617982}
I20260709 13:07:31.971935 21640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58370
I20260709 13:07:31.951721 24354 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.972886 21640 raft_consensus.cc:606] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:31.973431 21640 raft_consensus.cc:614] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:31.973156 24354 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.952684 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:31.975473 21635 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:31.845729 24418 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:31.953012 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:31.976780 21638 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:31.959306 24113 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:31.922677 21606 connection.cc:256] RPC call timeout handler was delayed by -1.2826568950000592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:07:31.979635 21606 connection.cc:256] RPC call timeout handler was delayed by -1.0807141110000202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24550000000000002s for a response
W20260709 13:07:31.979976 21606 connection.cc:256] RPC call timeout handler was delayed by -1.0052076790000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 13:07:31.964630 21568 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:07:31.981719 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 43757.8us
W20260709 13:07:31.967278 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.982263 21487 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:31.959997 21560 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:31.980832 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:31.977913 24418 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:31.978030 24336 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:31.964898 24297 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:31.997094 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:32.002357 24354 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.003163 21490 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:31.997099 24336 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:32.005621 21560 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.006989 21560 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.967397 24620 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:31.998574 24297 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:32.014755 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:32.024128 21485 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:32.020430 24613 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:32.020442 24297 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:32.030593 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 49934.7us
I20260709 13:07:32.030864 21642 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:32.031272 21642 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:32.031610 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:32.032182 21642 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.033202 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:32.029552 24613 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.035609 24620 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.036283 21563 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:32.033365 21642 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:32.037629 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.037868 24620 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:32.023201 24553 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.038642 24553 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:32.039285 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.040001 24625 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.040465 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:32.040585 24553 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.039289 24623 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.041211 24553 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.044049 24418 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:32.044510 24418 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:32.044976 24418 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.042218 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:32.036316 24613 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:32.048467 21642 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:32.019896 24506 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 13:07:32.054875 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.027909 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:32.058303 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:32.058132 21561 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:31.981276 24113 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.000025 24615 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.023350 24354 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.069358 24467 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.069804 24553 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:32.070055 24467 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.071982 21635 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:32.072237 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:32.079651 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:32.064909 24354 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.059640 24620 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.091343 24341 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.091903 24341 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.092265 24341 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.095185 24354 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.095250 24475 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.098825 24475 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.101027 24113 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:32.096339 24465 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:07:32.096561 24490 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.106937 24623 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:32.106842 24490 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.094668 24350 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.107611 24623 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.109118 24490 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.109578 24350 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:32.109867 24623 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:32.111943 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:32.114310 21566 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:32.114125 24354 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.115336 24620 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.115801 24620 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.116171 24620 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.117146 21637 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:32.101238 24341 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.121698 24556 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:32.122838 21440 auto_rebalancer.cc:893] Removing replace marker failed: Replica a87bd86b86e74aa8bb61189215b73439 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:07:32.123188 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:32.127817 22240 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:32.128109 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:32.102761 24303 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:32.134263 24303 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.136217 24297 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.124634 24336 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:32.104493 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 62378.4us
I20260709 13:07:32.137848 24336 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.138015 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:32.140313 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:32.102612 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:32.101795 24613 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:32.181937 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.129213 21440 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:07:32.126552 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:32.136580 24303 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:32.125108 24625 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:32.124387 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:32.183725 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 43554.9us
I20260709 13:07:32.097494 24615 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:32.132576 21565 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:32.159880 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:32.131768 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2166) took 2672 ms. Trace:
I20260709 13:07:32.208087 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:32.209347 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:32.211498 21491 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.210454 21561 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.194478 21639 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.213752 24354 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.218050 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:32.218333 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:32.128917 24341 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.218608 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:32.220302 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 93857.8us
I20260709 13:07:32.214893 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:32.218690 21566 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.193547 21565 pending_rounds.cc:85] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 4
I20260709 13:07:32.192962 21568 rpcz_store.cc:276] 0709 13:07:29.459047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.459569 (+   522us) service_pool.cc:224] Handling call
0709 13:07:32.131439 (+2671870us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b54001f90d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:32.131678 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5721612672}
W20260709 13:07:32.182945 21440 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:32.227136 21562 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:32.222091 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:32.236529 22240 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:32.095573 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:32.131091 24467 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:32.236037 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:32.130700 24543 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:07:32.252791 21641 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:32.256181 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:32.257524 21563 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:32.257761 21485 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 4.
I20260709 13:07:32.131197 24309 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.170s
I20260709 13:07:32.130450 24539 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:07:32.236444 21565 pending_rounds.cc:107] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:32.268712 24341 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:32.269906 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:32.270545 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:32.252708 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:32.272485 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:32.277185 21565 raft_consensus.cc:2889] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.278219 21562 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.222553 24256 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:32.129281 24490 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 13:07:32.286900 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:32.295938 21637 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
W20260709 13:07:32.299089 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.300283 24423 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.301537 24550 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:32.301693 21560 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:32.302016 24550 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:32.302636 24315 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:32.302901 24628 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.303092 24550 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.302661 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2159) took 3611 ms. Trace:
I20260709 13:07:32.304608 24550 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:32.304826 21560 rpcz_store.cc:276] 0709 13:07:28.691272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.804762 (+113490us) service_pool.cc:224] Handling call
0709 13:07:28.894338 (+ 89576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.945084 (+3050746us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b540011c9a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f59dc0 00007f98a9fe41c0 00007f98a9fe5231 00007f98a9fe1d8f 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c
0709 13:07:32.302297 (+357213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.302565 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5548615552}
I20260709 13:07:32.307598 24631 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.309669 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:32.310739 24580 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:32.310953 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:32.311769 21485 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 8: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:32.315977 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 97810.7us
I20260709 13:07:32.316864 24461 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:32.317363 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:32.319166 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:32.219602 24466 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:32.328277 24466 consensus_queue.cc:1243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:32.328851 24466 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:32.329223 24466 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:32.329540 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 145302us
I20260709 13:07:32.290349 24475 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.332681 21494 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:32.311573 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:32.316143 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46327.3us
I20260709 13:07:32.193790 24613 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.348456 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:32.351581 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64822us
W20260709 13:07:32.353389 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.353869 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.360878 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:32.218930 24622 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:07:32.277732 22239 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:32.368109 21561 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:32.375065 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:32.378803 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:32.379729 21638 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:32.337000 24354 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:32.317375 24461 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:32.385434 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:32.330230 24466 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.393477 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:32.387444 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:32.389966 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:32.406558 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:32.367075 24625 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.407290 21638 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:32.410048 22244 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:32.367468 24539 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:07:32.415614 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 67290.9us
I20260709 13:07:32.416168 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:32.409157 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1870) took 1588 ms. Trace:
I20260709 13:07:32.421442 21493 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:32.421816 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:32.423390 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:32.424762 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:32.426409 21606 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:32.426867 24462 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.427477 24303 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.429677 24622 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:32.430166 24303 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.396243 24113 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.431015 24113 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.431438 24113 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.431849 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:32.432669 24309 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:32.397037 24256 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.433744 24309 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.434475 24309 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:32.434731 24423 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.434830 24309 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:32.431034 24466 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.435344 24423 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:32.435797 24423 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.435880 24309 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.437251 24309 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.439320 24556 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.427953 24613 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:32.442620 24420 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.445463 24256 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:32.446514 24613 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.385656 24354 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:32.447167 24354 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.447793 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:32.451161 21489 raft_consensus.cc:2410] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:32.451364 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:32.453279 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.413388 24475 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:32.455245 21491 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:32.456424 24623 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:07:32.455615 21639 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:32.460897 24613 raft_consensus.cc:2764] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:07:32.462910 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.463464 21642 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:32.463598 24336 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.464335 24336 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.456032 24113 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.467613 21638 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:32.467908 24113 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.419416 21565 rpcz_store.cc:276] 0709 13:07:30.821470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.821570 (+   100us) service_pool.cc:224] Handling call
0709 13:07:32.131935 (+1310365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.294379 (+162444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.399709 (+105330us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001f90d0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:32.409095 (+  9386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3012726528}
I20260709 13:07:32.434492 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:32.397624 24461 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.482996 21640 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 3.
W20260709 13:07:32.491654 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 46932.3us
I20260709 13:07:32.493018 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:32.496608 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:32.508421 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.510100 24113 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.510514 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:32.511627 24543 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.510527 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:32.512182 24543 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.514394 24297 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.515558 24336 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.455322 24475 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.524271 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:32.530138 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:32.485029 24628 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:07:32.517360 24613 raft_consensus.cc:2764] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:07:32.540732 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 106353us
I20260709 13:07:32.541117 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:32.549751 21490 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:32.558341 21566 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:32.521785 24418 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.610368 21636 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:32.612043 24418 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:32.563108 24336 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.619335 24336 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.619823 24336 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.625425 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:32.560339 21562 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:32.566763 22243 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:32.566912 24479 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:32.554949 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:32.573509 24601 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:32.574014 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:32.643530 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 69603.5us
I20260709 13:07:32.579282 24467 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:32.579224 24423 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.585860 24620 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.586081 24309 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.586951 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:32.651333 21565 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.647117 24467 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:32.586944 24462 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.588708 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:32.595503 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 86434.8us
I20260709 13:07:32.597728 24475 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.543958 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:32.660874 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:32.649650 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:32.668002 21634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.038s	sys 0.035s
I20260709 13:07:32.640168 24479 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:32.668427 21639 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:32.668548 21634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.038s	sys 0.035s
W20260709 13:07:32.669792 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 81174.4us
W20260709 13:07:32.672519 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.676554 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:32.676826 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:32.652868 24358 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.680635 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:32.680682 21494 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:32.677255 21641 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:32.661875 24113 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.690407 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:32.677161 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:32.705209 21643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.024s	sys 0.019s
W20260709 13:07:32.711218 21643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.024s	sys 0.019s
I20260709 13:07:32.666941 24601 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:32.718938 21642 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:32.722826 24543 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:32.723107 24467 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.724877 24467 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.680922 24358 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.729090 24358 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.732774 24423 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:32.676698 24309 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:32.739291 24309 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:32.740624 24309 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.741617 24461 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.666409 24354 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.743639 21569 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:32.752202 24620 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:32.755228 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:32.757167 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:32.758173 24479 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.759577 24479 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.705070 24475 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.761682 24475 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.762219 24475 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.765002 24113 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:32.765564 24341 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.766017 24341 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.766536 24341 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.707406 24527 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:32.768378 24252 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.768720 24614 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:32.769001 24354 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:32.769683 21488 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:32.710106 24420 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:32.769830 24601 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.771938 21562 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:32.765827 24113 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:32.718425 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 68845.2us
I20260709 13:07:32.775884 21565 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
W20260709 13:07:32.778723 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.793725 21639 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:32.815719 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:32.846845 21569 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:32.819588 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:32.793185 24527 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:32.851079 24527 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:32.860419 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.861704 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:32.787014 24550 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:32.861498 24350 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:07:32.878649 24341 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.881428 24341 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:32.882216 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:32.862649 24600 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:32.882827 21569 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.890285 24336 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.890985 21569 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:32.893136 24336 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:32.899629 24615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.039s	sys 0.074s
I20260709 13:07:32.833561 24420 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:32.908829 24420 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.908751 24113 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:32.929782 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:32.930905 21569 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
W20260709 13:07:32.911207 24615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.040s	sys 0.074s
I20260709 13:07:32.938755 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:32.940234 21562 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:32.900347 24550 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:32.945127 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:32.930684 24600 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:32.944557 21487 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.006s	sys 0.009s
W20260709 13:07:32.951730 21487 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.006s	sys 0.009s
I20260709 13:07:32.957934 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:32.984740 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:32.993557 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:33.001241 24612 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:33.001782 24612 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:33.003326 24539 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:33.003772 24539 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:33.004664 24539 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.005889 24539 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.008754 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 374) took 1081 ms. Trace:
I20260709 13:07:33.009213 21634 rpcz_store.cc:276] 0709 13:07:31.927124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.987729 (+ 60605us) service_pool.cc:224] Handling call
0709 13:07:32.007904 (+ 20175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.029331 (+ 21427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.029364 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.029882 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.687033 (+657151us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:32.687085 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.687156 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.008522 (+321366us) raft_consensus.cc:1685] finished
0709 13:07:33.008541 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.008689 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9727,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":644090,"threads_started":1,"wal-append.queue_time_us":926849}
I20260709 13:07:33.015537 24252 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:33.016211 24252 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.016463 24600 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.020083 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:33.021027 21565 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:33.022445 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:33.023065 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:33.023561 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:33.024181 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:33.024850 21564 raft_consensus.cc:2368] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:33.024767 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:33.025566 21565 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:33.031317 21391 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 142) took 11688 ms (client timeout 15000 ms). Trace:
W20260709 13:07:33.031795 24644 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:07:33.031759 21391 rpcz_store.cc:269] 0709 13:07:21.343037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.343397 (+   360us) service_pool.cc:224] Handling call
0709 13:07:21.446717 (+103320us) spinlock_profiling.cc:243] Waited 95.5 ms on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4c090 00007f98a9feaf3a 00007f98afda11cc 00007f98afe9f37e 00007f98ae3602a4 00007f98ae360232 00007f98ae360161 00007f98ae3600dc 00007f98ae35f392 00007f98a831d48c 00007f98a831c8c6
0709 13:07:33.031104 (+11584387us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:30.790284 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:30.790872 (+   588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:30.790910 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:30.790929 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:30.791962 (+  1033us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:30.792045 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:30.792077 (+    32us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:30.792871 (+   794us) tablet.cc:701] Row locks acquired
0709 13:07:30.792889 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:07:30.793032 (+   143us) write_op.cc:270] Start()
0709 13:07:30.793146 (+   114us) write_op.cc:276] Timestamp: P: 1783602450792983 usec, L: 0
0709 13:07:30.793166 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:30.793800 (+   634us) log.cc:844] Serialized 4074 byte log entry
0709 13:07:31.462125 (+668325us) op_driver.cc:464] REPLICATION: finished
0709 13:07:31.708794 (+246669us) write_op.cc:301] APPLY: starting
0709 13:07:31.727508 (+ 18714us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:31.727857 (+   349us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:31.728033 (+   176us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:31.729774 (+  1741us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:31.730247 (+   473us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:07:31.730316 (+    69us) write_op.cc:312] APPLY: finished
0709 13:07:31.738621 (+  8305us) log.cc:844] Serialized 77 byte log entry
0709 13:07:31.781683 (+ 43062us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:31.814000 (+ 32317us) write_op.cc:454] Released schema lock
0709 13:07:31.822750 (+  8750us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:31.935072 (+112322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:31.935106 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1565257,"reported_tablets":26,"spinlock_wait_cycles":219684736,"child_traces":[["op",{"apply.queue_time_us":171145,"apply.run_cpu_time_us":5458,"apply.run_wall_time_us":265171,"num_ops":10,"prepare.queue_time_us":502997,"prepare.run_cpu_time_us":16216,"prepare.run_wall_time_us":208574,"raft.queue_time_us":276729,"raft.run_cpu_time_us":15757,"raft.run_wall_time_us":66807,"replication_time_us":668599,"spinlock_wait_cycles":2304,"thread_start_us":529889,"threads_started":4,"wal-append.queue_time_us":383969,"wal-append.run_cpu_time_us":13703,"wal-append.run_wall_time_us":1689660}]]}
W20260709 13:07:33.059480 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.061474 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 68002.1us
W20260709 13:07:33.058254 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.067312 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:33.074401 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:33.036520 24461 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:33.044164 24614 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:33.078928 24639 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:07:33.002657 24612 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:33.079861 24646 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:07:33.098676 21606 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.041s	sys 0.071s
I20260709 13:07:33.042332 21392 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.072407 24486 raft_consensus.cc:2764] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:33.081532 24466 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:33.120617 21485 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.017s	sys 0.025s
I20260709 13:07:33.072045 24475 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:33.111116 22213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.004s	sys 0.037s
I20260709 13:07:33.104127 24336 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.145535 24475 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:33.147166 21565 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:33.111521 24620 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:33.123946 21485 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.017s	sys 0.025s
W20260709 13:07:33.131632 22213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.005s	sys 0.037s
W20260709 13:07:33.132176 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 159391us
I20260709 13:07:33.154810 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:33.151489 21392 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:07:33.100693 21606 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.041s	sys 0.071s
I20260709 13:07:33.157460 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:33.157783 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 634512us
I20260709 13:07:33.167265 21488 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:33.173889 24462 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:33.174183 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:33.174502 24462 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.174961 24461 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.175365 24461 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.175721 24461 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.175508 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:33.153507 24612 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.139873 24614 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:33.149621 24466 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.179781 24550 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:33.155964 24620 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.180425 24341 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.208781 21392 catalog_manager.cc:5697] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:33.201467 24354 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.205241 24615 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:33.207652 24341 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.229012 24620 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:33.229358 24462 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:33.216857 24423 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:33.241150 24358 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 13:07:33.241623 24358 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.220818 24354 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:33.252080 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.234004 24341 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.217753 24418 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:33.249979 21392 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 7, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 7 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:33.233153 24462 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:33.257247 24423 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.266356 24354 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:33.267309 24423 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:33.267730 24643 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.319s	user 0.004s	sys 0.002s
I20260709 13:07:33.273145 24462 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.293483 21392 catalog_manager.cc:5697] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.312201 21392 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 4 to 5, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 5 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:33.257382 24615 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.295949 24423 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:33.328915 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:33.350387 21392 catalog_manager.cc:5697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 6, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 6 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:33.327126 24423 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:33.365754 21606 leader_election.cc:336] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.609s (SENT)
W20260709 13:07:33.366309 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 190887us
I20260709 13:07:33.366401 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:33.367511 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:33.348241 24645 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:07:33.376983 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1416) took 1256 ms. Trace:
I20260709 13:07:33.379565 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1366) took 1019 ms. Trace:
W20260709 13:07:33.428977 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 286148us
I20260709 13:07:33.411851 21485 rpcz_store.cc:276] 0709 13:07:32.359754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.369875 (+ 10121us) service_pool.cc:224] Handling call
0709 13:07:32.400279 (+ 30404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.485346 (+ 85067us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:33.152800 (+667454us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.378752 (+225952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.378894 (+   142us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:33.379019 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.379165 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.379437 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1763,"prepare.queue_time_us":651426,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"thread_start_us":826578,"threads_started":2}
I20260709 13:07:33.349023 24466 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:33.440956 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 117991us
I20260709 13:07:33.413245 21392 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 4 to 5, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 5 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.377686 24113 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:33.411546 21643 rpcz_store.cc:276] 0709 13:07:32.120507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.120622 (+   115us) service_pool.cc:224] Handling call
0709 13:07:32.120979 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.121300 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.121332 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.121911 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.711781 (+589870us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:32.711839 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.711952 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.267131 (+555179us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:33.365327 (+ 98196us) raft_consensus.cc:1685] finished
0709 13:07:33.365349 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.376894 (+ 11545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5201152,"thread_start_us":589355,"threads_started":1,"wal-append.queue_time_us":774715}
I20260709 13:07:33.367901 24358 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:33.410327 24467 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.446801 21392 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 7, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 7 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:33.453591 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 87877.3us
W20260709 13:07:33.444074 24649 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:07:33.414451 24418 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.376578 24462 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:33.459821 24252 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.467566 21392 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 7, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 7 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:33.441259 24620 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:33.473214 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:33.472361 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:33.478827 21606 leader_election.cc:336] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.643s (SENT)
I20260709 13:07:33.483469 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:33.449208 24113 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.444727 24523 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:33.491976 24656 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:07:33.496570 24655 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:07:33.498987 24601 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:33.500052 24423 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.501366 24423 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.502189 24504 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:33.502616 24504 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:33.503588 24504 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.504973 24504 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.509895 21392 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.512629 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:33.513278 21562 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:33.514937 24523 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.515915 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:33.517144 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:33.519140 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.524930 21392 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 7, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 7 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.527683 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:33.490857 24113 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:33.533715 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 54927.3us
I20260709 13:07:33.487846 24418 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.543257 24665 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:33.544389 24665 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:33.544715 24665 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:33.545459 24665 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.550161 24664 raft_consensus.cc:2764] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:33.534992 24462 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:33.552024 24462 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.550216 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2217) took 1093 ms. Trace:
I20260709 13:07:33.552815 21563 rpcz_store.cc:276] 0709 13:07:32.456577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.456727 (+   150us) service_pool.cc:224] Handling call
0709 13:07:32.457055 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.457435 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.457462 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.457972 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.915208 (+457236us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:32.915269 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.915367 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.550004 (+634637us) raft_consensus.cc:1685] finished
0709 13:07:33.550025 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.550158 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1026,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":456810,"threads_started":1,"wal-append.queue_time_us":719591}
I20260709 13:07:33.554163 24462 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:33.538075 21561 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:33.539492 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 111646us
I20260709 13:07:33.517134 24615 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:33.565959 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.525707 24466 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:33.571770 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:33.546746 24665 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:33.572144 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.507443 24620 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.563009 24297 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.587198 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.594089 21635 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:33.597424 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:33.597885 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.598503 21636 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:33.598896 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:33.599843 21639 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:33.593711 24297 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:33.601799 24297 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.602047 21634 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:33.603519 24550 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:33.604102 24550 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.579229 21392 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 4 to 7, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 7 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.621825 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:33.579238 24615 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.625249 21640 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:33.625249 21392 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 8, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.627723 24523 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:33.614086 24614 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:33.628206 22247 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 7 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:33.628822 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:33.629416 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:33.635445 21643 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:33.635990 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:33.638063 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.577301 24466 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.642028 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:33.643008 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.669452 21639 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.671810 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:33.646575 24341 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.648924 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.678359 21642 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:33.650394 21641 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:33.651369 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:33.679473 21635 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.678996 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:33.652603 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:33.682873 21638 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 3: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:33.652536 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:33.684190 22240 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:33.654260 24325 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:33.668706 24486 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.681810 24539 consensus_meta.cc:287] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.008s
I20260709 13:07:33.673854 24614 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.697332 24620 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:33.697497 24614 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:33.700282 24466 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:33.704001 24486 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:33.705174 24252 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:33.606751 24550 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:33.706566 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:33.712563 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.714147 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.715919 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.716754 21643 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:33.717617 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:33.718218 21494 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:33.668350 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:33.675755 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:33.676935 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:33.721959 21637 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:33.722370 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 46706.3us
I20260709 13:07:33.722886 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.723196 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:33.723625 21643 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:33.641381 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.718277 21490 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:33.722394 21564 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:33.714684 21642 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
W20260709 13:07:33.704509 24663 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
W20260709 13:07:33.657521 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 141664us
I20260709 13:07:33.736295 24309 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.733768 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.738819 21638 raft_consensus.cc:2410] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:33.739439 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:33.745774 21641 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:33.749704 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:33.750314 21485 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.747326 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:33.752848 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:33.753592 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:33.755118 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:33.757750 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:33.758634 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:33.763113 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:33.729283 24486 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:33.732297 24550 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.766415 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:33.677508 24461 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.770941 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:33.771811 21643 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:33.765718 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:33.756969 24614 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:33.756845 24420 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.758014 24475 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.784962 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:33.782169 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:33.799397 21641 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:33.729532 24297 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:33.807276 21488 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:33.770972 24669 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:33.785389 24486 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.762418 24354 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:33.817749 21639 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:33.756628 24682 raft_consensus.cc:2764] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:33.819371 22241 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3.
I20260709 13:07:33.792491 24614 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.820983 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:33.792466 24475 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:33.831779 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 71995.9us
I20260709 13:07:33.814342 24486 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.100878 22244 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:33.897357 21566 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:34.095199 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.084628 21637 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:34.111850 21491 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:34.085954 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:34.112982 21560 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:34.029788 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:33.863896 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:34.019335 21565 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:34.045717 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.113897 21561 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:33.852270 22245 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:33.822669 24612 consensus_meta.cc:287] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.001s
W20260709 13:07:33.893363 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 283830us
I20260709 13:07:33.866245 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:33.842617 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.126729 21488 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:34.090817 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.123723 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:34.138324 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:33.899228 24663 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:33.840133 24614 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.147625 21569 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:07:34.150779 21569 pending_rounds.cc:85] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 8
I20260709 13:07:34.151316 21569 pending_rounds.cc:107] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:34.151609 21569 raft_consensus.cc:2889] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.868386 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:33.841928 24475 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.046177 24669 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:34.159617 24669 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:34.164219 21567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:34.164800 21567 raft_consensus.cc:606] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:34.165138 21567 raft_consensus.cc:614] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:34.124325 24486 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.094246 24336 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:34.171860 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48225.5us
I20260709 13:07:34.177484 21485 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:34.186482 21563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:34.187407 21563 raft_consensus.cc:606] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:34.187850 21563 raft_consensus.cc:614] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:34.197067 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:34.194692 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:34.208021 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:34.237325 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 99090.8us
I20260709 13:07:34.238678 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:34.239970 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:34.241844 21486 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:34.242834 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1368) took 1852 ms. Trace:
I20260709 13:07:34.179222 24539 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:34.175833 24341 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:34.240365 22245 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:34.237403 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:34.146317 24252 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:07:34.243331 21487 rpcz_store.cc:276] 0709 13:07:32.360364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.360479 (+   115us) service_pool.cc:224] Handling call
0709 13:07:32.391267 (+ 30788us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:32.424173 (+ 32906us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:32.953751 (+529578us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.355532 (+401781us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:33.370852 (+ 15320us) log.cc:844] Serialized 52 byte log entry
0709 13:07:33.371042 (+   190us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:33.371337 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.371546 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.371640 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.500695 (+129055us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b180039e860. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:07:33.503878 (+  3183us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b180039e860. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98adeb658f 00007f98a6ef5571 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd
0709 13:07:33.703757 (+199879us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:34.212245 (+508488us) raft_consensus.cc:1685] finished
0709 13:07:34.212272 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.212431 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75393,"prepare.queue_time_us":725264,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":93,"raft.queue_time_us":30632,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":6317,"spinlock_wait_cycles":171868672,"thread_start_us":821463,"threads_started":2,"wal-append.queue_time_us":603110}
I20260709 13:07:34.249177 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:34.194235 24620 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:34.197522 24615 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.402097 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 74160.9us
I20260709 13:07:34.435801 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:34.212749 24690 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:34.195586 24504 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.205s
I20260709 13:07:34.191115 24336 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:34.424429 24656 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
W20260709 13:07:34.423539 24646 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:07:34.251098 24539 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:34.454659 24669 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.447012 24467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.033s	sys 0.094s
I20260709 13:07:34.440824 24652 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.447364 24596 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.467322 24665 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.888s	user 0.009s	sys 0.001s
W20260709 13:07:34.483989 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 289353us
I20260709 13:07:34.399042 24691 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.227s
I20260709 13:07:34.443308 24620 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:34.443012 24615 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:34.551664 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 313082us
I20260709 13:07:34.485625 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.643673 21487 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:34.447739 24612 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:34.550436 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.650404 21486 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
W20260709 13:07:34.542120 21635 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.862s	user 0.008s	sys 0.000s
I20260709 13:07:34.604111 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:34.645103 21392 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.006s	sys 0.000s
W20260709 13:07:34.662328 21392 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.006s	sys 0.000s
W20260709 13:07:34.661507 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 2.031s (SENT) [suppressed 24 similar messages]
I20260709 13:07:34.476030 24539 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.678589 21635 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
W20260709 13:07:34.611030 24681 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.562s	user 0.001s	sys 0.000s
W20260709 13:07:34.610219 24659 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:07:34.545733 21494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.002s	sys 0.015s
I20260709 13:07:34.485512 24461 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:34.698279 22211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.010s	sys 0.000s
W20260709 13:07:34.702865 22211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.011s	sys 0.000s
I20260709 13:07:34.700582 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2087) took 1030 ms. Trace:
I20260709 13:07:34.643260 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.645171 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:34.676916 24692 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.468s	user 0.001s	sys 0.000s
I20260709 13:07:34.703893 21635 rpcz_store.cc:276] 0709 13:07:33.649441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.651118 (+  1677us) service_pool.cc:224] Handling call
0709 13:07:34.679531 (+1028413us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:34.478719 24467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.033s	sys 0.094s
I20260709 13:07:34.631129 24297 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:34.709715 21494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.002s	sys 0.015s
W20260709 13:07:34.711702 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 66601.6us
I20260709 13:07:34.717836 21491 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:34.719300 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:34.722548 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:34.652280 24596 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:34.567534 24688 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.277s
W20260709 13:07:34.710364 24664 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.001s	sys 0.011s
I20260709 13:07:34.718052 24612 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.744613 24693 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.745393 24693 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.745880 24693 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.520015 24652 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:34.487062 24669 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:34.756846 21490 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:34.764520 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:34.767289 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:34.792793 22245 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.769863 24596 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:34.779357 24336 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:34.782223 24475 consensus_meta.cc:287] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.003s
I20260709 13:07:34.804751 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:34.806149 21491 raft_consensus.cc:2410] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:34.797924 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.799285 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:34.799943 24486 consensus_meta.cc:287] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 13:07:34.800225 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:34.787842 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 58094.9us
I20260709 13:07:34.810881 22245 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
W20260709 13:07:34.729986 24664 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.002s	sys 0.012s
I20260709 13:07:34.831043 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:34.837905 21638 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:34.833489 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:34.834136 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:34.834741 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:34.836621 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:34.836848 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:34.839599 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:34.839972 21641 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.841197 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:34.811496 24681 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:07:34.842768 21562 raft_consensus.cc:2368] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:34.843044 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:34.843140 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:34.855026 21561 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.843777 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:34.855944 21564 raft_consensus.cc:2368] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:34.844262 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:34.856834 21638 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 8: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:34.845350 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:34.857359 21642 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:34.845937 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:34.846639 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.847194 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:34.858897 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.848340 24615 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:34.809538 24423 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.850579 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:34.851547 24113 consensus_meta.cc:287] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.281s	user 0.013s	sys 0.000s
I20260709 13:07:34.853065 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.844321 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:34.792753 24297 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.849963 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:34.877234 21641 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:34.877125 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:34.878144 21486 raft_consensus.cc:2368] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:34.878961 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:34.882699 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:34.883977 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:34.888473 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:34.888779 24700 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:07:34.889073 24113 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:34.890309 21634 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:34.891638 24113 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:34.892787 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.894083 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.895373 21487 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:34.896409 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:34.896879 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.880781 21567 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:34.897660 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.897662 21491 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:34.899221 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:34.899600 21485 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:34.837597 24684 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.905452 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:34.906242 21637 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:34.900987 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:34.906553 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:34.815091 24486 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:34.837190 24336 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:07:34.886397 24523 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.911110 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:34.908406 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.920009 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.837302 24539 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:34.928170 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:34.928920 21491 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:34.920351 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:34.907507 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:34.908435 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:34.817770 24475 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:34.907810 21638 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:34.931226 21638 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:34.931898 21561 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:34.932505 21638 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:34.895416 24601 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:07:34.919772 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:34.934477 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:34.926980 24620 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:34.919637 24297 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:34.936559 24685 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.891s	user 0.004s	sys 0.014s
I20260709 13:07:34.938830 21636 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.938830 21634 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:34.947082 21638 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:34.948217 21492 raft_consensus.cc:2368] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:34.896962 24423 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:34.917585 24709 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:34.907308 24682 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.010s	sys 0.032s
W20260709 13:07:34.953693 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52832us
I20260709 13:07:34.926641 24652 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:34.949554 22238 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.953960 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:34.959012 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:34.952625 24297 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.963665 24596 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:34.965169 24708 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.965620 24713 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:34.968482 24475 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:34.927287 24523 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:34.913583 24684 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:34.971287 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:35.254765 22241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 455) took 1933 ms (client timeout 1591 ms). Trace:
I20260709 13:07:35.283999 21638 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.130014 21636 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:35.233232 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 397) took 1516 ms. Trace:
W20260709 13:07:35.284221 22241 rpcz_store.cc:269] 0709 13:07:33.321674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.323428 (+  1754us) service_pool.cc:224] Handling call
0709 13:07:35.254431 (+1931003us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54003b3b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:35.254625 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810168064}
I20260709 13:07:35.247119 24336 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:35.290633 24336 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.293574 24336 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:35.297729 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 390252us
W20260709 13:07:34.956670 24682 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.010s	sys 0.032s
I20260709 13:07:35.296677 24297 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:35.302881 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 649957us
I20260709 13:07:34.955636 24612 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:34.955577 24715 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:35.256037 24693 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.003s
W20260709 13:07:35.090611 24686 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 1.250s	user 0.000s	sys 0.024s
I20260709 13:07:35.096231 24690 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:35.110529 24701 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:07:35.358649 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.302614 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:34.969043 24423 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:35.280177 24539 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:34.970319 22238 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:35.376498 24336 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:35.376808 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 227114us
W20260709 13:07:35.474115 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 168672us
W20260709 13:07:35.558202 21490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1824) took 1681 ms (client timeout 1763 ms). Trace:
W20260709 13:07:35.676137 21490 rpcz_store.cc:269] 0709 13:07:33.839661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.840040 (+   379us) service_pool.cc:224] Handling call
0709 13:07:35.498908 (+1658868us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54002ca454. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:35.521367 (+ 22459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349159808}
I20260709 13:07:35.592932 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1828) took 1458 ms. Trace:
W20260709 13:07:35.677491 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 374957us
I20260709 13:07:35.298036 24550 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:35.521112 22244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 589) took 1896 ms (client timeout 1763 ms). Trace:
I20260709 13:07:35.678206 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:35.685711 21562 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:35.643831 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1370) took 1847 ms. Trace:
W20260709 13:07:35.558359 21492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1825) took 1658 ms (client timeout 2137 ms). Trace:
W20260709 13:07:35.591656 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.686682 21638 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
W20260709 13:07:35.686693 21492 rpcz_store.cc:269] 0709 13:07:33.863472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.863634 (+   162us) service_pool.cc:224] Handling call
0709 13:07:35.495846 (+1632212us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54003fa054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:35.521545 (+ 25699us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805134720}
I20260709 13:07:35.632061 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:35.286247 21493 rpcz_store.cc:276] 0709 13:07:33.716642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.719781 (+  3139us) service_pool.cc:224] Handling call
0709 13:07:33.720112 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.720348 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:33.793551 (+ 73203us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.793860 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.798003 (+1004143us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b1800417940. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:07:35.062873 (+264870us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b1800417940. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:07:35.110468 (+ 47595us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b1800417940. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:07:35.232735 (+122267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.232811 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:35.232873 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.232961 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.233144 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27350,"prepare.queue_time_us":89235,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":59866,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":213,"spinlock_wait_cycles":52780416,"thread_start_us":194824,"threads_started":2}
W20260709 13:07:35.685228 22244 rpcz_store.cc:269] 0709 13:07:33.624737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.624886 (+   149us) service_pool.cc:224] Handling call
0709 13:07:35.497122 (+1872236us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b540073ebd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:35.521002 (+ 23880us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171413248}
I20260709 13:07:35.297626 24713 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.696384 21561 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:35.684968 24550 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.697885 24713 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:35.698273 24550 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.621696 24693 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.699559 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:35.700188 21564 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.701087 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:35.701304 24693 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:35.701818 24693 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:35.663736 24539 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.592490 24715 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:35.704890 21566 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:35.703703 24539 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.705430 24664 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:35.705859 24664 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:35.705888 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:35.705087 24707 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.704032 24256 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.707100 24707 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.707368 24256 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.708024 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:35.706491 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:35.709302 24707 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:35.710022 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:35.710219 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:35.710716 21637 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:35.704484 24715 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.712311 24539 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:35.709321 24256 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:35.713343 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:35.703605 24309 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.698585 24713 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:35.714629 24309 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.715198 24713 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.706627 21486 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.377610 24615 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:35.286382 24596 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:35.717039 22243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.010s
I20260709 13:07:35.718963 21493 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:35.701745 21643 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:34.972295 24709 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:35.487849 22239 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:35.568444 24684 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:35.566928 24669 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:35.624073 24691 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.540834 24729 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:35.688736 21494 rpcz_store.cc:276] 0709 13:07:33.796615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.796944 (+   329us) service_pool.cc:224] Handling call
0709 13:07:33.811218 (+ 14274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.861537 (+ 50319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.861581 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.974110 (+112529us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.716508 (+742398us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:34.716556 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.716625 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.643518 (+926893us) raft_consensus.cc:1685] finished
0709 13:07:35.643549 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.643744 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8843,"raft.queue_time_us":78716,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":55668,"thread_start_us":732201,"threads_started":1,"wal-append.queue_time_us":834277}
I20260709 13:07:35.583323 24737 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.494649 24462 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:35.747247 24669 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.747447 24684 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:35.722913 21606 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:35.494277 24614 consensus_meta.cc:287] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 1.314s	user 0.010s	sys 0.004s
W20260709 13:07:35.727288 22243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.002s	sys 0.010s
I20260709 13:07:35.677407 21488 rpcz_store.cc:276] 0709 13:07:34.134656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.134857 (+   201us) service_pool.cc:224] Handling call
0709 13:07:34.188989 (+ 54132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.209406 (+ 20417us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:34.398907 (+189501us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.213924 (+815017us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b18004321c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:07:35.282164 (+ 68240us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x7b18004321c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98adeb658f 00007f98a6ef5571 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd
0709 13:07:35.469360 (+187196us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.470014 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.470204 (+   190us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:35.470237 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.470304 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.592636 (+122332us) raft_consensus.cc:1685] finished
0709 13:07:35.592665 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.592856 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":609176,"prepare.queue_time_us":189285,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":647924,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":104887,"spinlock_wait_cycles":75240064,"thread_start_us":401176,"threads_started":1,"wal-append.queue_time_us":504993}
I20260709 13:07:35.721297 24631 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.725473 21564 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:35.725965 24256 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.377404 24620 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:35.702421 24693 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.568827 24732 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:35.623184 24354 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:35.379093 24475 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:35.495462 24733 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.471825 24461 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.748258 24684 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:35.720589 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 88597.5us
I20260709 13:07:35.299163 24486 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:35.730327 24615 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.414433 24710 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:35.684894 24423 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.603464 24523 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:35.515301 24665 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:35.624428 24688 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 13:07:35.469879 24738 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:35.724794 24544 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.752317 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 73786.5us
I20260709 13:07:35.828886 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:35.753479 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:35.627439 24341 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 13:07:35.829979 21493 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 8: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:35.743744 24709 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.629249 24466 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.115s
W20260709 13:07:35.604101 24704 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.884s	user 0.002s	sys 0.000s
I20260709 13:07:35.749874 24669 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.630079 24297 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.874346 24467 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:35.875592 24297 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:35.747750 24462 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.876106 24709 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:35.877008 24113 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:35.877641 24113 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:35.879025 24113 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.880930 24113 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.882886 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:35.883646 21494 raft_consensus.cc:2376] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9. Re-sending same reply.
I20260709 13:07:35.884719 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:35.885582 21494 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:35.747545 24650 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:35.769766 24736 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.766806 24732 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.900847 24732 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:35.769968 24354 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.764776 24620 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.904510 24620 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:35.905095 24620 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:35.905562 24620 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:35.776752 24713 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:35.779670 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:35.780301 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:35.907541 21488 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 8: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:07:35.907773 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 127539us
I20260709 13:07:35.908753 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:35.590366 24734 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:35.721385 24336 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.768805 24612 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.762974 24740 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:35.728926 24690 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.755069 24614 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.719198 24664 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.780406 24684 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.732504 24596 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.828657 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2085) took 2174 ms. Trace:
I20260709 13:07:35.825907 24710 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.832059 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:35.827065 24665 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.832743 24309 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:35.923295 24341 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:35.754086 24691 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.780292 24733 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.747484 24737 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.762365 24631 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.837996 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.006321 21564 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:35.839076 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:35.840080 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.007230 21561 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:35.841323 24550 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.844087 24544 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.830926 24738 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.852033 24693 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:35.776661 24461 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.871717 24680 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:35.872714 24669 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:35.877756 24462 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:35.297168 24708 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:35.731232 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:35.886546 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:35.777226 24475 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.925029 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:36.027657 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 102717us
I20260709 13:07:35.925455 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:35.927986 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:35.824246 24423 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.948161 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:35.950191 21486 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:35.953464 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:35.930882 24600 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:36.003376 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 287759us
I20260709 13:07:35.906443 24620 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:35.976825 24664 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.948050 21640 rpcz_store.cc:276] 0709 13:07:33.647563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.653947 (+  6384us) service_pool.cc:224] Handling call
0709 13:07:33.654281 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.654631 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.654659 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.655232 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.776317 (+121085us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:33.776357 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.776424 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.984205 (+1207781us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:35.787847 (+803642us) raft_consensus.cc:1685] finished
0709 13:07:35.787879 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.821756 (+ 33877us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2376,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":1282,"spinlock_wait_cycles":7512960,"thread_start_us":120734,"threads_started":1,"wal-append.queue_time_us":139829}
I20260709 13:07:36.051206 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:36.020875 21566 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:36.026170 21489 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:36.031965 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:36.032775 21487 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:07:36.033687 24707 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.054677 24707 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.055030 24698 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:36.055477 24698 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.046442 24600 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:36.055940 24698 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.055995 24600 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.056551 24423 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:36.057178 24423 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:35.911898 24736 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.033308 21641 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:35.929102 24734 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.060247 24631 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.061147 24734 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.061621 24690 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.062036 24475 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:36.034116 21608 connection.cc:256] RPC call timeout handler was delayed by -1.6774855070000285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 13:07:36.063153 21608 connection.cc:256] RPC call timeout handler was delayed by -1.2826818210000965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
I20260709 13:07:36.063400 24336 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:36.063598 21608 connection.cc:256] RPC call timeout handler was delayed by -1.2415495150000879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:07:36.064189 21608 connection.cc:256] RPC call timeout handler was delayed by -1.0563186930000938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 13:07:36.065053 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1853) took 1210 ms. Trace:
I20260709 13:07:36.065291 24733 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.065438 21485 rpcz_store.cc:276] 0709 13:07:34.854447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.927726 (+ 73279us) service_pool.cc:224] Handling call
0709 13:07:34.928143 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.474859 (+546716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.474893 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.475650 (+   757us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.911513 (+435863us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:35.934419 (+ 22906us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.934686 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.934763 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.064838 (+130075us) raft_consensus.cc:1685] finished
0709 13:07:36.064858 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.064998 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":573079,"prepare.queue_time_us":23723,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":546659,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":15398,"thread_start_us":435333,"threads_started":1,"wal-append.queue_time_us":587177}
I20260709 13:07:36.067863 24614 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.068595 21485 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:36.069591 24737 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:36.035005 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 107113us
I20260709 13:07:36.071800 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.072628 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.023116 24354 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.073475 24688 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:36.074487 24354 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:36.074901 24354 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:36.075278 24354 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.076476 24688 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:36.076895 24688 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:36.077266 24688 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.046509 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:36.077898 21486 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:35.936272 24612 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.080524 24612 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.081269 21485 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:36.066696 24710 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.051908 21488 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:35.935715 24740 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.030373 24615 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:36.089151 21532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.026s	sys 0.044s
W20260709 13:07:36.095252 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 266411us
W20260709 13:07:36.097054 21532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.026s	sys 0.045s
I20260709 13:07:36.100867 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.106827 21641 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:36.111541 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:36.113615 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.114331 21641 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:36.116226 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:36.116757 21486 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.118551 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:36.120668 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.121718 21641 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 8: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:07:36.099730 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 226601us
I20260709 13:07:36.083635 24423 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.131505 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.137641 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:36.133953 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.138900 21640 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:36.146130 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:36.146354 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.146901 22244 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.147183 22239 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:36.148705 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:36.149856 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 63238.6us
I20260709 13:07:36.169369 22244 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
W20260709 13:07:36.181808 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.185231 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.196836 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:36.197700 21639 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.201411 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:36.203074 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:36.207697 24747 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:07:36.208619 24550 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.179147 24423 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.211002 24544 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.211760 24738 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.213186 24423 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.213966 24423 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:36.122591 24341 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:36.098667 24710 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:07:36.215734 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.215075 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.218694 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:36.220602 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 96704.4us
I20260709 13:07:36.221825 24256 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:36.222220 24256 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:36.224293 24708 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.225304 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.226810 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:36.228729 24736 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.228729 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.229799 24691 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.231419 22238 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:36.232671 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.232909 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:36.233320 21642 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:36.233820 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.234441 21638 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:36.235647 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.236241 21643 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:36.236318 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:36.236864 21488 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
W20260709 13:07:36.238612 21606 connection.cc:256] RPC call timeout handler was delayed by -1.2390578849999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 13:07:36.239508 21562 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:36.240584 21606 connection.cc:256] RPC call timeout handler was delayed by -1.09080695199998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
I20260709 13:07:36.242291 24354 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.258556 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.259189 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:36.259826 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 186448us
I20260709 13:07:36.260967 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:36.268019 21486 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:36.250974 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:36.135787 24615 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
W20260709 13:07:36.309721 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 58830.2us
I20260709 13:07:36.309881 21494 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:36.321378 24113 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:36.322274 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61364.5us
I20260709 13:07:36.322628 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.340185 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:36.341662 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:36.345755 21639 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:36.234972 24256 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.252844 24423 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:36.353900 21562 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:36.361704 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 296216us
I20260709 13:07:36.367231 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:36.362847 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:36.370994 24550 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.373440 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.238013 24755 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.144s
I20260709 13:07:36.375684 21568 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
W20260709 13:07:36.387689 21606 leader_election.cc:336] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.595s (SENT)
W20260709 13:07:36.389834 21606 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.598s (SENT)
W20260709 13:07:36.390471 21606 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.601s (SENT)
I20260709 13:07:36.391124 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:36.360018 24467 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.346776 24691 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:36.393710 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 173792us
W20260709 13:07:36.386561 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 203938us
I20260709 13:07:36.394966 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.401244 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.402261 24746 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:36.402302 21561 raft_consensus.cc:2368] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:36.403064 24746 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.404129 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.405668 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.405977 24746 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:36.406754 21561 raft_consensus.cc:2410] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:07:36.421474 21606 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.701s (SENT)
I20260709 13:07:36.422115 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:36.419225 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.429651 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:36.429574 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.430485 21567 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.431324 21608 leader_election.cc:400] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:36.431681 21608 leader_election.cc:403] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:36.379403 24615 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:36.441557 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.357335 24736 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 13:07:36.449750 21606 leader_election.cc:336] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.755s (SENT)
I20260709 13:07:36.417476 24738 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:36.431118 24746 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.367909 24423 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.427446 24461 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.369168 24698 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:36.455593 21606 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.763s (SENT)
I20260709 13:07:36.439668 24757 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.393033 24462 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:07:36.396342 24680 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 13:07:36.477008 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.459249 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:36.477694 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 109288us
I20260709 13:07:36.438490 24615 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:36.412993 24600 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.450836 24755 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:36.485440 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.491768 21640 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:36.449002 24759 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:36.488528 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:36.487911 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 68806.9us
I20260709 13:07:36.493417 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:36.496294 21606 leader_election.cc:336] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.803s (SENT)
I20260709 13:07:36.506110 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:36.480206 24652 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:36.508668 21606 leader_election.cc:336] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.814s (SENT)
I20260709 13:07:36.486933 24615 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:36.509688 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:36.510739 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:36.486654 24631 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:36.491285 24756 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:36.513080 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:36.514294 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:36.517198 21493 consensus_meta.cc:287] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.000s
I20260709 13:07:36.519088 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.459583 24738 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:36.513557 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 144831us
I20260709 13:07:36.491624 24746 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:36.479907 24688 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.584206 24600 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.575065 24354 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.528357 24759 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.577203 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.604278 21642 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:07:36.505851 24708 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:36.539116 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 124574us
W20260709 13:07:36.577353 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 127066us
I20260709 13:07:36.526688 24691 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:36.527444 24761 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:36.508855 24737 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:07:36.621515 24737 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:36.621928 24737 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:36.622406 24698 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.543982 24631 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.622866 24737 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.624222 24737 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.590826 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.590885 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:36.624709 24631 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.593448 21459 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:36.510234 24652 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.627715 24652 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.593580 24461 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:36.630030 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:36.631783 24759 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:36.632112 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:36.632838 21635 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.633982 21567 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:36.635118 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.600247 24690 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.510293 24755 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:36.604693 24746 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:36.635902 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.636317 24746 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:36.636667 22242 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:36.637187 24746 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:36.637825 24758 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:07:36.597029 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 84026.9us
I20260709 13:07:36.594957 24770 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:36.638947 24754 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:07:36.639581 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.600210 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.640326 21564 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:36.640553 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:36.641466 24763 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:07:36.642580 24614 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.528550 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:36.579401 21493 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:36.544836 24740 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:36.582450 21641 raft_consensus.cc:2410] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:36.625070 22243 raft_consensus.cc:2376] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 3. Re-sending same reply.
I20260709 13:07:36.639392 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:36.575047 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.656891 21635 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:36.662146 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:36.650974 24734 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:36.674475 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 81091.2us
W20260709 13:07:36.651806 24684 consensus_meta.cc:287] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.003s
I20260709 13:07:36.638706 24746 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.675804 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:36.675668 21567 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.678691 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:36.681052 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.675016 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.682578 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:36.683859 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:36.684485 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.687769 24778 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:36.688388 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 159970us
I20260709 13:07:36.689354 24778 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.689699 24778 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.696453 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:36.697080 21493 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:36.697400 21567 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:36.699195 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:36.678419 24461 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:36.700161 21635 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:36.688832 24486 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:36.701323 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:36.652222 24756 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:36.686683 24708 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:36.687705 24690 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:36.722683 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:36.723706 21635 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.709595 24486 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:36.728125 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2248) took 1032 ms. Trace:
I20260709 13:07:36.728396 24738 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:36.728958 24774 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:36.729616 24774 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:36.730563 24774 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.688849 24354 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:36.735023 24423 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:36.688745 24761 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:36.737802 24761 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.734513 24354 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:36.739823 24354 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.728569 21569 rpcz_store.cc:276] 0709 13:07:35.695702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.697501 (+  1799us) service_pool.cc:224] Handling call
0709 13:07:35.697935 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.976017 (+278082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.976049 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.011224 (+ 35175us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.456181 (+444957us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:36.456224 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.456535 (+   311us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.727912 (+271377us) raft_consensus.cc:1685] finished
0709 13:07:36.727932 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.728065 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48934,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8209,"thread_start_us":621874,"threads_started":2,"wal-append.queue_time_us":575258}
I20260709 13:07:36.698825 24755 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:36.725628 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:36.752849 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 117839us
I20260709 13:07:36.687251 24684 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.706530 24461 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.752962 24708 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:36.768766 24461 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.770546 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.718637 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:36.700744 24773 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:36.776957 21563 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:36.763248 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.765275 24527 raft_consensus.cc:2764] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:36.766368 24755 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:36.766557 24664 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.690s	user 0.005s	sys 0.001s
I20260709 13:07:36.768147 24684 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:36.778039 21635 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:36.761799 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:36.782980 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:36.784010 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 154065us
I20260709 13:07:36.798864 21636 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:36.787509 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.799137 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:36.770670 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.789718 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.799711 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.789953 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.792912 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:36.734580 24596 consensus_meta.cc:287] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.738s	user 0.006s	sys 0.005s
I20260709 13:07:36.793000 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:36.801100 21565 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:36.796132 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.795010 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.800328 21636 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:36.802697 21563 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:36.801699 21642 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
W20260709 13:07:36.806890 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 45209.5us
I20260709 13:07:36.778108 24773 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:36.807650 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 86679.7us
I20260709 13:07:36.799598 22247 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:36.769429 24708 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.809919 21608 leader_election.cc:400] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:36.823503 21608 leader_election.cc:403] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:36.790725 24113 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:36.820883 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:36.706983 24691 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.814327 24523 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:36.838618 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:36.841905 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 88643.3us
I20260709 13:07:36.843006 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.845008 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:36.814800 24773 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.848904 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:36.847807 22246 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:36.845865 21637 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:36.846616 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.851037 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:36.852470 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52932.7us
I20260709 13:07:36.853191 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:36.854512 21489 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:36.854120 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.858610 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:36.862600 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:36.863358 21643 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.811862 24596 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.840996 24527 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:36.867102 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.867718 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:36.873821 21485 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.862847 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:36.854005 24756 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:36.853698 24523 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:36.858156 24550 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:36.861377 24781 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:36.868451 24684 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:36.897781 22243 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:36.870149 24740 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:36.905751 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52614.3us
I20260709 13:07:36.906003 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:36.907584 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:36.895342 24738 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.861946 24750 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:07:36.911998 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:36.896029 24756 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:36.912918 21639 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:36.913123 21566 raft_consensus.cc:2376] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8. Re-sending same reply.
I20260709 13:07:36.914642 21485 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:36.906029 24740 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:36.933109 24715 consensus_meta.cc:287] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.222s	user 0.008s	sys 0.003s
I20260709 13:07:36.933748 24781 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:36.891927 24527 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.907703 24786 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:36.864347 24755 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.935228 24596 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:36.960040 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52531.7us
I20260709 13:07:36.960865 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:36.941946 24740 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.908398 24113 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.943856 24781 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:36.948702 24786 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.970320 21608 leader_election.cc:400] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:36.970780 21608 leader_election.cc:403] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:36.973554 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 111825us
I20260709 13:07:36.946401 24523 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:36.947386 24715 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.975201 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.971968 24781 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.971760 24786 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.985533 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:36.997040 24710 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:36.997231 24615 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:36.997843 24710 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:36.975972 24761 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:37.001879 21643 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:37.003557 21634 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.986754 24774 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:36.986419 24764 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:37.007987 24759 raft_consensus.cc:2764] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:07:36.972460 24756 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.011492 24774 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.006193 24794 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:37.004683 24761 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.025228 24764 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:37.032523 24774 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:37.068725 24795 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:07:37.071174 24707 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:37.071678 24486 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.038268 24652 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.024170 24710 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.080999 24761 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:37.081466 24652 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:37.097764 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 403) took 1319 ms. Trace:
I20260709 13:07:37.098238 24715 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:37.101445 24764 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.106277 24461 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.107407 24527 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:37.107612 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1386) took 1109 ms. Trace:
I20260709 13:07:37.109103 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:37.112932 21563 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:37.112571 21494 rpcz_store.cc:276] 0709 13:07:35.998152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.031695 (+ 33543us) service_pool.cc:224] Handling call
0709 13:07:37.107434 (+1075739us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54002774d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:37.107547 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441537280}
I20260709 13:07:37.109517 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:37.114293 22240 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:37.122087 24665 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:37.124809 24738 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.128890 24466 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.146122 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:37.131145 24620 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:37.147276 21563 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:37.147118 24466 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.147599 24620 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:37.148070 24256 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.148633 24620 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.149370 24466 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:37.149601 24620 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.131070 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.152776 21488 raft_consensus.cc:2410] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:37.133447 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.153486 21489 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 3.
I20260709 13:07:37.133760 24688 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:37.156003 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:37.133868 24761 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:37.110376 24778 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.144840 21634 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:37.098379 21491 rpcz_store.cc:276] 0709 13:07:35.778604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.778724 (+   120us) service_pool.cc:224] Handling call
0709 13:07:35.779102 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.013509 (+234407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.013550 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.014091 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.269464 (+255373us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:36.269525 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.097150 (+827625us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54002cb854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:37.097218 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.097287 (+    69us) raft_consensus.cc:1685] finished
0709 13:07:37.097309 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.097657 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2504,"raft.queue_time_us":3742,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1554,"spinlock_wait_cycles":538044800,"thread_start_us":183529,"threads_started":1,"wal-append.queue_time_us":414082}
I20260709 13:07:37.153596 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:37.159412 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:37.163551 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 296512us
W20260709 13:07:37.163666 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.193043 24761 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.204393 21563 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:37.205942 24761 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:37.206100 24354 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:37.207103 24354 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.207499 24461 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:37.207630 24354 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.195775 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:37.194727 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:37.219632 21562 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:37.218710 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:37.234664 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.223359 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:37.161585 24724 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.239513 21637 raft_consensus.cc:2368] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8.
I20260709 13:07:37.241283 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.245349 21491 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:37.245497 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:37.241283 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:37.246014 21494 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.243220 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:37.241572 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:37.251585 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:37.279731 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.289804 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:37.290495 21569 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:37.291687 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:37.291720 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.153100 24665 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:07:37.235515 24738 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.247153 24612 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:37.239640 24614 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.159559 24781 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.315109 24738 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.318950 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:37.319497 24806 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:07:37.319569 24785 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:37.320297 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:37.313012 24796 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.324138 24486 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.325651 24778 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:37.293622 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:37.337648 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.247398 24734 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.343859 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.346215 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:37.388173 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 94623.9us
I20260709 13:07:37.389096 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:37.340452 24612 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 9 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:37.349512 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.395912 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.396940 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:37.397339 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:37.397915 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.398566 21494 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:37.372191 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:37.399581 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.317629 24614 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.340945 24738 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.371507 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.322643 24774 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.393164 21487 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 3: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:37.393342 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:37.412194 21567 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.400046 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:37.400252 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:37.400266 21485 raft_consensus.cc:2368] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:37.416568 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.401602 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.418119 21486 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:37.403825 21490 raft_consensus.cc:2368] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:37.406279 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:37.420382 21494 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:37.422484 21494 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.428453 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:37.431219 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 200835us
I20260709 13:07:37.438397 21608 leader_election.cc:400] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:37.438992 21608 leader_election.cc:403] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:37.442536 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.446231 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.458019 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:37.432075 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.461055 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.355252 24773 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.465870 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.465870 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:37.466475 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:37.467568 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:37.402290 24737 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.403995 24614 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.403403 24708 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.466130 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:37.472929 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 181867us
I20260709 13:07:37.489454 21567 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:37.501084 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:37.502978 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:37.503762 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.507138 24756 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:37.359906 24785 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.387452 24786 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.509157 21493 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:37.509670 24785 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:37.400486 24734 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.510593 24786 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:37.511514 24755 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.511991 24755 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.512310 24734 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:37.513972 24755 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:37.514179 24690 consensus_meta.cc:287] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.002s
I20260709 13:07:37.514567 24684 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:37.514760 24690 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.515221 24684 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:37.516345 24684 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.517766 24773 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:37.519426 24808 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:07:37.519932 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:37.521407 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:37.522262 21562 raft_consensus.cc:2368] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:07:37.466588 24691 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.522825 24691 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.523361 24691 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.527724 24708 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.527470 24612 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.528394 24708 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.394894 24740 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.507608 24756 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:37.529018 24774 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:37.678162 24615 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:37.668179 24779 log.cc:927] Time spent T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.841s	user 0.003s	sys 0.000s
I20260709 13:07:37.680303 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:37.681561 21492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1401) took 1453 ms (client timeout 1749 ms). Trace:
I20260709 13:07:37.593788 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:37.681996 21492 rpcz_store.cc:269] 0709 13:07:36.228086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.640307 (+412221us) service_pool.cc:224] Handling call
0709 13:07:37.681361 (+1041054us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54000f4954. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:37.681494 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399977216}
I20260709 13:07:37.572616 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 1454) took 1314 ms. Trace:
I20260709 13:07:37.683912 21640 rpcz_store.cc:276] 0709 13:07:36.230909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.248922 (+ 18013us) service_pool.cc:224] Handling call
0709 13:07:37.544744 (+1295822us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400144954. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:37.544873 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534383488}
I20260709 13:07:37.546738 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:37.573230 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:37.685650 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:37.455547 24805 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:37.593760 24786 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:37.695798 24615 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:37.595011 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:37.704826 22238 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.704685 24615 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.681771 21568 raft_consensus.cc:2368] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:37.714210 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:37.714910 22241 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:37.473740 24746 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:37.718145 21564 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:37.700254 24756 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.774690 21560 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.764281 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:37.758350 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 226980us
I20260709 13:07:37.778162 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:37.733239 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.783042 21459 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:37.715310 24805 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:37.791693 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:37.801034 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.804020 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.806921 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 340487us
I20260709 13:07:37.808679 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:37.810277 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:37.812271 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:37.771909 24486 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.828846 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:37.829738 21568 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:37.833029 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:37.835750 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:37.795392 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:37.714897 24786 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.772192 24665 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:37.836511 21640 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:37.839395 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:37.841545 21487 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:37.845847 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:37.791812 24309 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:37.858767 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:37.846582 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.799340 24761 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.849344 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:37.863531 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:37.800016 24620 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.650s	user 0.013s	sys 0.000s
W20260709 13:07:37.860468 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.865428 21640 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.829286 24737 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.867807 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:37.834868 24486 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:37.878240 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.867272 24309 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:37.889778 22238 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:37.890002 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:37.890565 21492 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:37.891139 24669 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.848430 24467 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.892015 24467 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.892561 24805 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.894197 24467 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:37.891294 24737 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:37.896380 21566 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.008s	sys 0.014s
W20260709 13:07:37.901463 21566 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.009s	sys 0.014s
I20260709 13:07:37.905591 21486 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.865083 24688 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:37.867864 24781 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:37.909570 21492 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:07:37.896576 24486 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:37.909983 21488 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.030s	sys 0.025s
I20260709 13:07:37.912312 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:37.806285 24691 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:37.918257 21488 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.030s	sys 0.025s
I20260709 13:07:37.862774 24665 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:37.956805 21641 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:37.958212 21641 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:37.960809 24614 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:37.962963 21568 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:37.964989 24614 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:37.911780 24688 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:37.985116 21641 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:37.983309 24688 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:38.028937 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 216740us
I20260709 13:07:37.995898 24778 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.955971 24309 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:38.009837 24740 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.049307 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:38.038734 24738 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 13:07:38.060694 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:38.086906 24738 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:38.091859 24814 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:07:38.110033 21569 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:38.110910 24256 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:38.113762 24486 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:38.115209 24825 log.cc:927] Time spent T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:07:38.115935 21640 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:38.061563 24773 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.088919 24690 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:38.136673 21637 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2123) took 1303 ms (client timeout 1707 ms). Trace:
I20260709 13:07:38.059310 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:38.166731 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 107481us
I20260709 13:07:38.168239 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:38.146723 24828 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:07:38.147518 24724 consensus_meta.cc:287] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.897s	user 0.010s	sys 0.003s
I20260709 13:07:38.164296 21641 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:38.050220 24778 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.172619 21560 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:07:38.164928 21637 rpcz_store.cc:269] 0709 13:07:36.833437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.850730 (+ 17293us) service_pool.cc:224] Handling call
0709 13:07:38.136447 (+1285717us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54002e2a54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:38.136606 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891473280}
I20260709 13:07:38.164340 24256 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.190662 24665 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:38.192111 24256 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:38.193461 24354 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.985s	user 0.014s	sys 0.000s
I20260709 13:07:38.193943 24354 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.161455 24786 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.203752 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:38.188337 24724 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.208941 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:38.209848 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:38.180773 24612 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:38.215758 24612 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:38.218246 24612 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.218869 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 1456) took 1987 ms. Trace:
I20260709 13:07:38.219316 21634 rpcz_store.cc:276] 0709 13:07:36.231534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.232673 (+  1139us) service_pool.cc:224] Handling call
0709 13:07:38.218671 (+1985998us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b540009d654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:38.218807 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770938112}
I20260709 13:07:38.220613 24738 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.211473 24673 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:38.216252 24486 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.217222 21566 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.228260 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:38.229038 21562 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.230062 21566 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:38.232894 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:38.243256 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:38.246819 21634 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:38.248827 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 453492us
I20260709 13:07:38.248762 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:38.249787 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:38.251430 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:38.252142 21637 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.253042 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:38.253970 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:38.255146 21640 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:38.253935 21489 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:38.260247 21485 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:38.260748 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:38.261737 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:38.264048 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:38.264284 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:38.266882 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.267112 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:38.259788 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:38.269641 21562 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:38.270215 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:38.199388 24614 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.272737 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:38.247664 24825 log.cc:927] Time spent T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:07:38.278483 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:38.281951 21640 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.246569 24354 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.280254 21486 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:38.282917 21634 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:38.286446 21489 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:38.290009 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:38.292441 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:38.293291 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:38.295107 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:38.301939 21566 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.273305 24527 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.303382 24486 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:38.315820 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.271935 24841 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.321959 21637 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:38.225514 24665 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:07:38.328140 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:38.206933 24829 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:07:38.273348 24256 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:38.291555 24309 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.301110 21640 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:07:38.306145 24698 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.275880 24614 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:38.276423 24819 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:38.348240 24614 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.348475 24819 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:38.349479 24819 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:38.323277 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:38.351230 21634 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:38.326858 24486 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:38.292240 24691 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.314939 24840 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.315227 24664 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.326535 24841 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:38.361358 21566 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:38.287477 24820 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 13:07:38.357478 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.327979 24737 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:38.358333 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 125559us
W20260709 13:07:38.366959 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.366833 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:38.357106 24707 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:38.364046 24841 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.397948 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:38.405653 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:38.388923 24756 consensus_meta.cc:287] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.002s
W20260709 13:07:38.407743 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 137939us
I20260709 13:07:38.384001 24256 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:38.389263 24684 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.355540 24486 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.415069 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:38.382814 24848 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:38.357594 24664 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.393491 24707 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:38.381484 24737 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:38.366045 24840 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.414903 24341 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.424664 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:38.414650 24354 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.030546 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:38.415635 24756 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:38.426283 24778 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:38.443725 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:38.427253 24612 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.428963 24848 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:38.434073 24341 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:38.432818 24861 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.437155 24690 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:38.453174 24858 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.460373 24737 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:38.440275 24354 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:38.460150 24664 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:38.466215 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 99493.7us
I20260709 13:07:38.471926 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:38.472618 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.456791 24829 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.476485 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:38.460943 24341 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.476815 21608 leader_election.cc:400] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:07:38.479688 21640 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:38.480827 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 83030.2us
I20260709 13:07:38.482726 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:38.483470 21608 leader_election.cc:403] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:38.486706 21608 leader_election.cc:400] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:38.487246 21608 leader_election.cc:403] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:38.476425 24829 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:38.495011 21493 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1402) took 2266 ms (client timeout 2073 ms). Trace:
W20260709 13:07:38.495339 24851 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:07:38.495436 21493 rpcz_store.cc:269] 0709 13:07:36.228360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.701388 (+473028us) service_pool.cc:224] Handling call
0709 13:07:38.494834 (+1793446us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54003f8754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:38.494943 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682356096}
I20260709 13:07:38.501396 24829 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.504887 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1463) took 1246 ms. Trace:
I20260709 13:07:38.505303 21642 rpcz_store.cc:276] 0709 13:07:37.258062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.258725 (+   663us) service_pool.cc:224] Handling call
0709 13:07:37.259169 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.296507 (+ 37338us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:37.377585 (+ 81078us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.157967 (+780382us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b1800171280. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b8223a 00007f98a9feca2a
0709 13:07:38.386871 (+228904us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.387369 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.387512 (+   143us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:38.387545 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.387610 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.498605 (+110995us) raft_consensus.cc:1685] finished
0709 13:07:38.504680 (+  6075us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.504824 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45811,"prepare.queue_time_us":79173,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":101016,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":17985,"spinlock_wait_cycles":51356544,"thread_start_us":228593,"threads_started":2,"wal-append.queue_time_us":987723}
I20260709 13:07:38.473074 24690 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:38.485886 24861 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:07:38.538266 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2129) took 1120 ms. Trace:
I20260709 13:07:38.491148 24764 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:07:38.541409 24688 consensus_meta.cc:287] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 13:07:38.514617 24862 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.462607 24707 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.547905 24707 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.548951 21562 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:38.514806 24664 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:38.551321 24664 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.551680 24664 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:38.552553 24664 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:38.516115 24824 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.541s	user 0.004s	sys 0.001s
I20260709 13:07:38.471095 24256 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.516584 24615 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:38.562402 21564 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:38.519343 24854 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:07:38.519713 24354 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:38.520892 24846 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:07:38.510010 24848 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.526732 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2274) took 1365 ms. Trace:
I20260709 13:07:38.573280 21563 rpcz_store.cc:276] 0709 13:07:37.160838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.161002 (+   164us) service_pool.cc:224] Handling call
0709 13:07:37.161295 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.204910 (+ 43615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.526418 (+1321508us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b5400289bd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:38.526655 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83139968}
I20260709 13:07:38.528349 24840 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.529289 24756 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:38.503705 24466 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.491979 24778 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:38.501966 24860 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.588044 24860 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:38.588894 24841 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.589180 24860 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:38.562673 24796 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.592056 24796 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:38.593279 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:38.594069 24796 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:38.544062 24614 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.545514 24527 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.513662 24761 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:38.561322 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2117) took 1770 ms. Trace:
I20260709 13:07:38.538719 21636 rpcz_store.cc:276] 0709 13:07:37.418137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.418357 (+   220us) service_pool.cc:224] Handling call
0709 13:07:37.418803 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.529642 (+110839us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:37.599576 (+ 69934us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.916446 (+316870us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.916500 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:37.916546 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.536704 (+620158us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b18001dc1a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240
0709 13:07:38.537567 (+   863us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b18001dc1a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419
0709 13:07:38.538020 (+   453us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540024ca54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:38.538050 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.538200 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62089,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1522,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":4275,"spinlock_wait_cycles":327511424,"thread_start_us":310783,"threads_started":1,"wal-append.queue_time_us":431711}
I20260709 13:07:38.574404 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:38.567869 24664 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.575620 24691 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.584146 24612 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:07:38.594199 22239 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:38.543531 24690 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:38.571038 24794 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:38.598974 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 116310us
I20260709 13:07:38.603608 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:38.601357 21635 rpcz_store.cc:276] 0709 13:07:36.790635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.797543 (+  6908us) service_pool.cc:224] Handling call
0709 13:07:36.797889 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.798250 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:37.158873 (+360623us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b180037cc60. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98ad9da3c7 00007f98a9fec9a7 00007f98a9ffc0bf 00007f98a9ffc038
0709 13:07:37.459429 (+300556us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.001291 (+541862us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.525216 (+523925us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b180037cc60. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:07:38.531966 (+  6750us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b180037cc60. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98ad9da3c7 00007f98a9fec9a7 00007f98a9ffc0bf 00007f98a9ffc038
0709 13:07:38.532182 (+   216us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.532546 (+   364us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.532679 (+   133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.533125 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.533269 (+   144us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.533427 (+   158us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.533599 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.533669 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.561120 (+ 27451us) raft_consensus.cc:1685] finished
0709 13:07:38.561140 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.561265 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":516352,"prepare.queue_time_us":611363,"prepare.run_cpu_time_us":169,"prepare.run_wall_time_us":5538,"raft.queue_time_us":9639,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":9115,"spinlock_wait_cycles":34748288,"thread_start_us":761598,"threads_started":2,"wal-append.queue_time_us":582506}
I20260709 13:07:38.606393 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:38.618136 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:38.618824 21490 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:38.619140 24614 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.637111 21562 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:38.637679 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:38.637825 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:38.639655 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:38.637125 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:38.643006 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:38.644372 21635 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:38.647848 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:38.651050 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:38.651659 21635 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:38.655092 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:38.657404 21561 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:38.601368 24746 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.608533 24756 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.661425 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:38.662163 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:38.572768 24688 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.667948 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:38.588960 24775 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:07:38.680694 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:38.680979 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:38.681378 21493 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:38.667455 24746 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.672279 24688 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.672981 24710 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.674152 21490 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:38.673964 24829 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.635217 24614 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:38.678504 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 72122.4us
I20260709 13:07:38.636464 24761 consensus_queue.cc:1243] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:38.679375 21491 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:38.683229 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:38.696982 21493 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:38.678980 24612 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.664939 24841 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.684913 24708 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:38.611433 24691 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:38.693280 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 100618us
I20260709 13:07:38.698503 21635 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:38.699169 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:38.699746 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:38.687387 24756 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:38.701213 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:38.748378 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:38.763365 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 62227.2us
I20260709 13:07:38.755653 24829 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.756474 21566 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:38.765861 24724 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.766263 24724 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.766598 24724 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.667435 24778 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:07:38.635851 24794 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:38.669410 24866 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:07:38.760097 24805 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.762481 21567 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:38.665110 24863 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
W20260709 13:07:38.774631 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 135529us
I20260709 13:07:38.690516 24775 consensus_queue.cc:1243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:07:38.781471 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.792115 21457 leader_election.cc:400] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8.
I20260709 13:07:38.792563 21457 leader_election.cc:403] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:38.784781 24341 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.785409 24876 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:38.775893 24486 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:38.787312 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2140) took 1090 ms. Trace:
I20260709 13:07:38.787508 24707 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:38.788142 24857 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:38.789660 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:38.789830 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:38.806432 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:38.807284 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 138738us
I20260709 13:07:38.700477 24614 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:38.702153 24612 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.795117 24863 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:38.798617 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:38.799755 21568 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:07:38.800341 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2281) took 1010 ms. Trace:
I20260709 13:07:38.801064 21641 rpcz_store.cc:276] 0709 13:07:37.696751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.013345 (+316594us) service_pool.cc:224] Handling call
0709 13:07:38.164068 (+150723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.185703 (+ 21635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.787103 (+601400us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002648d0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:38.787247 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345565568}
I20260709 13:07:38.803527 24707 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:38.806216 24868 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.810050 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:38.799535 24698 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:07:38.812945 24486 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:38.813778 21639 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:38.894591 22243 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:38.954687 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:38.863363 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 422) took 1030 ms. Trace:
I20260709 13:07:38.959916 21494 rpcz_store.cc:276] 0709 13:07:37.832846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.832958 (+   112us) service_pool.cc:224] Handling call
0709 13:07:37.833265 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.985565 (+152300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.985599 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.985644 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:37.985677 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.841316 (+855639us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540013abd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:38.863095 (+ 21779us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.863288 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349790976}
I20260709 13:07:38.792330 24805 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:38.963501 21568 pending_rounds.cc:85] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 8
I20260709 13:07:38.970206 21568 pending_rounds.cc:107] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:38.800705 24876 consensus_queue.cc:1243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:38.970764 21568 raft_consensus.cc:2889] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.893213 24423 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:38.969311 21569 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:38.975924 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:38.962428 24309 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:38.814693 24341 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.963835 24698 consensus_queue.cc:1243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:38.983950 24856 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.984753 24856 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.987772 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:38.988520 22240 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:38.991334 22238 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:38.995075 24691 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.994870 24309 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.997573 24309 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:38.954031 21560 rpcz_store.cc:276] 0709 13:07:37.789556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.792570 (+  3014us) service_pool.cc:224] Handling call
0709 13:07:37.835162 (+ 42592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.184196 (+349034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.800103 (+615907us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400127d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:38.800287 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775276288}
I20260709 13:07:38.942710 24756 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.862946 24461 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:39.000846 24461 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:39.001657 24461 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.002830 24461 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.814595 24794 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:38.820252 24773 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:07:39.023275 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49523.9us
W20260709 13:07:39.028615 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.045552 21608 leader_election.cc:336] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.513s (SENT)
I20260709 13:07:39.046083 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:38.830708 24724 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.078670 24794 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.025808 24773 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.958141 24746 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:38.943112 24596 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.969637 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:38.972532 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:38.953986 24486 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:39.012436 24614 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:38.963402 24863 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:39.009810 24423 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.011184 24707 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.014330 24805 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:38.865932 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.089993 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 124506us
I20260709 13:07:39.119836 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:39.123354 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.128532 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 172508us
W20260709 13:07:39.130684 21606 leader_election.cc:336] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.544s (SENT)
I20260709 13:07:39.136539 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:39.088469 24596 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:39.113742 24864 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.137041 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:39.121145 24869 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.373s	user 0.000s	sys 0.008s
I20260709 13:07:39.139954 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:39.142693 21606 leader_election.cc:336] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.591s (SENT)
I20260709 13:07:39.143864 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:39.145923 21606 connection.cc:256] RPC call timeout handler was delayed by -1.0742153669999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260709 13:07:39.128160 24612 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:39.125043 24707 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.124061 24724 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:39.141119 24805 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.149955 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:39.148554 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:39.139230 24876 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.156574 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:39.120605 24856 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:39.190280 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:39.143050 24746 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.194144 24423 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:39.192405 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:39.193053 24466 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.196375 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:39.145641 24708 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.197206 24620 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.200969 24620 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.201372 24620 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.202255 24796 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:39.202663 24796 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:39.203197 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:39.203609 24796 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.204640 24796 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.147584 24486 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.205531 24486 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.206357 22239 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:39.198637 24612 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.207060 24612 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.207443 24612 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:39.207691 21639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2133) took 1783 ms (client timeout 1568 ms). Trace:
W20260709 13:07:39.208088 21639 rpcz_store.cc:269] 0709 13:07:37.436763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.572948 (+136185us) service_pool.cc:224] Handling call
0709 13:07:39.207501 (+1634553us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540021b954. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:39.207600 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2585816448}
I20260709 13:07:39.199858 24867 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.200259 24423 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:39.211709 24423 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:39.212606 24423 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.150238 24847 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.147444 24665 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.148573 24794 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.148473 24734 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.160396 24710 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:39.160725 24778 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:39.221338 24740 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.227923 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:39.160187 24864 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:39.247115 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:39.232940 24665 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.219761 24847 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.161257 24863 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.254366 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.254992 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.251829 24864 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.251665 24113 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:39.245786 24669 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.266492 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:39.253153 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:39.246088 24746 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.236162 24710 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.239126 24778 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:39.257323 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.233577 24794 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.256361 24309 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.216188 24596 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.286975 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:39.290215 24885 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:07:39.289958 24309 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.293861 24309 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.294845 24734 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.295835 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:39.298408 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:39.285730 24113 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:39.299371 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:39.299960 24113 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.300540 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:39.300961 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.301167 24113 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.301844 21488 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:39.302887 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.303460 21488 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:39.304314 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.305095 24867 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:39.305405 24738 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.306077 24738 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.306303 24840 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.306573 24738 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.307107 24840 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.307941 24868 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8.
I20260709 13:07:39.307817 24840 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:39.283350 24864 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.315961 24864 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:39.318710 24669 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:39.319380 24710 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:39.319571 24669 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:39.320003 24669 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:39.305517 24867 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.326341 21494 raft_consensus.cc:2368] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:07:39.300570 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:39.254431 24786 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.350596 24794 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:39.350497 24620 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:39.351861 24884 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:07:39.352659 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:39.353292 22240 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:39.353572 24620 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.341526 24746 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.443602 24819 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:07:39.446918 22239 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:07:39.447341 22239 pending_rounds.cc:85] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 8
I20260709 13:07:39.447571 22239 pending_rounds.cc:107] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:39.447830 22239 raft_consensus.cc:2889] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.448940 24539 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:39.451421 24612 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.453715 24612 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.345294 24876 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.453939 24539 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:39.438302 24796 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.455240 24796 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.458884 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:39.344960 24867 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.461371 21567 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:39.445389 24746 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.454493 24539 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:39.250627 24740 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.188s
I20260709 13:07:39.463932 21490 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:39.256429 24665 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.460598 24829 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.460150 24737 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.359375 24486 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:07:39.482278 21491 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:39.466825 24863 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.359923 24864 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:07:39.439610 24773 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.492223 24746 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:39.503855 24665 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:39.504875 24620 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.511962 24486 consensus_queue.cc:1243] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 549b31ac31b6428994b45938abc223a7 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:39.475010 24543 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:39.511750 24746 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.343734 24669 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:39.524649 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.531046 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:39.516290 24620 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.534570 24620 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:39.488061 24829 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.541668 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.545166 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.546018 21565 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:39.548722 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 200288us
I20260709 13:07:39.545776 21486 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:39.552698 21562 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:39.554634 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.492610 24737 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.536787 24738 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.551707 24113 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.565793 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:39.560009 24113 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.567631 21568 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:39.568050 24620 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.568589 24620 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.569617 24113 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.560370 24847 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:39.566447 22243 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:39.571149 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:39.600140 22240 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.559485 21565 pending_rounds.cc:85] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
W20260709 13:07:39.574633 21606 leader_election.cc:336] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.607s (SENT)
W20260709 13:07:39.571192 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.601840 21565 pending_rounds.cc:107] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:39.602829 21565 raft_consensus.cc:2889] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:39.603904 21606 leader_election.cc:336] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 2.137s (SENT)
W20260709 13:07:39.641419 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.630299 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.641523 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.641790 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:39.640743 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:39.605150 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.604707 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.640484 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.643501 21488 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:39.644440 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:39.609388 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:39.607429 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.601794 21567 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:39.596236 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:39.647503 21606 leader_election.cc:336] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 2.140s (SENT)
I20260709 13:07:39.603919 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.647990 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:39.645893 22243 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
W20260709 13:07:39.648732 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 346701us
I20260709 13:07:39.640282 24847 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:39.638535 21493 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:39.654567 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.655212 21493 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:39.570737 24620 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.580919 24341 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:39.656865 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:39.657418 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.659401 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.666337 21569 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.671247 21493 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:39.574558 24724 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:39.668917 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.572747 24829 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.591218 24796 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:39.668915 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.529258 24539 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.687815 21564 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:39.677263 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.688378 21490 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:39.672837 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.672118 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:39.689329 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:39.690452 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.690778 22246 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.680878 22241 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:39.691190 21564 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:39.691900 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.692267 22240 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:39.692649 21564 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:39.693957 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.681694 24665 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:39.647082 24746 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.682330 24773 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:39.678355 24724 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:39.656730 24847 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.653991 24794 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.651661 24423 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.681779 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:39.675954 21485 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:39.678828 21568 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:39.656278 24309 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:07:39.689296 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.695997 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.670033 24341 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:39.719821 21562 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:39.720963 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.721779 21490 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:39.722607 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:39.718230 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.698956 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:39.701103 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.725878 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.726930 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.701457 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:39.730225 21485 raft_consensus.cc:2410] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:39.706380 24737 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:39.702260 24889 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:07:39.653375 24868 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:07:39.698158 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.667485 24856 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:39.740908 21642 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:39.741036 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:39.690052 24829 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.729952 21568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:39.705876 22238 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 13:07:39.731631 24738 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:39.733013 21494 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.736105 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.716246 24778 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.742092 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:39.739583 24868 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.749361 21636 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:39.749701 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:39.751827 21568 raft_consensus.cc:606] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:39.759766 21568 raft_consensus.cc:614] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.752852 21485 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:39.752415 21493 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:39.756983 21634 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:39.757120 24847 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.758023 21635 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:39.758551 21562 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:39.759600 21641 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.740445 24423 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:39.758912 24341 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.755244 24724 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.788044 24794 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.754844 24737 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.794667 24669 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.797611 21489 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
W20260709 13:07:39.807320 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 148222us
I20260709 13:07:39.777465 24796 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.761652 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 111250us
I20260709 13:07:39.791996 21490 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:39.753244 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51820.4us
I20260709 13:07:39.759045 24868 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:39.809484 24724 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.754894 24829 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.814250 21640 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:39.821821 21640 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:39.823024 21640 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.824419 21640 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:39.814935 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:39.801789 21641 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:39.819895 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:39.829398 24847 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:39.829955 24847 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.830376 24847 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.832839 24867 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.806190 24794 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:39.804028 24466 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:07:39.845386 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:39.805164 24423 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.848567 21606 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:39.853372 24710 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:39.854635 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:39.857805 21568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:39.842648 24856 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.858556 21568 raft_consensus.cc:606] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:39.859433 21640 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:39.818010 24796 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:39.862133 21640 pending_rounds.cc:85] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 5
I20260709 13:07:39.840204 24894 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:39.870059 21640 pending_rounds.cc:107] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:39.870620 21640 raft_consensus.cc:2889] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:39.873919 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.860685 24778 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.852880 24794 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.854266 24746 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:39.904760 21641 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:39.903964 24794 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.908362 21568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:39.839224 24868 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:39.909965 24868 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:39.911224 24897 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:07:39.911830 24596 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.913530 24423 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:39.915254 24796 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:39.902015 24778 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.918960 24309 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:39.919523 24778 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.921362 24309 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:39.922227 24309 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:39.924448 21634 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:39.925613 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:39.926376 21637 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:39.927201 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:39.927776 21637 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.928090 21642 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:39.921383 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.929070 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:39.929648 21642 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.930130 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:39.933342 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:39.933921 21488 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.927114 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:39.935185 21636 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:39.939863 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:39.940150 21640 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:39.940558 21643 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:39.922555 24309 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:39.951527 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:39.952355 21637 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:39.951601 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:39.963593 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:39.963685 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:39.964601 21641 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:39.957607 21642 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:07:39.965924 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 107255us
I20260709 13:07:39.960875 21565 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:39.968031 21566 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:39.971050 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:39.976483 21560 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:39.906862 24867 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:39.979585 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:39.976796 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:39.983851 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:39.935658 24710 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:07:40.003069 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:39.969144 24737 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:40.013954 24737 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.016130 24737 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:40.018115 24710 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.000619 24738 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:39.986596 24756 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.018987 24309 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:40.019800 24756 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.020290 24756 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.020422 24309 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.021387 24738 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:40.022405 24738 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.013226 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:40.038774 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:40.039719 21485 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:40.041077 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:40.041539 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.041836 21485 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:40.045395 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:40.048632 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.051997 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.052861 21639 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:40.032542 24889 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:40.031901 24423 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.059201 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.057205 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:40.064158 24829 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:40.064599 24796 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.065168 24796 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:40.054378 24864 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:07:40.066085 21485 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:40.067277 24796 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:40.067786 21485 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:40.069092 21485 raft_consensus.cc:1217] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Deduplicated request from leader. Original: 4.6->[5.7-10.9]   Dedup: 9.8->[10.9-10.9]
I20260709 13:07:40.069608 21485 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: [5.7-10.9]
I20260709 13:07:40.070566 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:40.072419 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:40.075508 21642 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:40.076713 21641 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:40.077068 21641 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:40.077901 21641 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.079144 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.079898 21643 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:40.081149 21640 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:40.082228 24737 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:40.082676 24737 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:40.083612 21565 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:40.083539 24737 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.087496 24652 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.092254 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:40.094712 21641 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:40.095784 24896 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:07:40.099509 24423 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.100093 24423 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.101548 24698 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:40.105125 24341 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.006307 24740 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:07:40.107093 21488 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:40.106673 24665 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:40.044142 24863 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.108268 24863 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.108669 24863 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.002902 24805 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:40.074169 24847 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:40.132537 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.127830 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.118408 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:40.135488 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.044373 24773 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:07:40.126413 21485 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 13:07:40.142520 21485 pending_rounds.cc:85] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 8
I20260709 13:07:40.142807 21485 pending_rounds.cc:107] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:07:40.143041 21485 raft_consensus.cc:2889] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.127795 24805 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:40.128480 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.153913 21637 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 5.
I20260709 13:07:40.155500 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.156927 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:40.129822 24868 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.153790 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:40.153172 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.171649 21643 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:40.143608 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:40.161113 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:40.122602 24856 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.174350 21560 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
W20260709 13:07:40.176182 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 192408us
I20260709 13:07:40.179575 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:40.180068 21640 raft_consensus.cc:2376] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10. Re-sending same reply.
I20260709 13:07:40.180785 21641 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:07:40.181542 21641 pending_rounds.cc:85] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 4
I20260709 13:07:40.181806 21641 pending_rounds.cc:107] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:40.182046 21641 raft_consensus.cc:2889] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.187053 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:40.187480 21643 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:40.188777 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:40.160280 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.188763 21642 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:40.190393 21637 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:40.131413 24894 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:40.160573 21639 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:40.192785 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:07:40.193135 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.194171 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.205056 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.233428 21641 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:40.234416 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.235864 21637 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:07:40.239133 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 47055.8us
I20260709 13:07:40.153631 24805 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:40.181087 24665 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:40.251302 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 58588.7us
I20260709 13:07:40.252420 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:40.171947 24341 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.161314 24113 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:40.232553 24746 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:07:40.246728 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 258744us
I20260709 13:07:40.154158 24778 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.242147 24867 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.263002 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 76056.7us
I20260709 13:07:40.254949 24543 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:07:40.248760 24665 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.273502 24665 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.258224 24710 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.274159 24710 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:40.274636 24710 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.264168 24860 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:07:40.245235 24466 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.279085 24466 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:40.264626 24113 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:40.279340 24901 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:07:40.279559 24466 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.281491 24847 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:40.244329 24894 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:40.284070 24894 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:40.284279 24867 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.286135 24778 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:40.286428 24867 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:40.286664 21568 raft_consensus.cc:606] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:40.295338 21568 raft_consensus.cc:614] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:40.287252 21640 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:40.289827 24423 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.289992 24466 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.176503 24756 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:40.293706 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:40.236311 24868 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.258486 24909 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.297027 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:40.302318 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:40.299559 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:40.307106 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:40.308439 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44836.4us
I20260709 13:07:40.309091 21562 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:40.311864 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:40.320514 21643 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:40.320808 24840 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:40.310127 21606 leader_election.cc:400] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 4 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 4. Current term is 5.
I20260709 13:07:40.326071 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:40.322798 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:40.328639 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:40.329313 21492 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.313709 24778 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:40.332705 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:40.333978 21636 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.335386 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:40.312717 24909 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.339568 24847 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.309908 24773 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.344987 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:40.337921 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:40.346324 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:40.350225 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.342530 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.311573 24905 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.321115 24669 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.363337 21638 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:40.336575 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:40.378188 21487 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:40.308533 24913 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.386935 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.329861 24876 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.383836 21493 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:40.384161 21490 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:40.380774 21635 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:40.391531 21492 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
W20260709 13:07:40.392851 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 56372.4us
I20260709 13:07:40.333416 24620 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.397202 21634 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:40.334172 24840 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:40.408119 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:40.408407 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:40.384528 24669 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.415041 21490 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:40.415354 24669 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.402913 24773 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:40.331796 24710 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:40.335834 24829 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:07:40.345398 24778 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:40.305454 24805 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.432987 21489 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:40.398420 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.494168 21636 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
W20260709 13:07:40.501032 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.462710 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:40.414258 24673 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.424628 24341 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.430843 24710 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:40.445017 24905 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:40.532824 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 148975us
W20260709 13:07:40.527153 24914 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:40.487738 24746 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:40.541844 21485 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:40.530350 24805 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.535991 24673 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.600451 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 360009us
I20260709 13:07:40.602006 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:40.542454 24905 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:40.432325 24840 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:40.628434 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.560431 24710 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.546845 24423 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:40.562438 24673 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:40.667550 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 121257us
W20260709 13:07:40.661244 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 338510us
W20260709 13:07:40.710009 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.669633 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 207046us
I20260709 13:07:40.709729 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:40.542969 24665 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.560070 24746 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:40.618659 24724 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.774s	user 0.010s	sys 0.001s
I20260709 13:07:40.714268 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:40.736267 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:40.661487 24919 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
I20260709 13:07:40.719868 24905 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.721338 24309 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.706511 24466 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:40.722036 24596 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:40.722433 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.785729 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.722769 24864 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:40.561175 24614 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 13:07:40.604192 24909 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:40.737739 22243 raft_consensus.cc:2410] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:07:40.714892 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 212439us
I20260709 13:07:40.662057 24539 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.721735 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:40.705978 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 104085us
I20260709 13:07:40.826643 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:40.838733 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 117060us
I20260709 13:07:40.839859 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:40.840943 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:40.844316 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:40.739365 24868 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:40.705627 24876 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.734838 24423 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.756286 24710 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.661240 24778 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.788137 24596 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.866526 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:40.868968 24354 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:40.869094 24895 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.869413 24354 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.869903 24354 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.870062 24895 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.871025 24895 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:40.864492 24919 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:07:40.851893 24909 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:40.863873 24710 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.879276 24596 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:40.929438 24911 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:07:40.930761 24936 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.931334 24936 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:40.933497 24936 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:40.934172 24921 log.cc:927] Time spent T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.330s	user 0.003s	sys 0.000s
W20260709 13:07:40.937316 24929 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:07:40.939162 24920 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.399s	user 0.000s	sys 0.000s
I20260709 13:07:40.930400 24889 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:07:40.896489 24309 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.941183 24889 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.941664 24889 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:40.942111 24889 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.942210 24309 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:40.942759 24309 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.944723 24614 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.945400 24614 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:40.948880 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.951865 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 83816.9us
I20260709 13:07:40.865293 24912 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:07:40.960834 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 224673us
I20260709 13:07:40.879740 24423 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.925460 24756 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:40.927721 24710 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.947413 24631 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:40.948104 24909 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:40.967036 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:40.917846 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.889884 24930 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:07:40.863628 24876 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:40.975240 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:40.986322 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:40.987782 22244 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:40.961541 24341 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:07:40.992641 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:40.993311 21638 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:40.994421 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:40.995223 21640 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:07:40.975973 24923 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.410s	user 0.000s	sys 0.001s
I20260709 13:07:40.962102 24864 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:07:41.001996 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:41.007400 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.015376 21487 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:41.008702 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:41.010912 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:41.011153 21638 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:41.009800 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:40.986469 24915 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260709 13:07:40.950968 24746 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:41.075155 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48885.3us
I20260709 13:07:41.075654 21640 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
W20260709 13:07:41.078747 24620 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.001s
I20260709 13:07:41.105602 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:41.124444 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.009366 24756 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.112484 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:41.179730 21494 raft_consensus.cc:2376] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8. Re-sending same reply.
W20260709 13:07:41.180011 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.181023 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:41.182518 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.097692 24527 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.077692 24936 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
W20260709 13:07:41.163605 24944 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:07:41.087180 24614 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:40.989207 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:41.097244 24876 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.095712 24423 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:41.095753 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2322) took 1119 ms. Trace:
I20260709 13:07:41.001663 24868 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:41.140827 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61961.5us
I20260709 13:07:41.153240 22244 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
W20260709 13:07:41.147107 24805 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.004s
I20260709 13:07:40.986315 24937 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.162s
I20260709 13:07:41.145411 24665 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.174424 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:41.098044 24909 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.174098 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:41.132712 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 286479us
I20260709 13:07:41.157704 24620 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.184192 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:41.190340 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:41.092670 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:41.193388 24954 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.192554 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 181753us
I20260709 13:07:41.215839 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.217155 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:41.218578 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 455) took 1085 ms. Trace:
W20260709 13:07:41.173223 24863 consensus_meta.cc:287] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.059s	user 0.012s	sys 0.000s
I20260709 13:07:41.194350 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:41.195796 21561 rpcz_store.cc:276] 0709 13:07:39.976011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.976222 (+   211us) service_pool.cc:224] Handling call
0709 13:07:39.976500 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.976817 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.976843 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.977284 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.321810 (+344526us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:40.321867 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.321959 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.095566 (+773607us) raft_consensus.cc:1685] finished
0709 13:07:41.095582 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.095702 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5899,"raft.queue_time_us":528,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":14287,"thread_start_us":293767,"threads_started":1,"wal-append.queue_time_us":545781}
I20260709 13:07:41.204838 21634 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.219143 21488 rpcz_store.cc:276] 0709 13:07:40.133593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.166118 (+ 32525us) service_pool.cc:224] Handling call
0709 13:07:40.166494 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.280927 (+114433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.280957 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:40.280998 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:40.281038 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.218288 (+937250us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540009f1d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:41.218347 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.218506 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262704512}
I20260709 13:07:41.222147 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.206741 21638 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:41.223963 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.192114 24527 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:41.211263 24669 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.795s	user 0.005s	sys 0.006s
I20260709 13:07:41.211158 24953 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:41.226083 24669 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.189217 24756 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.226897 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:41.227787 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:41.229089 24756 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.229482 24669 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:41.233000 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48912.3us
I20260709 13:07:41.207232 24805 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.213148 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.248219 21493 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:41.249945 21493 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:41.225167 21488 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:41.226212 24953 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:41.211633 24940 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:41.216742 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.282464 21490 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:41.236737 22243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 397) took 1586 ms. Trace:
I20260709 13:07:41.237354 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35370 (request call id 39) took 1329 ms. Trace:
I20260709 13:07:41.237476 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:41.230113 24669 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.238974 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.239935 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.240176 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.240705 21634 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:41.243002 24945 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.243539 24778 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:41.243800 24925 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.314s	user 0.002s	sys 0.000s
I20260709 13:07:41.200312 24868 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:07:41.264899 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.283463 21568 rpcz_store.cc:276] 0709 13:07:39.907992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.908185 (+   193us) service_pool.cc:224] Handling call
0709 13:07:41.237181 (+1328996us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400151b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fdc853 00007f98aefaa60a 00007f98a85307d4 00007f98a8530762 00007f98a8530691 00007f98a853060c 00007f98a852f8c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:41.237277 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868445440}
I20260709 13:07:41.282945 22243 rpcz_store.cc:276] 0709 13:07:39.650829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.658193 (+  7364us) service_pool.cc:224] Handling call
0709 13:07:40.072267 (+414074us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5800124898. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:07:41.236496 (+1164229us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b5400610154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:41.236679 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554770048}
I20260709 13:07:41.285539 21494 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:41.213258 24614 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:41.281291 24953 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.296798 24614 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.298391 24868 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.229941 24756 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.244839 24863 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.299093 24756 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:41.299490 24927 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.448s	user 0.002s	sys 0.000s
I20260709 13:07:41.300133 24614 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.300882 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2331) took 1008 ms. Trace:
I20260709 13:07:41.301359 24863 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.302109 24863 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:41.301292 21560 rpcz_store.cc:276] 0709 13:07:40.292496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.292622 (+   126us) service_pool.cc:224] Handling call
0709 13:07:40.292957 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.293291 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.293320 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.293786 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.543427 (+249641us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:40.543493 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.543607 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.298895 (+755288us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:41.300623 (+  1728us) raft_consensus.cc:1685] finished
0709 13:07:41.300642 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.300824 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":456,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4806,"spinlock_wait_cycles":237287808,"thread_start_us":248270,"threads_started":1,"wal-append.queue_time_us":437485}
I20260709 13:07:41.283257 24805 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.303861 24913 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:41.304405 24913 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.304735 24805 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:41.301427 24924 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.512s	user 0.001s	sys 0.000s
I20260709 13:07:41.286609 24669 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:41.289214 24959 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:41.233544 24354 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:41.313503 24905 consensus_meta.cc:287] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.003s
I20260709 13:07:41.295248 24423 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:41.299515 24756 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.314500 24614 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.302677 24863 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:41.340384 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 141693us
W20260709 13:07:41.337253 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 93452.8us
I20260709 13:07:41.339404 21560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
W20260709 13:07:41.339859 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 137810us
I20260709 13:07:41.341387 21560 raft_consensus.cc:606] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.326128 24959 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.341817 21560 raft_consensus.cc:614] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:41.296242 24778 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.324640 24669 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.342553 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:41.346165 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:41.341828 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 113068us
I20260709 13:07:41.351701 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:41.275400 24954 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.354594 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:41.355340 21561 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.354998 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:41.357836 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:41.358980 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:41.358122 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:41.368275 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.369738 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.370232 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:41.358981 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:41.371052 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.374662 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:41.375777 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:41.379433 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:41.378726 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:41.382486 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.349076 24959 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.357556 24937 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:41.348834 24913 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.384652 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2330) took 1269 ms. Trace:
I20260709 13:07:41.326812 24950 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:07:41.372465 24930 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:41.398118 21560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:41.393504 21561 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:41.400352 21565 rpcz_store.cc:276] 0709 13:07:40.115242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.115408 (+   166us) service_pool.cc:224] Handling call
0709 13:07:40.115787 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.156959 (+ 41172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.157015 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.172042 (+ 15027us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.503773 (+331731us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:40.503815 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.503886 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.300875 (+796989us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:41.356926 (+ 56051us) raft_consensus.cc:1685] finished
0709 13:07:41.356948 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.384586 (+ 27638us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40673,"raft.queue_time_us":43456,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":10043,"spinlock_wait_cycles":375689472,"thread_start_us":247988,"threads_started":1,"wal-append.queue_time_us":429687}
I20260709 13:07:41.333779 24423 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.340236 24614 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.387387 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.331972 24905 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.388209 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.377195 24945 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:41.418953 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 45204.7us
I20260709 13:07:41.456089 21490 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
W20260709 13:07:41.389526 24673 consensus_meta.cc:287] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.001s
I20260709 13:07:41.384825 24341 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:41.395174 24840 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:41.467528 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 79420.8us
I20260709 13:07:41.473342 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.403321 24737 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.386139 24964 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.383708 24969 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.407801 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:41.486414 21490 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:41.412643 24930 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.487313 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:41.489233 21560 raft_consensus.cc:606] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.495164 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.498977 21560 raft_consensus.cc:614] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:41.461604 24957 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.516683 21489 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:41.477322 24950 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.516103 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:41.471642 24937 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:41.390285 24309 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.499687 21491 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:41.466717 24960 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.457307 24913 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:07:41.491101 24969 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.489389 24909 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:41.458202 24889 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.551643 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.542126 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.512859 24930 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:41.567278 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 71842us
I20260709 13:07:41.422998 24965 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 13:07:41.548887 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.518409 22239 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.553723 21488 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:41.474306 24673 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.555112 24946 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:07:41.577044 22246 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:41.579221 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:41.583005 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.584388 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:41.559412 24966 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:07:41.559845 24905 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.561743 24778 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:41.562453 24354 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:41.569191 24596 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.001s
I20260709 13:07:41.494729 24964 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:41.564424 24963 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:07:41.558277 24868 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.562969 24805 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:41.581041 24341 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:41.601672 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 128397us
I20260709 13:07:41.552415 24969 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.551879 24950 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:41.611706 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 195825us
I20260709 13:07:41.579599 24960 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.616029 21637 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:07:41.618000 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.568868 24909 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:41.636500 24970 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:07:41.610654 24596 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:41.637823 24968 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:07:41.638067 24967 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:07:41.638901 24964 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:41.639366 24596 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.640738 24954 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.641418 24889 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.642901 24354 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:41.643425 24354 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.643465 24953 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.646443 24971 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:41.621286 24863 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.657249 24614 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.628265 24905 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.646132 24354 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.634179 24960 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:41.650009 24710 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.002s
I20260709 13:07:41.621529 24805 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.648255 24909 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.659615 24971 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.631917 24950 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.676095 24868 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.686267 24805 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.687480 24953 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.687765 24959 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.681129 24930 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.625664 24937 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.701217 24969 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:41.702283 24934 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.854s	user 0.002s	sys 0.000s
I20260709 13:07:41.691336 24959 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:41.707633 24956 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.462s	user 0.000s	sys 0.002s
W20260709 13:07:41.709579 24942 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.823s	user 0.000s	sys 0.002s
I20260709 13:07:41.713418 24950 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.690742 24946 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.714841 24946 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:41.715981 24946 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.717679 24946 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.719971 24971 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.758318 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:41.760411 21494 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:41.763670 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:41.764489 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.624549 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:41.769941 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 146054us
I20260709 13:07:41.771685 21606 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.778200 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:41.779511 21637 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:41.779619 21638 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:41.780552 21485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1444) took 1445 ms (client timeout 1772 ms). Trace:
I20260709 13:07:41.781015 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:41.781157 21485 rpcz_store.cc:269] 0709 13:07:40.334997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.335154 (+   157us) service_pool.cc:224] Handling call
0709 13:07:41.780130 (+1444976us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540013a1d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:41.780334 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467330816}
I20260709 13:07:41.782245 21637 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:41.693703 24930 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.668960 24960 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:41.706036 24969 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:41.694464 24973 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:07:41.774696 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.805173 24805 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:41.824357 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 62957.5us
I20260709 13:07:41.831207 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:41.644029 24423 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:41.844401 24981 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:41.842151 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:41.845036 24960 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.855062 24965 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:41.855674 24940 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.888091 24950 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:41.888852 24309 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.888598 24940 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.889025 24950 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.859432 24985 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:41.860664 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:41.869694 24994 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.870798 21638 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:41.872428 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:41.881477 24805 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.886981 24889 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:41.887622 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 273267us
I20260709 13:07:41.895437 25002 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:41.896934 24959 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.866668 24989 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:41.901903 24985 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.906952 25003 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:41.912309 21485 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.912497 24113 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.915489 24940 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.919929 24805 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.921082 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:41.922008 24991 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:41.668660 24710 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.922871 24991 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.925808 21636 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:41.890230 24965 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.928792 24990 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.935416 24113 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:41.936232 24889 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.937520 24994 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.939077 24985 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.950464 24995 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.950816 24867 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.952149 24867 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.952627 24737 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:41.953541 24737 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.955410 24959 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:41.956218 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 181795us
I20260709 13:07:41.957931 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:41.915419 25003 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:41.959744 24989 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.967001 24746 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.969473 24710 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.971055 24941 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.971494 24965 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.971555 24941 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:41.958539 24959 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:41.976272 24935 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.094s	user 0.003s	sys 0.002s
I20260709 13:07:41.981271 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:41.963342 24889 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:41.987417 24737 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:41.994184 24113 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.948886 24805 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.963464 24614 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.945147 25002 consensus_queue.cc:1243] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:41.902523 24341 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:41.963814 24985 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.012440 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:42.023762 24990 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:42.024580 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:42.032541 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:42.033142 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.033715 22243 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 5: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:42.033564 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.034816 24113 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.034643 24856 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:42.035784 24856 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.039130 24856 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:42.034535 22238 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:42.053995 21485 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:42.061331 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:42.061616 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.062506 22244 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:07:42.066356 24669 consensus_meta.cc:287] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.703s	user 0.014s	sys 0.004s
I20260709 13:07:42.017323 24991 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.012403 24941 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.024696 24990 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.086549 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.087509 21486 raft_consensus.cc:2410] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:42.108295 25003 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:42.110344 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 189499us
I20260709 13:07:42.115226 24989 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.115939 24794 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.116746 24794 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:42.125420 24756 consensus_meta.cc:287] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.005s
I20260709 13:07:42.127161 24527 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:42.082041 24856 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:42.082396 24950 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.047807 24985 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.140451 22244 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:42.150617 24985 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.140596 24994 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.082067 24805 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.164227 24805 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.144388 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.088194 24990 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:42.165717 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:42.165892 22238 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:42.166630 22244 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:42.166936 24794 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:42.182389 24673 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.168428 24941 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.146446 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.172674 24756 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.148010 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:07:42.191203 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 166828us
I20260709 13:07:42.191756 24614 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:42.191900 22246 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:42.192246 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:42.193424 24995 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.193934 24995 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:42.194475 24995 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:42.207518 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 51374.7us
I20260709 13:07:42.211409 24740 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:42.213089 24740 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:42.217523 24950 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:42.219233 24738 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:42.219744 24738 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:42.220777 24738 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.222582 24738 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.227473 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:42.228488 24614 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:42.228962 24614 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.229384 24614 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.243753 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:42.247301 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:42.252240 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:42.253795 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 57426.3us
W20260709 13:07:42.257313 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.254768 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:42.257977 21392 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 234) took 20643 ms (client timeout 15000 ms). Trace:
I20260709 13:07:42.262209 24938 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:42.265616 24867 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.266450 24867 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:42.267042 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.267844 24773 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.271885 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 106105us
I20260709 13:07:42.274116 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:42.275002 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:42.275241 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:42.255388 21390 catalog_manager.cc:5697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 3 to 5, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 5 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:07:42.276603 22239 consensus_meta.cc:287] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.002s
I20260709 13:07:42.279194 24867 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.280522 21486 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:42.283005 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:42.283842 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.082357 24669 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.284775 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.287388 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:42.296080 24756 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.283880 21492 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:42.306097 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.283699 24614 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.312914 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.312829 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.313511 24710 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.313833 21494 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:42.314128 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:42.314460 21489 raft_consensus.cc:2368] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:42.320189 22246 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:42.311152 24867 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.322950 22243 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:42.330353 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:42.333958 21637 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.335800 24710 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:42.336300 24710 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.339102 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:42.339406 24949 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:42.339639 24746 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:42.339900 24794 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:42.340118 21492 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:42.334686 21491 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:07:42.340693 21635 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:42.341542 21491 pending_rounds.cc:85] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 9
I20260709 13:07:42.352536 21637 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:07:42.356330 21485 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:42.323884 22239 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:42.362967 21638 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.350224 21491 pending_rounds.cc:107] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:07:42.369812 21491 raft_consensus.cc:2889] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.376250 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.379278 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.380204 24614 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.363148 24773 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.382084 22243 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:07:42.382925 24829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.691s	user 0.012s	sys 0.051s
W20260709 13:07:42.383370 24829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.723s	user 0.012s	sys 0.052s
I20260709 13:07:42.383855 24829 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:42.383890 24773 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.384351 24829 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:42.385569 24829 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.386219 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.391849 21488 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:42.393123 21486 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:42.340696 24794 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:42.402562 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 147910us
I20260709 13:07:42.360124 24960 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.390455 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.412065 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.413164 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.413583 24829 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.414022 21560 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:07:42.415144 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:42.415984 21636 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:42.416491 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.417448 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.417603 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.418210 21569 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:42.418552 21564 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:42.425606 21638 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:42.426599 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.429261 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:42.431234 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.432228 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:42.433568 24946 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.715s	user 0.017s	sys 0.001s
I20260709 13:07:42.340253 24949 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.340435 24746 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.445751 21485 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:42.450919 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:42.404917 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 612) took 1035 ms. Trace:
I20260709 13:07:42.453625 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:42.456911 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.457798 21565 raft_consensus.cc:2393] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:42.463037 21489 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:42.463668 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:42.458595 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.471830 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:42.455371 22239 rpcz_store.cc:276] 0709 13:07:41.369812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.372173 (+  2361us) service_pool.cc:224] Handling call
0709 13:07:42.389286 (+1017113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:42.478281 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.480212 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.481668 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.482918 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.484336 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.485194 21566 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:42.486235 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.487167 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.488062 21560 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:42.488636 24794 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.488952 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.490056 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.491202 24949 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.491288 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.447947 24756 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.491967 21568 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:42.492877 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.493434 21568 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:42.493485 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.494226 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.494469 21569 raft_consensus.cc:2410] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:42.496549 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.433604 24710 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.495838 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:42.261448 21392 rpcz_store.cc:269] 0709 13:07:21.614350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.614609 (+   259us) service_pool.cc:224] Handling call
0709 13:07:42.257685 (+20643076us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:34.842369 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:34.849348 (+  6979us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:34.849394 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:07:34.849406 (+    12us) tablet.cc:662] Decoding operations
0709 13:07:34.850804 (+  1398us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:34.850937 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:34.850974 (+    37us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:07:34.852189 (+  1215us) tablet.cc:701] Row locks acquired
0709 13:07:34.852233 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:07:34.852407 (+   174us) write_op.cc:270] Start()
0709 13:07:34.852564 (+   157us) write_op.cc:276] Timestamp: P: 1783602454852339 usec, L: 0
0709 13:07:34.852586 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:07:34.853264 (+   678us) log.cc:844] Serialized 5623 byte log entry
0709 13:07:35.709766 (+856502us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800233920. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:07:36.209567 (+499801us) op_driver.cc:464] REPLICATION: finished
0709 13:07:36.524923 (+315356us) write_op.cc:301] APPLY: starting
0709 13:07:36.543595 (+ 18672us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:36.652072 (+108477us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:36.656549 (+  4477us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:36.972991 (+316442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:36.987010 (+ 14019us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:07:36.999433 (+ 12423us) write_op.cc:312] APPLY: finished
0709 13:07:37.033500 (+ 34067us) log.cc:844] Serialized 101 byte log entry
0709 13:07:37.396626 (+363126us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:37.430888 (+ 34262us) write_op.cc:454] Released schema lock
0709 13:07:37.460754 (+ 29866us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:37.507268 (+ 46514us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:37.507302 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13899,"reported_tablets":49,"spinlock_wait_cycles":59136,"child_traces":[["op",{"apply.queue_time_us":295126,"apply.run_cpu_time_us":53437,"apply.run_wall_time_us":997037,"num_ops":14,"prepare.queue_time_us":756840,"prepare.run_cpu_time_us":17491,"prepare.run_wall_time_us":86505,"raft.queue_time_us":496930,"raft.run_cpu_time_us":24398,"raft.run_wall_time_us":189917,"replication_time_us":1356788,"spinlock_wait_cycles":36435328,"thread_start_us":1429292,"threads_started":5,"wal-append.queue_time_us":682903,"wal-append.run_cpu_time_us":43599,"wal-append.run_wall_time_us":2294394}]]}
I20260709 13:07:42.405560 24995 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.505820 21560 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:42.508002 24913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.021s	sys 0.046s
I20260709 13:07:42.508492 21561 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:42.508849 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 44833.2us
I20260709 13:07:42.509948 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:42.511762 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:42.508428 24913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.021s	sys 0.046s
I20260709 13:07:42.514998 21568 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:42.517185 21565 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:42.504662 24946 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.518999 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:42.536669 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 69141us
I20260709 13:07:42.539256 24857 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.540100 24857 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.542991 24857 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:42.543809 24946 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.544355 24946 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.546819 24960 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.551244 21562 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:42.552233 21640 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
W20260709 13:07:42.554545 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 107533us
I20260709 13:07:42.547396 24710 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:42.556871 21641 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:07:42.557193 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 45507.3us
I20260709 13:07:42.516528 24949 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.559361 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.564072 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:42.518973 24669 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.576149 24995 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.562330 24466 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:42.581154 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.579294 24746 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.563733 24949 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:42.597783 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.609709 21493 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:42.610283 21641 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:42.598433 24466 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:42.611685 24466 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.612365 24991 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:42.612841 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.613305 24991 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:42.613662 21486 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:42.620337 24466 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.622279 24994 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:42.622936 24994 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.623605 24466 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.625394 24994 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.633780 22212 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:42.613718 24991 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:42.638689 21568 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:42.640549 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.636015 24949 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:42.651723 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 138278us
I20260709 13:07:42.657689 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.655982 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:42.661921 21641 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:42.667026 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 227866us
I20260709 13:07:42.660254 21491 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:42.686853 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.690452 21562 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
W20260709 13:07:42.648049 24341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.010s	sys 0.054s
I20260709 13:07:42.697768 21568 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:42.706722 24864 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:42.707513 24864 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.709766 24864 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.711091 21491 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: [8.5-11.6]
I20260709 13:07:42.711750 24864 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.712644 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.712486 24864 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.713404 21493 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:42.714406 24994 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:42.647691 24946 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.715062 24994 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.715936 24864 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.717363 24946 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.721617 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.722658 21489 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:42.723755 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2183) took 1272 ms. Trace:
I20260709 13:07:42.724294 21634 rpcz_store.cc:276] 0709 13:07:41.366025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.366198 (+   173us) service_pool.cc:224] Handling call
0709 13:07:41.366623 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.367094 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:41.875604 (+508510us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.362914 (+487310us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.445886 (+ 82972us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.446030 (+   144us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:42.469662 (+ 23632us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.498848 (+ 29186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.512763 (+ 13915us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:42.634933 (+122170us) raft_consensus.cc:1685] finished
0709 13:07:42.634957 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.638391 (+  3434us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":309566,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":29196,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":27780,"thread_start_us":946573,"threads_started":2,"wal-append.queue_time_us":715479}
I20260709 13:07:42.727789 24998 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.728412 24998 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:42.730482 25012 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:07:42.732120 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1507) took 1120 ms. Trace:
I20260709 13:07:42.732446 21643 rpcz_store.cc:276] 0709 13:07:41.611885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.871425 (+259540us) service_pool.cc:224] Handling call
0709 13:07:41.872030 (+   605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.881378 (+  9348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.882395 (+  1017us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:41.907192 (+ 24797us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.311645 (+404453us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:42.311687 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.318443 (+  6756us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:42.731768 (+413325us) raft_consensus.cc:1685] finished
0709 13:07:42.731794 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.731948 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25899,"raft.queue_time_us":7713,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":1118,"thread_start_us":403928,"threads_started":1,"wal-append.queue_time_us":565683}
I20260709 13:07:42.733645 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.734172 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.734959 21564 raft_consensus.cc:2368] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:42.735121 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.736009 21565 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:42.738552 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.739331 21566 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:42.740813 21566 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:42.736002 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.742404 21564 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:42.746320 24957 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:42.746758 24957 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:42.749627 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.751188 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.751935 21564 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:42.669627 24856 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.717432 24994 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.753222 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:42.656663 24876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.029s	sys 0.035s
I20260709 13:07:42.701027 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:42.764890 21566 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.766120 21564 raft_consensus.cc:2368] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8.
I20260709 13:07:42.767724 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.769958 21566 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:42.770974 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.771469 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:42.771843 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.773774 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 102730us
I20260709 13:07:42.649513 24867 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.777105 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.728878 24998 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.734915 24972 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:42.769238 24876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.442s	user 0.029s	sys 0.036s
I20260709 13:07:42.788553 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.794308 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:42.803514 21568 raft_consensus.cc:2368] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:42.798988 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:42.799815 24864 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:42.810626 24864 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.813488 24864 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.827301 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:42.835606 24913 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:42.844085 24913 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.782101 24856 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:42.856657 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 57775.6us
I20260709 13:07:42.859033 24913 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:42.872273 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 269216us
W20260709 13:07:42.876130 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.877264 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 113927us
I20260709 13:07:42.848901 24994 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:42.875882 24341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.011s	sys 0.054s
I20260709 13:07:42.792146 24991 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:42.891875 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 63300.6us
I20260709 13:07:42.887856 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:42.897742 24868 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.898546 24868 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.901711 24868 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.862699 24972 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.926501 25010 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:42.926380 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:42.927418 25010 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:42.929622 24913 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:42.930279 24913 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.932371 24913 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.933323 25011 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:42.954250 24939 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:42.955000 24939 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.957193 24939 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:42.958964 24991 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.962934 24673 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.963501 24724 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.966353 21641 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:42.968256 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:42.972110 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 64041.3us
I20260709 13:07:42.971508 24596 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.975852 21560 raft_consensus.cc:2410] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:42.977836 21606 leader_election.cc:400] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:42.980293 21606 leader_election.cc:403] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:07:42.975000 25015 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 13:07:42.969699 24724 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:42.921382 24994 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:42.993078 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.993309 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:42.979041 24596 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.996693 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:42.998004 24994 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:42.982908 24867 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:42.990576 24972 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:43.007515 25010 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:42.994664 24746 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:43.001009 24596 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.018534 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:43.021585 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:43.032954 21487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.072s	sys 0.162s
W20260709 13:07:43.033399 21487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.073s	sys 0.162s
W20260709 13:07:43.034905 25016 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:07:43.037096 24724 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:43.039093 24856 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:43.040026 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:43.042587 24773 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:43.066642 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 53035.5us
I20260709 13:07:43.018189 24794 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:43.042428 25010 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:43.072296 22239 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:43.071028 24960 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:43.086122 24972 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.114298 24960 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:43.134341 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:43.121125 24913 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:43.138983 24960 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:43.146852 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.125087 24856 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:07:43.150600 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:43.151479 21642 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.152503 24994 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.153102 24746 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:43.153163 24994 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.157809 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.158228 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.158533 21636 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:43.158830 21638 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:07:43.160060 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.164235 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.160254 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.137223 24995 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:43.173126 21635 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:43.175047 24995 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.132154 24972 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.178170 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:43.179035 21487 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:43.179139 24972 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:43.179395 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.180562 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.181241 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:43.181646 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.182761 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:43.183166 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:43.183763 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:43.184333 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:43.184755 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:43.185611 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.186164 21638 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:43.187163 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.187687 21638 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:43.183907 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:43.178556 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:43.153874 24746 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.186205 24957 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.190763 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.198293 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.200976 21636 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:43.199206 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.199353 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:43.203091 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:43.203214 21641 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:43.203370 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:43.207096 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:43.204196 21487 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:07:43.206744 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:43.210907 21491 raft_consensus.cc:2368] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10.
I20260709 13:07:43.211156 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:43.209664 21639 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:43.215250 21638 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:43.211747 21489 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:43.213177 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.203034 24995 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:43.220151 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:43.221771 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:43.233600 21637 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:43.173318 24913 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:43.238484 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:43.202924 22239 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:43.217017 24856 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.227159 24710 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:07:43.243705 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.202829 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:43.252524 22242 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:43.265761 21493 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.269001 21487 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
W20260709 13:07:43.260912 24949 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.586s	user 0.002s	sys 0.010s
I20260709 13:07:43.251148 24773 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:43.242370 24957 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.276005 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.276290 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.308943 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.325137 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.332204 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:43.333877 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.341265 21639 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:07:43.342032 21490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1457) took 1697 ms (client timeout 1885 ms). Trace:
W20260709 13:07:43.342471 21490 rpcz_store.cc:269] 0709 13:07:41.515515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.515752 (+   237us) service_pool.cc:224] Handling call
0709 13:07:43.204391 (+1688639us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400089b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:43.212788 (+  8397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3177310464}
I20260709 13:07:43.326198 24773 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.359603 21491 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:43.369396 21637 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:43.373500 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:43.375098 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.375370 21606 leader_election.cc:400] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10.
I20260709 13:07:43.375973 21606 leader_election.cc:403] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:43.376853 21642 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:43.376032 21635 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:43.385782 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:43.327241 24949 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:43.389492 21641 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.389043 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:43.390764 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.389887 21493 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:43.385967 24994 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:43.400686 24949 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:43.400792 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.400424 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:43.402841 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:43.404539 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:43.404966 24994 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.405018 24876 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:43.405413 24995 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.405486 24994 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.405718 24876 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:43.406716 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:43.409191 24774 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.411755 24774 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:43.413765 24774 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:43.414222 24945 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.414723 24945 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.416836 24945 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:43.405905 24995 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.397689 25001 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:43.398360 24856 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10.
I20260709 13:07:43.406001 24994 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:43.429381 21640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.012s	sys 0.041s
W20260709 13:07:43.438690 21640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.012s	sys 0.041s
I20260709 13:07:43.440749 24710 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:43.440979 24949 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.442162 24710 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:43.442899 24710 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.444876 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:43.406004 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:43.429441 24995 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:43.430505 24998 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.004s
W20260709 13:07:43.456207 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 50262.8us
I20260709 13:07:43.455451 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:43.456385 24856 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.455245 24949 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:43.523857 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 309539us
I20260709 13:07:43.538148 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:43.485355 21459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.025s	sys 0.029s
W20260709 13:07:43.552767 21459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.025s	sys 0.029s
W20260709 13:07:43.531644 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 318326us
W20260709 13:07:43.484983 21569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.022s	sys 0.030s
I20260709 13:07:43.457197 24913 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:43.554489 21569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.022s	sys 0.031s
I20260709 13:07:43.483839 24746 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:43.553138 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 705909us
I20260709 13:07:43.536262 24945 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.524587 24856 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.575524 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:43.552223 21608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.615s (SENT) [suppressed 26 similar messages]
I20260709 13:07:43.556244 25010 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:43.517287 24998 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:43.584282 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 309457us
I20260709 13:07:43.563179 24949 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:43.575289 24724 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.581013 24856 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.626690 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2344) took 1146 ms. Trace:
I20260709 13:07:43.627171 21569 rpcz_store.cc:276] 0709 13:07:42.480417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.497252 (+ 16835us) service_pool.cc:224] Handling call
0709 13:07:42.497613 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.497964 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:42.885365 (+387401us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.626323 (+740958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.626380 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:43.626429 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.626495 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.626630 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40376,"prepare.queue_time_us":505232,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":71974,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":1022097,"threads_started":2}
I20260709 13:07:43.614935 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:43.631319 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.634473 21641 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:43.609954 24972 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:43.670434 21639 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:43.670642 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 216906us
I20260709 13:07:43.631175 24867 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:43.652436 24941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.002s	sys 0.018s
I20260709 13:07:43.594748 25010 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.694084 25010 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:43.650226 25001 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:43.657754 24724 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.632553 24746 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.570182 24876 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:43.686739 25025 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
W20260709 13:07:43.674091 25037 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
I20260709 13:07:43.602345 24945 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.708757 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:43.712540 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:43.739133 21567 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:07:43.730845 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49062.6us
W20260709 13:07:43.740177 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 187998us
W20260709 13:07:43.682571 24941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.002s	sys 0.018s
W20260709 13:07:43.727705 25028 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:07:43.710162 24596 consensus_meta.cc:287] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.004s
I20260709 13:07:43.742092 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:43.743762 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1464) took 1276 ms. Trace:
W20260709 13:07:43.755717 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 179485us
I20260709 13:07:43.754935 21485 rpcz_store.cc:276] 0709 13:07:42.460861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.465169 (+  4308us) service_pool.cc:224] Handling call
0709 13:07:42.499414 (+ 34245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.556646 (+ 57232us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:43.099331 (+542685us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.737332 (+638001us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.737380 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:43.737425 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.737486 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.737607 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":665006,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":43,"raft.queue_time_us":150231,"thread_start_us":1055104,"threads_started":3}
I20260709 13:07:43.757660 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:43.760293 21642 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.749475 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2349) took 1267 ms. Trace:
W20260709 13:07:43.743589 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 179032us
I20260709 13:07:43.694763 25010 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:43.720623 24746 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.717985 24994 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:43.795821 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 220348us
I20260709 13:07:43.808343 21640 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: [8.5-11.6]
I20260709 13:07:43.749508 24972 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:43.727686 24710 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:43.804589 25025 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:43.828325 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:43.821916 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:43.834758 21642 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:43.827405 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:43.841559 21485 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:43.803735 25011 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:43.839736 21490 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:43.847777 21489 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:43.773782 21561 rpcz_store.cc:276] 0709 13:07:42.481869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.509385 (+ 27516us) service_pool.cc:224] Handling call
0709 13:07:42.509714 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.510028 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:42.876242 (+366214us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.736244 (+860002us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.749073 (+ 12829us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:43.749149 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.749234 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.749402 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":315816,"prepare.queue_time_us":498705,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":319368,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7140,"thread_start_us":886396,"threads_started":3,"wal-append.queue_time_us":660745}
I20260709 13:07:43.695298 24949 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.755270 24596 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:43.696566 25001 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:43.854260 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:43.855126 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:43.861917 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.810525 24991 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:43.852861 25047 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:07:43.918390 24596 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:43.918912 24794 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:43.862243 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:43.920822 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58697.3us
I20260709 13:07:43.920631 24972 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.870651 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2335) took 1278 ms. Trace:
I20260709 13:07:43.923079 22244 raft_consensus.cc:2368] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8.
I20260709 13:07:43.921873 21563 rpcz_store.cc:276] 0709 13:07:42.382098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.439976 (+ 57878us) service_pool.cc:224] Handling call
0709 13:07:42.456455 (+ 16479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.456765 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:42.829788 (+373023us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.211697 (+381909us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.371543 (+159846us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b18003f0700. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef5522 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:07:43.559653 (+188110us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b18003f0700. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:07:43.659590 (+ 99937us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.659777 (+   187us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:43.659939 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.660223 (+   284us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.660659 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206730,"prepare.queue_time_us":556264,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":73,"raft.queue_time_us":369895,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":13682,"spinlock_wait_cycles":13365120,"thread_start_us":829705,"threads_started":3,"wal-append.queue_time_us":554202}
I20260709 13:07:43.924616 24710 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:43.924751 24876 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:43.925323 24710 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:43.872493 24946 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:43.928536 24946 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:43.928978 24946 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.925355 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:43.933950 24998 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:43.935920 24994 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:43.937040 24773 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.006s
I20260709 13:07:43.937495 24773 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:43.840804 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:43.913614 21491 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.944391 24746 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:43.945744 24746 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:43.914019 21486 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:43.956118 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 115464us
I20260709 13:07:43.957607 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:43.919931 25033 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:43.936086 24945 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:43.816383 25010 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:43.958323 24991 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:43.959067 25047 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:43.906967 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:43.966064 21494 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:43.913924 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 139036us
I20260709 13:07:43.967267 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:43.961681 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:43.946292 24746 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:43.999730 21567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2355) took 1358 ms (client timeout 1601 ms). Trace:
I20260709 13:07:44.003873 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:44.006855 21569 raft_consensus.cc:2393] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:44.000177 21567 rpcz_store.cc:269] 0709 13:07:42.646511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.646679 (+   168us) service_pool.cc:224] Handling call
0709 13:07:43.999510 (+1352831us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54002224d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:43.999660 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903515008}
I20260709 13:07:44.005169 21491 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:44.015259 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:44.016078 21561 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.972174 24867 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.971131 24991 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:44.009114 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47465us
W20260709 13:07:44.040525 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 238324us
I20260709 13:07:44.010437 24945 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:44.010855 25047 consensus_queue.cc:1243] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:44.052950 21639 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:44.043067 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:44.012784 24957 consensus_meta.cc:287] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.001s
W20260709 13:07:44.077199 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 74225.5us
W20260709 13:07:44.077471 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 66163.4us
I20260709 13:07:44.078285 21459 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.078732 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:44.053630 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 132173us
W20260709 13:07:44.075017 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 262714us
I20260709 13:07:44.023159 24867 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.085005 21486 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:44.085337 21643 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:44.081934 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.084303 22241 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:43.910849 25011 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.025840 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:44.082255 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.085347 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:44.013406 25053 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.023958 24773 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:44.088599 24867 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.091516 25059 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:07:44.092517 24957 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:44.092937 25046 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.093019 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:44.093708 25011 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:44.076359 24913 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.100905 24794 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.101807 24746 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:44.103587 25010 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:44.085121 24945 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:44.105670 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:44.043744 24991 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.122102 21494 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
W20260709 13:07:44.122622 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44402.9us
I20260709 13:07:44.124665 21561 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:07:44.124572 24856 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.132951 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:44.187870 22245 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:44.133332 25050 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:44.121206 24466 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.134975 25057 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:44.121054 25047 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:44.141600 24995 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.003s
I20260709 13:07:44.126012 25053 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.231115 25053 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.231060 24995 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.233517 24995 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:44.155133 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 79613.3us
W20260709 13:07:44.235975 25027 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.639s	user 0.001s	sys 0.002s
I20260709 13:07:44.236646 25061 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:44.237218 25061 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:44.174899 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 82014us
I20260709 13:07:44.174752 25060 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:44.238965 21642 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:44.239560 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:44.240064 25061 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:44.240734 25061 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.240805 21608 leader_election.cc:400] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:44.241266 21608 leader_election.cc:403] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:44.143939 24957 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:44.242260 24957 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.243937 21638 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.175387 25065 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.203377 24773 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:07:44.173812 24746 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.246551 24746 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:44.210988 25057 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.249116 25057 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:44.220255 24945 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.223224 25064 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.269820 25064 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:44.272904 25064 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:44.223973 25056 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
W20260709 13:07:44.229804 25070 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:07:44.145262 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 63966.4us
I20260709 13:07:44.274964 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.237406 25011 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:44.245855 24773 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:44.155478 25046 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:44.156687 24794 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:44.267095 22212 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:44.199252 25050 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:44.158067 24913 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.284941 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:44.181485 24946 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:44.267160 25057 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:44.302007 21643 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:44.300437 24856 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:44.303648 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:44.310200 25054 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:44.310684 25054 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.311051 25054 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.311513 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:44.277839 24773 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:44.331732 22244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 622) took 1127 ms. Trace:
I20260709 13:07:44.331815 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.332442 22244 rpcz_store.cc:276] 0709 13:07:43.180269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.184551 (+  4282us) service_pool.cc:224] Handling call
0709 13:07:44.307653 (+1123102us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54006c02d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:44.307853 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696343424}
I20260709 13:07:44.333995 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.286921 24794 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.280052 25046 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.336800 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:44.317577 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 50573.7us
W20260709 13:07:44.337760 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 133989us
I20260709 13:07:44.313063 25060 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:44.334897 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 99204.6us
I20260709 13:07:44.336545 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.341686 21490 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.342020 21486 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:44.300297 24466 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:44.344718 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:44.292817 25069 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:44.291241 25064 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:44.347157 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.352161 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:44.355571 21487 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.278031 25068 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:07:44.353472 21639 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.355913 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.346258 21491 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:44.356719 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:44.358067 21486 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:44.290968 24972 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:07:44.300846 24724 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:44.367092 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:44.339576 24945 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.374962 21643 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:44.359707 25079 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:44.360232 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:44.361214 25032 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:44.367058 25062 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:44.368268 24946 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:44.380615 24946 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.359048 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.381067 24867 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.381727 21494 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:44.303143 25026 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:07:44.381127 24946 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.384809 24946 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:44.385325 24946 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:44.376634 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:44.385658 24957 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.347612 25060 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:44.386981 25079 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.387866 25063 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.387532 25060 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.388372 25063 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:44.347265 24466 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.389462 24466 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.347386 24941 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:44.398679 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:44.398746 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.332424 25057 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.357436 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:44.414088 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 65609.6us
I20260709 13:07:44.418845 25062 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:44.420024 25062 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:44.423550 24941 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:44.432143 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:44.433506 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:44.434095 21490 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.434193 21487 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:07:44.430338 21639 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:44.436852 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:44.437115 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.447968 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.448642 21493 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:44.450855 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.454571 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:44.455286 21639 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:44.431308 24941 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:44.466691 24867 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:44.438994 22239 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:44.450313 25079 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:44.476034 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.466857 25065 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:44.491709 25065 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:44.492688 25065 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.452142 24466 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.495702 25057 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:44.496908 24466 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:44.499279 24941 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:44.500692 24941 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.506044 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.509672 21490 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:44.459209 24991 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.511454 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:44.513197 25063 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:44.533743 24794 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.526436 25053 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.536859 25053 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:44.512696 21457 leader_election.cc:400] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8.
I20260709 13:07:44.592976 21457 leader_election.cc:403] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:07:44.591792 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 101092us
W20260709 13:07:44.585312 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.594763 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.596777 21459 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:44.598423 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 257263us
I20260709 13:07:44.599349 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:44.514174 24466 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.600313 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:44.605170 21459 leader_election.cc:400] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8.
I20260709 13:07:44.606043 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:44.604744 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 96161.7us
I20260709 13:07:44.563556 24949 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.610213 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:44.552968 24991 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:44.613500 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.616065 25057 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.603066 24466 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:44.616353 25068 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:44.616171 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:44.617365 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:44.639469 21640 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.623013 25064 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:44.616158 25081 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:44.626183 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.627115 25089 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:44.627625 25001 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.611020 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:44.541715 25046 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:44.601810 25026 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.601986 24957 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:44.640383 24994 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.602607 25069 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.624155 21634 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.642340 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:44.607388 24876 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8.
I20260709 13:07:44.542203 25054 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.641273 24466 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.648710 24794 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:44.604060 25053 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:44.655053 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44128.4us
I20260709 13:07:44.656941 21640 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:44.609117 25043 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:44.637848 25057 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:44.643393 24710 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.662542 24994 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.660480 25069 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.663542 25047 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:44.661759 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:44.677747 24913 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:44.677865 25054 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:44.657537 25001 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:44.671379 24746 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:44.618628 24773 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.671891 25046 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:44.667183 25064 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:44.698020 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.700387 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.701802 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.747622 21567 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:44.747959 21569 raft_consensus.cc:2410] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:44.703295 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:44.660241 25089 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:44.748659 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 108249us
I20260709 13:07:44.729771 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.731148 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:44.731225 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 69498.1us
I20260709 13:07:44.659451 24991 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:44.752363 21566 raft_consensus.cc:2368] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
W20260709 13:07:44.732338 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 106216us
I20260709 13:07:44.744115 24794 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:44.741539 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.751322 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:44.740669 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.743621 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.744117 25001 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.753317 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:44.757493 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.758383 21567 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:44.757505 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.705435 25057 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.730317 25047 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:44.759652 21564 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:44.729399 25069 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.730466 24710 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.751235 21561 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:44.740661 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.750670 21560 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:44.744418 24746 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:44.760912 21565 raft_consensus.cc:2368] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:44.749935 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.746552 25087 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.778344 24994 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:44.778985 24994 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:44.779357 21562 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:44.779893 24994 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.781009 25054 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:44.782848 25047 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.784286 25047 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.775069 24945 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:44.789048 24945 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:44.789223 25043 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:44.789686 25043 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:44.798936 25089 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.803323 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.804845 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.805591 21562 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:44.805415 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.805842 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:44.806706 21565 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:44.778499 24746 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:44.810940 25087 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:44.811772 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.812080 24746 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.812973 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:44.813241 25087 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:44.813668 21562 raft_consensus.cc:2368] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11.
I20260709 13:07:44.771575 24991 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:44.815135 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.790346 24945 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.815668 24991 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.820173 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.821298 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.822151 21566 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:44.788093 24773 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.865242 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.760730 24794 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.865061 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:44.772505 24710 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.751732 25064 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:44.866240 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.869675 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.705286 25053 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:44.886132 21561 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
W20260709 13:07:44.889407 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 84064.3us
I20260709 13:07:44.892379 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:44.893833 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:44.894196 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:44.894836 21566 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:07:44.880049 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 101943us
I20260709 13:07:44.860934 24946 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.914145 25011 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:44.914722 25011 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:44.915179 25011 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.919785 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:44.904318 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:44.922430 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:44.923069 21567 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.884999 24794 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.952560 25069 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:44.956722 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.926335 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:44.932400 25001 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.961346 21564 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:44.961953 25001 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:44.962965 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:44.963656 21638 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.964351 25081 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:44.964957 25081 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.934366 21568 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:44.934719 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:44.967756 21565 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:44.934746 25079 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.939252 21566 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:44.939437 25050 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:44.940789 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:44.941478 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:44.977932 21490 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:44.943125 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.944000 25095 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:44.944221 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:44.988863 21486 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:44.945394 25026 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:44.946280 25065 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:44.948987 24876 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:44.974225 21638 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:44.985961 21634 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:44.790506 25043 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.029054 25095 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:45.032404 25064 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.043978 21566 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:45.057842 21640 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:45.059044 22244 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:44.887948 25053 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:45.061331 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 141634us
I20260709 13:07:45.066627 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.068141 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:45.036901 25050 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.075611 21567 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:07:45.083570 25093 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:07:45.086908 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.027215 24876 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:45.060444 24466 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.042805 25066 consensus_queue.cc:1059] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:07:45.062568 25065 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:45.103152 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.103487 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:45.087303 25089 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:45.037271 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:45.076422 25043 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.130631 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.028237 25026 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.111110 25047 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:45.056649 24710 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.156924 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:45.165789 24466 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:45.157938 25001 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.171175 25001 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.173393 25001 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:45.163403 25045 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.174335 25045 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.176043 25065 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:45.176380 25045 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:45.176518 25095 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.178153 25087 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.181137 25026 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:45.181639 25081 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.183588 24857 raft_consensus.cc:3055] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:45.184016 24857 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:45.163787 25069 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:45.185945 22242 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:45.129868 25089 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:45.152855 25079 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:45.158303 24946 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:45.201234 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:45.202104 21486 raft_consensus.cc:2393] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:45.126736 24794 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.205801 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:45.218621 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:45.207373 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 50535.5us
I20260709 13:07:45.208487 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:45.232440 21489 raft_consensus.cc:2410] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:45.233211 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:45.233395 21486 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:45.210090 21485 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:45.204545 24946 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:45.191335 25089 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.245270 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:45.251911 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:45.253669 21486 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:45.194211 25069 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:45.262858 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:45.263796 21635 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:45.265220 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:45.266049 21486 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.268441 24991 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.269001 21493 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:45.270876 25011 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.271879 21643 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:45.273056 25011 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:45.259419 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:45.275878 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:45.276682 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:45.277927 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:45.278666 21636 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.280706 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:45.281391 21642 raft_consensus.cc:2368] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10.
I20260709 13:07:45.185396 24857 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.251914 25064 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:45.279942 25069 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:45.290272 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.304317 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.257243 24946 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.309749 21566 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:45.314679 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 81537.6us
I20260709 13:07:45.315733 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.317873 21490 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:45.318465 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:45.319793 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 278093us
I20260709 13:07:45.322811 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.323279 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:45.306286 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:45.329181 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:45.324023 21568 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:45.340020 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:45.340943 21568 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:45.334954 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:45.341863 21561 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:45.342535 21493 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:45.336575 21459 leader_election.cc:400] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11.
I20260709 13:07:45.342268 21565 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:45.343350 21459 leader_election.cc:403] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:45.344779 21459 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:45.346149 21491 raft_consensus.cc:2393] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:45.337218 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.285881 25045 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:45.342549 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:45.307552 25064 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.356144 21459 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:45.355679 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49640.4us
I20260709 13:07:45.360833 21457 leader_election.cc:400] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10.
I20260709 13:07:45.361239 21457 leader_election.cc:403] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:45.224874 24876 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.330446 25011 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:45.389416 21486 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:07:45.302944 25049 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:07:45.342221 25087 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:45.306486 24957 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:07:45.317499 24746 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:07:45.306176 25065 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:07:45.356232 24857 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.335592 24913 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:07:45.359638 25047 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:45.361346 25026 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.371178 24773 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:45.336051 25079 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:07:45.401504 25087 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:45.414908 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:45.432021 24876 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.390915 24466 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11.
I20260709 13:07:45.364400 25064 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.443300 24710 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:45.393572 25011 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:45.460325 25065 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:45.460712 25053 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:45.461995 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:45.464319 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:45.465847 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.473688 25060 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.434664 25081 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:45.432276 25101 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:45.438377 21390 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 245) took 27177 ms (client timeout 15000 ms). Trace:
I20260709 13:07:45.447353 24773 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.403091 21561 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:45.456889 25087 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.451917 25054 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:45.520212 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.520562 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.535742 24794 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:45.505105 25011 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.504628 25065 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:45.555894 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 218736us
I20260709 13:07:45.537926 24773 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.567950 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:45.548642 24957 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.574029 25102 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:07:45.576040 24710 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:45.576463 24710 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:45.577495 24710 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:45.579331 25103 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:07:45.584836 22242 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:07:45.529765 21390 rpcz_store.cc:269] 0709 13:07:18.261335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.261587 (+   252us) service_pool.cc:224] Handling call
0709 13:07:18.873817 (+612230us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4c090 00007f98a9feaf3a 00007f98afda11cc 00007f98afe9f37e 00007f98ae3602a4 00007f98ae360232 00007f98ae360161 00007f98ae3600dc 00007f98ae35f392 00007f98a831d48c 00007f98a831c8c6
0709 13:07:45.438276 (+26564459us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:43.026053 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:43.026713 (+   660us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:43.026767 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:07:43.026810 (+    43us) tablet.cc:662] Decoding operations
0709 13:07:43.033359 (+  6549us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:43.033452 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:43.033485 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:43.033778 (+   293us) tablet.cc:701] Row locks acquired
0709 13:07:43.033822 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:07:43.033986 (+   164us) write_op.cc:270] Start()
0709 13:07:43.034161 (+   175us) write_op.cc:276] Timestamp: P: 1783602463033919 usec, L: 0
0709 13:07:43.034191 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:07:43.034929 (+   738us) log.cc:844] Serialized 544 byte log entry
0709 13:07:44.227158 (+1192229us) op_driver.cc:464] REPLICATION: finished
0709 13:07:44.412298 (+185140us) write_op.cc:301] APPLY: starting
0709 13:07:44.412453 (+   155us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:44.412596 (+   143us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:44.412740 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:44.418748 (+  6008us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:44.419077 (+   329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:44.419122 (+    45us) write_op.cc:312] APPLY: finished
0709 13:07:44.419443 (+   321us) log.cc:844] Serialized 23 byte log entry
0709 13:07:44.419657 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:44.419756 (+    99us) write_op.cc:454] Released schema lock
0709 13:07:44.419810 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:44.420220 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:44.420252 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":88433,"reported_tablets":46,"spinlock_wait_cycles":56620416,"child_traces":[["op",{"apply.queue_time_us":120224,"apply.run_cpu_time_us":2363,"apply.run_wall_time_us":44823,"num_ops":1,"prepare.queue_time_us":529631,"prepare.run_cpu_time_us":34177,"prepare.run_wall_time_us":556691,"raft.queue_time_us":457795,"raft.run_cpu_time_us":18264,"raft.run_wall_time_us":131688,"replication_time_us":1192723,"thread_start_us":1232621,"threads_started":4,"wal-append.queue_time_us":597356,"wal-append.run_cpu_time_us":38784,"wal-append.run_wall_time_us":1775813}]]}
I20260709 13:07:45.585115 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:45.586246 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 258894us
I20260709 13:07:45.433871 24984 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.159s
I20260709 13:07:45.598233 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.538576 25060 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.571534 24991 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.595851 24913 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:45.612483 24698 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:45.613646 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.617815 24698 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:45.619185 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:45.619581 25047 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.619997 24698 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:45.620296 25047 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:45.619732 24913 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.621222 25047 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:45.623597 25105 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:45.624104 24913 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:45.624289 25060 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:45.626052 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:45.626287 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:45.627512 24984 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:45.626693 22241 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.627933 24984 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.628372 24984 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:45.630401 25050 consensus_meta.cc:287] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.000s
I20260709 13:07:45.634192 25065 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.635492 25065 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.635645 22241 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:45.600348 24710 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.648675 21563 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:07:45.649489 21563 pending_rounds.cc:85] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 5
I20260709 13:07:45.649786 21563 pending_rounds.cc:107] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:07:45.650063 21563 raft_consensus.cc:2889] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.598845 25069 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:45.672252 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:45.655113 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:45.678184 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 317543us
I20260709 13:07:45.679502 25069 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:45.679524 21636 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:45.591601 24957 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.682825 21567 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:45.645844 25060 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:45.647220 25045 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:45.675787 25050 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:45.704634 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 348540us
I20260709 13:07:45.705716 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:45.687343 24913 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:45.746914 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 142749us
I20260709 13:07:45.752506 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:45.753197 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:45.716596 25050 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:45.732925 25097 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.733124 25116 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.768035 21493 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:45.768374 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:45.770287 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:45.760540 25057 consensus_meta.cc:287] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.897s	user 0.011s	sys 0.001s
I20260709 13:07:45.773211 21490 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:45.746603 24913 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:45.771716 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:45.746119 25053 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:45.779636 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.783283 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:45.783970 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:45.788208 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:45.734213 25060 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.786624 21485 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:45.794234 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.769552 25121 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.774343 25049 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:45.827607 25049 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:45.828263 25121 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.828840 25049 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.803112 21608 leader_election.cc:400] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:45.805148 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:45.808202 25112 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:45.831863 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.832746 25112 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:45.760195 25087 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.835028 25087 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:45.772145 25116 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.838073 25116 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:45.838604 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.786581 25057 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.815681 25114 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:45.816286 25050 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.823743 25053 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.824599 25117 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:45.796716 24794 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:45.826700 25060 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:45.833088 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.792845 25120 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:45.876821 21608 leader_election.cc:400] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:45.877282 21608 leader_election.cc:403] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:45.862483 25089 consensus_meta.cc:287] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
W20260709 13:07:45.872095 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.830688 25121 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:45.876266 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:45.880029 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:45.882799 21492 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:45.880095 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:45.859113 24746 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.889781 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:45.893215 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:45.883074 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:45.885145 21489 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:45.895702 21641 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:45.900143 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:45.845937 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:45.901589 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:45.898274 21561 raft_consensus.cc:2368] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10.
I20260709 13:07:45.912669 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:45.915856 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 45473.4us
I20260709 13:07:45.910734 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:45.917207 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:45.917624 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:45.914053 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:45.918484 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.919993 21639 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:45.920838 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:45.902665 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:45.842180 24984 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.924340 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:45.925798 21566 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:45.926276 24984 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:45.927063 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:45.927186 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:45.927665 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:45.878708 25120 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:45.884469 25112 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:45.932715 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:45.927966 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:45.934196 21639 raft_consensus.cc:2368] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10.
I20260709 13:07:45.881547 25079 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.929528 21636 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:45.935681 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:45.929060 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.937582 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.912542 25050 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.799860 25045 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.937091 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 1979) took 1131 ms. Trace:
I20260709 13:07:45.940574 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:45.941226 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:45.942585 25052 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.937114 25060 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:45.986132 25060 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.985597 25052 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:45.988327 25052 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:45.988966 24876 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.936808 25114 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:45.990159 24710 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.990821 25114 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.945592 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:45.993291 22242 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:45.962364 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:45.996941 21640 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:45.875036 25064 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:45.998018 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 198216us
I20260709 13:07:45.919925 22239 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
W20260709 13:07:45.995786 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 50313.4us
I20260709 13:07:46.000305 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:46.000514 21459 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:46.001286 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:45.934278 25121 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:07:46.002799 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:45.896890 25089 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.891516 24773 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:45.962007 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:46.009539 21637 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:46.007562 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:46.004837 25043 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.850s	user 0.008s	sys 0.005s
I20260709 13:07:46.004460 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:45.943010 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:45.936646 25063 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:45.937191 25120 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:45.994143 25046 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.009s	sys 0.006s
I20260709 13:07:46.011121 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:46.000918 21560 rpcz_store.cc:276] 0709 13:07:44.803889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.820947 (+ 17058us) service_pool.cc:224] Handling call
0709 13:07:44.890413 (+ 69466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:44.905579 (+ 15166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.905675 (+    96us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:44.927187 (+ 21512us) log.cc:844] Serialized 52 byte log entry
0709 13:07:45.190311 (+263124us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:45.519537 (+329226us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.935080 (+415543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.935191 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.935248 (+    57us) raft_consensus.cc:1685] finished
0709 13:07:45.935268 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.935395 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":492069,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3983,"raft.queue_time_us":114368,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":48013,"thread_start_us":960754,"threads_started":3,"wal-append.queue_time_us":440993}
I20260709 13:07:46.019862 21492 raft_consensus.cc:2410] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:46.019879 21640 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.011507 21639 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:45.915544 24746 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.010533 21642 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:45.928239 25081 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:07:46.016682 25049 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:46.031430 25049 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:46.031883 25049 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.032459 24746 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:46.021600 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:46.023980 21564 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:46.035765 25081 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.036542 25081 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:46.039054 21638 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:45.935745 25112 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:46.041209 21639 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:46.042936 21639 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:46.026083 21532 leader_election.cc:400] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10.
I20260709 13:07:45.999934 25087 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:46.025170 25046 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.010s	sys 0.007s
I20260709 13:07:46.017450 25100 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:07:46.048417 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:46.044258 21639 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:46.048009 21640 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:46.048964 21532 leader_election.cc:403] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:46.053216 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:46.056170 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:46.057215 21563 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:46.064862 21637 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:46.065162 25139 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.067785 21560 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:46.070567 22244 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:46.071280 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:45.922179 24913 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:46.072880 21485 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:46.052235 24946 consensus_meta.cc:287] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.000s
I20260709 13:07:46.047371 25087 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.045305 25112 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.943002 25079 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.039391 25011 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.003398 25131 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:07:46.094358 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:46.083549 24946 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.101691 25117 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:46.103865 25060 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:46.106266 24773 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:46.070813 25116 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10.
I20260709 13:07:46.107973 25120 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.055583 24876 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 13:07:46.109405 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.111092 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 173586us
W20260709 13:07:46.084295 25135 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:46.082273 25087 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.112103 21561 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:46.108536 25079 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:46.077198 25081 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.029476 25063 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:46.085074 25136 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:46.111580 25057 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:46.151261 24876 consensus_queue.cc:1243] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:46.167618 25120 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:46.169188 25011 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:46.110060 25054 consensus_meta.cc:287] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.001s
I20260709 13:07:46.170022 25054 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10.
I20260709 13:07:46.171391 25064 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:46.171805 25144 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:46.153453 21569 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:46.111796 25131 consensus_queue.cc:1243] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:46.179251 21494 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:46.159549 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:46.161767 25112 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.163997 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:46.183611 21563 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:46.164206 25140 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:07:46.165346 25089 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:46.165717 25063 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:46.153378 25046 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:46.185302 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:46.188345 21563 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:46.191572 25120 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:46.191977 25120 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:46.192368 25120 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.196334 24946 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:46.196869 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:46.200670 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:46.158455 25114 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.199301 21636 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:46.206187 25112 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:46.186980 25064 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.219524 22244 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:46.223281 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:46.225095 21608 leader_election.cc:400] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10.
I20260709 13:07:46.225592 21608 leader_election.cc:403] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:46.225219 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:46.227501 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:46.190285 25046 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:46.232764 25060 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:46.235787 25146 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10.
I20260709 13:07:46.165726 25081 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:46.252795 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:46.294811 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 169991us
I20260709 13:07:46.300133 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:46.232563 25057 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.222690 25114 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:46.301843 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:46.376372 25049 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.429510 25065 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:07:46.437283 25001 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:07:46.480976 21494 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: [8.5-11.6]
I20260709 13:07:46.481253 25065 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:46.481600 25065 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:46.482069 25049 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:46.306559 25119 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:46.482388 25065 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.324748 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:46.376224 25120 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.484676 21489 raft_consensus.cc:1217] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-7.4]   Dedup: 7.4->[]
I20260709 13:07:46.485234 21489 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:46.485329 25120 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:46.439069 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:46.486282 21563 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:46.472493 24913 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.486599 21489 raft_consensus.cc:1217] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[6.5-8.6]   Dedup: 6.5->[8.6-8.6]
I20260709 13:07:46.254904 24991 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.226s
W20260709 13:07:46.483489 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.487191 21489 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
W20260709 13:07:46.487614 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.415576 25081 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:46.340713 25153 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:07:46.472666 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 170893us
I20260709 13:07:46.491114 24945 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:46.491557 24945 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:46.459532 25069 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:46.492444 24945 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.492929 25069 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.493573 24945 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.495085 25069 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:46.496078 24991 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.496579 24991 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.497085 24913 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:46.373922 25087 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.499125 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:46.499642 25149 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:07:46.500022 24913 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.500182 25087 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:46.361649 21565 raft_consensus.cc:2410] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:46.501730 21635 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:46.501919 21566 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:46.502295 21566 pending_rounds.cc:85] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 5
I20260709 13:07:46.502496 21566 pending_rounds.cc:107] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:46.502732 21566 raft_consensus.cc:2889] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.503199 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:46.503805 21635 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:46.505311 21635 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:46.505776 24991 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:46.473016 21637 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:46.511807 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 636) took 1061 ms. Trace:
W20260709 13:07:46.512863 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.515199 21486 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:46.515426 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:46.516381 25120 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.516585 21486 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:46.519446 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2380) took 1211 ms. Trace:
I20260709 13:07:46.519959 21569 rpcz_store.cc:276] 0709 13:07:45.308516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.308658 (+   142us) service_pool.cc:224] Handling call
0709 13:07:45.308960 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.183467 (+874507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.519156 (+335689us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54000181d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:46.519374 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1941753216}
I20260709 13:07:46.526280 24957 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:46.513684 24913 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.531042 21490 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:46.531752 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2385) took 1221 ms. Trace:
I20260709 13:07:46.592516 24913 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.593191 21567 rpcz_store.cc:276] 0709 13:07:45.310114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.311094 (+   980us) service_pool.cc:224] Handling call
0709 13:07:45.311323 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.685901 (+374578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.531518 (+845617us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54003ea654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:46.531695 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785725696}
I20260709 13:07:46.533095 25053 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:46.594570 25053 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:46.594884 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 79545us
I20260709 13:07:46.595543 25053 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.596554 25053 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.534555 21491 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:46.456925 24994 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:46.598169 24994 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:46.599072 24994 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.600255 24994 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.604473 21567 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:46.604753 21569 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:46.534627 22239 rpcz_store.cc:276] 0709 13:07:45.450001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.463973 (+ 13972us) service_pool.cc:224] Handling call
0709 13:07:46.511667 (+1047694us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54006dc754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:46.511751 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877686528}
I20260709 13:07:46.535578 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2386) took 1225 ms. Trace:
W20260709 13:07:46.513060 25143 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.514s	user 0.005s	sys 0.006s
I20260709 13:07:46.605754 21564 rpcz_store.cc:276] 0709 13:07:45.310403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.310856 (+   453us) service_pool.cc:224] Handling call
0709 13:07:45.311799 (+   943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.035188 (+723389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.535283 (+500095us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b540028a0d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:46.535501 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638948608}
I20260709 13:07:46.537963 24991 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:46.445154 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:46.607867 21568 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:46.435497 25091 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:46.608003 24991 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:46.441545 25108 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.901s	user 0.002s	sys 0.002s
I20260709 13:07:46.612581 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1960) took 1671 ms. Trace:
I20260709 13:07:46.613050 24991 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:46.612972 21487 rpcz_store.cc:276] 0709 13:07:44.941260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.943584 (+  2324us) service_pool.cc:224] Handling call
0709 13:07:45.061677 (+118093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.107160 (+ 45483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.107205 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.122190 (+ 14985us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.346346 (+224156us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:45.346425 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.346606 (+   181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.440803 (+1094197us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:46.612282 (+171479us) raft_consensus.cc:1685] finished
0709 13:07:46.612300 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.612511 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47827,"raft.queue_time_us":39831,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":33192,"spinlock_wait_cycles":9374592,"thread_start_us":223637,"threads_started":1,"wal-append.queue_time_us":332392}
I20260709 13:07:46.326875 25046 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:46.478609 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:46.616073 21638 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:46.616878 21493 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
W20260709 13:07:46.569592 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.586057 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:46.590415 24972 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.619206 24972 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:46.621400 24972 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:46.622152 22242 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:46.624428 21569 pending_rounds.cc:85] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 4
I20260709 13:07:46.625468 21569 pending_rounds.cc:107] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:46.625808 21569 raft_consensus.cc:2889] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.627278 25046 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.633388 24913 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:46.641269 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:46.591699 21486 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:46.611146 25091 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:46.642964 25091 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.643939 25065 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.644178 25091 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.644685 21457 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:46.645746 25026 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:46.646163 25026 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:46.655517 25026 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.423781 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 511) took 1005 ms. Trace:
I20260709 13:07:46.664371 21641 rpcz_store.cc:276] 0709 13:07:45.418474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.419426 (+   952us) service_pool.cc:224] Handling call
0709 13:07:45.446707 (+ 27281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.914585 (+467878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.423453 (+508868us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54002648d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:46.423699 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032091904}
I20260709 13:07:46.648998 24991 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.650034 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:46.559700 21636 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:46.685981 24991 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:46.687014 24957 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.687647 24957 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:46.650954 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 61159.5us
I20260709 13:07:46.691340 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:46.692385 24949 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:46.693475 24991 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:46.693434 25091 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:46.695520 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:46.699717 25091 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:46.695561 24949 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:46.700650 24949 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:46.618235 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:46.701481 24949 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.670114 22242 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:46.676925 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:46.702700 24949 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.703004 24913 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:46.703519 24913 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.703917 24913 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.679953 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:46.702008 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 83881.9us
I20260709 13:07:46.704540 21568 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:46.684695 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 185651us
I20260709 13:07:46.706135 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:46.706384 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:46.666031 21392 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 11, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:46.679188 21562 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:07:46.707266 21562 pending_rounds.cc:85] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 5
I20260709 13:07:46.707593 21562 pending_rounds.cc:107] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:46.707870 21562 raft_consensus.cc:2889] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.304648 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:46.707055 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:46.717865 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:46.308183 21485 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:46.720682 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:46.720851 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:46.720572 21392 catalog_manager.cc:5697] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 8, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 8 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:46.721380 21642 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:46.722205 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:46.722138 21392 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 8, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.723311 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:46.728807 21392 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 7, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 7 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:46.732040 25118 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:46.733342 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 60483.4us
I20260709 13:07:46.252180 25112 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.738022 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:46.761176 21639 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.740511 21392 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:46.747344 22210 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:46.763265 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:46.763162 21392 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.764576 21392 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 8, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.765879 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:46.301705 25045 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.766650 21485 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:46.315757 25060 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.759493 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:46.766849 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:46.775409 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:46.302126 25146 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.766765 21392 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 6, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 6 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:46.769375 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:46.315853 25151 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:46.793820 21392 catalog_manager.cc:5697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 7, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 7 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.805858 21566 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:46.783114 21642 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:46.788975 21639 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:46.735102 25053 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.790675 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:46.822218 21636 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:07:46.791322 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:46.823601 21487 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:46.728221 24991 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:46.796151 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.743518 25050 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:46.790722 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:46.834283 21641 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:46.734136 25047 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:46.799952 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:46.803800 21392 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 4 to 5, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 5 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:46.844810 21392 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 6, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 6 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:46.825601 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:46.825878 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:46.846805 21488 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.828112 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:46.847142 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 141456us
W20260709 13:07:46.832166 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 100043us
W20260709 13:07:46.832818 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.837288 21638 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.822151 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:46.848361 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:46.823947 25064 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.848847 21489 raft_consensus.cc:2410] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:46.733944 25087 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:07:46.730048 24945 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:07:46.863865 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:46.851912 21491 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:46.852150 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:46.853058 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.846252 21392 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 8, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 8 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:46.766371 25138 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:07:46.821523 24466 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:46.858196 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.858441 21564 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:07:46.859560 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 59720us
I20260709 13:07:46.830816 25053 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.877835 25053 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.766255 25066 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:07:46.849088 25106 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.867285 21392 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 7, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 7 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:46.869426 21638 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:46.795344 25118 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:46.780731 24994 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:07:46.792886 25045 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.799196 25154 consensus_queue.cc:1059] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:07:46.827464 25151 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:46.889387 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 132747us
I20260709 13:07:46.899470 21392 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 3 to 6, term changed from 5 to 7, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132), 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:07:46.893508 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 145796us
I20260709 13:07:46.796336 25060 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:46.871199 25069 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:46.849782 25097 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:46.873917 25172 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:46.854718 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:46.905927 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 158661us
I20260709 13:07:46.930264 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:46.931252 22242 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:46.897022 24466 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:46.903359 24991 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:46.946183 21634 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:46.911080 21392 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:46.864037 25169 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:07:46.932390 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 77768.6us
I20260709 13:07:46.937781 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:46.963682 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:46.964516 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:46.905927 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:46.892176 25100 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.909276 24957 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:46.966100 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 60268us
I20260709 13:07:46.970670 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:46.967113 21392 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:46.945053 25171 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.974959 21392 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.901201 25155 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:07:46.985270 25026 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.987488 25100 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:46.989640 25100 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:46.990850 25171 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:46.991322 25171 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.992161 25151 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:46.992897 25114 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:46.993865 25165 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:46.983572 24466 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:46.987550 25026 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:46.967837 25164 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:07:46.977494 21392 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.974915 25065 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:47.009488 25065 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.009889 25065 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.953416 24991 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:47.010269 21392 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.011638 24991 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.011875 21392 catalog_manager.cc:5697] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 5, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 5 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:47.012669 24991 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.013549 21392 catalog_manager.cc:5697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.980104 25179 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:46.929245 25172 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:46.982828 25060 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:46.983639 25176 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:47.020745 21488 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:47.022713 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:47.024376 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:46.921603 25043 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 13:07:47.029994 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.035508 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.031816 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:47.031352 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:47.048635 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.030575 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:47.049306 25050 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:47.050272 25050 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:46.999188 25049 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:47.035085 21392 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:47.061057 21392 catalog_manager.cc:5697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 2 to 4, term changed from 1 to 8, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130), 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.069082 21643 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:47.020183 25176 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.019815 25087 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:47.069597 21392 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 6, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 6 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:47.071463 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:47.074311 21392 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:47.075649 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:47.034914 25179 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:47.077957 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:47.079329 21485 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:47.079514 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 141823us
I20260709 13:07:47.081466 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:47.082099 21485 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:47.081806 21392 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 2 to 8, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 8 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:47.090610 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:47.079649 24994 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:47.072172 25176 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.091470 21488 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.033293 25175 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:07:47.073014 25087 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:47.095770 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:47.079597 25026 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:47.101888 21485 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.108162 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:47.110492 21568 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:47.111722 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:47.089277 25118 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.114373 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:47.116173 21488 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:47.116206 21491 raft_consensus.cc:2368] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:47.079185 24949 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:07:47.121687 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:47.094560 24994 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:47.103974 25087 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.136140 21491 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:47.028950 25172 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:47.137921 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.106346 25026 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.170212 25026 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.135851 24994 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.122656 25118 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.177778 25118 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:47.149961 21485 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:07:47.137133 24984 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:47.154317 25065 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:47.116473 25171 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.204478 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:47.154528 25179 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.156700 25049 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.159461 25053 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:47.163903 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:47.168540 24466 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:47.169525 25172 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:47.218703 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.149034 21487 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
W20260709 13:07:47.214835 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51031.5us
I20260709 13:07:47.223905 21637 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:47.227515 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:47.212638 25045 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:47.216248 25174 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:47.227489 25053 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:47.181000 25182 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:07:47.203338 24984 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:47.239810 25173 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.239732 25100 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.239733 25060 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:47.243986 25185 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.242103 25066 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:47.217136 25049 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.229887 25026 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:47.275004 25106 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.304939 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.339128 25190 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:07:47.343075 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45332.7us
W20260709 13:07:47.328073 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53426.1us
I20260709 13:07:47.349236 21491 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:47.343014 25193 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:47.289958 25173 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:47.413223 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.417114 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:47.417783 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:47.421483 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:47.418435 21569 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:47.421969 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:47.388418 24913 consensus_meta.cc:287] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.000s
I20260709 13:07:47.424088 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:47.426070 21567 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:47.428727 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:47.369194 25193 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:47.323052 25185 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.431310 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:47.492146 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 134125us
I20260709 13:07:47.512852 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:47.298859 25060 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:47.437438 21561 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:47.337424 25106 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:47.298655 25100 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:47.517881 21567 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:47.523679 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:47.420305 25186 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:47.433926 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:47.329015 25066 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:47.514276 25108 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:07:47.534544 21562 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:07:47.548463 22241 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:47.432575 24913 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.563249 25181 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:47.563896 25181 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:47.848368 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 332752us
W20260709 13:07:47.839438 25172 consensus_meta.cc:287] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.005s
I20260709 13:07:47.875656 25173 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:47.788754 25026 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:47.616568 24984 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:47.876389 21568 raft_consensus.cc:2410] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:07:47.607072 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.877198 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:47.598503 25196 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:47.878334 22246 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:47.749027 25049 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:47.878674 25196 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.652977 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1497) took 1734 ms. Trace:
I20260709 13:07:47.565248 25097 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.633299 25181 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:47.664146 25192 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 13:07:47.880298 25097 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:47.847218 25066 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:47.881664 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2421) took 1076 ms. Trace:
W20260709 13:07:47.882712 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.882046 21565 rpcz_store.cc:276] 0709 13:07:46.804775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.804895 (+   120us) service_pool.cc:224] Handling call
0709 13:07:46.850591 (+ 45696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.063642 (+213051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.063681 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.064136 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.293194 (+229058us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:47.293246 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.293331 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.881477 (+588146us) raft_consensus.cc:1685] finished
0709 13:07:47.881496 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.881609 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2898,"raft.queue_time_us":44039,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5771,"thread_start_us":411796,"threads_started":2,"wal-append.queue_time_us":278538}
I20260709 13:07:47.617571 25185 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:47.623272 25193 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:47.885193 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.885385 22213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.006s
W20260709 13:07:47.885732 22213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.003s	sys 0.006s
I20260709 13:07:47.667569 25001 raft_consensus.cc:3055] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:47.886322 25001 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:47.887272 25001 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.888247 25001 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.662683 25065 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:47.664544 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:47.621225 25197 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:47.892191 21494 rpcz_store.cc:276] 0709 13:07:45.918848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.482024 (+563176us) service_pool.cc:224] Handling call
0709 13:07:46.482310 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.933850 (+451540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.933880 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.933917 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:46.933945 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.652635 (+718690us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540002dfd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:47.652704 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.652890 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038020992}
I20260709 13:07:47.630584 25100 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:47.565623 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:07:47.752530 25087 consensus_meta.cc:287] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 13:07:47.895012 25087 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:47.898572 21485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.001s	sys 0.009s
I20260709 13:07:47.880975 25196 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:47.898960 21485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.001s	sys 0.009s
W20260709 13:07:47.746871 25163 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.814s	user 0.005s	sys 0.000s
I20260709 13:07:47.539474 25171 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:47.564967 24913 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:47.845405 24994 consensus_meta.cc:287] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.000s
W20260709 13:07:47.746217 25195 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:07:47.543678 25186 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.847777 25206 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.905081 25087 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:47.927325 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 392340us
I20260709 13:07:47.874042 25060 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:47.903838 24941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.005s	sys 0.013s
W20260709 13:07:47.907308 21392 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.013s	sys 0.005s
I20260709 13:07:47.874183 25106 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:47.959833 21392 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.013s	sys 0.005s
I20260709 13:07:47.905576 25185 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:07:47.961143 24941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.005s	sys 0.013s
I20260709 13:07:47.975777 25155 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.977862 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 70810.8us
I20260709 13:07:47.990815 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:47.976369 25186 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:47.976361 25155 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:47.981002 24913 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:47.960481 25206 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:47.933082 24994 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:48.000278 25176 consensus_meta.cc:287] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.891s	user 0.011s	sys 0.000s
I20260709 13:07:47.998773 24945 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.000439 24972 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.010281 25204 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.226s	user 0.000s	sys 0.002s
W20260709 13:07:48.023046 24991 consensus_meta.cc:287] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 1.010s	user 0.004s	sys 0.009s
I20260709 13:07:48.042500 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:48.043295 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:48.023664 24945 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.078351 22245 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:48.012646 24913 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:48.047735 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.052086 25206 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:48.024343 25066 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:48.054400 25097 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:48.056087 25120 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:48.062776 21642 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:48.094650 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 660749us
I20260709 13:07:48.095614 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:48.096237 21642 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:48.097007 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:48.025522 24972 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.063966 21457 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:48.081305 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:48.083003 25155 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:48.088333 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.105775 21641 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:48.099885 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:48.105121 21635 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:48.109542 25065 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:48.105527 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:48.110322 21642 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.110134 25065 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.111949 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:48.112628 21635 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:48.113058 25118 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:48.114193 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:48.114849 21489 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:48.117731 21642 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:07:48.119017 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.119488 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:48.120195 21562 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:48.120338 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:48.120976 25171 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.118829 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:48.121883 21487 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:48.121623 25171 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:48.127540 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:48.128599 25171 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:48.122568 25087 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:48.124205 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:48.129428 25087 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.128163 21642 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:48.129503 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:48.131822 25087 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:48.121119 21561 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:48.123972 25053 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.133188 25049 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.133006 25053 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.133867 25049 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.135944 25053 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:48.136453 25049 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:48.126436 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:48.137319 21488 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:48.137511 25155 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.138137 25155 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.138605 25155 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.140087 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:48.103814 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:48.143427 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:48.144428 21639 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:48.133023 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:48.145776 21486 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:48.078527 25154 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:48.094727 25001 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.125216 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:48.153110 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:48.097711 25146 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.132385 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:48.164253 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:48.159950 21494 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:48.149358 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:48.168651 21561 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:48.022509 25176 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:48.174822 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:48.176716 21561 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:07:48.178081 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45014.8us
I20260709 13:07:48.178843 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:48.178943 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:48.180975 25046 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:48.094273 25066 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:48.148389 22240 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:48.153743 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.166210 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:48.105018 25060 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.150857 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:48.198096 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47372.7us
I20260709 13:07:48.198884 21606 leader_election.cc:400] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:48.199177 21606 leader_election.cc:403] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:48.181552 25147 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:48.166265 25223 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:07:48.183869 21563 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.184670 24972 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:48.186553 25176 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:48.187186 22242 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:48.187307 24945 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:48.187553 24994 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:48.104655 25185 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:48.187938 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:48.109583 25183 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.112315 25065 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:48.226397 25196 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7.
I20260709 13:07:48.188428 25146 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.162312 25181 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:48.293531 25181 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.293955 25181 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.294555 25146 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:48.276594 22238 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.180891 25049 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:48.187969 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:48.102077 25120 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.213521 24949 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:48.228621 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:48.234211 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:48.186911 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:50.338719 21565 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:50.339211 21565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2430) took 2189 ms (client timeout 2401 ms). Trace:
W20260709 13:07:50.339540 21565 rpcz_store.cc:269] 0709 13:07:48.149915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.151311 (+  1396us) service_pool.cc:224] Handling call
0709 13:07:50.339151 (+2187840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.197093 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:48.192907 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.591876 21561 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:07:50.592439 21561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2440) took 2411 ms (client timeout 1899 ms). Trace:
W20260709 13:07:50.592803 21561 rpcz_store.cc:269] 0709 13:07:48.181321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.192634 (+ 11313us) service_pool.cc:224] Handling call
0709 13:07:50.592367 (+2399733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.163407 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:50.594162 21636 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.190006 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:50.599494 21639 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
W20260709 13:07:50.600109 21639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2285) took 2410 ms (client timeout 1876 ms). Trace:
W20260709 13:07:50.600484 21639 rpcz_store.cc:269] 0709 13:07:48.189606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.189774 (+   168us) service_pool.cc:224] Handling call
0709 13:07:50.600003 (+2410229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:50.601624 21639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2286) took 2410 ms (client timeout 1500 ms). Trace:
W20260709 13:07:50.601953 21639 rpcz_store.cc:269] 0709 13:07:48.191534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.601403 (+2409869us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:50.601543 (+   140us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:48.190809 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:48.301048 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:48.307945 22245 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:48.408679 21568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
W20260709 13:07:50.605660 22245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 651) took 2428 ms (client timeout 1899 ms). Trace:
W20260709 13:07:50.606138 22245 rpcz_store.cc:269] 0709 13:07:48.177722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.202415 (+ 24693us) service_pool.cc:224] Handling call
0709 13:07:50.605566 (+2403151us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:48.455391 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.607396 21608 connection.cc:256] RPC call timeout handler was delayed by -2.0910043349999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 13:07:50.607709 21608 connection.cc:256] RPC call timeout handler was delayed by -2.0127043349999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:07:50.608084 21608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.688s (SENT) [suppressed 9 similar messages]
W20260709 13:07:49.005597 22238 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.012s
I20260709 13:07:49.015223 25246 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:50.608978 21636 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:50.609181 22238 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:07:50.609666 21636 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2280) took 2538 ms (client timeout 2401 ms). Trace:
I20260709 13:07:49.019646 25248 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.609447 25246 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.610376 25248 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.612193 25246 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:49.018311 25247 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.613196 25247 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.615794 25247 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:49.020645 25249 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:49.042681 22210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.012s	sys 0.021s
I20260709 13:07:49.029974 25250 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:50.616964 25250 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:49.729972 21637 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:07:50.621369 21637 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2275) took 2559 ms (client timeout 1530 ms). Trace:
W20260709 13:07:50.610126 21636 rpcz_store.cc:269] 0709 13:07:48.071123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.106679 (+ 35556us) service_pool.cc:224] Handling call
0709 13:07:50.609586 (+2502907us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.813434 25251 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:49.835026 25254 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:50.236611 21489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.094s	user 0.018s	sys 0.027s
W20260709 13:07:50.623198 21489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.481s	user 0.019s	sys 0.027s
I20260709 13:07:50.623148 25254 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.623812 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2288) took 2431 ms. Trace:
W20260709 13:07:50.244122 21532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.140s	user 0.030s	sys 0.045s
W20260709 13:07:50.624409 21532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.520s	user 0.030s	sys 0.045s
W20260709 13:07:50.624814 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 2.52841e+06us
I20260709 13:07:50.625695 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:49.886615 25255 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:50.626818 25255 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.628871 25118 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.629139 25255 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.249188 25259 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:50.629946 25259 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.631935 25259 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.631613 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:50.632470 25259 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:50.633890 25259 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:50.634347 25259 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:50.249320 25256 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:50.635075 25256 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.636920 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:50.637308 25256 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.251070 25260 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.637801 25264 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.638132 25260 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.640334 25260 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.252832 25258 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:50.640959 25258 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.641312 25069 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.641415 25264 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:50.641942 25069 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.643712 25258 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.643966 25069 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.645133 25258 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.645622 25258 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.646078 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2437) took 2465 ms. Trace:
W20260709 13:07:50.253671 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.264940 21607 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.036s	user 0.006s	sys 0.028s
W20260709 13:07:50.647141 21607 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.418s	user 0.007s	sys 0.028s
I20260709 13:07:50.647974 25264 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.280684 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2002) took 2857 ms. Trace:
W20260709 13:07:50.254595 21638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.052s	user 0.005s	sys 0.024s
W20260709 13:07:50.649019 21638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.446s	user 0.006s	sys 0.024s
I20260709 13:07:50.649919 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2269) took 2610 ms. Trace:
I20260709 13:07:50.648490 21569 rpcz_store.cc:276] 0709 13:07:47.423062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.423240 (+   178us) service_pool.cc:224] Handling call
0709 13:07:47.423628 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.967034 (+543406us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:47.977257 (+ 10223us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.132744 (+155487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.132795 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:48.132837 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.278540 (+2145703us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54000a1254. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:50.278596 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.280573 (+  1977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29255,"prepare.queue_time_us":13145,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":30755,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"spinlock_wait_cycles":1248977152,"thread_start_us":128337,"threads_started":1,"wal-append.queue_time_us":298327,"wal-append.run_cpu_time_us":1234,"wal-append.run_wall_time_us":1001271}
W20260709 13:07:50.287317 21457 connection.cc:256] RPC call timeout handler was delayed by -1.6610554710000542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 13:07:50.650246 21638 rpcz_store.cc:276] 0709 13:07:48.039628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.040031 (+   403us) service_pool.cc:224] Handling call
0709 13:07:48.040313 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.040513 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:48.049302 (+  8789us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.649579 (+2600277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.649632 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:50.649684 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.649742 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.649868 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9058,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":50,"raft.queue_time_us":77098,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":129,"thread_start_us":2599913,"threads_started":2,"wal-append.queue_time_us":281785,"wal-append.run_cpu_time_us":1395,"wal-append.run_wall_time_us":1023648}
I20260709 13:07:50.307999 25262 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:50.309213 21606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.107s	user 0.010s	sys 0.026s
W20260709 13:07:50.652411 21606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.450s	user 0.011s	sys 0.026s
I20260709 13:07:50.292341 21635 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
W20260709 13:07:50.315971 22211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.087s	user 0.000s	sys 0.032s
I20260709 13:07:50.652319 25262 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:50.652866 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 2.45267e+06us
W20260709 13:07:50.653122 22211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.427s	user 0.000s	sys 0.032s
I20260709 13:07:50.653630 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:50.310058 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2270) took 2270 ms. Trace:
I20260709 13:07:50.341187 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.347385 22244 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:50.351845 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2273) took 2291 ms. Trace:
W20260709 13:07:50.353363 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 2.12466e+06us
I20260709 13:07:50.353657 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 646) took 2316 ms. Trace:
I20260709 13:07:48.254874 24945 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:50.351222 24994 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.174199 25001 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.226847 25046 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:50.286603 25049 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.222258 25060 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.285825 25065 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:50.286237 25091 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.197093 25066 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:50.285370 25114 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:48.355031 25120 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:48.405045 25181 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.277510 25201 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:50.353245 25225 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:48.107440 24876 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:48.291689 24913 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:48.233531 24941 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:48.319736 24949 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.223810 25043 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.287159 25097 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:50.284332 25100 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:50.284905 25117 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:48.200644 25147 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.166942 25154 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.350572 25155 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.222958 25173 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:48.271930 25185 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:48.331389 25193 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.280457 25196 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:50.240547 25202 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:50.559592 22240 consensus_meta.cc:287] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 2.361s	user 0.027s	sys 0.015s
I20260709 13:07:50.563071 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2271) took 2521 ms. Trace:
I20260709 13:07:50.575804 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2438) took 2395 ms. Trace:
W20260709 13:07:50.603895 21642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 542) took 2414 ms (client timeout 1628 ms). Trace:
I20260709 13:07:50.604174 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2429) took 2454 ms. Trace:
W20260709 13:07:50.609781 22238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 649) took 2462 ms (client timeout 2401 ms). Trace:
I20260709 13:07:50.612654 25248 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:50.616557 22210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.391s	user 0.012s	sys 0.021s
W20260709 13:07:50.621721 21637 rpcz_store.cc:269] 0709 13:07:48.061563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.061712 (+   149us) service_pool.cc:224] Handling call
0709 13:07:50.621175 (+2559463us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540009c754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:50.621299 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3727144704}
W20260709 13:07:49.805966 21566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.623s	user 0.012s	sys 0.026s
W20260709 13:07:50.240139 21640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.051s	user 0.028s	sys 0.049s
W20260709 13:07:50.276814 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 2.05464e+06us
I20260709 13:07:50.319199 25263 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.344596 22242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 645) took 3320 ms (client timeout 3182 ms). Trace:
I20260709 13:07:50.728607 25043 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.660025 25260 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:50.730108 25147 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:50.729043 21643 rpcz_store.cc:276] 0709 13:07:48.041619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.041737 (+   118us) service_pool.cc:224] Handling call
0709 13:07:48.044063 (+  2326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.056320 (+ 12257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.056359 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.056762 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.202614 (+145852us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:48.202654 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.202722 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.562763 (+2360041us) raft_consensus.cc:1685] finished
0709 13:07:50.562813 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.563002 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11824,"raft.queue_time_us":12489,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":145475,"threads_started":1,"wal-append.queue_time_us":218534,"wal-append.run_cpu_time_us":1520,"wal-append.run_wall_time_us":1001549}
I20260709 13:07:50.730254 25260 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.731382 25263 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.732795 21568 raft_consensus.cc:606] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:50.733222 21568 raft_consensus.cc:614] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:50.733178 22238 rpcz_store.cc:269] 0709 13:07:48.147525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.151958 (+  4433us) service_pool.cc:224] Handling call
0709 13:07:50.609717 (+2457759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24448}
I20260709 13:07:50.734644 25264 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.735526 24949 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.735488 25049 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.732399 25046 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.737046 25264 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.737015 25097 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.658107 25219 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:50.738402 21491 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.716025 24972 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.739543 25001 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:50.740257 21640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.551s	user 0.029s	sys 0.051s
I20260709 13:07:50.739748 24941 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.679888 25259 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.655336 25251 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.742102 24941 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:50.742319 24876 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:50.742959 25219 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.655172 21564 raft_consensus.cc:2410] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:50.652812 25069 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.747952 25069 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.743335 24876 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.748822 25196 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.625753 25254 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.619633 25250 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.749742 25060 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:50.643239 21636 rpcz_store.cc:276] 0709 13:07:48.192814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.622843 (+2430029us) service_pool.cc:224] Handling call
0709 13:07:50.623207 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.623396 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.623419 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.623458 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:50.623492 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.623544 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.623757 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.658488 25175 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:50.751708 25196 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.752496 25181 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:50.753347 24994 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:50.731159 22242 rpcz_store.cc:269] 0709 13:07:47.024019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.024140 (+   121us) service_pool.cc:224] Handling call
0709 13:07:50.344318 (+3320178us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003b3b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:50.344490 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2672491264}
I20260709 13:07:50.728826 22240 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:50.755883 22240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 647) took 2658 ms. Trace:
I20260709 13:07:50.755602 25117 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.756341 25251 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.756310 22240 rpcz_store.cc:276] 0709 13:07:48.097851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.098046 (+   195us) service_pool.cc:224] Handling call
0709 13:07:48.148223 (+ 50177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.755650 (+2607427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.755831 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.746488 21491 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:07:50.758098 25117 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.646510 21563 rpcz_store.cc:276] 0709 13:07:48.180510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.314203 (+2133693us) service_pool.cc:224] Handling call
0709 13:07:50.314547 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.644599 (+330052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.644643 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.644699 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:50.644741 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.645859 (+  1118us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54000a2154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:50.645897 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.646023 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758483712}
W20260709 13:07:50.745833 21642 rpcz_store.cc:269] 0709 13:07:48.189288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.190534 (+  1246us) service_pool.cc:224] Handling call
0709 13:07:50.603827 (+2413293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.745765 25100 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.760094 25185 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:50.760469 25100 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.737695 25049 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.748296 24913 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.761404 24913 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.762238 25069 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.763696 24913 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:50.763908 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 119508us
I20260709 13:07:50.764101 21459 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:50.766006 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:50.766006 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.766834 25201 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:50.767360 25201 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:50.767859 25065 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.768239 25155 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:50.655010 21635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2283) took 2530 ms (client timeout 1918 ms). Trace:
I20260709 13:07:50.768886 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:50.769644 21494 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:50.769937 25065 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.769994 25155 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.732751 25260 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:50.767082 25091 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.770859 21641 rpcz_store.cc:276] 0709 13:07:48.060790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.061849 (+  1059us) service_pool.cc:224] Handling call
0709 13:07:48.096590 (+ 34741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.106187 (+  9597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.351561 (+2245374us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b5400219b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:50.351783 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20248320}
I20260709 13:07:50.773149 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:50.654664 25262 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:50.744354 21566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.561s	user 0.012s	sys 0.034s
I20260709 13:07:50.729701 21634 rpcz_store.cc:276] 0709 13:07:48.039929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.040716 (+   787us) service_pool.cc:224] Handling call
0709 13:07:48.041009 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.056255 (+ 15246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.056299 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.056762 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.203301 (+146539us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:48.203343 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.203405 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.309730 (+2106325us) raft_consensus.cc:1685] finished
0709 13:07:50.309763 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.309962 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14805,"raft.queue_time_us":15366,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":146139,"threads_started":1,"wal-append.queue_time_us":185664,"wal-append.run_cpu_time_us":2083,"wal-append.run_wall_time_us":1035956}
I20260709 13:07:50.738987 25202 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.734223 22239 rpcz_store.cc:276] 0709 13:07:48.037025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.048060 (+ 11035us) service_pool.cc:224] Handling call
0709 13:07:48.048422 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:48.093754 (+ 45332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.096087 (+  2333us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:48.188508 (+ 92421us) log.cc:844] Serialized 52 byte log entry
0709 13:07:48.378098 (+189590us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:48.378502 (+   404us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.353293 (+1974791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.353375 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.353424 (+    49us) raft_consensus.cc:1685] finished
0709 13:07:50.353439 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.353579 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1973733,"prepare.queue_time_us":172,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1988004,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":15927,"thread_start_us":189115,"threads_started":1,"wal-append.queue_time_us":182205,"wal-append.run_cpu_time_us":3315,"wal-append.run_wall_time_us":1008586}
I20260709 13:07:50.775154 25091 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.752089 25175 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:50.769227 21635 rpcz_store.cc:269] 0709 13:07:48.124714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.129282 (+  4568us) service_pool.cc:224] Handling call
0709 13:07:50.654841 (+2525559us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400264dd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:50.654947 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4969114368}
I20260709 13:07:50.775595 22244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 502) took 3255 ms. Trace:
I20260709 13:07:50.806716 22244 rpcz_store.cc:276] 0709 13:07:47.519845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.519976 (+   131us) service_pool.cc:224] Handling call
0709 13:07:50.347173 (+2827197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.752701 (+405528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.775406 (+ 22705us) spinlock_profiling.cc:243] Waited 2.83 s on lock 0x7b54003b3b50. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:50.775535 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6501195520}
I20260709 13:07:50.744167 25114 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:50.759784 21491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 1991) took 2655 ms (client timeout 1530 ms). Trace:
I20260709 13:07:50.745334 21567 rpcz_store.cc:276] 0709 13:07:48.149591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.151416 (+  1825us) service_pool.cc:224] Handling call
0709 13:07:48.151813 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.164996 (+ 13183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.165040 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.582287 (+2417247us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b2c00010da8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:07:50.582826 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.601060 (+ 18234us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:50.601110 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.601194 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.603781 (+  2587us) raft_consensus.cc:1685] finished
0709 13:07:50.603806 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.604048 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12665,"raft.queue_time_us":15136,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":10396,"spinlock_wait_cycles":27970304,"thread_start_us":17754,"threads_started":1,"wal-append.queue_time_us":19175}
I20260709 13:07:50.735956 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35370 (request call id 42) took 2507 ms. Trace:
W20260709 13:07:50.748307 21564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2433) took 2569 ms (client timeout 3358 ms). Trace:
W20260709 13:07:50.814957 21564 rpcz_store.cc:269] 0709 13:07:48.179373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.191612 (+ 12239us) service_pool.cc:224] Handling call
0709 13:07:50.748123 (+2556511us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b5400128754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:50.748253 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147971328}
I20260709 13:07:50.750547 25060 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:50.616576 25249 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.795136 21494 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:50.798345 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:50.798691 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:50.801891 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.823783 21488 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 8: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:50.739830 24972 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.730875 21565 rpcz_store.cc:276] 0709 13:07:48.180769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.340285 (+2159516us) service_pool.cc:224] Handling call
0709 13:07:50.340624 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.356868 (+ 16244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:50.564562 (+207694us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.572421 (+  7859us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.572873 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.573019 (+   146us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:50.573054 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.573143 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.575587 (+  2444us) raft_consensus.cc:1685] finished
0709 13:07:50.575612 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.575745 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14291,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":16448,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":181,"thread_start_us":230567,"threads_started":3,"wal-append.queue_time_us":6839}
W20260709 13:07:50.812311 21491 rpcz_store.cc:269] 0709 13:07:48.104196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.139727 (+ 35531us) service_pool.cc:224] Handling call
0709 13:07:50.759583 (+2619856us) spinlock_profiling.cc:243] Waited 2.6 s on lock 0x7b54003fa054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:50.759682 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5973866880}
I20260709 13:07:50.814097 21568 rpcz_store.cc:276] 0709 13:07:48.228111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.406123 (+178012us) service_pool.cc:224] Handling call
0709 13:07:50.735789 (+2329666us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54000177d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fdc853 00007f98aefaa60a 00007f98a85307d4 00007f98a8530762 00007f98a8530691 00007f98a853060c 00007f98a852f8c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:50.735902 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292286208}
I20260709 13:07:50.842336 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2277) took 2778 ms. Trace:
W20260709 13:07:50.820585 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 168511us
W20260709 13:07:50.830476 21608 connection.cc:256] RPC call timeout handler was delayed by -1.9524043349999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 13:07:50.846297 21608 connection.cc:256] RPC call timeout handler was delayed by -1.6641386960000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:07:50.846735 21608 connection.cc:256] RPC call timeout handler was delayed by -1.6050043349999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2323s for a response
W20260709 13:07:50.847196 21608 connection.cc:256] RPC call timeout handler was delayed by -1.531204334999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2405s for a response
W20260709 13:07:50.847609 21608 connection.cc:256] RPC call timeout handler was delayed by -1.517621599999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:07:50.848028 21608 connection.cc:256] RPC call timeout handler was delayed by -1.5096043349999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2429s for a response
W20260709 13:07:50.848438 21608 connection.cc:256] RPC call timeout handler was delayed by -1.5042043349999403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24350000000000002s for a response
W20260709 13:07:50.848883 21608 connection.cc:256] RPC call timeout handler was delayed by -1.4637043349999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.248s for a response
W20260709 13:07:50.850806 22210 connection.cc:256] RPC call timeout handler was delayed by -1.5587227949999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:07:50.851343 22210 connection.cc:256] RPC call timeout handler was delayed by -1.3626421149999715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 13:07:50.851742 22210 connection.cc:256] RPC call timeout handler was delayed by -1.201542115000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 13:07:50.852124 22210 connection.cc:256] RPC call timeout handler was delayed by -1.1003371969999307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:07:50.852490 22210 connection.cc:256] RPC call timeout handler was delayed by -1.1003371969999307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:07:50.852859 22210 connection.cc:256] RPC call timeout handler was delayed by -1.0470713779999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 13:07:50.849985 25185 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.734225 25263 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.724197 21389 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 6 to 7, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129), now has a pending config: VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131), VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129), VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130), VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 7 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:07:50.858520 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 204967us
I20260709 13:07:50.859067 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:50.859395 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:50.650442 25258 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:50.806176 25173 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:50.755937 24994 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.868927 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.883262 21488 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:50.869942 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.870827 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.871820 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.884933 21494 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:50.885154 21490 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:07:50.872742 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.876971 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:50.877846 21392 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 235) took 8124 ms. Trace:
I20260709 13:07:50.875866 21562 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:50.886523 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:50.886484 21392 rpcz_store.cc:276] 0709 13:07:42.738352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.738522 (+   170us) service_pool.cc:224] Handling call
0709 13:07:50.862899 (+8124377us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:47.975325 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:47.975910 (+   585us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:47.975945 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:07:47.975963 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:48.004949 (+ 28986us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:48.005013 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:48.005042 (+    29us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:07:48.057660 (+ 52618us) tablet.cc:701] Row locks acquired
0709 13:07:48.057681 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:48.057907 (+   226us) write_op.cc:270] Start()
0709 13:07:48.058960 (+  1053us) write_op.cc:276] Timestamp: P: 1783602468057844 usec, L: 0
0709 13:07:48.058994 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:07:48.227523 (+168529us) log.cc:844] Serialized 10393 byte log entry
0709 13:07:48.418632 (+191109us) op_driver.cc:464] REPLICATION: finished
0709 13:07:48.423697 (+  5065us) write_op.cc:301] APPLY: starting
0709 13:07:48.423804 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:48.424172 (+   368us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:48.424346 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:48.426912 (+  2566us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:48.427751 (+   839us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 13:07:48.427799 (+    48us) write_op.cc:312] APPLY: finished
0709 13:07:48.428160 (+   361us) log.cc:844] Serialized 176 byte log entry
0709 13:07:48.428346 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:48.429018 (+   672us) write_op.cc:454] Released schema lock
0709 13:07:48.429110 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:48.429681 (+   571us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:48.429720 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36054,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":4803,"apply.run_cpu_time_us":4936,"apply.run_wall_time_us":5945,"num_ops":26,"prepare.queue_time_us":625092,"prepare.run_cpu_time_us":17653,"prepare.run_wall_time_us":414122,"raft.queue_time_us":914,"raft.run_cpu_time_us":4180,"raft.run_wall_time_us":4992,"replication_time_us":359470,"spinlock_wait_cycles":12544,"thread_start_us":735886,"threads_started":4,"wal-append.queue_time_us":180301,"wal-append.run_cpu_time_us":4186,"wal-append.run_wall_time_us":1017129}]]}
I20260709 13:07:50.893879 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.894980 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.850136 25001 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:50.849891 25257 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:50.899967 21608 connection.cc:256] RPC call timeout handler was delayed by -1.0721025100000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
I20260709 13:07:50.895929 21565 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:07:50.897833 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:50.893977 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.856305 25185 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.896652 21492 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
W20260709 13:07:50.897436 21532 connection.cc:256] RPC call timeout handler was delayed by -3.0796596179999369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 13:07:50.865024 25154 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.920884 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:50.864070 25049 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:50.927485 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1994) took 2796 ms. Trace:
I20260709 13:07:50.925047 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:50.931226 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.924099 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:50.863435 25060 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:50.940606 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.942225 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.942655 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.943230 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.950024 21561 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:50.896533 25117 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:50.920305 25262 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:50.935292 21389 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.934906 21489 rpcz_store.cc:276] 0709 13:07:48.115843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.116497 (+   654us) service_pool.cc:224] Handling call
0709 13:07:48.116787 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.117992 (+  1205us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:48.141981 (+ 23989us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.638568 (+2496587us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.911814 (+273246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.911888 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:50.911952 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.912048 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.912215 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33271,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":8682,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":1945,"thread_start_us":2768857,"threads_started":3,"wal-append.queue_time_us":266761,"wal-append.run_cpu_time_us":1064,"wal-append.run_wall_time_us":1001096}
I20260709 13:07:50.963027 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:50.944605 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.964484 21569 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:50.945117 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:50.901995 25263 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:50.956228 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.957195 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.955935 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.900980 25001 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.985306 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:50.985687 25001 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.986164 25249 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:50.768265 25201 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.920166 25240 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:50.926482 25258 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:50.923142 25181 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:50.903546 24913 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:50.973079 21567 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:50.888280 25091 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:07:50.984658 25262 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.970526 21563 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:50.965970 25117 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.997782 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:50.998059 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 97068.3us
I20260709 13:07:51.070220 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:51.092998 21567 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.098397 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:51.099346 21565 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:51.044315 25173 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.954119 25260 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:51.068393 24913 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.986574 25277 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:51.119446 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:51.110860 21568 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:51.002955 21389 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 5 to 6, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 6 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.025400 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:51.077243 25284 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:07:51.077845 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:50.842993 21640 rpcz_store.cc:276] 0709 13:07:48.063529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.063706 (+   177us) service_pool.cc:224] Handling call
0709 13:07:48.101529 (+ 37823us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:48.141333 (+ 39804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.141366 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:48.151204 (+  9838us) log.cc:844] Serialized 52 byte log entry
0709 13:07:50.740683 (+2589479us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:50.740981 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.821879 (+ 80898us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.841852 (+ 19973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.842045 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.842099 (+    54us) raft_consensus.cc:1685] finished
0709 13:07:50.842116 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.842267 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23494,"prepare.queue_time_us":17358,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":40699,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":57108,"thread_start_us":2631227,"threads_started":2,"wal-append.queue_time_us":182247,"wal-append.run_cpu_time_us":2242,"wal-append.run_wall_time_us":1005452}
I20260709 13:07:51.079435 25258 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:51.079887 25114 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:51.080282 25155 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.086395 22243 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:51.065794 25283 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:51.065994 25175 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:51.087811 25060 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:50.955919 25154 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:07:51.069921 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:51.091857 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:51.092347 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:50.996145 25263 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:51.159139 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 271246us
W20260709 13:07:51.135922 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 68004.7us
W20260709 13:07:51.134615 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 229526us
I20260709 13:07:51.089504 25117 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.146399 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:51.147640 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2434) took 2968 ms. Trace:
W20260709 13:07:51.145635 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 222632us
I20260709 13:07:51.148691 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:51.146658 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:51.156194 21389 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 7, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 7 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:51.157112 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:51.179082 22240 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:51.178308 22238 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:51.180653 21567 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:51.159117 21564 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
W20260709 13:07:51.197232 22210 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.811s (SENT)
I20260709 13:07:51.089013 25066 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:51.205250 21389 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 6 to 8, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 8 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.207911 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:51.119995 25260 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:51.215772 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:51.215245 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:51.120970 25219 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:51.215399 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:51.234957 21488 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:51.146355 25155 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:51.156339 25287 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.135002 25097 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:51.254528 21489 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:51.156505 25113 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.149127 25283 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:51.258600 22247 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.156091 25280 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:51.122246 25249 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:07:51.176417 25275 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:51.212118 25202 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:51.197062 25261 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:51.273283 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:51.288028 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 342975us
I20260709 13:07:51.300666 21565 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:51.291232 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:51.297662 25282 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260709 13:07:51.298031 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:51.299160 25274 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:07:51.260732 25287 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:51.069365 25240 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:50.924221 25257 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:51.117417 25277 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:51.565934 21639 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.009s	sys 0.008s
W20260709 13:07:51.411919 21562 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2439) took 3230 ms (client timeout 1918 ms). Trace:
W20260709 13:07:51.919750 21639 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.022s	sys 0.011s
W20260709 13:07:51.605015 21491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.006s	sys 0.012s
I20260709 13:07:51.218055 25291 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:51.338824 21606 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:51.395364 21565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
W20260709 13:07:51.318534 25289 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:07:52.174022 25297 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:51.917821 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 720563us
I20260709 13:07:52.176841 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:51.918426 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:51.413182 22243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 504) took 3868 ms (client timeout 1745 ms). Trace:
I20260709 13:07:52.173976 21565 raft_consensus.cc:606] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:52.178316 21607 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.000s	sys 0.014s
I20260709 13:07:51.974550 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:52.179593 21607 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.000s	sys 0.014s
I20260709 13:07:52.179451 21565 raft_consensus.cc:614] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:51.303308 22247 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:07:52.174572 25302 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.088s	user 0.004s	sys 0.001s
I20260709 13:07:52.182240 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.182672 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.183002 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.183358 21636 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:52.183445 21634 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 11: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:52.181046 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:52.178990 22243 rpcz_store.cc:269] 0709 13:07:47.545130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.565390 (+ 20260us) service_pool.cc:224] Handling call
0709 13:07:51.412912 (+3847522us) spinlock_profiling.cc:243] Waited 3.13 s on lock 0x7b540073ebd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:51.413058 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7190360960}
I20260709 13:07:51.177927 21566 rpcz_store.cc:276] 0709 13:07:48.179650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.181534 (+  1884us) service_pool.cc:224] Handling call
0709 13:07:48.181893 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:48.182268 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.182297 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:48.182924 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 13:07:50.775809 (+2592885us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:50.776890 (+  1081us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.147307 (+370417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.147397 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.147436 (+    39us) raft_consensus.cc:1685] finished
0709 13:07:51.147447 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.147583 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":620,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":3854,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":26264,"thread_start_us":2962522,"threads_started":2,"wal-append.queue_time_us":563868,"wal-append.run_cpu_time_us":1567,"wal-append.run_wall_time_us":1001622}
I20260709 13:07:52.186710 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:52.173894 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 835145us
W20260709 13:07:51.412575 22274 debug-util.cc:398] Leaking SignalData structure 0x7b0800372340 after lost signal to thread 20385
W20260709 13:07:52.176052 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 980348us
I20260709 13:07:52.190435 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:51.562371 25100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.010s	sys 0.007s
I20260709 13:07:51.286422 25043 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:51.645648 25181 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:51.268872 25283 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:51.579537 25147 consensus_meta.cc:287] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.002s
I20260709 13:07:52.200747 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:52.201670 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:51.393576 25258 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:51.394914 25066 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:52.189867 22274 debug-util.cc:398] Leaking SignalData structure 0x7b08002e52a0 after lost signal to thread 21426
W20260709 13:07:52.203045 25100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.026s	sys 0.029s
W20260709 13:07:52.130386 25117 consensus_meta.cc:287] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.918s	user 0.005s	sys 0.007s
W20260709 13:07:51.914297 25001 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.928s	user 0.009s	sys 0.002s
I20260709 13:07:51.282590 25113 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:51.283281 25280 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:51.300467 25275 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:51.340514 25261 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:51.403355 25260 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.231587 25262 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:51.631646 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 1989) took 3528 ms. Trace:
I20260709 13:07:52.279917 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1533) took 1309 ms. Trace:
I20260709 13:07:52.232707 25185 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:52.325086 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2287) took 4133 ms. Trace:
I20260709 13:07:52.323082 21487 rpcz_store.cc:276] 0709 13:07:50.970085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.068494 (+ 98409us) service_pool.cc:224] Handling call
0709 13:07:51.069751 (+  1257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.089875 (+ 20124us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:51.124118 (+ 34243us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.611291 (+487173us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.611917 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.612086 (+   169us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:51.612131 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.612223 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.996284 (+384061us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b4800080358. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f 00007f98aeff9f37 00007f98af00e55c 00007f98af00e508 00007f98af00e488 00007f98af00e443 00007f98af00d6ec 00007f98adf37a96
0709 13:07:52.278904 (+282620us) raft_consensus.cc:1685] finished
0709 13:07:52.279141 (+   237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.279622 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":339215,"prepare.queue_time_us":23226,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":8863,"raft.queue_time_us":185428,"raft.run_cpu_time_us":21465,"raft.run_wall_time_us":395428,"spinlock_wait_cycles":14376704,"thread_start_us":258135,"threads_started":1,"wal-append.queue_time_us":934194}
I20260709 13:07:52.281052 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 495) took 1120 ms. Trace:
I20260709 13:07:52.280874 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:52.281831 21533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.013s
I20260709 13:07:52.283635 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.205272 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.339807 21643 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:52.340269 21561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:52.287613 21566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36498
I20260709 13:07:52.341585 21566 raft_consensus.cc:606] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:52.340310 21492 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:52.342103 21566 raft_consensus.cc:614] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:51.946769 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:52.289018 21491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.345s	user 0.013s	sys 0.031s
I20260709 13:07:52.295626 21640 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:52.190274 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:52.203634 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:07:52.198601 22239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.010s
I20260709 13:07:52.351114 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:52.351424 22239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.001s	sys 0.010s
W20260709 13:07:52.351783 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 161468us
I20260709 13:07:52.353325 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 417) took 1232 ms. Trace:
W20260709 13:07:52.176678 21562 rpcz_store.cc:269] 0709 13:07:48.181042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.229749 (+ 48707us) service_pool.cc:224] Handling call
0709 13:07:51.411634 (+3181885us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400127354. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:51.411793 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335383936}
I20260709 13:07:52.297870 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.298210 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:52.355259 21494 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:07:52.353912 22239 rpcz_store.cc:276] 0709 13:07:51.121120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.134144 (+ 13024us) service_pool.cc:224] Handling call
0709 13:07:51.156118 (+ 21974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.156366 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:51.693410 (+537044us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.243906 (+550496us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b18004520e0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:07:52.352426 (+108520us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.352567 (+   141us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:52.352733 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.352891 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.353160 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1083660,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":488,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":317,"spinlock_wait_cycles":4306176,"thread_start_us":1138629,"threads_started":2,"wal-append.queue_time_us":546920}
I20260709 13:07:52.355779 25311 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.202191 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:52.356349 25311 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.356709 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.356956 25311 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.357297 22245 raft_consensus.cc:2410] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:52.357640 21494 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:52.278510 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.358716 21489 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:52.359297 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 502) took 1078 ms. Trace:
I20260709 13:07:52.359824 21489 rpcz_store.cc:276] 0709 13:07:51.280549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.277475 (+996926us) service_pool.cc:224] Handling call
0709 13:07:52.359242 (+ 81767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.360671 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1531) took 1486 ms. Trace:
I20260709 13:07:52.327039 21486 rpcz_store.cc:276] 0709 13:07:51.160456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.162920 (+  2464us) service_pool.cc:224] Handling call
0709 13:07:51.163285 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.163622 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.163655 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.208601 (+ 44946us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.615878 (+407277us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:51.794828 (+178950us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.816214 (+ 21386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.816399 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.276015 (+459616us) raft_consensus.cc:1685] finished
0709 13:07:52.276095 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.280834 (+  4739us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20907,"prepare.queue_time_us":169001,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":56966,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":67291,"thread_start_us":331373,"threads_started":1,"wal-append.queue_time_us":829845}
I20260709 13:07:52.361348 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:52.361793 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.362443 21489 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.229542 25117 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:51.651222 24913 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:51.365422 24972 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:51.363742 25196 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:52.374219 25196 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:52.375623 25117 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:52.376041 25196 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.325618 21639 rpcz_store.cc:276] 0709 13:07:48.191818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.602550 (+2410732us) service_pool.cc:224] Handling call
0709 13:07:50.604376 (+  1826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.604572 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:50.607379 (+  2807us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.176196 (+1568817us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.324306 (+148110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.324425 (+   119us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.324518 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.324643 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.324891 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":187915,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":99315,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":1718011,"threads_started":5,"wal-append.queue_time_us":105250,"wal-append.run_cpu_time_us":1056,"wal-append.run_wall_time_us":1003579}
I20260709 13:07:52.378346 25196 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.218916 25147 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:51.649607 25120 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:52.380343 22244 raft_consensus.cc:2368] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9.
I20260709 13:07:52.380256 25120 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:52.382402 22244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 652) took 1485 ms (client timeout 1569 ms). Trace:
I20260709 13:07:52.241644 25275 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:52.384670 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.241169 25277 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:52.178303 25291 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:52.385557 22244 rpcz_store.cc:269] 0709 13:07:50.897368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.897535 (+   167us) service_pool.cc:224] Handling call
0709 13:07:52.382100 (+1484565us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54006dc754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:52.382312 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3399474048}
W20260709 13:07:52.175925 25294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.005s	sys 0.009s
I20260709 13:07:52.387473 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:52.387969 25294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.006s	sys 0.010s
I20260709 13:07:52.388509 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1538) took 1041 ms. Trace:
I20260709 13:07:52.212221 25298 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:07:52.388943 21486 rpcz_store.cc:276] 0709 13:07:51.347101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.387047 (+1039946us) service_pool.cc:224] Handling call
0709 13:07:52.388446 (+  1399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.386514 25066 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.246006 25304 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:52.391927 25066 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.243875 25280 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:52.185391 25287 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.387512 25291 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.309139 25263 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.309664 25240 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:51.395167 25155 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.396852 25155 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.311163 25181 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.228907 25001 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:52.338505 21533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.003s	sys 0.014s
I20260709 13:07:52.402463 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:52.403148 25113 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.404011 21561 raft_consensus.cc:606] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:52.344117 21490 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:52.405036 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1541) took 1047 ms. Trace:
I20260709 13:07:52.405416 21490 rpcz_store.cc:276] 0709 13:07:51.357456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.946364 (+588908us) service_pool.cc:224] Handling call
0709 13:07:52.404909 (+458545us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.390389 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.344125 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:52.348073 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:52.302737 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 650) took 4138 ms (client timeout 2551 ms). Trace:
I20260709 13:07:52.318701 21485 rpcz_store.cc:276] 0709 13:07:48.102826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.102953 (+   127us) service_pool.cc:224] Handling call
0709 13:07:48.103196 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.731290 (+2628094us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:50.731622 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.396429 (+664807us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18004447c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b
0709 13:07:51.398317 (+  1888us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b18004447c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b8223a
0709 13:07:51.454932 (+ 56615us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.576065 (+121133us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b18004447c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:07:51.580398 (+  4333us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b18004447c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef5522 00007f98a6ef77c1
0709 13:07:51.607338 (+ 26940us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b18004447c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:07:51.610293 (+  2955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.610371 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:51.610444 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.631283 (+ 20839us) spinlock_profiling.cc:243] Waited 2.63 s on lock 0x7b54003f9154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:51.631350 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.631552 (+   202us) inbound_call.cc:177] Queueing success response
0709 13:07:52.241835 (+610283us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b18004447c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef5522 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
Metrics: {"mutex_wait_us":161898,"prepare.queue_time_us":87936,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":106,"raft.queue_time_us":200265,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":26812,"spinlock_wait_cycles":6226224896,"thread_start_us":76541,"threads_started":1,"wal-append.queue_time_us":76890}
I20260709 13:07:52.364349 25249 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:52.355377 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1537) took 1071 ms. Trace:
I20260709 13:07:52.365006 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:52.220551 22274 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5e80 after lost signal to thread 21518
I20260709 13:07:51.965214 25259 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.422120 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.422693 25259 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:52.424887 21389 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.003s	sys 0.016s
W20260709 13:07:52.425360 21389 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.004s	sys 0.016s
I20260709 13:07:52.382556 25257 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:52.361166 21491 rpcz_store.cc:276] 0709 13:07:50.874476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.876883 (+  2407us) service_pool.cc:224] Handling call
0709 13:07:50.877200 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.896009 (+ 18809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.896043 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.903368 (+  7325us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.359044 (+1455676us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:52.359721 (+   677us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.360120 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.360260 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.360327 (+    67us) raft_consensus.cc:1685] finished
0709 13:07:52.360338 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.360587 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18459,"prepare.queue_time_us":2489,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":110,"raft.queue_time_us":25782,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":293,"thread_start_us":1400847,"threads_started":1,"wal-append.queue_time_us":1293100}
I20260709 13:07:52.388976 25261 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.174743 25297 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:52.404244 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:52.407738 22247 rpcz_store.cc:269] 0709 13:07:48.163886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.300755 (+136869us) service_pool.cc:224] Handling call
0709 13:07:52.302291 (+4001536us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54000d0554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:52.302523 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504442240}
I20260709 13:07:52.404095 25263 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:52.413077 21486 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:52.411084 21488 rpcz_store.cc:276] 0709 13:07:51.284002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.297101 (+1013099us) service_pool.cc:224] Handling call
0709 13:07:52.355308 (+ 58207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.411957 22240 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:52.425743 25259 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.446220 25066 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:52.429028 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:52.426889 25297 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:52.450569 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.434968 25249 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.435027 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.437386 21561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:52.437770 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1540) took 1080 ms. Trace:
I20260709 13:07:52.437372 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.440709 25263 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:52.422191 22274 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc860 after lost signal to thread 21519
I20260709 13:07:52.435205 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.454094 21639 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.428267 25120 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:52.458984 21492 rpcz_store.cc:276] 0709 13:07:51.357120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.428008 (+1070888us) service_pool.cc:224] Handling call
0709 13:07:52.436934 (+  8926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.437317 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.437344 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.437417 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.437483 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.437545 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.437671 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.465842 21494 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:52.467687 25249 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:52.468461 25263 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:52.463478 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 116092us
I20260709 13:07:52.468864 21640 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:52.458436 21561 raft_consensus.cc:606] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:52.473222 21561 raft_consensus.cc:614] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:52.476243 25257 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.476918 25257 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:52.478210 22274 debug-util.cc:398] Leaking SignalData structure 0x7b0800302e20 after lost signal to thread 21667
I20260709 13:07:52.479323 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.479391 25263 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.485615 21485 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:52.491721 21643 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:52.483733 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:52.498911 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.496444 25263 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.499783 21561 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:52.497376 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.503072 21640 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:52.504197 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.504803 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.505095 21635 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:52.503598 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.505766 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.498483 21565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:52.507268 21638 raft_consensus.cc:2410] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:52.507334 21565 raft_consensus.cc:606] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:52.505815 21637 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:52.508846 21643 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:52.509532 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:52.509748 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:52.510686 21635 raft_consensus.cc:2376] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10. Re-sending same reply.
I20260709 13:07:52.478363 25257 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.515286 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 497) took 1354 ms. Trace:
I20260709 13:07:52.516825 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:52.515826 21493 rpcz_store.cc:276] 0709 13:07:51.160945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.170028 (+  9083us) service_pool.cc:224] Handling call
0709 13:07:51.170382 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.170716 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.170755 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.575727 (+404972us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4800080358. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f 00007f98aeff9f37 00007f98af00e55c 00007f98af00e508 00007f98af00e488 00007f98af00e443 00007f98af00d6ec 00007f98adf37a96
0709 13:07:52.277732 (+702005us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.415200 (+137468us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:52.456159 (+ 40959us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.471422 (+ 15263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.481563 (+ 10141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.488059 (+  6496us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b18002f5a20. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98adeb658f 00007f98a6ef5571 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd
0709 13:07:52.514883 (+ 26824us) raft_consensus.cc:1685] finished
0709 13:07:52.514905 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.515101 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60880,"prepare.queue_time_us":45210,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":17651,"raft.run_cpu_time_us":3123,"raft.run_wall_time_us":385369,"spinlock_wait_cycles":39012352,"thread_start_us":67656,"threads_started":1,"wal-append.queue_time_us":202392}
W20260709 13:07:52.515527 22274 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee4c0 after lost signal to thread 22277
W20260709 13:07:52.518393 22274 debug-util.cc:398] Leaking SignalData structure 0x7b0800309920 after lost signal to thread 22278
I20260709 13:07:52.498822 25291 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.521579 25291 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:52.527730 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:52.528784 21564 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:52.528621 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.529377 21566 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:52.530551 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.531411 21562 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:52.531509 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.532359 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.532447 21567 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
W20260709 13:07:52.526959 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55747.4us
I20260709 13:07:52.521644 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:52.537093 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 115423us
I20260709 13:07:52.541332 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.542032 21567 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:52.542848 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.544931 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.541335 25120 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.547889 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.547008 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.547188 25120 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:52.549942 25120 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.552780 25283 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.555119 21642 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 11: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:52.556123 25283 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:52.552847 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:52.557392 21568 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.559234 25249 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:52.559935 25249 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.561992 25249 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.563103 25249 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.564112 21640 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:52.564778 21561 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:52.565259 25263 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.563829 25249 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.568576 25001 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.569497 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.570276 21494 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:52.568674 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:52.572672 25249 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.573184 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:52.574136 21493 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:52.575145 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:52.576323 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:52.577193 25263 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.577569 25263 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.577950 25263 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.586738 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:52.588964 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:52.589767 25283 raft_consensus.cc:2764] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:52.591867 25181 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:52.566756 25147 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:52.592864 25181 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:52.594260 25181 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:52.595582 25320 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.130s	user 0.004s	sys 0.000s
I20260709 13:07:52.593961 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:52.585201 22212 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:52.604173 21639 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:52.606050 21568 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:52.608780 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.610091 21489 raft_consensus.cc:2410] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:52.572901 25311 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.605440 25294 raft_consensus.cc:2764] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:52.612214 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:52.613221 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 67180.8us
I20260709 13:07:52.615756 21561 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.607185 25249 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.618726 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.621693 25259 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.622320 25259 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.622776 25259 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.623327 25120 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.617548 25249 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.629209 25249 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.630172 25287 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.638633 25322 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.639057 25001 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:52.639285 25322 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:52.639827 25322 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.639900 25001 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.639951 25120 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:52.640786 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:52.644079 25001 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.620685 25283 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:52.647670 25319 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:07:52.650640 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.651331 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.652323 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.655333 25297 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.664119 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.674018 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.675489 21639 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:52.679612 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:52.681661 21641 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.682026 21634 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:52.683081 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.684788 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.685879 21640 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:52.687018 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 46386.2us
I20260709 13:07:52.687134 25261 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.679589 21637 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:52.687731 25261 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:52.688267 25261 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.689585 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:52.691282 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:52.692130 21636 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:52.695457 25251 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:52.696563 25250 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:52.697041 25250 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:52.697525 25250 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.696563 25251 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.702337 25251 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:52.703050 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 109482us
I20260709 13:07:52.703450 25251 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.704950 25251 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.706240 25283 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:52.697415 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:52.707365 25283 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:52.710959 25283 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:52.711601 25260 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.712452 25297 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:52.712023 25283 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.712075 25260 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.712656 25261 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.713478 25283 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.713608 25260 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.710989 21635 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:52.715018 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.715528 25261 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:52.717048 25287 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:52.728641 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.734759 21565 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.736189 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.739087 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.747186 21636 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:52.761837 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.722381 25322 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.761220 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:52.765455 21639 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
W20260709 13:07:52.773016 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 54461.1us
I20260709 13:07:52.773200 25311 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:52.777994 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:52.779158 25001 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.782546 21635 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:07:52.771891 21640 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:52.780398 21566 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:07:52.773201 25318 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:07:52.776448 21457 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:52.787396 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.791759 25066 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:52.792279 25066 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:52.792668 25066 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.793015 25001 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.799489 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:52.828348 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52094.6us
I20260709 13:07:52.800992 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.810065 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:52.767647 25250 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:52.811704 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 76938.9us
W20260709 13:07:52.816483 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.814703 21638 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:52.816820 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.825678 21642 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.801437 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.812470 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:52.834547 21643 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.812410 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.834542 21636 raft_consensus.cc:2410] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:52.839092 25288 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:07:52.834892 25249 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.841107 21569 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:52.841905 25249 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.796164 25001 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:52.810201 21459 connection.cc:256] RPC call timeout handler was delayed by -2.6222709999999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:07:52.843963 21459 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:52.802934 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:52.848548 21639 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:52.844964 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:52.852789 21640 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
W20260709 13:07:52.873593 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 85688.4us
I20260709 13:07:52.876690 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.831727 25155 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.800482 25322 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:52.860746 21635 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:52.887239 21566 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:52.887308 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.816069 25311 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:52.890503 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.855958 25288 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:52.811203 25259 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.897393 21638 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:52.881188 25155 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.903568 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.819406 25066 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.907437 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:52.914130 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.915268 21635 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 8: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:52.916378 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.917302 21635 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:52.920106 21643 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:52.894034 25288 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.927660 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.929083 25066 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.930006 21638 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:52.930935 25065 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.931437 25065 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:52.931907 25065 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.932077 25250 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:52.904155 25249 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:52.933805 25249 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.934388 25249 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.847648 25117 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 13:07:52.939270 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 94411.7us
I20260709 13:07:52.918377 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.940646 21459 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:52.906826 25155 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.951442 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:52.892030 25263 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.956120 21640 raft_consensus.cc:2368] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10.
I20260709 13:07:52.957715 21635 raft_consensus.cc:2410] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:52.960055 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:52.960685 21642 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.927030 21643 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:52.952728 25297 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.941267 25288 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:52.966773 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 85204.8us
I20260709 13:07:52.967089 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:52.968077 21568 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:52.965875 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:52.963274 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 73321.7us
I20260709 13:07:52.968564 21635 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.970644 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:52.973119 21563 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:52.972462 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:52.975021 21643 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.976424 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:52.986192 21634 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:52.947599 25260 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:52.949997 25311 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:52.985347 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:52.970162 25117 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.996564 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:52.996599 22244 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.994704 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:52.998027 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:52.998309 21641 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:53.002909 25327 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 13:07:53.007361 25334 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:07:53.011808 22245 raft_consensus.cc:2376] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10. Re-sending same reply.
W20260709 13:07:53.024113 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.031239 21640 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:53.034746 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:53.037746 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:53.039450 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:53.040310 22238 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.040956 25262 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:53.041433 25262 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:53.041855 25262 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.041993 21642 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:53.049875 25249 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:53.052284 21637 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:53.015808 22247 raft_consensus.cc:2376] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10. Re-sending same reply.
I20260709 13:07:53.056823 22239 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 6: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:52.997543 25117 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:53.062211 21639 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:53.069983 21636 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:53.071115 25251 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:07:53.076853 21635 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:52.995374 25297 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:53.070113 25117 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:53.084425 25336 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:07:53.240484 22238 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:53.266669 22247 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:53.239822 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 264092us
I20260709 13:07:53.053586 25288 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:53.266932 25113 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.104269 25263 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:53.373696 25249 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:53.385812 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.382113 25262 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:53.437418 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 61469.4us
I20260709 13:07:53.450220 25311 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:53.466259 25297 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:53.468953 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.470669 25155 consensus_meta.cc:287] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.003s
I20260709 13:07:53.472121 25262 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:53.517228 25344 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:07:53.471809 25155 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:53.526296 25065 consensus_meta.cc:287] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.594s	user 0.012s	sys 0.001s
I20260709 13:07:53.529856 25065 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:53.534358 25288 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:53.535915 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:53.546108 22210 leader_election.cc:400] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10.
I20260709 13:07:53.546522 22210 leader_election.cc:403] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:53.549197 25066 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10.
I20260709 13:07:53.549981 25297 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.550599 25297 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:53.553035 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:53.554286 25347 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.555756 25347 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:53.556584 25347 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:53.556921 25347 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:53.557883 25322 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:53.557891 25347 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:53.560554 25297 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:53.559867 25155 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:53.559154 25240 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:53.572028 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:53.572572 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:53.575366 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:53.574435 25347 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.577502 25117 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:53.580158 25117 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:53.570966 25240 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:53.594460 25259 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:53.598256 25240 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:53.599574 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:53.603840 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:53.599777 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:53.604627 22245 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:53.601107 22238 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:07:53.602085 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:53.603137 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:53.607128 25240 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.614213 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:53.617219 25260 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:53.618075 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:53.627110 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 618576us
I20260709 13:07:53.628029 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:53.628991 25117 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.629396 25117 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:53.629774 25117 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.635964 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:53.619731 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:54.010496 22246 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:53.769635 22244 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:07:53.800472 25155 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.019826 25155 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.020285 25155 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.810060 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:54.024994 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 215011us
I20260709 13:07:53.845369 21565 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:53.859194 25065 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:53.869019 25345 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.027341 25345 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:54.027856 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.029459 25345 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:53.886251 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.015936 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:53.660876 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:54.699318 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 1.03844e+06us
I20260709 13:07:54.700007 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:54.701073 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:54.048607 25352 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:54.059187 25353 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:54.063387 25354 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:53.965839 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:07:54.094476 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 275126us
W20260709 13:07:54.093156 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 487142us
I20260709 13:07:54.734359 25345 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.735286 25345 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.735673 25345 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.736007 25345 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:54.070410 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.760468 25357 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.036607 25155 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.765563 25155 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:53.999938 25259 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.771840 25259 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.070998 25257 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.774832 25257 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.776240 25287 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:54.777560 25358 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.777733 25257 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:54.778016 25358 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:07:54.587951 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 1.59321e+06us
I20260709 13:07:54.779038 21457 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:54.779862 25259 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:54.589584 21391 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 6 to 7, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 7 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.602887 24972 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:54.781628 24972 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:54.353554 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:54.681581 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.783818 24972 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:54.663779 25065 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:54.784406 25065 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.784801 25065 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.785619 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:54.787009 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:54.703630 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 737861us
I20260709 13:07:54.788180 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:54.712057 25354 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.717096 21459 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:54.718704 25356 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.792727 25288 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:54.793231 25288 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.793366 25356 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:54.793663 25288 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.794148 25356 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:54.795334 25356 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.721618 25260 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:54.726938 22210 leader_election.cc:336] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.628s (SENT)
I20260709 13:07:54.796970 25260 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:54.797080 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:54.797587 25260 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:54.798175 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 71263.7us
I20260709 13:07:54.799058 25359 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:54.748723 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.799496 21391 catalog_manager.cc:5697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:07:54.800777 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.801414 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.801059 21391 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 4 to 6, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 6 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:54.761291 25352 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:54.802878 25352 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:54.803704 25352 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:54.804878 25352 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.987308 25117 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.808007 25260 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:54.815402 25260 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:53.659403 25346 consensus_queue.cc:1175] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5727b19579474da6a12f79730b924770" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 13:07:54.780499 25155 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.791095 25354 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:54.823580 25358 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:54.824776 25354 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:54.716176 21590 debug-util.cc:398] Leaking SignalData structure 0x7b0800302ba0 after lost signal to thread 20385
W20260709 13:07:54.826229 21590 debug-util.cc:398] Leaking SignalData structure 0x7b08001902e0 after lost signal to thread 21426
W20260709 13:07:54.826596 21590 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3360 after lost signal to thread 21440
W20260709 13:07:54.827804 21590 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8e20 after lost signal to thread 21518
W20260709 13:07:54.828099 21590 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6860 after lost signal to thread 21519
W20260709 13:07:54.829208 21590 debug-util.cc:398] Leaking SignalData structure 0x7b0800307680 after lost signal to thread 21593
I20260709 13:07:54.829535 25155 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.829993 25155 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:54.830415 21590 debug-util.cc:398] Leaking SignalData structure 0x7b0800162100 after lost signal to thread 21667
I20260709 13:07:54.792070 25249 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.788151 24972 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.808415 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:54.808861 25117 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:54.762226 25353 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.744789 25345 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.815030 21391 catalog_manager.cc:5697] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 4 to 8, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:54.766840 25357 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:54.831046 21590 debug-util.cc:398] Leaking SignalData structure 0x7b080026dfc0 after lost signal to thread 21668
W20260709 13:07:54.849542 21590 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1040 after lost signal to thread 22277
I20260709 13:07:54.813501 25065 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:54.851894 21590 debug-util.cc:398] Leaking SignalData structure 0x7b08002f21a0 after lost signal to thread 22278
W20260709 13:07:54.840159 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 43549.4us
W20260709 13:07:54.851122 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 101459us
W20260709 13:07:54.836208 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 60459.5us
W20260709 13:07:54.853060 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 136068us
W20260709 13:07:54.853320 21608 leader_election.cc:336] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.530s (SENT)
W20260709 13:07:54.856094 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 47710us
I20260709 13:07:54.863054 21391 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:54.865154 21391 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 7 to 8, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 8 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.868182 25065 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:54.849179 25260 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:54.867981 21391 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 4 to 5, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 5 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:54.868817 25155 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.870558 21391 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 7 to 8, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 8 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.874168 21391 catalog_manager.cc:5697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 6 to 7, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 7 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:54.876121 21391 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 7 to 8, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:54.854439 21459 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:54.880770 25155 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:54.881354 25065 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.849334 25353 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:54.888211 25345 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:54.888211 25288 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.889410 25353 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:54.889940 25357 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:54.890439 25288 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:54.897898 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:54.898422 21490 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:54.886384 25356 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:07:54.899562 25356 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:54.899920 25356 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:54.895073 25353 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:54.901072 24972 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.903569 25358 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.908023 22242 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:54.900835 25353 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.911228 25352 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:54.900709 25356 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.911839 25352 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:54.912626 25356 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.914104 25352 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:54.911850 25353 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:54.911477 21459 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:54.909339 22242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 521) took 1306 ms. Trace:
I20260709 13:07:54.917938 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:54.918893 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:54.929411 25353 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:54.929641 22238 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:54.929942 25353 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:54.897236 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:54.928202 22242 rpcz_store.cc:276] 0709 13:07:53.603126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.603594 (+   468us) service_pool.cc:224] Handling call
0709 13:07:54.847665 (+1244071us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b5400480920. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f59dc0 00007f98a9fe5e18 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:54.909147 (+ 61482us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400540e54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:54.909283 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2796661248}
I20260709 13:07:54.932206 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:54.932821 22245 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:54.933072 25352 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.933822 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:54.933933 21608 leader_election.cc:336] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.635s (SENT)
I20260709 13:07:54.934821 25352 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:54.936400 21389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 143) took 15011 ms (client timeout 15000 ms). Trace:
I20260709 13:07:54.937345 25352 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:54.937534 25065 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:54.937948 25357 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.938344 25357 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.939268 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:54.942353 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:54.930915 25353 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:54.943071 21636 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:54.945320 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:54.946051 21489 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:54.931679 25366 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:54.946976 25366 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:54.949564 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:54.950555 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 57186.3us
I20260709 13:07:54.939636 25357 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.951283 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:54.942430 25065 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.954802 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:54.958135 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:54.939271 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:54.959925 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:54.955610 25363 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.960860 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:54.961586 21493 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:07:54.962528 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:54.963223 21638 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:07:54.958662 21636 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:54.965114 25345 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:54.965538 25352 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:54.965036 25288 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:54.970062 21608 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.730s (SENT)
I20260709 13:07:54.970965 25352 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:54.971974 25352 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:54.975149 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:54.975708 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:54.956843 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:54.987627 21457 connection.cc:256] RPC call timeout handler was delayed by -2.3915402899999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260709 13:07:54.989609 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:54.989765 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:54.990644 21635 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:07:54.995415 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:54.998739 21637 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:07:55.000635 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 143408us
W20260709 13:07:54.994055 21608 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.783s (SENT)
I20260709 13:07:55.002489 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.002527 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:55.006410 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.007236 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.007897 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.008085 21640 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:55.008622 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.008977 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.009214 21486 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.009495 21488 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.011145 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.011387 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.008662 21487 raft_consensus.cc:2368] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9.
I20260709 13:07:54.979092 25363 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:55.007998 21492 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:55.012641 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.016750 21638 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.978823 24972 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.027091 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:55.023283 21457 connection.cc:256] RPC call timeout handler was delayed by -2.1152402899999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 13:07:55.013288 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.013485 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.011169 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:54.980765 25365 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:55.012805 21634 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:55.012575 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.020838 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:55.022073 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:55.030737 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.027766 22239 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:55.031698 21635 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:55.034194 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:55.022441 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:54.976801 25155 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:07:55.004248 25356 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:55.023522 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.036659 21493 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:55.024725 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46850.4us
W20260709 13:07:55.037912 21608 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.837s (SENT)
I20260709 13:07:55.025560 22245 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.981321 25366 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:55.028206 21489 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:54.936781 21389 rpcz_store.cc:269] 0709 13:07:39.925090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.925309 (+   219us) service_pool.cc:224] Handling call
0709 13:07:54.936291 (+15010982us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:52.465219 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:52.563460 (+ 98241us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:52.563531 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:07:52.563578 (+    47us) tablet.cc:662] Decoding operations
0709 13:07:52.564605 (+  1027us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:52.564702 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:52.564731 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:07:52.565515 (+   784us) tablet.cc:701] Row locks acquired
0709 13:07:52.565571 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:07:52.565799 (+   228us) write_op.cc:270] Start()
0709 13:07:52.565944 (+   145us) write_op.cc:276] Timestamp: P: 1783602472565733 usec, L: 0
0709 13:07:52.565982 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:07:52.636697 (+ 70715us) log.cc:844] Serialized 2399 byte log entry
0709 13:07:53.376944 (+740247us) op_driver.cc:464] REPLICATION: finished
0709 13:07:53.534249 (+157305us) write_op.cc:301] APPLY: starting
0709 13:07:53.534369 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:53.534560 (+   191us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:53.534693 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:53.538906 (+  4213us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:53.541052 (+  2146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:07:53.541123 (+    71us) write_op.cc:312] APPLY: finished
0709 13:07:53.541488 (+   365us) log.cc:844] Serialized 47 byte log entry
0709 13:07:53.541697 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:53.541867 (+   170us) write_op.cc:454] Released schema lock
0709 13:07:53.541923 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:53.542365 (+   442us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:53.542390 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":31133,"mutex_wait_us":761056,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":137879,"apply.run_cpu_time_us":3489,"apply.run_wall_time_us":11757,"num_ops":5,"prepare.queue_time_us":903263,"prepare.run_cpu_time_us":21288,"prepare.run_wall_time_us":350029,"raft.queue_time_us":123482,"raft.run_cpu_time_us":9109,"raft.run_wall_time_us":385149,"replication_time_us":634277,"thread_start_us":992804,"threads_started":4,"wal-append.queue_time_us":214790,"wal-append.run_cpu_time_us":31632,"wal-append.run_wall_time_us":1887473}]]}
I20260709 13:07:55.028945 21636 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.018034 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:55.027033 21494 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:55.029524 21457 connection.cc:256] RPC call timeout handler was delayed by -2.0945402899999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
I20260709 13:07:55.047658 22238 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:55.038304 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:55.040154 22247 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:07:55.076893 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.018349 25363 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.078189 21635 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.042984 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:55.079123 21457 connection.cc:256] RPC call timeout handler was delayed by -1.463664031999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2919s for a response
I20260709 13:07:55.083092 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:55.095924 21532 connection.cc:256] RPC call timeout handler was delayed by -2.5734280980000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:07:55.096390 21532 connection.cc:256] RPC call timeout handler was delayed by -2.5518280979999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:07:55.096800 21532 connection.cc:256] RPC call timeout handler was delayed by -2.5437280980000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:07:55.097157 21532 connection.cc:256] RPC call timeout handler was delayed by -2.4834280979999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:07:55.097527 21532 connection.cc:256] RPC call timeout handler was delayed by -2.4708280980000836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 13:07:55.098651 21638 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:55.095991 21492 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:55.101986 21486 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:55.109942 21493 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:07:55.112879 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.117944 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.118606 21486 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 8: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:55.118651 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:55.118146 25356 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:55.124459 25356 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:55.039543 25257 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.104624 25363 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.127298 21637 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.127350 25257 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:55.128925 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.107306 25155 consensus_queue.cc:1243] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:55.129513 21642 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.129797 25364 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:55.076387 25065 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:55.118911 25365 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:55.135347 21637 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:55.134865 25365 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:55.136927 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.138068 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.139559 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.140702 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:55.141233 21643 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:55.141975 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.077347 25358 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:55.117139 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 140572us
I20260709 13:07:55.146122 21635 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:55.154392 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.155736 21635 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.150625 21642 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:55.138586 21637 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.148814 21643 raft_consensus.cc:2368] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9.
I20260709 13:07:55.158365 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.162437 21636 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:55.163671 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:55.164407 21638 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:07:55.166040 21488 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:55.159097 21487 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:07:55.154595 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:55.180299 21489 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:55.182687 21635 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:07:55.184279 21486 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:55.187830 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.187999 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.188617 21634 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 8: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:55.191346 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:55.153337 25358 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:55.204954 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.168109 25354 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.208108 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.208501 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 54001.2us
I20260709 13:07:55.208616 21643 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:55.215916 21637 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:55.217973 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.218259 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.218900 21488 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:55.218037 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.220427 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.221884 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.222340 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:55.230391 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.208222 25358 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:55.248842 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.199532 25345 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.249729 21488 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.256851 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.258244 21494 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:55.261765 21488 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:07:55.263236 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.264122 21488 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:55.267477 21493 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:55.270130 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.279583 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 57357.9us
I20260709 13:07:55.213302 25354 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:55.304224 21515 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2460 after lost signal to thread 20385
W20260709 13:07:55.305703 21515 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2560 after lost signal to thread 21426
W20260709 13:07:55.306182 21515 debug-util.cc:398] Leaking SignalData structure 0x7b08003d9600 after lost signal to thread 21440
I20260709 13:07:55.307828 21487 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:55.308840 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:55.310534 21515 debug-util.cc:398] Leaking SignalData structure 0x7b0800130f20 after lost signal to thread 21518
W20260709 13:07:55.310976 21515 debug-util.cc:398] Leaking SignalData structure 0x7b0800138120 after lost signal to thread 21519
W20260709 13:07:55.312374 21515 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1840 after lost signal to thread 21593
W20260709 13:07:55.312719 21515 debug-util.cc:398] Leaking SignalData structure 0x7b0800360d80 after lost signal to thread 21594
W20260709 13:07:55.314473 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 276561us
W20260709 13:07:55.320245 25378 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:07:55.328228 21515 debug-util.cc:398] Leaking SignalData structure 0x7b080026e580 after lost signal to thread 21667
W20260709 13:07:55.328694 21515 debug-util.cc:398] Leaking SignalData structure 0x7b08003d21c0 after lost signal to thread 21668
W20260709 13:07:55.329439 21608 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.870s (SENT)
W20260709 13:07:55.329874 21515 debug-util.cc:398] Leaking SignalData structure 0x7b080033a700 after lost signal to thread 22277
W20260709 13:07:55.330199 21515 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7380 after lost signal to thread 22278
I20260709 13:07:55.331621 24972 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:55.332146 24972 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:55.333117 24972 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:55.335148 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.284252 25288 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.344997 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.346103 21494 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:07:55.347270 21640 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:55.352663 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.345422 24972 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:55.391448 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 95142.3us
W20260709 13:07:55.356874 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 95696.5us
I20260709 13:07:55.327905 25155 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:55.399583 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.406376 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:55.412606 25369 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:07:54.892192 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:36512 (local address 127.19.231.130:41371)
0709 13:07:54.966932 (+ 74740us) server_negotiation.cc:207] Beginning negotiation
0709 13:07:54.966978 (+    46us) server_negotiation.cc:400] Waiting for connection header
0709 13:07:54.967048 (+    70us) server_negotiation.cc:408] Connection header received
0709 13:07:54.967217 (+   169us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 13:07:54.967249 (+    32us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 13:07:54.967538 (+   289us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 13:07:54.967799 (+   261us) server_negotiation.cc:227] Negotiated authn=SASL
0709 13:07:54.999470 (+ 31671us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0709 13:07:55.083627 (+ 84157us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0709 13:07:55.280090 (+196463us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0709 13:07:55.390637 (+110547us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
0709 13:07:55.408532 (+ 17895us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
0709 13:07:55.408716 (+   184us) server_negotiation.cc:882] Received SASL_INITIATE request from client
0709 13:07:55.408750 (+    34us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
0709 13:07:55.408844 (+    94us) server_negotiation.cc:923] calling sasl_server_start()
0709 13:07:55.409006 (+   162us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
0709 13:07:55.409089 (+    83us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
0709 13:07:55.409916 (+   827us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36512: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":74063,"thread_start_us":46521,"threads_started":1}
I20260709 13:07:55.416443 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:55.417618 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:55.424727 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 167602us
I20260709 13:07:55.425151 21568 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.423733 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:55.426344 21565 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.418263 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:55.418511 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:55.422307 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 300746us
I20260709 13:07:55.428785 21566 raft_consensus.cc:2368] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10.
I20260709 13:07:55.433909 21494 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:55.434835 21562 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:55.441566 25399 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.443282 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:55.430647 25321 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:07:52.383648 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.19.231.130:41371 (local address 127.0.0.1:36512)
0709 13:07:52.643371 (+259723us) negotiation.cc:107] Waiting for socket to connect
0709 13:07:52.643464 (+    93us) client_negotiation.cc:175] Beginning negotiation
0709 13:07:52.644026 (+   562us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 13:07:54.971619 (+2327593us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0709 13:07:54.971674 (+    55us) client_negotiation.cc:404] Received NEGOTIATE response from server
0709 13:07:54.971827 (+   153us) client_negotiation.cc:190] Negotiated authn=SASL
0709 13:07:54.972839 (+  1012us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0709 13:07:54.972923 (+    84us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0709 13:07:55.117816 (+144893us) client_negotiation.cc:281] Received TLS_HANDSHAKE NegotiatePB response
0709 13:07:55.122614 (+  4798us) client_negotiation.cc:543] Received TLS_HANDSHAKE response from server
0709 13:07:55.258162 (+135548us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0709 13:07:55.268619 (+ 10457us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0709 13:07:55.269114 (+   495us) client_negotiation.cc:564] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
0709 13:07:55.317691 (+ 48577us) client_negotiation.cc:639] Initiating SASL PLAIN handshake
0709 13:07:55.317779 (+    88us) client_negotiation.cc:672] calling sasl_client_start()
0709 13:07:55.317874 (+    95us) client_negotiation.cc:830] callback for SASL_CB_AUTHNAME
0709 13:07:55.318101 (+   227us) client_negotiation.cc:262] Sending SASL_INITIATE NegotiatePB request
0709 13:07:55.387635 (+ 69534us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.19.231.130:41371: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":200104,"thread_start_us":80598,"threads_started":1}
I20260709 13:07:55.443328 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:55.444326 21569 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.452613 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:55.452850 21563 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:55.453944 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:55.454010 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:55.454708 21566 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.455170 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:55.456213 21563 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:55.447804 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:55.447767 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 132398us
I20260709 13:07:55.461515 21568 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:55.461759 21565 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:55.465133 21561 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:55.454594 25385 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:07:55.471933 21566 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:55.472998 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:55.442312 25399 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:55.477747 21532 connection.cc:256] RPC call timeout handler was delayed by -2.4168280979999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 13:07:55.478210 21532 connection.cc:256] RPC call timeout handler was delayed by -2.414128097999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:07:55.478504 21532 connection.cc:256] RPC call timeout handler was delayed by -2.4042280979999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:07:55.475183 21562 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:55.478770 21532 connection.cc:256] RPC call timeout handler was delayed by -2.3439280979999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:07:55.479146 21532 connection.cc:256] RPC call timeout handler was delayed by -2.2942965789999334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:07:55.479586 21532 connection.cc:256] RPC call timeout handler was delayed by -2.1729280980000567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 13:07:55.479987 21532 connection.cc:256] RPC call timeout handler was delayed by -2.1450280980000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 13:07:55.480295 21532 connection.cc:256] RPC call timeout handler was delayed by -2.1333280979999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 13:07:55.480981 21532 connection.cc:256] RPC call timeout handler was delayed by -1.7634280980000767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2626s for a response
W20260709 13:07:55.481268 21532 connection.cc:256] RPC call timeout handler was delayed by -1.5402280980000569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28740000000000004s for a response
W20260709 13:07:55.481881 21608 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.934s (SENT)
I20260709 13:07:55.489212 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:55.491247 21440 auto_rebalancer.cc:893] Removing replace marker failed: Client connection negotiation failed: client connection to 127.19.231.130:41371: received 0 of 4 requested bytes
W20260709 13:07:55.491863 21440 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:07:55.492208 21440 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:55.499135 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:55.500757 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.525427 21562 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:07:55.545301 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 67925.6us
I20260709 13:07:55.545396 21569 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:07:55.546295 21608 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.937s (SENT)
I20260709 13:07:55.534936 25260 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:55.556900 25357 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
W20260709 13:07:55.565202 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 159595us
W20260709 13:07:55.567773 21608 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.963s (SENT)
W20260709 13:07:55.568706 21608 leader_election.cc:336] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.139s (SENT)
W20260709 13:07:55.570202 21608 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.323s (SENT)
I20260709 13:07:55.570452 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.526284 25358 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:55.572093 25357 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:55.588349 21635 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:55.590950 21459 leader_election.cc:400] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10.
I20260709 13:07:55.591347 21459 leader_election.cc:403] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:55.590644 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.595769 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:55.601599 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:55.605289 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:55.609510 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.609987 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.606021 25365 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:55.611861 25365 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:55.612861 25354 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:55.613107 25260 raft_consensus.cc:2764] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:07:55.618554 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48357.4us
W20260709 13:07:55.610877 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 2.692s (SENT) [suppressed 66 similar messages]
W20260709 13:07:55.624612 25397 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.050s	user 0.002s	sys 0.001s
I20260709 13:07:55.599654 25375 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10.
I20260709 13:07:55.607007 25155 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:55.633594 25155 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:55.634687 25155 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:55.605921 25384 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.274s	user 0.003s	sys 0.000s
I20260709 13:07:55.633621 25399 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:55.612784 25365 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:55.624622 25358 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:55.639444 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 51327.4us
I20260709 13:07:55.640223 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:55.626933 21608 leader_election.cc:336] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.405s (SENT)
I20260709 13:07:55.637322 25357 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:55.604840 25389 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.647931 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.605031 25117 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:55.610875 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:55.637354 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.658805 25375 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:55.659381 25375 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:55.659250 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 158636us
W20260709 13:07:55.661057 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 50293.2us
I20260709 13:07:55.663648 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:55.663744 25288 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:55.665185 25288 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:55.665292 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:55.665767 25288 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:55.666591 21608 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.429s (SENT)
W20260709 13:07:55.667568 21608 leader_election.cc:336] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.435s (SENT)
I20260709 13:07:55.668053 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.667623 25288 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:55.669122 21608 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.480s (SENT)
I20260709 13:07:55.669513 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.605159 25363 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:55.671706 25363 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:55.673003 22210 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.666328 22247 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:55.648934 25065 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.683375 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:55.650291 25117 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.695479 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:55.696661 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:55.699265 25374 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:55.700098 25374 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:55.700544 25374 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:55.700927 25371 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.706817 25287 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:55.692148 25364 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:55.687314 25357 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:55.707686 25364 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:55.674120 25352 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.692456 25363 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:55.702278 25117 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.712272 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.713681 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.714566 25410 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:55.715013 25410 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:55.715385 25410 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.718981 25260 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:55.719800 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.721977 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:55.726863 25361 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:55.708567 25364 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:55.727417 25361 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:55.727835 25361 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:55.701448 25374 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:55.731034 25399 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.731894 25287 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:55.732846 25287 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:55.735751 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 70516.4us
I20260709 13:07:55.660331 25375 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:55.770051 25364 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.775758 25405 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:55.776445 25405 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:55.776934 25405 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:55.783905 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 61999.8us
W20260709 13:07:55.784865 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 115781us
I20260709 13:07:55.785298 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:55.788636 21608 leader_election.cc:336] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.583s (SENT)
I20260709 13:07:55.789227 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:55.790627 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 96951.4us
I20260709 13:07:55.788668 24972 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:07:55.795967 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 74984.8us
I20260709 13:07:55.800526 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:55.801156 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:55.801946 22238 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.803222 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.807154 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:55.783169 25260 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:55.811038 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:55.811056 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:55.811779 22246 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.814807 21567 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:55.791066 25346 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.817437 22242 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:55.819849 21560 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:55.778054 25414 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:07:55.822443 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.806233 24972 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:55.834271 22238 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:07:55.835947 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.824481 25357 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:07:55.837265 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:55.824111 25420 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:55.822160 25383 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:55.841205 25260 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:55.842447 25383 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:55.842885 25383 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:55.845335 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.845369 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:55.830245 24972 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:55.875106 24972 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.843758 25383 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:55.888419 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.903518 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.902437 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.902500 25415 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:55.904151 21485 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:07:55.931735 21567 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:55.936818 21490 raft_consensus.cc:2368] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:55.881186 25257 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:55.941190 22246 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:55.947623 25402 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:55.948717 25417 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:55.949326 25417 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:55.949769 25417 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.950419 21487 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:55.950981 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.951334 25383 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.952317 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:55.953133 21489 raft_consensus.cc:2410] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:55.954423 21486 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:55.955551 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.956864 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.957958 25257 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:55.958954 25257 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:55.904487 25366 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.962612 25416 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:55.967777 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.968586 21490 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:55.938215 25345 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:07:55.971197 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.961242 25366 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:55.950498 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.987285 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:55.988175 21492 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:55.989957 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:55.998921 22246 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:56.000201 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:56.001101 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.005913 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:56.009974 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:56.010216 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.003361 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.011891 21564 raft_consensus.cc:2410] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:56.014010 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:55.979972 25366 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.014935 21643 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:55.975113 25410 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:55.992354 25364 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:07:56.003633 25357 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:56.009366 25359 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.036823 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:56.059893 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 213829us
I20260709 13:07:56.063120 21489 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:56.063793 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.028245 25414 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:56.065487 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:56.038555 25405 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:56.096501 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.062992 25357 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:56.118508 25357 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.118583 25414 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:56.120833 25410 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.127547 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.127717 25361 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.129112 22238 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:56.135535 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.145756 21487 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.130689 21564 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:56.138192 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.143734 21491 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:56.144145 21494 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:56.149106 21494 pending_rounds.cc:85] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 4
I20260709 13:07:56.149471 21494 pending_rounds.cc:107] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:56.149799 21494 raft_consensus.cc:2889] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:56.151688 21491 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:56.151886 21493 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:07:56.154250 21493 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:56.154953 21491 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:56.157155 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.157998 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.158074 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.162407 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.120438 25414 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:56.170408 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.163956 21489 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
W20260709 13:07:56.165146 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 103969us
I20260709 13:07:56.172147 21493 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:07:56.179243 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:56.179538 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.172967 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.177621 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.177304 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.179286 21492 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:07:56.187376 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.178313 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.176239 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.188555 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.200003 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.200735 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.201130 21490 raft_consensus.cc:2376] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10. Re-sending same reply.
I20260709 13:07:56.189038 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.201797 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.202757 21493 raft_consensus.cc:2368] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:56.182767 25356 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:07:56.204825 21494 raft_consensus.cc:2368] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
W20260709 13:07:56.176977 25422 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:07:56.205760 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.207218 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.207787 21490 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:56.209617 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.188184 25414 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.165712 25117 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.205466 25410 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:56.240293 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.252683 21489 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:56.259837 21563 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:56.258399 25257 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.262610 25375 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:56.262832 25257 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.268838 21560 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:56.269882 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.275554 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 269721us
I20260709 13:07:56.251921 25410 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:56.277845 21485 raft_consensus.cc:2368] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:07:56.170583 24972 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:56.278903 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 245240us
I20260709 13:07:56.279193 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:56.282547 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.283468 21489 raft_consensus.cc:2376] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11. Re-sending same reply.
I20260709 13:07:56.286082 21643 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:56.289335 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.282649 25379 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:07:56.288547 25383 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:07:56.293977 25117 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.299490 21560 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:56.280531 25410 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.281903 25386 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:56.310142 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.302613 25420 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:56.282266 25417 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.311537 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:56.312975 25402 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.313212 25386 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.300074 25257 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:56.314112 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:56.328342 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.314920 25420 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:56.331632 21487 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:56.331844 25417 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.332741 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.333869 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.334415 21494 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:07:56.335130 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.335701 21488 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:56.337579 25405 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.338333 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.339401 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.339509 25260 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.340080 21490 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 7: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:56.340889 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.341988 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.343560 25386 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.344087 21488 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:07:56.344486 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:56.345853 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:56.346582 25423 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:56.337714 21569 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:56.349058 21489 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.357714 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:56.362475 21641 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:56.366643 21489 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:56.367805 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:56.371999 21641 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:56.371228 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:56.370198 21492 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:56.375734 22244 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:56.379197 22239 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:56.380687 22245 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:56.378849 25364 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:56.393566 21635 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:56.381316 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:56.391248 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:56.398365 21639 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.355983 25423 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:56.401238 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:56.403189 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:56.400348 25155 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.369587 25383 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:56.371485 25257 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.369779 25405 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:07:56.425699 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 77079.4us
I20260709 13:07:56.435812 22244 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.383908 25417 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:07:56.381102 25065 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:56.415364 25364 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:56.435390 25430 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.448731 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:56.409883 25389 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:56.456068 21639 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:56.462414 25441 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:56.438767 25117 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:07:56.423828 25257 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.471112 25440 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:07:56.482914 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:56.475486 25364 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:56.499569 25364 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.476840 24972 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:56.455135 25371 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:56.493887 25257 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:56.494621 25435 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:07:56.487704 25423 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.496431 25386 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:56.496902 21608 leader_election.cc:336] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.523s (SENT)
I20260709 13:07:56.496786 25410 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.455786 25357 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:56.478371 25389 consensus_queue.cc:1243] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:56.485857 25415 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:56.520576 25417 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:56.521631 25260 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:56.523061 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:07:56.527704 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 114979us
I20260709 13:07:56.535320 22246 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:56.535336 21563 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.534112 25345 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.537406 25345 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.538441 25410 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:56.539484 25389 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:56.539880 25389 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:56.540123 25386 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.535086 25415 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:56.540719 25389 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.542001 25389 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.531991 25417 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:56.543625 25417 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.546270 25345 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.548501 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:56.554023 25357 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.554766 25357 consensus_queue.cc:1243] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:56.555264 25357 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:56.555588 25357 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:56.541661 25415 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.557147 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:56.558334 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:56.559794 25443 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:07:56.563438 25410 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:56.563658 25361 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.563966 25410 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:56.564488 25410 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.567624 25357 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.570616 25357 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.570849 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:56.570539 25260 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:56.572628 25260 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:56.572999 25260 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.576036 21532 leader_election.cc:400] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9.
I20260709 13:07:56.576493 21532 leader_election.cc:403] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:56.578486 21641 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:56.580336 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.552317 25441 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:56.586282 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:56.588308 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:56.590619 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 141952us
I20260709 13:07:56.591339 21457 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:56.602326 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:56.603170 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:56.572953 25155 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:56.605546 21561 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:56.610549 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.581246 25440 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:56.588909 25441 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:56.614022 25374 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:56.589265 25257 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:56.617690 25440 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:56.648697 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 72856.2us
I20260709 13:07:56.647305 25440 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.633970 25441 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.679209 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:56.675879 25374 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:56.694756 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:56.695998 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:56.696633 21487 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.696877 24972 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:56.697546 24972 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.699899 25155 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:56.701833 25288 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:56.702261 25288 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:56.703229 25454 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:56.703864 25454 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:56.703305 25288 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.704278 25454 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.705077 25288 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.706987 25447 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:56.707576 25447 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.708653 24972 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.709939 25447 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.715011 25359 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:56.692857 25364 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:56.728578 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:56.731925 21567 raft_consensus.cc:2410] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:56.733323 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.740904 21487 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:07:56.742611 25440 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.744828 25440 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.744882 25410 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.746414 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.746863 25445 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:56.730489 25414 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:56.747670 25450 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:07:56.748991 25414 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.749191 25455 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:56.749830 25424 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:56.751137 21562 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:56.751272 25410 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.742646 25374 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.755549 25420 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.755986 25441 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.756894 25420 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.758181 25441 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:56.724274 25257 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:07:56.766543 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.767319 21560 raft_consensus.cc:2368] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:56.775254 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:56.775549 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.766039 25445 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:56.787374 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:56.790747 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:56.761341 25364 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.790479 25346 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:56.797791 25424 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:56.803675 21563 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.796396 25414 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:56.803877 25459 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:56.831460 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 249709us
I20260709 13:07:56.835835 25364 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:56.838173 25444 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:56.844988 21564 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:56.864655 21569 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:56.862470 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.865900 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.866837 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.827745 25414 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:56.842554 25445 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.871644 25414 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.872850 25414 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.839110 25446 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9.
I20260709 13:07:56.846745 25424 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.874353 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.856097 25365 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:07:56.875089 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 77572.2us
I20260709 13:07:56.888038 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:56.804765 25358 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:07:56.829699 25459 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:07:56.853988 25452 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.213s	user 0.003s	sys 0.000s
I20260709 13:07:56.847216 25442 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:56.856882 25379 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:56.846298 25461 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:56.901893 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.867069 25364 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:56.875447 25443 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:56.905576 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.839030 25388 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
W20260709 13:07:56.906910 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 207485us
I20260709 13:07:56.902695 21567 raft_consensus.cc:2376] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8. Re-sending same reply.
I20260709 13:07:56.896057 25455 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.943650 25455 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.903214 25371 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:56.896311 25442 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:56.946228 25366 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:56.946332 25442 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.947943 25442 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.921748 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:56.906877 25461 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.838750 25444 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.900360 25379 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:56.935374 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:56.938323 25459 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.952315 25379 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.953454 25379 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.953540 25459 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.939342 25383 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:56.937954 25466 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.955233 25383 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:56.955628 25466 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.956030 25371 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:56.956226 25383 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.943063 25430 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:56.957446 25430 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:56.957284 25371 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.958338 25430 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:56.959578 25430 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.947072 25366 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:56.962087 25366 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.963845 25366 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:56.964459 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.975250 25155 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:56.976578 25364 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.980090 25155 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:56.988529 25405 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.989280 25405 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:56.989459 25155 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:56.992471 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:57.001667 25375 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:57.002473 25375 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:57.003585 25375 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.028199 21562 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:57.043553 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 178082us
W20260709 13:07:57.043684 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 155726us
I20260709 13:07:57.047947 21635 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:57.048426 21635 pending_rounds.cc:85] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 5
I20260709 13:07:57.048687 21635 pending_rounds.cc:107] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:57.048928 21635 raft_consensus.cc:2889] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:57.049948 21643 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:57.057828 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:57.067962 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.064427 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:57.069343 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:57.069996 21639 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:07:57.071898 21567 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.072721 25399 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:57.073812 25399 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:57.074208 25399 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:57.066834 25383 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:57.075098 25399 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.076395 25399 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:57.076642 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:57.077224 22246 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.079499 25454 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:57.076679 25417 consensus_meta.cc:287] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.532s	user 0.013s	sys 0.003s
I20260709 13:07:57.080509 21390 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:57.081925 25444 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:57.083161 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.083449 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.083925 21567 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:07:57.086014 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.087416 21566 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:57.093679 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.080552 25417 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.105127 25461 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:57.105466 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:57.105971 25417 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:57.106271 21569 raft_consensus.cc:2368] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:07:57.066933 25469 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:57.093308 25466 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:57.111352 22246 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:07:57.116400 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 52054us
I20260709 13:07:57.124380 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:57.117799 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.082391 21390 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 7, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 7 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.127764 21390 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 8, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.133728 21390 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 7, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 7 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:07:57.139623 21608 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.564s (SENT)
I20260709 13:07:57.139905 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:57.140115 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:57.140527 21641 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:57.141116 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:57.141755 21638 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:07:57.135401 21390 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 9, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:57.145229 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:57.145977 21638 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:57.147670 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.149606 21634 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:57.144775 21390 catalog_manager.cc:5697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.152388 21390 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 8, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 8 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:57.110988 25155 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.117102 25443 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.159379 21390 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:57.156563 25466 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:57.166656 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.168355 21390 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 9, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:57.145206 25374 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.171651 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.170760 21390 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 4 to 11, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:57.175392 21560 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:57.175823 21390 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.175832 25437 raft_consensus.cc:2955] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:57.177284 21560 raft_consensus.cc:2955] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:57.178264 21390 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:57.180605 21390 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 9, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:07:57.185683 21608 leader_election.cc:336] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.615s (SENT)
I20260709 13:07:57.186172 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:57.149317 25469 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:57.182355 21390 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 4 to 7, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 7 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:07:57.201817 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 77499.4us
I20260709 13:07:57.203343 21606 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:57.205392 21390 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 11, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:57.164548 25365 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.170418 25444 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.211838 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.217341 21560 raft_consensus.cc:2410] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:57.153061 25415 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:07:57.217715 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.236902 21561 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:57.211078 21390 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 8, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 8 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:57.235836 21391 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 241) took 22979 ms (client timeout 15000 ms). Trace:
I20260709 13:07:57.239197 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.170805 25117 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:07:57.160288 25288 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:07:57.241042 21390 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 10, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 10 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:07:57.170209 25155 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.245898 21390 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 6, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 6 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.247213 22246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:07:57.208473 25405 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:57.250713 21560 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.234930 25443 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.254815 21390 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 9, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:57.243690 25357 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:57.200810 25374 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.238971 25364 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:57.219425 25365 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:57.237962 21391 rpcz_store.cc:269] 0709 13:07:34.449319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.478610 (+ 29291us) service_pool.cc:224] Handling call
0709 13:07:57.217020 (+22738410us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:54.930549 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:54.931298 (+   749us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:54.931345 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:07:54.931374 (+    29us) tablet.cc:662] Decoding operations
0709 13:07:55.193037 (+261663us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:55.193133 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:55.193165 (+    32us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:55.194023 (+   858us) tablet.cc:701] Row locks acquired
0709 13:07:55.194044 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:55.194195 (+   151us) write_op.cc:270] Start()
0709 13:07:55.194316 (+   121us) write_op.cc:276] Timestamp: P: 1783602475194146 usec, L: 0
0709 13:07:55.194340 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:07:55.250661 (+ 56321us) log.cc:844] Serialized 4055 byte log entry
0709 13:07:55.835705 (+585044us) op_driver.cc:464] REPLICATION: finished
0709 13:07:56.272696 (+436991us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a6ed80ac 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98ada18ef0
0709 13:07:56.433876 (+161180us) write_op.cc:301] APPLY: starting
0709 13:07:56.436162 (+  2286us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:56.461606 (+ 25444us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:56.471351 (+  9745us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:56.492916 (+ 21565us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:56.493210 (+   294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:07:56.493257 (+    47us) write_op.cc:312] APPLY: finished
0709 13:07:56.493548 (+   291us) log.cc:844] Serialized 77 byte log entry
0709 13:07:56.493727 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.493858 (+   131us) write_op.cc:454] Released schema lock
0709 13:07:56.493907 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:56.494354 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.494392 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":596101,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":560460,"apply.run_cpu_time_us":3929,"apply.run_wall_time_us":82454,"num_ops":10,"prepare.queue_time_us":47722,"prepare.run_cpu_time_us":39744,"prepare.run_wall_time_us":517202,"raft.queue_time_us":185067,"raft.run_cpu_time_us":19675,"raft.run_wall_time_us":508108,"replication_time_us":630047,"spinlock_wait_cycles":22906752,"thread_start_us":766441,"threads_started":4,"wal-append.queue_time_us":268040}]]}
W20260709 13:07:57.266844 25260 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.693s	user 0.015s	sys 0.006s
I20260709 13:07:57.276714 25260 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.278995 21563 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:57.279863 25260 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:57.267716 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64445us
I20260709 13:07:57.258767 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:57.260149 25389 consensus_meta.cc:287] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.017s
I20260709 13:07:57.283007 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.262545 25357 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:57.289036 21606 leader_election.cc:400] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:57.291267 21606 leader_election.cc:403] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:57.294698 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.275679 25455 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:57.323545 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.299021 25437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58604 (request call id 0) took 1653 ms. Trace:
I20260709 13:07:57.333357 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.319828 25459 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8.
I20260709 13:07:57.333961 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:57.358770 21608 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.789s (SENT)
I20260709 13:07:57.360152 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:07:57.361757 25479 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:57.329088 25448 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:57.267658 25469 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.367342 25287 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.370491 25287 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.331699 25437 rpcz_store.cc:276] 0709 13:07:55.638287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.649116 (+ 10829us) service_pool.cc:224] Handling call
0709 13:07:55.783817 (+134701us) log.cc:844] Serialized 508 byte log entry
0709 13:07:56.273823 (+490006us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b180034f060. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9f3bb0b 00007f98a9fc0b63 00007f98a9fe8752 00007f98a9fe09fa
0709 13:07:57.289374 (+1015551us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212813,"raft.queue_time_us":280536,"raft.run_cpu_time_us":4711,"raft.run_wall_time_us":58781,"spinlock_wait_cycles":9207040,"thread_start_us":185372,"threads_started":1,"wal-append.queue_time_us":230498}
I20260709 13:07:57.375691 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 377467a782f94dd2b6e76b88920dfb8b with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:57.376768 25357 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.387873 22246 raft_consensus.cc:606] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:57.388950 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:57.396095 21560 raft_consensus.cc:2410] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:57.368162 25459 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:57.404690 21643 raft_consensus.cc:2955] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:07:57.416603 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:57.417269 21560 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.420849 25459 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:57.420981 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 87081.9us
I20260709 13:07:57.421829 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:57.430007 21606 leader_election.cc:400] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:07:57.430333 21606 leader_election.cc:403] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:57.431067 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:57.431818 25389 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:57.432475 25389 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.402192 25455 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.435986 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 100146us
I20260709 13:07:57.436713 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:07:57.438006 21608 leader_election.cc:336] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.610s (SENT)
I20260709 13:07:57.438630 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:57.431960 25492 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:07:57.411408 25155 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:57.455109 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:57.457475 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:57.458869 21639 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:57.415102 25374 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:57.463419 22238 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:57.465502 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:57.468029 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 296292us
I20260709 13:07:57.437577 25389 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.462327 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:57.461002 21640 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:57.447834 25478 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:57.475565 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:57.472431 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:57.448428 25443 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.483557 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:57.485255 21637 raft_consensus.cc:2410] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:57.485752 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:57.486423 22245 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:57.487557 21567 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:57.452785 25365 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:57.444079 25455 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.492180 25459 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:57.512809 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.514353 25455 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:57.493414 25357 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.515867 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:57.517616 21567 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.448685 25345 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:07:57.518326 25437 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:57.462410 25489 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:57.518748 25437 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.518906 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.519373 25437 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.520226 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.521098 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:57.521232 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.521637 21566 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.522833 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:57.523114 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.523880 21568 raft_consensus.cc:2410] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:57.524075 25357 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:57.524327 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:57.524827 25357 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.519321 25489 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:57.526259 21565 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:07:57.526631 21565 pending_rounds.cc:85] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 5
I20260709 13:07:57.527071 21565 pending_rounds.cc:107] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:57.526525 25489 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:57.528220 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.492628 25485 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:07:57.528568 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.522643 21564 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:57.512113 25366 consensus_meta.cc:287] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.527s	user 0.015s	sys 0.000s
I20260709 13:07:57.517671 21562 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.531195 25454 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:57.527305 21565 raft_consensus.cc:2889] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:57.532251 21564 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:57.501999 25442 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.554s	user 0.004s	sys 0.012s
I20260709 13:07:57.518808 25484 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:07:57.534077 25484 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:57.534433 25484 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:57.534873 21568 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.534932 25117 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.535250 25484 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.535609 25117 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.536615 25484 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.537799 25117 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:57.539472 25448 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:57.540019 25448 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:57.540539 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.542289 25448 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:57.542732 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:57.543394 25437 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.543741 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:57.544348 21492 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
W20260709 13:07:57.511780 25414 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.638s	user 0.016s	sys 0.010s
I20260709 13:07:57.544958 25480 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:57.514582 25365 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:57.545369 25480 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:57.546142 25365 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:57.546650 25365 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:57.547659 25365 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.550135 25365 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:57.551554 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.543390 21489 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:07:57.552795 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.554244 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.553100 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.558398 21568 raft_consensus.cc:2368] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:07:57.518581 25345 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:57.559146 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.560403 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:57.561105 21489 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:07:57.561136 21487 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.562494 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.563663 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:57.564051 22246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:07:57.564896 22246 raft_consensus.cc:606] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:57.565099 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.565393 22246 raft_consensus.cc:614] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:57.563334 21566 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:57.567385 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.569583 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:57.506592 25379 consensus_meta.cc:287] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.553s	user 0.000s	sys 0.017s
I20260709 13:07:57.570910 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.575910 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.577459 21567 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.578933 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:57.579986 21567 raft_consensus.cc:2410] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:57.581205 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:57.581854 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.583259 21565 raft_consensus.cc:2410] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:57.576076 21563 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:07:57.584532 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.585840 21636 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:57.587836 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.589808 21563 raft_consensus.cc:2410] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:57.593019 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.596593 21560 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:07:57.597443 21567 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:57.560864 25443 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:57.600078 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:57.600560 21487 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:57.560505 25345 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:57.607442 21459 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:57.603199 21560 raft_consensus.cc:2376] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9. Re-sending same reply.
I20260709 13:07:57.546290 25480 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:57.625450 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64232.7us
I20260709 13:07:57.628561 22246 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:57.592077 25442 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.631992 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:07:57.632004 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.632627 22246 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:07:57.639047 25117 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:57.639722 25117 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.639635 25345 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.641160 25345 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.621265 25445 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:57.644603 21641 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:57.640374 25117 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.645046 21641 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:57.648206 25442 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.581059 25357 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:07:57.640107 22238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:07:57.651600 22238 raft_consensus.cc:606] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:57.651955 22238 raft_consensus.cc:614] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:57.652334 25442 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:57.650430 21641 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.602432 25443 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:57.653441 25443 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.653540 21641 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:57.654603 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.644675 25445 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:57.655205 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:57.655488 25445 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:57.656342 25445 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.657016 25389 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.657501 25445 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.639052 25480 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:57.658893 25490 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:57.650362 25464 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:07:57.660048 25464 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:57.660426 25464 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:57.661062 25430 consensus_meta.cc:287] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.701s	user 0.015s	sys 0.003s
I20260709 13:07:57.661245 25464 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.596761 25448 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:07:57.662497 25464 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.663019 25448 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:57.677796 22246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:07:57.719830 22246 raft_consensus.cc:606] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:57.756601 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 77794.2us
I20260709 13:07:57.762028 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.675004 25437 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:57.772753 25389 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:57.760839 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:57.793663 21608 leader_election.cc:336] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.888s (SENT)
I20260709 13:07:57.794219 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:07:57.811486 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.756059 25447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.011s	sys 0.062s
I20260709 13:07:57.813302 21561 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:07:57.677181 25448 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:07:57.818010 25447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.063s
I20260709 13:07:57.817618 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:57.819437 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.820690 21560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:07:57.825877 21560 raft_consensus.cc:606] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:57.826368 21560 raft_consensus.cc:614] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:57.757336 25257 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:57.712786 25357 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:07:57.839018 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:57.845234 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.843394 25359 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:57.847245 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:57.847342 25359 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.847990 25359 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.850942 25371 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:57.898913 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 105288us
I20260709 13:07:57.899330 25399 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:57.899740 25466 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:57.899912 25399 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.901580 25357 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:57.901991 25357 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:57.902076 25399 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:57.827848 25448 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.820007 25502 raft_consensus.cc:2764] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:57.903323 25357 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.905125 21568 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:57.906903 25357 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.890990 25402 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.908396 25402 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:57.909509 25498 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.276s	user 0.002s	sys 0.000s
I20260709 13:07:57.833704 25257 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.914260 25358 raft_consensus.cc:993] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:07:57.914829 25358 raft_consensus.cc:1081] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:07:57.914893 21563 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:57.915951 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 74119.6us
I20260709 13:07:57.916446 25371 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:57.917441 25371 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.918602 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:07:57.899679 21608 leader_election.cc:336] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.897s (SENT)
I20260709 13:07:57.839105 25493 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:57.843578 25468 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:07:57.896150 21565 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:57.896564 21641 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:07:57.897291 21566 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:57.933374 21566 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:57.897716 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.890865 25430 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.920198 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:57.935411 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:57.922830 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 245470us
I20260709 13:07:57.937304 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.935150 21569 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:57.934144 21566 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.939230 21566 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.919312 21638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:36050
I20260709 13:07:57.941315 21638 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.941674 21638 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:57.944525 22246 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:57.947702 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48050us
I20260709 13:07:57.948362 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:07:57.948506 21608 leader_election.cc:336] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.919s (SENT)
I20260709 13:07:57.948935 21492 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:57.948951 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:07:57.918737 25257 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:57.910674 25402 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:57.950079 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:57.946502 25379 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:57.959375 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:57.960274 21568 raft_consensus.cc:2368] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
W20260709 13:07:57.961441 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.967736 21608 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.941s (SENT)
W20260709 13:07:57.969652 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.932319 25482 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:07:57.972515 21566 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:07:57.976730 21566 pending_rounds.cc:85] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 5
I20260709 13:07:57.974673 21638 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.953984 25444 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:57.946864 25065 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:57.939767 25430 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:57.982635 25430 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:57.985802 25287 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:57.936415 25443 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.954197 25155 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:07:57.989648 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.989878 21638 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:57.977151 21566 pending_rounds.cc:107] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:58.011994 21566 raft_consensus.cc:2889] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.013685 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:58.014361 21566 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.946892 25383 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:57.964699 25257 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:58.004473 21608 leader_election.cc:336] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.066s (SENT)
I20260709 13:07:57.937237 25493 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:57.960006 25402 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:57.951538 25389 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:07:57.967379 25414 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.044613 25484 consensus_meta.cc:287] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 13:07:58.045109 22242 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:58.046633 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:58.051146 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:58.055207 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:58.055997 21641 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:07:58.056787 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:58.056931 21635 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:58.057878 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:58.058133 25443 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:58.059075 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:58.059289 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:58.059686 21643 raft_consensus.cc:2376] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10. Re-sending same reply.
I20260709 13:07:58.061216 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:58.061771 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:58.062282 25359 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.062956 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:58.064530 25359 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:58.065346 21642 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:58.065770 25117 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.066741 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:58.067346 21637 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.067962 25117 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:58.069588 22244 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
W20260709 13:07:58.073800 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.074581 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:07:58.023125 21608 leader_election.cc:336] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.111s (SENT)
I20260709 13:07:57.954547 25437 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:07:58.025123 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:58.027293 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:58.027554 21492 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:58.029400 21566 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:58.035305 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:58.077539 22245 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:58.036758 25500 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:07:58.041316 25493 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:58.076274 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:58.078413 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:58.088474 21637 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:58.089509 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:58.094280 21489 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:58.094293 21487 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:07:58.079188 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:58.077625 21560 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:07:58.082229 22242 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:58.077986 22245 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:58.097610 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:58.078598 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:58.098331 21566 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.100730 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:58.102428 21492 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.102720 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:58.072867 25418 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:58.104787 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:58.104931 25418 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:58.105417 21563 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.106302 25428 raft_consensus.cc:993] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:07:58.107395 25469 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:07:58.108553 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 85474.4us
I20260709 13:07:58.109215 25492 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:58.105803 25418 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:58.113549 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:58.117502 21488 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:58.118932 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:58.120520 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:58.125723 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:58.121188 21566 raft_consensus.cc:2410] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:58.129158 21486 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:07:58.122008 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.122666 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:07:58.042397 25414 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:58.027122 25402 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.130729 22242 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:58.124029 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:58.134093 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:58.136714 21487 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:07:58.125267 22245 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.137873 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:58.138890 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:58.139523 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:58.139866 22245 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.140466 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:58.140561 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:58.141238 21638 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:58.143894 25379 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:58.144937 25379 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:58.146207 25379 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:58.146966 25257 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:58.147372 25257 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:58.148304 25257 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.151424 25418 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.151804 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:58.152936 25492 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:58.153209 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.154388 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:58.155049 25257 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.155386 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:58.156033 21560 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:58.157084 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:58.157680 21560 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:07:58.159456 25443 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:58.160991 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:58.161849 25443 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:58.164090 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:07:58.141673 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:07:58.165710 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.168247 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.168134 21638 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.158561 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:58.172191 21485 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:58.172417 21608 leader_election.cc:400] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:07:58.141237 21566 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.167866 22212 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:58.174347 21489 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
W20260709 13:07:58.174890 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.175557 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.179900 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:58.179613 21494 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:58.127182 25469 raft_consensus.cc:1081] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:07:58.188834 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:58.191236 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:58.215010 21638 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:07:58.215327 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:58.217113 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.217820 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:58.218611 21637 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
W20260709 13:07:58.221521 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.222039 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.136843 25402 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.197369 22244 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:07:58.224721 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:58.226174 21560 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:58.226362 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.187557 25500 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:58.231127 22245 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:58.178498 25443 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:58.234018 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:58.235229 21565 raft_consensus.cc:2410] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:58.178501 25430 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:58.242254 21566 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:07:58.247805 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:58.250002 25389 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.250618 25389 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:58.252996 25389 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:58.250631 21565 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:58.224309 25492 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.229619 25415 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.273419 21560 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:07:58.275277 21532 connection.cc:256] RPC call timeout handler was delayed by -1.7042929169999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:07:58.276584 21532 connection.cc:256] RPC call timeout handler was delayed by -1.6601929170000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:07:58.276927 21532 connection.cc:256] RPC call timeout handler was delayed by -1.6601929170000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
I20260709 13:07:58.231480 25428 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:58.277204 21532 connection.cc:256] RPC call timeout handler was delayed by -1.6241929170000731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:07:58.277658 21532 connection.cc:256] RPC call timeout handler was delayed by -1.5539929170000732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 13:07:58.278416 21532 connection.cc:256] RPC call timeout handler was delayed by -1.4378929169999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 13:07:58.278870 21532 connection.cc:256] RPC call timeout handler was delayed by -1.3757929170000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 13:07:58.279398 21532 connection.cc:256] RPC call timeout handler was delayed by -1.3334929170000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 13:07:58.280040 21532 connection.cc:256] RPC call timeout handler was delayed by -1.3172929170000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 13:07:58.280946 21532 connection.cc:256] RPC call timeout handler was delayed by -1.2308929170000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 13:07:58.281390 21532 connection.cc:256] RPC call timeout handler was delayed by -1.221892916999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20260709 13:07:58.281872 21532 connection.cc:256] RPC call timeout handler was delayed by -1.221892916999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20260709 13:07:58.282251 21532 connection.cc:256] RPC call timeout handler was delayed by -1.1777929170000334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 13:07:58.282635 21532 connection.cc:256] RPC call timeout handler was delayed by -1.1336929170000758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260709 13:07:58.283133 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0580929170000672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2318s for a response
W20260709 13:07:58.284243 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.283586 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0238929170000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2356s for a response
W20260709 13:07:58.285729 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0238929170000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2356s for a response
I20260709 13:07:58.287184 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:58.270819 25430 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.295419 21567 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:58.299959 25357 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.300559 25357 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:58.302665 25357 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:58.279208 25415 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.308164 25515 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.277467 25492 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:58.313393 21563 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:07:58.308733 25515 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:58.322504 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.307890 25415 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:58.328022 25414 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:58.331264 25428 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:58.331966 25428 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.340555 25492 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:58.341612 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 69871.4us
I20260709 13:07:58.343997 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:58.347278 25386 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:58.347779 25386 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:58.348672 25386 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:58.349540 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51083.8us
I20260709 13:07:58.351891 25437 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:58.353013 25518 raft_consensus.cc:2764] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:07:58.355724 25461 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:58.356312 25461 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:58.364760 25287 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.365753 25287 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.372135 21643 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:58.376164 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:07:58.378067 25257 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:58.378743 25257 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:07:58.380292 25257 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:58.383025 25475 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.208s	user 0.008s	sys 0.015s
I20260709 13:07:58.383087 21637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:36050
I20260709 13:07:58.384851 21637 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:58.385314 21637 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.387293 21561 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:58.387801 21561 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:58.427696 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:58.428454 21487 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.435127 21561 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:58.436460 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:58.437218 21486 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:07:58.357508 25461 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.443822 25287 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:58.446260 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.449788 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:58.436642 21561 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.451865 21638 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
W20260709 13:07:58.454571 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.453666 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:07:58.446687 25513 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:07:58.491343 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.518216 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.462044 25469 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:58.550588 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 263470us
I20260709 13:07:58.661000 21487 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:07:58.661818 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:58.598425 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.664184 21561 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
W20260709 13:07:58.656680 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.456589 25461 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.654776 21637 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.667948 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:58.700167 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:58.701377 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:07:58.671185 25402 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.675400 25517 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:58.677351 25448 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.660665 25442 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.714650 25442 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:58.717134 25442 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:58.681008 25405 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:58.717815 25405 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:58.664480 25469 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.668706 25519 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:58.719496 21641 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:58.719960 25519 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:58.666654 25483 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.195s	user 0.005s	sys 0.005s
W20260709 13:07:58.695899 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.698464 21561 pending_rounds.cc:85] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 4
I20260709 13:07:58.712479 25402 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:58.706854 25518 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:58.707360 25414 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:58.720870 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:58.724540 25519 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:58.722535 21561 pending_rounds.cc:107] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:58.723063 21637 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:58.730675 21563 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:07:58.743489 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.719514 25469 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.751964 21561 raft_consensus.cc:2889] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:58.735834 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.763136 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:07:58.756152 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 47712us
I20260709 13:07:58.765564 21459 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:58.769533 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:58.770364 21563 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.732347 25515 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:07:58.774677 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.770251 25442 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:58.788883 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:07:58.774461 25364 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:07:58.792448 25442 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.810087 25519 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.815382 25442 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.797500 25463 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:58.799041 25371 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.784363 25484 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:07:58.825150 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.833842 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.832530 21563 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
W20260709 13:07:58.840764 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.844048 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 78586.1us
I20260709 13:07:58.846711 25365 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:58.874121 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 172775us
I20260709 13:07:58.876673 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:58.879187 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.837885 22212 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:07:58.890698 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52912.8us
I20260709 13:07:58.826217 25463 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:58.722395 25405 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:58.910060 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 104947us
I20260709 13:07:58.895068 25375 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:58.899268 25386 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:58.917791 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 71713.7us
I20260709 13:07:58.825452 25371 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:07:58.924260 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47802.6us
I20260709 13:07:58.924834 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:58.926486 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:58.922407 21459 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:58.928217 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:58.926903 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:58.942948 22245 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:58.915375 25414 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 9 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:58.942344 25364 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.945854 25386 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:07:58.960692 25386 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.962924 25542 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:58.963691 25542 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:58.964025 25542 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:58.964372 25542 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.965076 25430 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:07:58.972904 25524 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:07:58.948581 25536 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:58.976164 25536 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.976560 25536 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:58.976955 25536 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.931012 25356 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:58.921147 25375 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:58.942441 25492 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:07:59.034145 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 105226us
I20260709 13:07:59.053330 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:59.026290 21493 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:07:58.959048 25364 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.033056 25448 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:59.022874 25482 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:59.057385 21563 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:59.057837 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 130922us
W20260709 13:07:59.058763 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.057897 21569 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:58.956557 25257 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
W20260709 13:07:59.121394 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.146718 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.151532 25443 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.160967 25525 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:07:59.160885 25443 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:59.164825 25527 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:07:59.044888 25357 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:07:59.237449 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.238122 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.052306 25518 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:07:59.159601 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 100904us
I20260709 13:07:59.248459 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:59.061007 25364 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.060585 25448 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:59.290731 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 122029us
I20260709 13:07:58.949628 25463 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.295521 21532 leader_election.cc:400] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9.
I20260709 13:07:59.051896 25442 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.306404 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:59.302901 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 374954us
W20260709 13:07:59.308224 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.055576 25492 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.166612 25414 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.292333 25533 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.321624 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:59.319988 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:07:59.322367 21485 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.152504 25482 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.303534 25448 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:59.318542 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.325251 21486 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:59.327565 25547 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:59.330338 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.329471 25545 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.332273 25544 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:59.331849 25545 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:59.331349 25529 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:07:59.334542 25545 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.337545 25545 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:59.338274 25545 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.341444 25545 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:59.343364 25519 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:59.337571 25379 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:59.305769 25534 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:59.261875 25357 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:59.322566 25461 consensus_meta.cc:287] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.002s
I20260709 13:07:59.314056 25402 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:07:59.367791 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:07:59.368345 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.374076 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.370251 25379 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:59.377277 25539 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:59.303633 25540 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:07:59.386626 21635 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:59.387099 21635 pending_rounds.cc:85] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 9
I20260709 13:07:59.387344 21635 pending_rounds.cc:107] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:59.388422 21635 raft_consensus.cc:2889] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.388900 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:07:59.390424 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:59.404654 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:59.432715 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:59.366871 25534 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:59.452152 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.452780 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.422686 21485 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:07:59.370857 25257 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:59.419814 25519 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:59.464289 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.387771 25443 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:59.420832 25533 raft_consensus.cc:2764] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:07:59.468246 25492 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:59.453442 25371 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:59.469553 25443 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:59.470165 25443 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.471879 25357 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:59.472810 25443 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:59.473994 25469 consensus_meta.cc:287] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.702s	user 0.004s	sys 0.004s
W20260709 13:07:59.474912 25428 consensus_meta.cc:287] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 1.142s	user 0.014s	sys 0.000s
I20260709 13:07:59.475329 25428 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.476323 22238 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:59.468655 25542 consensus_meta.cc:287] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.002s
I20260709 13:07:59.477366 25542 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.479250 25549 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:59.479717 25549 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.480067 25549 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.480988 25542 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:59.481308 25428 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.482050 25542 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:59.482206 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 556) took 1034 ms. Trace:
I20260709 13:07:59.482583 25542 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:59.482965 25531 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:59.482671 22238 rpcz_store.cc:276] 0709 13:07:58.447713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.448791 (+  1078us) service_pool.cc:224] Handling call
0709 13:07:58.449217 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.476691 (+1027474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.478656 (+  1965us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400540e54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:07:59.482143 (+  3487us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361710464}
I20260709 13:07:59.487563 25519 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:59.491003 25356 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:59.491273 25418 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:59.492022 25418 consensus_queue.cc:1243] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:59.492127 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:59.492604 25418 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:59.491459 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:59.453682 25534 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.493659 21563 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:07:59.493806 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 186099us
I20260709 13:07:59.391717 25402 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.491688 25519 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:59.497699 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.498859 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:07:59.496716 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:59.474443 25469 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.492972 25418 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:07:59.486590 25557 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:59.461746 25257 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.508543 25492 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.483727 25542 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.534722 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:07:59.522032 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:59.387326 25518 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.520836 25546 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:59.548985 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:59.512637 25545 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:59.552170 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.552716 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:07:59.561189 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:07:59.563006 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.545789 25522 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.541827 25557 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.577010 21485 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:59.548166 25546 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:59.575174 25442 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.578392 25546 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.619257 25555 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:59.619917 25555 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.616770 25546 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.622246 25555 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:59.622843 25546 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.554633 25545 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:59.681830 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.669118 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.733064 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:59.643819 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1581) took 1543 ms. Trace:
I20260709 13:07:59.737283 21493 rpcz_store.cc:276] 0709 13:07:58.102261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.102410 (+   149us) service_pool.cc:224] Handling call
0709 13:07:59.643547 (+1541137us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54002779d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:07:59.643699 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983162112}
W20260709 13:07:59.740274 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 307665us
I20260709 13:07:59.741881 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:59.566921 25550 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:59.571902 25540 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.744338 21567 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:59.715919 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 150444us
I20260709 13:07:59.552397 25415 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:07:59.542301 25492 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:59.654569 25520 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.885s	user 0.004s	sys 0.012s
I20260709 13:07:59.553826 25356 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.174s
I20260709 13:07:59.755722 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:59.759809 21567 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:59.583055 25553 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:59.742895 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:59.758330 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:07:59.742614 25536 consensus_meta.cc:287] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.765s	user 0.012s	sys 0.001s
I20260709 13:07:59.595587 25379 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:59.629499 25482 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:59.572744 25418 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.766175 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:59.740710 25389 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.741616 25545 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.740108 25555 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.753695 25533 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:59.597467 25557 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:59.771790 25536 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.626672 25364 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.576766 25522 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.586236 25448 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:07:59.789731 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.784241 25379 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:59.791468 25379 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.775961 25389 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.796337 25492 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:59.796666 25389 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:59.797624 25469 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.778777 25482 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.798259 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.798556 25482 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.766608 25418 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.781881 25402 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.781710 25414 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:59.836937 25531 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:59.802634 25549 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.786665 25533 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:07:59.838177 25364 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.838935 25482 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:07:59.786052 25548 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:07:59.782935 25388 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:07:59.866425 21564 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:07:59.842141 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:59.846100 25534 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.847312 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2560) took 1772 ms. Trace:
I20260709 13:07:59.852532 25536 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.854607 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:59.782307 25555 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.858319 25522 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.873045 21565 rpcz_store.cc:276] 0709 13:07:58.075087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.256368 (+181281us) service_pool.cc:224] Handling call
0709 13:07:58.256658 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.286892 (+ 30234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.286924 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.287410 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.649313 (+361903us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:58.649372 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.649445 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.653725 (+1004280us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:59.846982 (+193257us) raft_consensus.cc:1685] finished
0709 13:07:59.847005 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.847227 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66886,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":108925,"spinlock_wait_cycles":23970560,"thread_start_us":302256,"threads_started":2,"wal-append.queue_time_us":413579}
W20260709 13:07:59.881876 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 315481us
I20260709 13:07:59.886363 25536 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:59.887120 25536 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.888023 25555 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:07:59.888266 25526 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.164s	user 0.005s	sys 0.014s
I20260709 13:07:59.864224 25531 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:59.894376 21643 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:59.896365 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:59.900156 21637 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:59.901393 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:59.902733 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:59.909292 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:59.918711 21638 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:07:59.918864 21637 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:59.920068 22211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.006s	sys 0.006s
W20260709 13:07:59.920819 22211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.006s	sys 0.006s
I20260709 13:07:59.923027 21637 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:59.923187 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:59.924134 21641 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:07:59.926393 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:59.926584 21567 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:07:59.882652 25482 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.928766 21634 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:59.927109 21637 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:07:59.932317 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2562) took 1856 ms. Trace:
W20260709 13:07:59.936123 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.889302 25364 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:07:59.932426 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:07:59.934502 21566 rpcz_store.cc:276] 0709 13:07:58.075623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.271797 (+196174us) service_pool.cc:224] Handling call
0709 13:07:58.272447 (+   650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.309583 (+ 37136us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:58.309622 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.313267 (+  3645us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.647131 (+333864us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:58.647175 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.647357 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.887718 (+1240361us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:07:59.928045 (+ 40327us) raft_consensus.cc:1685] finished
0709 13:07:59.928065 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.932243 (+  4178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79882,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"spinlock_wait_cycles":145062144,"thread_start_us":205570,"threads_started":2,"wal-append.queue_time_us":345041}
I20260709 13:07:59.943706 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:07:59.944501 21561 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.945442 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:59.912786 25555 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:07:59.911705 25415 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:07:59.960942 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:59.962391 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:59.963213 21636 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.942375 25519 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.951596 25492 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:07:59.977564 21460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.010s	sys 0.039s
W20260709 13:07:59.977950 21460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.011s	sys 0.040s
W20260709 13:07:59.987520 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.992962 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 226834us
I20260709 13:07:59.975042 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:07:59.994573 21634 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.993981 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:07:59.960201 25536 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:07:59.951311 25364 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.007560 21561 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:07:59.951094 25482 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.004990 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:00.010448 21636 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:07:59.971808 25448 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.922406 25533 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:07:59.974051 25357 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:07:59.979079 25549 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:07:59.957134 25555 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:00.040357 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.021258 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:00.043867 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:00.013358 25546 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.083199 25531 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:00.085448 25531 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.094480 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:07:59.980273 25519 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:07:59.993847 25492 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.097136 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:00.185432 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 88386.2us
W20260709 13:08:00.072535 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 55565us
W20260709 13:08:00.109061 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.188313 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.096148 21567 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:00.189579 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:00.025256 25389 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.021639 25442 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.096110 25542 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:00.093488 25534 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:00.097931 25523 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 1.153s	user 0.006s	sys 0.011s
I20260709 13:08:00.086684 25546 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.024993 25536 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.252195 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.284371 21642 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.177258 25557 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:00.048173 25568 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.182201 25566 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.049072 25518 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:00.124516 25257 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:00.176486 25414 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:00.035254 25357 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:00.228775 25517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.515s	user 0.013s	sys 0.051s
I20260709 13:08:00.329075 21566 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:08:00.354945 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.320725 22212 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:00.094689 25545 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:00.350039 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.257788 25469 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.112439 25549 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.212s
W20260709 13:08:00.301797 25430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.049s	sys 0.128s
I20260709 13:08:00.302452 25550 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.248422 25366 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.363224 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.364439 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.366674 21642 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:00.367426 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:00.323613 25542 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:00.369287 21494 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:00.371492 21489 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:00.373318 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:00.304068 25563 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.348642 25566 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.382738 21488 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:08:00.373966 25430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.050s	sys 0.133s
W20260709 13:08:00.362923 25517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.650s	user 0.013s	sys 0.052s
I20260709 13:08:00.388070 21486 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:00.388666 21492 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:00.387012 21567 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:00.327852 25388 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:08:00.283449 25442 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.257680 25389 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.396095 25519 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:00.393285 25566 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.374858 25484 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:00.402696 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 213193us
I20260709 13:08:00.409487 21488 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.374879 25518 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:00.336853 25536 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.347656 25557 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.390359 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.432547 21485 raft_consensus.cc:2368] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11.
I20260709 13:08:00.348891 25568 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.375677 25469 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.422772 21608 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:00.382354 25550 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.393775 25563 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.453192 21493 raft_consensus.cc:2410] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:00.428164 25257 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:00.430629 25484 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:00.469246 25545 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:00.469645 25546 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:00.474927 25581 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:08:00.476161 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 618) took 2104 ms. Trace:
I20260709 13:08:00.476670 21635 rpcz_store.cc:276] 0709 13:07:58.371848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.372260 (+   412us) service_pool.cc:224] Handling call
0709 13:07:58.372558 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.388851 (+1016293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.475870 (+1087019us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000bcf54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:00.476073 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2331215232}
W20260709 13:08:00.476259 25592 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:00.487236 21634 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
W20260709 13:08:00.459780 25570 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
W20260709 13:08:00.456327 25575 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
I20260709 13:08:00.449054 25364 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:00.480031 25576 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:08:00.468881 25597 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.516340 25577 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
W20260709 13:08:00.536747 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 114151us
I20260709 13:08:00.537698 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:00.456893 25414 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.522486 25257 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.543679 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 84724.7us
I20260709 13:08:00.550156 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:00.456723 25542 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.509394 25566 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.540279 25482 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:00.544255 25521 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.560827 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:00.564563 21640 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:00.572300 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:00.578613 21640 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.548842 25555 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:00.553550 25357 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:00.586898 25602 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:00.587491 25482 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.547194 25484 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.529456 25518 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.575268 25521 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.593462 25548 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.525986 25597 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.593681 25598 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:08:00.602150 25605 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.582032 25599 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.602425 25536 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:00.553467 25257 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.632766 25599 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.634466 25257 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:00.606567 21492 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:00.635672 21492 pending_rounds.cc:85] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 8
I20260709 13:08:00.636029 21492 pending_rounds.cc:107] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:00.636255 21492 raft_consensus.cc:2889] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:00.607492 25582 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:08:00.636948 21491 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:00.638837 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2573) took 1577 ms. Trace:
I20260709 13:08:00.639176 22239 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:00.639791 22239 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:08:00.607802 25578 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:08:00.608253 25566 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:00.608393 25356 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.608527 25590 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:08:00.609210 25583 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:08:00.609537 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.594357 25492 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:00.599321 25555 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.602454 25442 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:00.603107 25602 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.699368 25599 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:00.699860 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2582) took 1192 ms. Trace:
I20260709 13:08:00.618712 21635 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:00.665304 22239 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.700531 21636 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.618505 21486 raft_consensus.cc:1217] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.9->[8.10-8.10]   Dedup: 8.10->[]
W20260709 13:08:00.620008 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 78115.9us
I20260709 13:08:00.620780 21489 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:00.701627 21486 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:08:00.621198 21487 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:00.703104 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.703950 21487 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:00.705199 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.700243 21563 rpcz_store.cc:276] 0709 13:07:59.507640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.508665 (+  1025us) service_pool.cc:224] Handling call
0709 13:07:59.508977 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.509312 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.509339 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.671503 (+162164us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b2c00010da8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:07:59.672110 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.020540 (+348430us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:00.020630 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.020915 (+   285us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.699576 (+678661us) raft_consensus.cc:1685] finished
0709 13:08:00.699601 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.699804 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1763,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":9931,"spinlock_wait_cycles":7630592,"thread_start_us":347507,"threads_started":1,"wal-append.queue_time_us":362711}
I20260709 13:08:00.639336 21569 rpcz_store.cc:276] 0709 13:07:59.061125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.062608 (+  1483us) service_pool.cc:224] Handling call
0709 13:07:59.062993 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.167058 (+104065us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:59.507877 (+340819us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b18002fff80. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98ad9da3c7 00007f98a9fec9a7 00007f98a9ffc0bf 00007f98a9ffc038
0709 13:07:59.768510 (+260633us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.965299 (+196789us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.974034 (+  8735us) log.cc:844] Serialized 26 byte log entry
0709 13:07:59.974313 (+   279us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:59.974405 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.974552 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.638413 (+663861us) raft_consensus.cc:1685] finished
0709 13:08:00.638565 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.638738 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4851,"prepare.queue_time_us":299844,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":194042,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":25929,"spinlock_wait_cycles":26964864,"thread_start_us":439790,"threads_started":2,"wal-append.queue_time_us":309375}
I20260709 13:08:00.621505 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.623027 25469 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:00.623561 25597 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:00.627768 25375 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:00.628263 25405 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.629043 25521 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:00.618997 25548 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.631531 25605 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.635506 25550 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:00.604005 25606 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:00.662345 22246 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:00.663795 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.665781 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:00.640933 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:00.675951 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.677021 21494 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:00.691850 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:00.742270 22242 raft_consensus.cc:2368] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7.
I20260709 13:08:00.693408 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:00.694751 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.742688 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.743239 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:00.695883 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.912s (SENT) [suppressed 26 similar messages]
I20260709 13:08:00.743882 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:00.744156 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48318.6us
I20260709 13:08:00.744500 21491 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:00.745316 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.697185 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:00.698609 25418 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.865s	user 0.008s	sys 0.005s
I20260709 13:08:00.710078 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.743675 21494 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:00.706674 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.747915 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.748358 22243 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:00.708673 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:00.748647 21494 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:00.618289 25482 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.714031 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:00.636265 25563 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:00.760321 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:00.723026 25557 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:00.723323 21636 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:00.724112 25389 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:00.731472 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:00.640856 25545 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.662710 25357 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:08:00.739446 21560 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:00.768004 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:00.746579 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:00.748867 21486 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.741482 21492 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:08:00.769232 21563 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.770313 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.771312 21492 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:00.772272 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.749534 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:00.678427 25568 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:00.752044 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:00.774390 21565 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:00.775269 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:00.776378 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:00.776981 21565 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:00.753564 21459 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:00.756198 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:00.758095 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.677754 25356 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:00.759451 21485 raft_consensus.cc:2410] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:00.760252 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:00.662777 25522 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:00.760689 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:00.787115 22246 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.761224 22245 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:00.762185 21490 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:00.763562 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.764467 21489 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.780407 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:00.789116 21565 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:00.791069 25602 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:00.784111 21640 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:00.741215 25469 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:00.785640 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:00.803617 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:00.804100 21561 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:00.804306 21637 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:00.805109 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:00.806597 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:00.805033 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:00.811853 21640 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:00.821007 21563 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:00.796530 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.821636 21637 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.825291 21490 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:00.746841 25399 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:08:00.827575 21487 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:00.827831 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.824435 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:00.827765 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.832942 21485 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:00.835017 21489 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:00.791137 25418 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:00.837319 22246 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:00.838570 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.841842 21489 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:00.837073 21486 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:08:00.842893 21492 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:00.839831 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:08:00.850052 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.765267 25482 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:00.872466 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.844197 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.872871 21637 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:08:00.873126 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.784857 25545 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:00.874326 21608 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.720s (SENT)
I20260709 13:08:00.875283 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.872538 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.841180 25375 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:00.881225 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:00.746881 25606 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.883381 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.884510 21486 raft_consensus.cc:2410] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:00.803112 25522 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:00.901408 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 140062us
I20260709 13:08:00.877153 25605 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:00.887420 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.910364 21486 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:08:00.910737 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.910408 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.894138 22241 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:00.896308 21494 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:00.911671 21485 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:00.820616 25469 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:00.830924 25536 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:00.830174 25388 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:00.903607 22212 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:00.912352 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.966835 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:00.967705 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64189.2us
I20260709 13:08:00.967960 22242 raft_consensus.cc:2410] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:08:00.967402 21494 raft_consensus.cc:2376] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12. Re-sending same reply.
I20260709 13:08:00.886628 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:00.921826 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.886300 25375 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.962474 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.962771 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:00.963645 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 123898us
I20260709 13:08:00.979820 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:00.980707 21494 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:08:00.973778 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:00.982035 21634 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:00.975975 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:00.983249 21637 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.906913 25611 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.188s
I20260709 13:08:01.012097 25548 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.015928 25611 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.016434 25548 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:01.016534 25611 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:00.964740 25582 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:00.998868 25375 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.977466 25542 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.017937 25542 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.019793 25522 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.007827 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:01.020537 25522 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.020830 21634 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.020898 25522 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:01.021351 25522 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.024645 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:01.025832 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:01.027279 25618 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:08:01.028374 21634 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:01.019906 25542 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:01.028683 25617 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:08:01.005853 21637 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:01.028489 25375 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.033990 25557 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:01.034924 25557 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.033996 25375 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:01.037374 25557 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:01.033044 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:00.980592 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:01.032604 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:01.039378 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58860.3us
I20260709 13:08:01.039841 21634 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:08:01.017004 25548 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:01.046517 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:01.004251 25518 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:01.048405 25518 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:01.050067 25616 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:08:01.052320 25606 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:01.053918 21485 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:01.054962 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:01.055919 21485 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:01.056680 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:01.060658 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:01.061340 21634 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:01.062752 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:01.063560 21634 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:01.040089 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:01.072072 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:01.073562 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:01.075784 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:01.076808 21637 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:01.079098 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:01.030515 25442 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:01.096140 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:01.096365 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:01.096776 21561 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.096939 21565 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:01.095762 25611 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.068217 25418 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:01.099093 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:01.050661 25518 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.068573 25388 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:01.114058 21636 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:01.106024 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:01.115535 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:01.116318 22246 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:01.116380 21636 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:08:01.058413 25548 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.110706 25418 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.111769 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:01.112042 25375 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:01.112413 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:01.119865 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 47899.5us
I20260709 13:08:01.131886 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:01.132531 21634 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:01.120699 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:01.129168 21561 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:01.134011 21565 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:01.134371 21565 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:01.131086 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:01.133597 21491 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
W20260709 13:08:01.138538 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.138804 22241 raft_consensus.cc:2393] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:01.135301 21565 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.098405 25626 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:01.136570 25552 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:01.146015 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:01.099588 25625 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:01.121065 25388 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.155195 21565 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.166368 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:01.166606 25632 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.167034 21634 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:01.167125 25632 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.167544 25632 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:01.175194 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 206864us
I20260709 13:08:01.101866 25442 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.158291 25552 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.153225 25356 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.163893 25388 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:01.189595 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.163079 25518 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:01.189061 25552 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.162678 25375 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:01.164876 25624 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:08:01.256100 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.257495 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:01.215154 21381 maintenance_manager.cc:419] P 8a31697310664f6da99c69fbc04b3926: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033388
W20260709 13:08:01.262089 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.261946 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:01.264056 21565 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:01.278662 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:01.281123 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:01.198136 25482 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:01.192112 25386 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.282887 22244 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:01.183383 25625 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.261008 25469 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:01.294582 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.301168 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 167800us
I20260709 13:08:01.301906 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:01.258976 25518 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.307880 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:01.300783 25626 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:01.319494 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:01.319978 25418 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:01.322404 25418 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:01.323338 25418 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.332026 25375 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:01.332715 25375 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:01.334684 25375 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.310695 25463 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:01.336223 25463 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:01.336602 25463 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.336762 25625 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:01.320853 25632 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.339593 25442 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:01.340515 25593 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.864s	user 0.000s	sys 0.002s
I20260709 13:08:01.341007 25632 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.292204 25386 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.342016 22246 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
W20260709 13:08:01.343775 21564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2584) took 1822 ms (client timeout 1923 ms). Trace:
I20260709 13:08:01.344271 25518 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:01.344197 21564 rpcz_store.cc:269] 0709 13:07:59.521648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.521807 (+   159us) service_pool.cc:224] Handling call
0709 13:08:01.343545 (+1821738us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400152054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:01.343675 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737089920}
W20260709 13:08:01.346062 25627 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.281s	user 0.003s	sys 0.000s
I20260709 13:08:01.347009 22239 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.348330 25522 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:01.361307 25588 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.972s	user 0.004s	sys 0.004s
I20260709 13:08:01.362056 21489 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:01.363824 21494 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:01.367743 22239 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
W20260709 13:08:01.368335 22239 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 559) took 2587 ms (client timeout 2137 ms). Trace:
W20260709 13:08:01.368703 22239 rpcz_store.cc:269] 0709 13:07:58.781099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.781244 (+   145us) service_pool.cc:224] Handling call
0709 13:08:00.639001 (+1857757us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b540037ba20. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f59dc0 00007f98a9fe5e18 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:01.346803 (+707802us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b58007328d0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f3e0aa 00007f98a9fc0447 00007f98a9fd8fe7 00007f98a9fda7de 00007f98a9fe627c 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c
0709 13:08:01.368260 (+ 21457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227169920}
W20260709 13:08:01.373039 25468 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:08:01.375852 25626 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:01.379527 21642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2384) took 1426 ms (client timeout 1848 ms). Trace:
W20260709 13:08:01.380321 21642 rpcz_store.cc:269] 0709 13:07:59.952757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.952991 (+   234us) service_pool.cc:224] Handling call
0709 13:08:01.379253 (+1426262us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540009c254. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:01.379407 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741076864}
I20260709 13:08:01.372690 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:01.384632 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:01.385509 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:01.385823 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:01.386152 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:01.388445 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:01.390813 21566 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:01.392153 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:01.396857 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:01.398339 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:01.399282 25637 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.399732 25637 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.400149 25637 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.404663 21565 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:01.405889 25634 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:01.406683 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.393245 25442 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:01.409096 25442 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:01.409516 25442 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.408116 25536 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:01.411026 25536 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.410943 25463 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.411566 25536 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.406442 25634 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.412599 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:01.412912 25634 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.413415 25463 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:01.393815 25564 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.415140 25522 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.406656 25356 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:01.432367 25379 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:01.385751 25548 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.449117 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:01.449766 21566 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.435599 25552 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.461277 25552 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:01.476434 25515 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:08:01.484632 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.485837 22240 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
W20260709 13:08:01.489871 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.436637 25632 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:08:01.428264 25605 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:01.500353 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:01.501636 25534 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:01.502179 21457 leader_election.cc:400] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7.
I20260709 13:08:01.499179 21566 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:01.503381 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:01.503876 22212 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:01.488991 25552 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:08:01.485158 25356 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:01.509904 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:01.512449 21566 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:01.514055 25637 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:01.519941 25568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.006s	sys 0.001s
W20260709 13:08:01.520591 25568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.006s	sys 0.001s
I20260709 13:08:01.522985 25637 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.502185 25534 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:01.523509 25388 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.525904 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1585) took 1165 ms. Trace:
I20260709 13:08:01.539978 21493 rpcz_store.cc:276] 0709 13:08:00.360762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.362933 (+  2171us) service_pool.cc:224] Handling call
0709 13:08:01.525672 (+1162739us) spinlock_profiling.cc:243] Waited 77.2 ms on lock 0x7b54000e10d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:01.525836 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177644288}
I20260709 13:08:01.523629 25386 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.529506 25634 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.509486 25522 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:01.545912 21565 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:01.511912 25548 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:01.555748 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.543696 25649 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:01.592757 25573 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.221s	user 0.000s	sys 0.007s
I20260709 13:08:01.593722 25534 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.560012 25522 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:01.559374 25386 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:08:01.617666 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2571) took 2559 ms. Trace:
I20260709 13:08:01.618866 21568 rpcz_store.cc:276] 0709 13:07:59.056657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.056769 (+   112us) service_pool.cc:224] Handling call
0709 13:07:59.061731 (+  4962us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.062115 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:59.554894 (+492779us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.929493 (+374599us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.929992 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:07:59.930120 (+   128us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:59.930152 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.930230 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.592431 (+1662201us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b24000f86a8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6d7b9c4 00007f98a6d79acb 00007f98a6f34dc9 00007f98a6f34a55 00007f98a6f3409d 00007f98a9b6610e 00007f98a9b7d88c 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221
0709 13:08:01.595506 (+  3075us) raft_consensus.cc:1685] finished
0709 13:08:01.615281 (+ 19775us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.615513 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":282392,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":3470,"raft.queue_time_us":75241,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":57356,"spinlock_wait_cycles":15163776,"thread_start_us":762041,"threads_started":2,"wal-append.queue_time_us":674793}
W20260709 13:08:01.640640 25580 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.338s	user 0.002s	sys 0.000s
I20260709 13:08:01.514899 25356 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:01.649255 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 145968us
I20260709 13:08:01.649969 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:01.653234 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:01.656649 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:01.616978 25442 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.664405 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:01.651541 25568 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:01.667449 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:01.676952 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:01.678421 21637 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:01.658044 25625 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.682765 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:01.682161 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:01.683761 21636 raft_consensus.cc:2368] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7.
I20260709 13:08:01.659325 25551 raft_consensus.cc:2764] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:01.660643 25602 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.684912 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:01.689193 21640 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.660425 25379 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:01.686857 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:01.690336 22241 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:08:01.751670 25652 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:08:01.659579 25552 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:08:01.657742 25649 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:01.720496 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:01.719913 25379 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.712271 25602 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.712467 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:01.711900 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:01.794404 21490 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:01.750921 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:01.720741 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:01.796288 21493 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:01.796439 25366 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:01.796931 25366 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:01.712553 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:01.712010 25442 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:01.713132 25653 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.671012 25522 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.684048 25637 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.777987 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.778277 21640 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
W20260709 13:08:01.781167 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.792528 21494 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:08:01.786231 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:01.731949 25357 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:01.708129 25418 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.797089 25379 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:01.777073 25388 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.784343 25634 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.849161 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:01.823743 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.816828 21457 leader_election.cc:400] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7.
I20260709 13:08:01.841671 25637 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.850577 21457 leader_election.cc:403] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:08:01.851245 21637 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.840040 25442 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:01.844694 25418 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:01.860718 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44103.6us
W20260709 13:08:01.847088 25665 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:01.813139 25653 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.862244 25442 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.862316 25365 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.891057 22242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 685) took 1152 ms. Trace:
I20260709 13:08:01.891528 22242 rpcz_store.cc:276] 0709 13:08:00.738496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.742998 (+  4502us) service_pool.cc:224] Handling call
0709 13:08:01.890733 (+1147735us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54003b3b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:01.890964 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515094784}
I20260709 13:08:01.892645 22243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 566) took 1192 ms. Trace:
I20260709 13:08:01.893065 22243 rpcz_store.cc:276] 0709 13:08:00.699846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.766037 (+ 66191us) service_pool.cc:224] Handling call
0709 13:08:01.890998 (+1124961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.891224 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.891250 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:01.891293 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:01.891337 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.891421 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.892437 (+  1016us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003b3b50. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:01.892576 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2553942272}
I20260709 13:08:01.895704 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:01.895939 21637 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:01.886283 25442 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.862253 25658 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:08:01.902925 25655 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:08:01.913520 25602 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:01.921736 25664 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:01.922152 25637 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.928861 25545 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:01.929795 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.928966 25653 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.932183 25366 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:01.929996 25418 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:01.928996 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.945730 21637 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:08:01.951045 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 225657us
W20260709 13:08:01.915520 25536 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.000s
I20260709 13:08:01.959020 25536 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.961258 25536 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:01.956682 25414 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:01.963431 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.974017 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2379) took 2043 ms. Trace:
I20260709 13:08:01.979204 21606 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:01.996331 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:01.954464 25515 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.012295 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:01.981096 25414 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:01.974606 21639 rpcz_store.cc:276] 0709 13:07:59.931009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.931142 (+   133us) service_pool.cc:224] Handling call
0709 13:07:59.931493 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.038533 (+107040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.038562 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.051460 (+ 12898us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.290740 (+239280us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:00.558483 (+267743us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.619634 (+ 61151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.951504 (+1331870us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54001153d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:01.951555 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.951599 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:01.973780 (+ 22181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.973948 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10744,"prepare.queue_time_us":192626,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":76468,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":134618,"spinlock_wait_cycles":245254400,"thread_start_us":444427,"threads_started":3,"wal-append.queue_time_us":508223,"wal-append.run_cpu_time_us":10839,"wal-append.run_wall_time_us":1147251}
W20260709 13:08:02.023898 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 72147.5us
I20260709 13:08:02.028128 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:02.018208 25379 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:01.984911 25659 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:08:02.036967 21568 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:02.029886 25365 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 6. Current term is 7.
I20260709 13:08:02.039454 25379 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.039623 25402 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:02.042021 21568 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:01.994323 25602 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:02.044624 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 806440us
I20260709 13:08:02.025589 25661 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.043260 25379 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:02.056164 25661 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:02.062428 25661 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.062680 25379 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.063946 25379 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.071183 25559 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.025264 25515 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.073396 25442 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.079658 25442 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:02.045112 25602 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:02.081784 25602 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.087116 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:02.088819 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:02.096068 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 227004us
I20260709 13:08:02.097018 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:02.097971 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:02.098820 21567 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 7: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:02.104318 21564 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:02.104682 21564 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:02.105465 21564 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.106412 21564 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.107342 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:02.110047 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:02.098707 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:02.085047 25515 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:02.111362 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.112537 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:02.114696 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:02.112709 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:02.071846 25559 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:02.119695 25414 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:02.117856 25442 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.121407 25559 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:02.121995 25257 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:02.122444 25257 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:02.126204 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:02.126295 25442 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:02.138371 25442 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.139667 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:02.140389 21565 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.145237 25540 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:02.126092 25365 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:02.155355 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 579) took 1420 ms. Trace:
I20260709 13:08:02.156323 25257 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:02.157894 25257 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.155808 21485 rpcz_store.cc:276] 0709 13:08:00.735267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.295335 (+560068us) service_pool.cc:224] Handling call
0709 13:08:01.295990 (+   655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.297845 (+  1855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.297877 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.298466 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.075463 (+776997us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b1800327f40. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:08:02.125348 (+ 49885us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:02.125387 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.125471 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.140433 (+ 14962us) raft_consensus.cc:1685] finished
0709 13:08:02.140453 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.155287 (+ 14834us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1171,"raft.queue_time_us":87,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3725,"spinlock_wait_cycles":2702720,"thread_start_us":49521,"threads_started":1,"wal-append.queue_time_us":838946}
I20260709 13:08:02.159242 25624 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.123824 25515 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.159788 25624 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.162000 25624 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:02.164112 25662 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.240s	user 0.002s	sys 0.000s
I20260709 13:08:02.164887 24972 raft_consensus.cc:2955] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Committing config change with OpId 7.5: config changed from index 2 to 5, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:02.166731 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2061) took 1556 ms. Trace:
I20260709 13:08:02.166946 25365 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:02.167516 21641 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:02.167908 25365 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.168731 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:02.169361 21638 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:02.175611 25626 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.176082 25626 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:02.176957 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:02.176929 25626 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:02.177768 21636 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:02.178303 25626 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.178723 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:02.177834 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:02.179870 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:02.180454 21637 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.180816 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:02.167191 21488 rpcz_store.cc:276] 0709 13:08:00.610298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.612888 (+  2590us) service_pool.cc:224] Handling call
0709 13:08:01.525819 (+912931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.559515 (+ 33696us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:01.559565 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.560092 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.627489 (+ 67397us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:01.627549 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.627652 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.024321 (+396669us) raft_consensus.cc:1685] finished
0709 13:08:02.024341 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.166454 (+142113us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54000e10d0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:02.166663 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33267,"raft.queue_time_us":41557,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":7699,"spinlock_wait_cycles":2099240448,"thread_start_us":57974,"threads_started":1,"wal-append.queue_time_us":95798}
I20260709 13:08:02.180308 21641 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:02.189133 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:02.191433 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 578) took 1456 ms. Trace:
I20260709 13:08:02.192065 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 564) took 1492 ms. Trace:
I20260709 13:08:02.191463 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:02.192730 22247 rpcz_store.cc:276] 0709 13:08:00.699235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.764875 (+ 65640us) service_pool.cc:224] Handling call
0709 13:08:00.792974 (+ 28099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.962501 (+169527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.962534 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.962579 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:00.962619 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.191842 (+1229223us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54000d0554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:02.191890 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.191998 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314640128}
I20260709 13:08:02.191874 21491 rpcz_store.cc:276] 0709 13:08:00.735025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.143421 (+408396us) service_pool.cc:224] Handling call
0709 13:08:01.143817 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.219026 (+ 75209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.219073 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:01.219136 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:01.219196 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.191197 (+972001us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b54002cbd54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:02.191244 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.191379 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172143360}
W20260709 13:08:02.194868 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.201545 25647 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.202164 25647 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.207281 25673 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:02.216382 21639 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:08:02.224615 25668 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.301s	user 0.002s	sys 0.000s
I20260709 13:08:02.226749 25482 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.227306 25482 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:02.228327 25482 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.234424 21560 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.234920 21560 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:02.235637 21560 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.236514 21560 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.236546 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:02.237200 21568 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:02.238893 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:02.239084 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:02.240468 25521 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.240942 25521 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.241291 25521 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:02.243273 25656 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.379s	user 0.000s	sys 0.002s
I20260709 13:08:00.082469 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:02.243858 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:02.244472 21638 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:02.247320 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:02.245543 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:02.247928 21640 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:08:02.248747 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 89854.3us
I20260709 13:08:02.250109 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:02.250231 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 61174.8us
I20260709 13:08:02.250924 21641 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.251943 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:02.252290 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 240057us
I20260709 13:08:02.253779 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:02.259191 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:02.259783 21563 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:02.262017 21568 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:02.264292 21563 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:02.250527 21637 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:02.265678 21640 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:08:02.268769 21608 leader_election.cc:336] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.916s (SENT)
W20260709 13:08:02.286425 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.287604 21608 leader_election.cc:336] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.775s (SENT)
W20260709 13:08:02.288692 21608 leader_election.cc:336] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.110s (SENT)
W20260709 13:08:02.289029 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.289180 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:02.246517 25366 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.253554 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:02.297093 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:02.293409 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:02.312237 21560 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:02.251555 25482 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.319528 22245 raft_consensus.cc:2955] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Committing config change with OpId 7.5: config changed from index 2 to 5, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:02.321942 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:02.323875 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.326030 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:02.292086 25659 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.292196 25658 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.350536 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:02.351487 22246 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:08:02.352777 21641 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:02.353093 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:02.332021 21564 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:08:02.333433 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:02.359678 21564 pending_rounds.cc:85] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:08:02.360162 21564 pending_rounds.cc:107] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:08:02.360606 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:02.360693 21564 raft_consensus.cc:2889] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:02.361620 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.321694 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:02.293916 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:02.340175 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.295136 25673 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:02.300595 25657 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.295274 25386 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:02.292302 25649 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.367089 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:02.317386 25548 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.320838 25550 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.364779 21637 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:02.380151 21637 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:02.361943 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:02.343304 21565 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:02.321354 25558 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:02.383240 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:02.388813 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.347465 25375 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:02.397383 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 75779.2us
I20260709 13:08:02.403817 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:02.404496 21637 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:08:02.383251 25656 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:02.408157 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:02.409787 21641 raft_consensus.cc:2955] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Committing config change with OpId 7.5: config changed from index 2 to 5, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:02.368748 25673 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:02.368683 25536 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:02.418421 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 56546us
I20260709 13:08:02.418545 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:02.385234 25356 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.376685 25386 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:02.422398 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 391856us
I20260709 13:08:02.397609 25484 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.432088 25484 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:02.432541 25484 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.434757 25568 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:02.435221 25568 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.435514 25653 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:02.438026 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.427693 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.435552 25568 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.398168 25379 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:02.442731 25386 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.419668 25536 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.444800 25536 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.447556 25568 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.451623 21457 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:02.452545 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:02.453356 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:02.454679 25572 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:02.455183 21565 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:02.455986 25568 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:02.456151 25572 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:02.456610 25572 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:02.457587 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.346820 25602 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.457315 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:02.463121 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:02.469892 21634 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:02.404309 25375 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.497107 21637 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:02.456679 25568 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:02.347330 25625 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:08:02.471208 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:02.515241 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44161.3us
I20260709 13:08:02.419814 25673 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.516067 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:02.472388 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:02.464581 21640 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:02.406423 25357 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.406666 25365 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:02.510295 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53053.4us
I20260709 13:08:02.519093 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:02.525239 25356 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.525977 25356 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.532506 25356 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:02.533102 25546 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:02.418298 25550 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:02.368698 25659 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.536564 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:02.511451 25375 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.493745 25540 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.514662 25624 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.542989 21637 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.542287 25605 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:02.493016 25414 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.493551 25572 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.512722 25515 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:02.495747 25559 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:02.545104 25632 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:02.466462 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:02.539005 25568 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:02.541224 25469 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:02.537973 21642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.004s	sys 0.019s
W20260709 13:08:02.693954 21642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.004s	sys 0.019s
W20260709 13:08:02.708257 25674 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:02.640096 25550 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.611805 25624 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:02.708001 25414 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:02.670987 25442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.055s	sys 0.084s
I20260709 13:08:02.709585 25624 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:02.592653 25661 consensus_meta.cc:287] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.005s
I20260709 13:08:02.558566 25540 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:02.710572 25632 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:02.711498 25540 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.711540 25632 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:02.602458 25647 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:02.544278 25365 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:02.716182 25365 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:02.717181 25568 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:02.710299 25442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.057s	sys 0.087s
W20260709 13:08:02.726468 25691 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:08:02.750252 25670 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:02.691948 25605 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:02.785302 25677 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:08:02.560648 25682 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:02.747742 25469 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:02.755282 25659 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:02.747990 25661 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:02.796326 25605 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.852721 25469 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:02.802945 25682 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:02.855742 25661 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:02.939746 21459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.006s
W20260709 13:08:02.940704 21459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.011s	sys 0.006s
W20260709 13:08:02.941278 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 506822us
W20260709 13:08:02.652405 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.948240 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.952926 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.664692 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 375990us
I20260709 13:08:02.977808 21634 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.980454 21636 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:02.980911 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2411) took 1286 ms. Trace:
W20260709 13:08:02.982437 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.981108 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 631) took 2240 ms. Trace:
W20260709 13:08:03.017104 24972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.023s	sys 0.048s
W20260709 13:08:03.017831 24972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.023s	sys 0.048s
W20260709 13:08:03.039150 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.034613 21606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.016s	sys 0.019s
I20260709 13:08:03.045118 25711 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:03.046499 25711 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:02.981510 21643 rpcz_store.cc:276] 0709 13:08:01.693919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.896799 (+202880us) service_pool.cc:224] Handling call
0709 13:08:01.897139 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.902589 (+  5450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.902626 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.905877 (+  3251us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.398885 (+493008us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:02.398969 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.399137 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.980301 (+581164us) raft_consensus.cc:1685] finished
0709 13:08:02.980351 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.980682 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3131,"raft.queue_time_us":3784,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":1850,"spinlock_wait_cycles":357760,"thread_start_us":445020,"threads_started":1,"wal-append.queue_time_us":729924}
I20260709 13:08:03.050312 21390 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 236) took 8463 ms. Trace:
W20260709 13:08:03.056603 21639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.004s	sys 0.011s
W20260709 13:08:03.061795 21606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.017s	sys 0.019s
W20260709 13:08:03.057125 21639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.005s	sys 0.012s
W20260709 13:08:03.074527 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.076614 25515 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.080610 25515 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:03.087730 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.090924 25358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.030s	sys 0.032s
W20260709 13:08:03.091601 25358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.030s	sys 0.032s
W20260709 13:08:03.092728 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 103585us
I20260709 13:08:03.093990 21459 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:03.096184 22247 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:03.111418 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.991469 21635 rpcz_store.cc:276] 0709 13:08:00.740400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.741869 (+  1469us) service_pool.cc:224] Handling call
0709 13:08:00.767153 (+ 25284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.918008 (+150855us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:00.918299 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.894485 (+976186us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b1800314740. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b8223a 00007f98a9feca2a
0709 13:08:02.343048 (+448563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:02.343156 (+   108us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:02.343246 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.980567 (+637321us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002648d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:02.980648 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.980917 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38990,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":2162,"raft.queue_time_us":51953,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":16405,"spinlock_wait_cycles":350285952,"thread_start_us":409222,"threads_started":1,"wal-append.queue_time_us":1625236}
I20260709 13:08:03.121665 25414 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.056107 21390 rpcz_store.cc:276] 0709 13:07:54.601699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.601896 (+   197us) service_pool.cc:224] Handling call
0709 13:08:03.049939 (+8448043us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:57.440242 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:57.440689 (+   447us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:57.440738 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:07:57.440755 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:57.441808 (+  1053us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:57.441870 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:57.441887 (+    17us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:07:57.442746 (+   859us) tablet.cc:701] Row locks acquired
0709 13:07:57.442755 (+     9us) write_op.cc:260] PREPARE: finished
0709 13:07:57.447554 (+  4799us) write_op.cc:270] Start()
0709 13:07:57.463887 (+ 16333us) write_op.cc:276] Timestamp: P: 1783602477442906 usec, L: 0
0709 13:07:57.463933 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:07:57.497944 (+ 34011us) log.cc:844] Serialized 7563 byte log entry
0709 13:07:57.652587 (+154643us) op_driver.cc:464] REPLICATION: finished
0709 13:07:57.740994 (+ 88407us) write_op.cc:301] APPLY: starting
0709 13:07:57.741090 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:57.741629 (+   539us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:57.741774 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:57.744068 (+  2294us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:57.744521 (+   453us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:07:57.744589 (+    68us) write_op.cc:312] APPLY: finished
0709 13:07:57.745131 (+   542us) log.cc:844] Serialized 132 byte log entry
0709 13:07:57.745366 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:57.745600 (+   234us) write_op.cc:454] Released schema lock
0709 13:07:57.745677 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:57.824245 (+ 78568us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:57.837604 (+ 13359us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":237238,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":88096,"apply.run_cpu_time_us":5202,"apply.run_wall_time_us":18082,"num_ops":19,"prepare.queue_time_us":104192,"prepare.run_cpu_time_us":4475,"prepare.run_wall_time_us":58022,"replication_time_us":182389,"thread_start_us":208144,"threads_started":2}]]}
I20260709 13:08:03.152304 25682 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.082705 21392 catalog_manager.cc:5697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 5 to 8, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 8 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.175212 21634 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:03.188915 21392 catalog_manager.cc:5697] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 5 to 9, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 9 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:03.191591 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 97834.9us
I20260709 13:08:03.192047 25534 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.119875 25711 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:03.225492 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 758967us
I20260709 13:08:03.228334 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:03.227764 21392 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 8 to 10, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 10 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:03.229498 25682 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:03.244393 25673 consensus_meta.cc:287] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.701s	user 0.016s	sys 0.016s
I20260709 13:08:03.245117 25673 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.207962 25602 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:03.255337 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 60929.2us
I20260709 13:08:03.268123 25550 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:03.268339 21392 catalog_manager.cc:5697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 7 to 11, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 11 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:03.270017 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 159278us
I20260709 13:08:03.269011 25550 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.297312 25632 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:03.277383 21392 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 5 to 8, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 8 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.309029 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2429) took 1065 ms. Trace:
I20260709 13:08:03.311116 21639 rpcz_store.cc:276] 0709 13:08:02.243124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.245922 (+  2798us) service_pool.cc:224] Handling call
0709 13:08:02.246254 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:02.246901 (+   647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.246929 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:02.248171 (+  1242us) log.cc:844] Serialized 52 byte log entry
0709 13:08:03.112759 (+864588us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:03.203267 (+ 90508us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.276807 (+ 73540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.285279 (+  8472us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.288871 (+  3592us) raft_consensus.cc:1685] finished
0709 13:08:03.288940 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.308926 (+ 19986us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37264,"raft.queue_time_us":52082,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":13657856,"thread_start_us":812214,"threads_started":2,"wal-append.queue_time_us":367320}
W20260709 13:08:03.329186 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51396.4us
W20260709 13:08:03.326623 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 1.03272e+06us
W20260709 13:08:03.334529 25366 consensus_meta.cc:287] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 1.033s	user 0.005s	sys 0.022s
I20260709 13:08:03.335637 25550 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:03.337888 21459 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:03.334548 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:03.339943 25661 raft_consensus.cc:2764] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:08:03.342185 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:03.343294 25661 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:03.343866 25484 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.911s	user 0.013s	sys 0.044s
I20260709 13:08:03.343899 25661 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:03.353075 25484 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:03.346640 21637 consensus_meta.cc:287] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.758s	user 0.011s	sys 0.011s
I20260709 13:08:03.356196 21637 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
W20260709 13:08:03.349392 25521 consensus_meta.cc:287] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 1.107s	user 0.011s	sys 0.021s
W20260709 13:08:03.346307 25375 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.793s	user 0.018s	sys 0.010s
I20260709 13:08:03.357338 25521 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.347059 25640 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:03.358242 25257 consensus_meta.cc:287] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.200s	user 0.006s	sys 0.029s
I20260709 13:08:03.353737 25661 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.358531 25640 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.359313 21638 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:03.356091 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:03.356839 25482 consensus_meta.cc:287] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.994s	user 0.011s	sys 0.024s
I20260709 13:08:03.357686 25375 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.354306 25673 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:03.353926 25626 consensus_meta.cc:287] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 1.175s	user 0.010s	sys 0.015s
I20260709 13:08:03.349104 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:03.366581 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 112404us
I20260709 13:08:03.365707 25521 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:03.373418 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 223403us
I20260709 13:08:03.376046 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:03.377074 25682 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.377489 25682 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:03.377918 25682 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.379490 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 571) took 1054 ms. Trace:
I20260709 13:08:03.379880 22247 rpcz_store.cc:276] 0709 13:08:02.324985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.325154 (+   169us) service_pool.cc:224] Handling call
0709 13:08:02.325510 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.096853 (+771343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.379188 (+282335us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b5400540e54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:03.379408 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770842368}
I20260709 13:08:03.380959 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:03.381795 21643 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:03.382907 25482 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:03.383154 25548 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:03.383767 25548 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.386040 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:03.386386 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:03.386925 21636 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.387176 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:03.391786 25702 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.392186 25482 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:03.392669 25482 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.392851 25711 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.393049 25482 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.401952 25545 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.402675 25545 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.403542 25484 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.404036 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2431) took 1040 ms. Trace:
I20260709 13:08:03.404456 21641 rpcz_store.cc:276] 0709 13:08:02.363800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.363918 (+   118us) service_pool.cc:224] Handling call
0709 13:08:02.365107 (+  1189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.409636 (+ 44529us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:02.651054 (+241418us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.675393 (+ 24339us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.690217 (+ 14824us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.145823 (+455606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.148223 (+  2400us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:03.148388 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.403542 (+255154us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b54001149d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:03.403593 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.403866 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":333961,"prepare.queue_time_us":25595,"raft.queue_time_us":421599,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":1940,"spinlock_wait_cycles":179189120}
I20260709 13:08:03.406317 25702 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:03.407297 25702 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.409607 25482 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.410476 25702 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:03.405494 25545 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:03.426980 25605 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:03.432438 25536 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.987s	user 0.019s	sys 0.014s
I20260709 13:08:03.432900 25536 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.433373 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:03.433478 25605 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.424629 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:03.437242 25717 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:03.437543 25657 raft_consensus.cc:2764] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:03.433573 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 644) took 1060 ms. Trace:
I20260709 13:08:03.442955 21638 rpcz_store.cc:276] 0709 13:08:02.373123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.373866 (+   743us) service_pool.cc:224] Handling call
0709 13:08:02.374117 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.359712 (+985595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.433282 (+ 73570us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b540021a054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:03.433511 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264316160}
W20260709 13:08:03.419721 25386 consensus_meta.cc:287] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.847s	user 0.012s	sys 0.009s
I20260709 13:08:03.435204 25375 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.465408 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:03.476982 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.474442 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 136738us
W20260709 13:08:03.483690 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.484956 24972 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:03.485838 24972 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.485169 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2404) took 1806 ms. Trace:
I20260709 13:08:03.488361 24972 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:03.488561 21642 rpcz_store.cc:276] 0709 13:08:01.678185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.678320 (+   135us) service_pool.cc:224] Handling call
0709 13:08:01.687066 (+  8746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.902201 (+215135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.902232 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.906528 (+  4296us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.697377 (+790849us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:03.170999 (+473622us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.272489 (+101490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.284243 (+ 11754us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.454241 (+169998us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b24003d4828. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6d7b9c4 00007f98a6d79acb 00007f98a6f34dc9 00007f98a6f34a55 00007f98a6f33fb0 00007f98a9baa488 00007f98a9baabe8 00007f98a9b82398 00007f98a9b7d76a 00007f98a9b7cbb6
0709 13:08:03.484704 (+ 30463us) raft_consensus.cc:1685] finished
0709 13:08:03.484807 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.484977 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":625718,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":4191,"raft.queue_time_us":161205,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":25697,"spinlock_wait_cycles":4176640,"thread_start_us":1027312,"threads_started":3,"wal-append.queue_time_us":691954}
W20260709 13:08:03.503764 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.473802 21643 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:03.539851 21636 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
W20260709 13:08:03.543702 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.544107 21392 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 8 to 10, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 10 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.545790 25548 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:03.552460 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52479.9us
I20260709 13:08:03.469194 25545 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.547396 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:03.546499 21392 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 3 to 5, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 5 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.560972 21565 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:03.563737 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:03.500011 25702 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:03.573287 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.576866 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.565418 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:03.563514 25484 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.498164 25386 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.570617 25657 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:03.560961 25402 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:08:03.593209 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 93311.7us
I20260709 13:08:03.589298 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:03.561677 25375 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:08:03.611634 21564 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:03.612083 21564 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:03.613914 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 238023us
I20260709 13:08:03.616456 25540 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:03.616742 25702 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.617249 25540 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.617904 25482 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:03.619028 25716 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
W20260709 13:08:03.619167 25572 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.014s
I20260709 13:08:03.619767 25572 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.620486 25536 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:03.622454 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.625777 25640 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:03.628244 25704 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:03.628955 25704 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.622150 25572 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:03.631507 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 171317us
I20260709 13:08:03.632829 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:03.633224 21564 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.634439 21564 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.637827 25357 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:03.638339 25357 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.638674 25357 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:03.640125 25688 log.cc:927] Time spent T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.993s	user 0.003s	sys 0.000s
I20260709 13:08:03.643321 22243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 700) took 1472 ms. Trace:
I20260709 13:08:03.643676 22243 rpcz_store.cc:276] 0709 13:08:02.170769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.170925 (+   156us) service_pool.cc:224] Handling call
0709 13:08:02.171733 (+   808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.179746 (+  8013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.179784 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.189287 (+  9503us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.303110 (+113823us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:02.303153 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.303228 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.639255 (+1336027us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:03.642868 (+  3613us) raft_consensus.cc:1685] finished
0709 13:08:03.642888 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.643165 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7647,"raft.queue_time_us":8519,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":11295,"spinlock_wait_cycles":20751232,"thread_start_us":100681,"threads_started":1,"wal-append.queue_time_us":430623}
W20260709 13:08:03.647118 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.646176 25711 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:03.646375 25550 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.580718 25682 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.651988 25711 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.652724 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:08:03.653726 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 66540.2us
I20260709 13:08:03.654304 25711 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.655933 25626 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:03.656478 25626 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:03.595434 25484 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.657478 25626 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.659075 25484 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:03.660143 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.660889 21565 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:03.659968 25371 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:08:03.663655 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:03.663925 21392 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 8 to 11, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 11 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.666009 25729 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:03.666505 25729 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.666916 25729 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.667764 25548 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:03.669731 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 651) took 1237 ms. Trace:
I20260709 13:08:03.670239 21634 rpcz_store.cc:276] 0709 13:08:02.432137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.472135 (+ 39998us) service_pool.cc:224] Handling call
0709 13:08:03.669361 (+1197226us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400294d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:03.669523 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031464192}
I20260709 13:08:03.671315 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:03.672009 21560 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.654657 25682 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:03.677834 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.678660 21569 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
W20260709 13:08:03.679217 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 101879us
I20260709 13:08:03.680452 25649 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:03.682854 25550 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:03.684029 25442 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.684653 25442 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.685686 25704 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.665944 21392 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 8 to 9, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 9 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.588227 25545 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.694334 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:03.694887 21641 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:03.677673 25386 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.708634 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:03.619077 25702 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:03.720212 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:03.718161 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:03.688948 25442 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.717121 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:03.737183 22243 raft_consensus.cc:2376] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7. Re-sending same reply.
W20260709 13:08:03.714233 25534 consensus_meta.cc:287] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.002s
I20260709 13:08:03.743207 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:03.706988 25657 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:03.752779 25711 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:03.753801 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.718488 25358 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:03.714928 25602 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:03.775348 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 65766.8us
I20260709 13:08:03.757508 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:03.777747 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:03.747563 25534 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:03.796931 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 88665.6us
I20260709 13:08:03.756029 25661 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.802417 25602 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.803148 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:03.805063 21636 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.760900 25711 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:03.776361 25540 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:03.785903 25386 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:03.810307 21637 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:03.781105 25682 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.818986 25657 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.820988 25602 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:03.850378 22245 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:03.852967 25682 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.822620 25725 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:03.823235 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:03.855341 25725 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.856526 25682 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.823954 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:03.824460 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.859647 21561 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:03.824843 25653 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.860437 25653 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.860878 25653 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.804652 21569 raft_consensus.cc:2955] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Committing config change with OpId 7.5: config changed from index 2 to 5, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:03.825222 25640 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:03.825810 25735 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:03.863792 25386 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.864394 25386 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:03.866640 25357 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.867254 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.867652 25679 raft_consensus.cc:2764] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:03.867971 21568 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:03.868469 25679 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:03.869089 25679 consensus_queue.cc:1243] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:03.869485 25357 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:03.846750 25661 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.870963 25414 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:03.872953 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.873179 25661 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:03.876250 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:03.877029 21608 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.656s (SENT)
I20260709 13:08:03.877547 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:03.878324 21568 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:03.832895 25402 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:03.886390 25402 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:03.887212 21567 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:03.887781 25402 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.870451 25679 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:08:03.889972 25661 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:03.787698 25442 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:03.891157 25442 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:03.862157 25657 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:03.892244 25442 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.847311 21637 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:08:03.878827 21608 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.667s (SENT)
I20260709 13:08:03.897325 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:03.897281 21637 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.898473 21637 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:03.899960 21608 leader_election.cc:336] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.736s (SENT)
I20260709 13:08:03.900480 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:03.879709 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.901860 21562 raft_consensus.cc:2410] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:08:03.842368 25711 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.902837 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.903632 21562 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:03.903780 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.904404 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.905464 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.906342 25679 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:03.826654 25696 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.108s	user 0.002s	sys 0.001s
I20260709 13:08:03.811496 25358 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:03.907196 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.907290 25679 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.908085 21562 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:03.909471 25679 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:03.909590 25358 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:03.836671 21643 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:03.910588 25661 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:03.900998 25657 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:03.796166 21606 connection.cc:256] RPC call timeout handler was delayed by -1.47529099399992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:08:03.921622 21606 connection.cc:256] RPC call timeout handler was delayed by -1.0765909939999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 13:08:03.922041 21606 connection.cc:256] RPC call timeout handler was delayed by -1.0315909939998846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 13:08:03.879101 25725 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:03.915817 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.888203 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.927500 21567 raft_consensus.cc:2410] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:08:03.924037 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:03.924697 25738 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:08:03.908860 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.925426 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:03.934505 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.924839 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.932608 21635 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:03.919425 21564 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:08:03.940136 25626 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:03.943122 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.943843 21562 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:03.944864 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.945492 21562 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:03.949844 21563 raft_consensus.cc:2410] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:03.951182 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:03.952082 25739 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:03.942968 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:03.954767 25661 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:03.954664 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:03.956426 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.946451 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.959893 21562 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
W20260709 13:08:03.960626 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 117423us
I20260709 13:08:03.939144 21564 pending_rounds.cc:85] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 8
W20260709 13:08:03.962622 21608 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.912s (SENT)
I20260709 13:08:03.963265 25649 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:03.968876 25649 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.968966 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.969411 25649 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:03.971582 25731 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:08:03.965262 25729 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:03.973160 21532 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:41010 dropped due to backpressure: service queue is full with 50 items [suppressed 2 similar messages]
I20260709 13:08:03.976626 25729 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:03.982161 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:03.983533 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:03.967988 21564 pending_rounds.cc:107] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:04.002189 21564 raft_consensus.cc:2889] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:04.002674 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.978132 25653 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:03.927479 21637 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:04.005545 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.017671 21560 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
W20260709 13:08:04.017953 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.020042 21567 raft_consensus.cc:2410] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:08:04.040635 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 82385.1us
I20260709 13:08:04.041693 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:04.046005 21608 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.738s (SENT)
W20260709 13:08:04.046628 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.055650 21566 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:04.030028 24972 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.065008 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.019011 21636 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:04.051359 25602 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.049567 25545 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:04.082654 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:04.051759 25482 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:04.087930 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.089732 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.973475 21532 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:41010 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36572 (request call id 874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2137)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2119)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2134)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2128)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2644)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2640)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2642)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2647)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2648)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 875)
W20260709 13:08:04.094096 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 139963us
I20260709 13:08:04.105986 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:04.106366 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 60433.7us
I20260709 13:08:04.111572 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.111200 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.119961 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:04.120688 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.121265 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.093998 25661 raft_consensus.cc:2764] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:08:04.124287 21638 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:04.124092 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.119439 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:04.125777 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.126284 21643 raft_consensus.cc:1813] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Handling vote request from an unknown peer 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:04.126636 21643 raft_consensus.cc:2368] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9.
I20260709 13:08:04.131596 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:04.105921 25657 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:04.136660 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.139828 25719 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.141819 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.144515 22242 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:04.171693 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:04.174389 21637 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:04.145346 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.146387 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.149153 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.155918 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:04.157136 21638 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:04.158160 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.160647 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.167487 25388 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:04.167228 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.169840 21488 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:04.169495 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:04.170648 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 55931.8us
I20260709 13:08:04.170674 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.181191 21492 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.181093 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.182078 22241 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:04.178897 21487 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:04.183858 21635 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.185463 21643 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:04.187947 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:04.193398 21636 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.120872 25729 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:08:04.199852 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:04.201910 21637 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.121300 24972 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:04.152136 25482 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:04.205384 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:04.214506 22240 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.208194 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.171268 25725 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:08:04.191545 25521 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:04.208266 21491 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:08:04.242725 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.245841 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.246361 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.250200 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.250896 21494 raft_consensus.cc:2376] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7. Re-sending same reply.
I20260709 13:08:04.251681 21636 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
W20260709 13:08:04.252087 25742 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:04.260668 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.261862 21643 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:04.186934 25649 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:04.274708 21562 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:04.288149 21491 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:08:04.422453 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.277045 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.277818 21485 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:04.280812 21489 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:04.286949 25442 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.205657 25719 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:04.429997 21569 consensus_meta.cc:287] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.001s
I20260709 13:08:04.351696 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.426183 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:04.425246 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.469689 21567 raft_consensus.cc:2410] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:08:04.378013 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.471040 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.326117 22246 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:04.324570 21638 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:04.427063 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.429358 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.308431 25482 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:04.463248 22241 raft_consensus.cc:2368] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12.
I20260709 13:08:04.426982 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.474812 21566 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:04.319254 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.476023 21487 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:04.477032 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.477612 21487 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:04.210999 25388 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:04.481571 22242 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:04.481925 21563 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:08:04.288291 25737 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:08:04.311159 25711 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:04.336812 25657 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:04.492949 25657 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.330796 25521 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:04.315877 25653 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:04.348474 25386 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:04.494318 25521 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:04.495639 25442 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:04.496522 21490 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:04.497380 25719 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:04.497897 25442 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:04.489732 21568 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:04.489919 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.499819 21489 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:08:04.290072 24972 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:04.500769 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:04.501538 21608 leader_election.cc:336] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.115s (SENT)
W20260709 13:08:04.502518 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.275743 21492 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:04.487577 22240 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:04.505024 21635 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:04.506397 21637 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
W20260709 13:08:04.508833 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.478523 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.515846 21487 raft_consensus.cc:2368] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:04.507889 25388 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:04.516996 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.518362 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.520670 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.521301 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.521938 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.523279 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:04.523736 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.522100 21492 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.528038 25657 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:04.529747 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.523205 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.531320 21486 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:04.532842 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.533329 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.533721 21489 raft_consensus.cc:2368] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
I20260709 13:08:04.534739 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.535403 25657 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:04.537308 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:04.539301 21608 leader_election.cc:336] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.136s (SENT)
I20260709 13:08:04.539556 22245 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 10. Ops: []
I20260709 13:08:04.539327 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.544379 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.545743 21486 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:04.545012 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.552254 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.552378 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.553136 21490 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.553651 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.554194 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.555013 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.555483 21485 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:04.556241 21491 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:04.556680 21485 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:04.557359 21491 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:04.557766 21485 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:04.559672 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.546368 25657 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.322131 21534 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36572 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36572 (request call id 876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36572 (request call id 874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2137)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2119)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2134)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2128)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2644)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2640)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2642)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2647)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2648)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 875)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2649)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 880)
I20260709 13:08:04.520210 21487 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.572497 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.580338 21489 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:04.583313 21492 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
W20260709 13:08:04.606863 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 46052.9us
W20260709 13:08:04.624863 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.588315 25653 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.621568 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:04.629753 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:04.639168 21637 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.630435 22243 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:04.630766 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.633271 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.634310 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.641316 21567 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:04.635188 21638 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.635754 25534 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:04.646489 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.647354 21566 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:04.653519 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.639926 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:04.660377 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.661677 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:04.662494 21564 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.663641 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.665731 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.649205 25357 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:04.667546 22242 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:04.668381 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:04.669318 22247 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:04.582545 25657 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:04.676024 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.677713 21566 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:04.667817 25357 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.670812 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.682705 21485 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:04.681821 21568 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:04.685768 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.687239 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.688271 21491 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:04.689483 21637 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:04.689648 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.689507 21560 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:04.678596 25357 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.689716 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.691815 21606 leader_election.cc:400] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:04.693807 21606 leader_election.cc:403] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:04.670344 25257 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:04.673645 25534 consensus_queue.cc:1243] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 549b31ac31b6428994b45938abc223a7 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:08:04.703581 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44453.9us
I20260709 13:08:04.705336 21606 leader_election.cc:400] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
I20260709 13:08:04.705667 21606 leader_election.cc:403] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:08:04.709676 25747 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.076s	user 0.000s	sys 0.002s
I20260709 13:08:04.710045 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:04.711256 21635 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:04.711352 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.707967 21565 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:04.716262 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:04.719208 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.721223 21637 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:04.722632 21563 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:04.722848 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.724501 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.724485 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:04.725405 21560 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:04.726945 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.728552 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.727396 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:04.730477 21562 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:04.732074 21568 raft_consensus.cc:2368] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:08:04.733330 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.733371 21636 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:08:04.748461 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.749938 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.751525 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.752214 21636 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:04.753290 21636 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:04.754364 21636 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:04.754964 25358 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:04.755471 25748 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:08:04.756346 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.757364 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.757624 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.758301 21567 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:04.757388 21640 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:04.759039 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.759624 21485 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.758680 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.760725 21561 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:04.761497 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.712604 25482 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.463065 21533 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40994 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36572 (request call id 876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36572 (request call id 874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2137)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2119)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2134)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2128)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2644)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2640)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2642)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2647)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2648)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 875)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2649)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 880)
I20260709 13:08:04.773659 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.774667 21642 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:04.762576 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.775723 21561 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:04.776846 21641 raft_consensus.cc:2410] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:04.777964 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.776836 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.782006 21564 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:04.783380 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.787232 25386 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:04.788133 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:04.788566 25657 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:04.722275 25257 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:04.790097 25257 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:04.791105 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.792308 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:04.734052 25661 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
I20260709 13:08:04.793494 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.794301 21643 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:04.794404 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:04.678668 25749 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:08:04.795596 25749 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:04.795949 25749 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:04.796773 25749 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:04.798074 25749 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.795949 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.799486 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.799876 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.800333 21565 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:04.800920 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.801121 21567 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:04.801764 25711 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:04.802215 21567 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:04.802354 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:04.804030 25751 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
I20260709 13:08:04.804097 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.804795 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:04.794986 21562 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.805847 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:04.806820 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.807642 21566 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:04.810545 21487 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:04.811312 21489 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:04.805282 25649 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:04.819823 21560 raft_consensus.cc:2410] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:04.802589 21567 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:04.820734 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:04.822486 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 117282us
I20260709 13:08:04.826439 21457 leader_election.cc:400] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9.
I20260709 13:08:04.826583 21490 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:04.805995 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.826896 21457 leader_election.cc:403] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:04.826615 21564 raft_consensus.cc:2410] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:04.824690 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:04.831282 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.831521 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.843933 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:04.845902 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:04.851612 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:04.857934 21457 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:04.869583 21565 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:04.873764 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:04.832715 21567 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:04.870560 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 46883.4us
I20260709 13:08:04.877887 21564 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:04.878373 21564 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:04.879499 21563 raft_consensus.cc:1217] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[9.9-9.9]   Dedup: 9.9->[]
I20260709 13:08:04.880174 21563 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:08:04.886340 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.893051 25545 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:04.911551 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:04.842679 25657 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.889068 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.918202 21485 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:04.881732 25540 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.926636 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.822978 25442 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:08:04.929244 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:04.929922 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:04.933622 21565 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.883747 25661 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:04.942895 25418 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.944672 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:04.945571 25482 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:04.946384 25482 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:04.868451 25653 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:08:04.923451 25754 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:04.891325 25649 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:04.969805 21642 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:08:04.984117 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.969857 21636 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:08:04.972755 21532 connection.cc:256] RPC call timeout handler was delayed by -2.478920052000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260709 13:08:04.988164 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 136621us
I20260709 13:08:04.959601 21567 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.968815 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:05.003137 21637 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:08:04.875842 25602 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:08:05.010960 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:04.923964 25358 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:04.950343 21634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.032s	sys 0.042s
W20260709 13:08:05.019136 21634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.033s	sys 0.043s
I20260709 13:08:04.947448 21560 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:05.019778 21560 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:04.946677 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:04.999552 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.999868 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:04.971240 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:05.002460 21532 connection.cc:256] RPC call timeout handler was delayed by -2.3421200520000411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 13:08:05.021454 21532 connection.cc:256] RPC call timeout handler was delayed by -2.1855200520000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 13:08:05.021546 21635 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
W20260709 13:08:05.022260 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.956369 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:05.021863 21532 connection.cc:256] RPC call timeout handler was delayed by -2.1855200520000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260709 13:08:05.022753 21532 connection.cc:256] RPC call timeout handler was delayed by -2.1018200519999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 13:08:05.023166 21532 connection.cc:256] RPC call timeout handler was delayed by -2.1018200519999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
I20260709 13:08:04.970244 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:05.011801 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:05.024296 21563 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.025362 21636 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:04.947659 25365 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.987353 25540 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9.
I20260709 13:08:05.037911 21635 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:04.938360 25719 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:08:04.955168 25386 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:08:05.021467 25649 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:04.938215 25521 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:08:05.074362 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:05.075543 21566 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:05.052891 25640 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:05.087738 21640 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:05.087764 21565 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
W20260709 13:08:05.088560 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 132271us
I20260709 13:08:05.034916 25657 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:08:05.113010 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.079272 25719 consensus_queue.cc:1243] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 549b31ac31b6428994b45938abc223a7 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:08:05.126652 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 241183us
I20260709 13:08:05.153653 25770 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.154719 25770 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:05.155175 25770 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:08:05.155628 25766 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:05.156168 25770 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:05.157032 21564 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.159061 25546 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:05.157631 25770 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.078362 25711 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:08:05.164462 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:05.192188 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:05.195441 21562 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:05.199837 21564 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:05.197860 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:05.128167 25521 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:08:05.130402 25442 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:08:05.226187 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:05.201785 25764 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.203363 25540 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:05.256650 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:05.273869 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.276381 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.291460 21639 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:05.286049 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2451) took 1173 ms. Trace:
I20260709 13:08:05.295006 21564 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:08:05.299357 21564 pending_rounds.cc:85] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:08:05.300884 21564 pending_rounds.cc:107] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:08:05.243371 25661 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:05.292163 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:05.303268 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 356668us
W20260709 13:08:05.304845 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.306996 25657 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.307659 25657 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:05.309888 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.310983 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:05.311182 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2115) took 1001 ms. Trace:
I20260709 13:08:05.311721 21486 rpcz_store.cc:276] 0709 13:08:04.310241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.554542 (+244301us) service_pool.cc:224] Handling call
0709 13:08:04.561487 (+  6945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.632842 (+ 71355us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:05.042266 (+409424us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.217268 (+175002us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.221340 (+  4072us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.221536 (+   196us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:05.221842 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.235052 (+ 13210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.235163 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.310905 (+ 75742us) raft_consensus.cc:1685] finished
0709 13:08:05.310934 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.311106 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79502,"prepare.queue_time_us":121330,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":85,"raft.queue_time_us":70296,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":18287,"spinlock_wait_cycles":9997440,"thread_start_us":486215,"threads_started":2,"wal-append.queue_time_us":234814}
I20260709 13:08:05.273491 25536 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:05.319168 25536 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:05.319650 25657 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:05.320127 25536 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:05.321439 25536 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.323804 25415 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:05.324466 25415 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:05.325279 25364 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.325587 25415 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.206956 25649 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.335291 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:05.341001 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.250661 25640 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:05.353757 21563 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:05.254869 25540 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:05.243101 25764 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:05.357919 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 319717us
I20260709 13:08:05.387760 21532 leader_election.cc:400] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12.
I20260709 13:08:05.388185 21532 leader_election.cc:403] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:05.389264 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 307258us
I20260709 13:08:05.390091 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:05.391426 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 294364us
I20260709 13:08:05.356369 25602 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.392304 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:05.302811 21564 raft_consensus.cc:2889] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:05.367295 25767 log.cc:927] Time spent T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:08:05.397513 21486 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:05.408916 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:05.415843 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2648) took 1481 ms. Trace:
I20260709 13:08:05.422013 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:05.423537 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.427947 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:05.434940 21635 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:05.416388 21564 rpcz_store.cc:276] 0709 13:08:03.934448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.829455 (+895007us) service_pool.cc:224] Handling call
0709 13:08:04.869396 (+ 39941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.142482 (+273086us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4c003c1140. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a82aea20 00007f98a82bfa29 00007f98a8285644 00007f98a82acf2d 00007f98a82acb93 00007f98a9fdd18b 00007f98a9fddcb5 00007f98a9fd8f30 00007f98a9fda7de 00007f98a9fe4b49 00007f98a9fe5416
0709 13:08:05.415534 (+273052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.415777 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24757632}
W20260709 13:08:05.414875 25357 consensus_meta.cc:287] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.013s
I20260709 13:08:05.436183 25418 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:05.447265 21567 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:08:05.358636 25640 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:05.417840 25702 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:05.447822 21567 pending_rounds.cc:85] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 4
I20260709 13:08:05.452840 21567 pending_rounds.cc:107] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:08:05.453154 21567 raft_consensus.cc:2889] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.442982 25386 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:05.460626 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2640) took 1548 ms. Trace:
I20260709 13:08:05.461581 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:05.416720 25602 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.437016 24972 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.461062 21567 rpcz_store.cc:276] 0709 13:08:03.912190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.801818 (+889628us) service_pool.cc:224] Handling call
0709 13:08:04.802066 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.460364 (+658298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.460568 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:05.466403 21567 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:05.466873 21567 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:05.470100 21486 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:05.465925 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:05.475859 21564 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:05.476320 21564 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:05.457681 25568 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:05.478535 21636 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:08:05.486229 21636 pending_rounds.cc:85] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 6
I20260709 13:08:05.486555 21636 pending_rounds.cc:107] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 10.7
W20260709 13:08:05.479794 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 174299us
W20260709 13:08:05.474459 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 114197us
I20260709 13:08:05.486934 21636 raft_consensus.cc:2889] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.446832 25357 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:05.506068 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.486871 21567 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.542958 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2642) took 1630 ms. Trace:
I20260709 13:08:05.546430 21564 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:05.542488 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.549732 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 61930.5us
W20260709 13:08:05.547462 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 87164.5us
I20260709 13:08:05.545130 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:05.554476 21608 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.665s (SENT)
I20260709 13:08:05.556288 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:05.559059 21564 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:05.447309 25661 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.546422 21568 rpcz_store.cc:276] 0709 13:08:03.912884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.805599 (+892715us) service_pool.cc:224] Handling call
0709 13:08:04.842410 (+ 36811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.868803 (+ 26393us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:05.383362 (+514559us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.540320 (+156958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.542642 (+  2322us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:05.542693 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.542768 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.542904 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":596539,"thread_start_us":565965,"threads_started":2}
W20260709 13:08:05.565110 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 133076us
I20260709 13:08:05.562856 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2634) took 1865 ms. Trace:
I20260709 13:08:05.460282 25776 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:08:05.486099 25568 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:05.553325 21560 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:05.569528 21567 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:05.570111 21568 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:05.573161 21568 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:05.565761 21569 rpcz_store.cc:276] 0709 13:08:03.683145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.697302 (+ 14157us) service_pool.cc:224] Handling call
0709 13:08:03.706123 (+  8821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.747033 (+ 40910us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:04.468885 (+721852us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.247904 (+779019us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.548218 (+300314us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.548414 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.548475 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:05.548558 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.548677 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.548830 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81847,"raft.queue_time_us":327755,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":22826,"spinlock_wait_cycles":27283200,"thread_start_us":874549,"threads_started":4,"wal-append.queue_time_us":333227}
W20260709 13:08:05.571056 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.477267 25657 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.591748 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 116265us
I20260709 13:08:05.593554 21564 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:05.594988 21564 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:05.561725 25777 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:05.591095 21560 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.468420 25540 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:05.600311 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46055.4us
W20260709 13:08:05.618187 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.595878 25768 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.343s	user 0.002s	sys 0.008s
W20260709 13:08:05.624715 25758 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.699s	user 0.004s	sys 0.000s
I20260709 13:08:05.626878 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2126) took 1006 ms. Trace:
I20260709 13:08:05.576555 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:05.577783 25780 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12.
I20260709 13:08:05.631515 21569 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:05.617580 21568 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:05.629879 21608 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.743s (SENT)
W20260709 13:08:05.631026 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 54582us
I20260709 13:08:05.637902 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:05.638715 21459 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:08:05.642731 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.643433 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.606652 21567 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:05.645905 21567 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:05.646250 21567 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:05.629777 21489 rpcz_store.cc:276] 0709 13:08:04.620631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.620811 (+   180us) service_pool.cc:224] Handling call
0709 13:08:04.811155 (+190344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.819892 (+  8737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.626618 (+806726us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54002cae50. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:05.626816 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412890368}
I20260709 13:08:05.632228 21636 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:05.632836 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:05.588876 25779 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:05.675987 21564 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:05.678638 21564 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:05.691560 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.697134 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 58523us
I20260709 13:08:05.698127 21459 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:05.711279 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.770902 21567 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.780426 21560 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:05.639286 25568 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:05.781800 24972 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:05.803900 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 211489us
I20260709 13:08:05.785127 21636 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:05.635140 25415 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.791169 21560 pending_rounds.cc:85] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 8
I20260709 13:08:05.804551 21568 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.805910 21560 pending_rounds.cc:107] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 9.9
W20260709 13:08:05.799465 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.806304 21560 raft_consensus.cc:2889] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.610476 25657 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.782711 21569 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:05.807641 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 878) took 1621 ms. Trace:
I20260709 13:08:05.826689 21560 rpcz_store.cc:276] 0709 13:08:04.186520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.932268 (+745748us) service_pool.cc:224] Handling call
0709 13:08:04.947300 (+ 15032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.469833 (+522533us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b4c004e2d00. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a82aea20 00007f98a82bfa29 00007f98a8285644 00007f98a82acf2d 00007f98a82acb93 00007f98a9fdd18b 00007f98a9fddcb5 00007f98a9fd8f30 00007f98a9fda7de 00007f98a9fe4b49 00007f98a9fe5416
0709 13:08:05.807358 (+337525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.807563 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42257664}
I20260709 13:08:05.779668 25375 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:05.819775 21642 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.627s	user 0.036s	sys 0.007s
I20260709 13:08:05.786057 25779 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:05.835219 21642 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:05.837829 21564 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.803566 25386 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:05.791915 25764 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:05.845860 21567 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:05.847458 25787 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:08:05.833866 25780 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:05.852922 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 234154us
I20260709 13:08:05.847200 25358 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:05.868697 21638 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:05.872490 21564 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.883088 21567 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:08:05.888063 21567 pending_rounds.cc:85] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 7
I20260709 13:08:05.890869 21567 pending_rounds.cc:107] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:08:05.891350 21567 raft_consensus.cc:2889] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:05.859315 25770 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.000s
W20260709 13:08:05.895362 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 197254us
I20260709 13:08:05.901902 21641 raft_consensus.cc:2410] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:05.897102 21564 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:08:05.902891 21564 pending_rounds.cc:85] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 5
I20260709 13:08:05.903147 21564 pending_rounds.cc:107] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:05.903390 21564 raft_consensus.cc:2889] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.904470 21563 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:05.908327 25778 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.909755 25800 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:05.911850 25779 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:05.849980 25783 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:08:05.914170 25357 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:05.885197 25789 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:05.930189 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 46091.7us
I20260709 13:08:05.870677 25386 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:05.933135 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.933410 25790 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.105s	user 0.001s	sys 0.001s
I20260709 13:08:05.931449 25770 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:05.953333 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 323453us
I20260709 13:08:05.929387 25779 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:05.956146 21608 leader_election.cc:336] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.829s (SENT)
I20260709 13:08:05.956730 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:05.930002 25789 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:05.960845 21564 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:05.961257 21564 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:05.962028 21564 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.908931 25778 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:05.944638 25540 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:05.966924 21564 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:05.967303 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 122529us
W20260709 13:08:05.970777 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.956971 25779 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.949846 25602 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:05.973739 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.963346 25640 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:05.967237 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:05.979338 21564 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:05.981726 21564 pending_rounds.cc:85] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:08:05.981949 25798 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:05.982095 21564 pending_rounds.cc:107] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:05.982239 25702 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:05.982690 25798 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:05.983114 25415 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:05.983784 25798 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:05.985283 25375 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:05.986550 25415 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:05.982679 21564 raft_consensus.cc:2889] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.991518 25778 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:05.994565 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2659) took 1220 ms. Trace:
I20260709 13:08:05.997572 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2660) took 1223 ms. Trace:
I20260709 13:08:05.998003 21565 rpcz_store.cc:276] 0709 13:08:04.774166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.122824 (+348658us) service_pool.cc:224] Handling call
0709 13:08:05.123576 (+   752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.124441 (+   865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.124527 (+    86us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.131114 (+  6587us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.417168 (+286054us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:05.417215 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.417293 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.997356 (+580063us) raft_consensus.cc:1685] finished
0709 13:08:05.997378 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.997514 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":326996,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7822,"thread_start_us":199254,"threads_started":1,"wal-append.queue_time_us":404822}
I20260709 13:08:06.006830 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:05.995239 21561 rpcz_store.cc:276] 0709 13:08:04.773907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.109890 (+335983us) service_pool.cc:224] Handling call
0709 13:08:05.110969 (+  1079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.111960 (+   991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.112036 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.113960 (+  1924us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.408814 (+294854us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:05.547646 (+138832us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.547851 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.547931 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.994285 (+446354us) raft_consensus.cc:1685] finished
0709 13:08:05.994314 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.994481 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30655,"prepare.queue_time_us":218759,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":4724,"raft.queue_time_us":382735,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":20308,"thread_start_us":371502,"threads_started":2,"wal-append.queue_time_us":859978}
I20260709 13:08:06.010166 25388 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:06.010660 25388 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:05.294075 21634 rpcz_store.cc:276] 0709 13:08:04.112360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.112557 (+   197us) service_pool.cc:224] Handling call
0709 13:08:04.128535 (+ 15978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.128781 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:04.182619 (+ 53838us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.035518 (+852899us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.285290 (+249772us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.285579 (+   289us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.285648 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:05.285716 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.285807 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.285976 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7327,"prepare.queue_time_us":54259,"prepare.run_cpu_time_us":200,"prepare.run_wall_time_us":14345,"raft.queue_time_us":123650,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":43399,"spinlock_wait_cycles":19900672,"thread_start_us":1032273,"threads_started":2,"wal-append.queue_time_us":557851}
I20260709 13:08:06.015394 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:06.017683 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.974246 25808 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:06.023990 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.011814 25388 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.028040 21634 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:05.976572 25782 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:08:06.031186 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.032186 21568 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
W20260709 13:08:06.037958 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 81862.4us
I20260709 13:08:06.039914 22242 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:06.034759 21568 pending_rounds.cc:85] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:08:06.043282 21568 pending_rounds.cc:107] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:06.043797 21568 raft_consensus.cc:2889] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.046329 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:05.976781 25540 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:06.049476 21608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 3.154s (SENT) [suppressed 38 similar messages]
I20260709 13:08:06.037658 25783 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:06.058085 21608 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.730s (SENT)
I20260709 13:08:06.062224 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2667) took 1110 ms. Trace:
I20260709 13:08:06.062850 21568 rpcz_store.cc:276] 0709 13:08:04.952044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.565106 (+613062us) service_pool.cc:224] Handling call
0709 13:08:05.565434 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.061828 (+496394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.062119 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.027417 25375 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:06.067533 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:06.073408 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.039499 25442 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:08:06.083427 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52312.3us
W20260709 13:08:06.083561 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52474.9us
I20260709 13:08:06.044772 25802 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:08:06.072351 25780 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.075210 25783 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:06.000366 25789 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.081692 25657 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:06.095348 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 49134.1us
I20260709 13:08:06.082366 25803 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.101477 25442 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:06.101653 25807 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:06.102125 21608 leader_election.cc:336] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.796s (SENT)
I20260709 13:08:06.104485 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.107002 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:06.090651 25808 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:06.115027 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.123509 25813 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:06.124522 25797 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.125710 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.128273 21532 leader_election.cc:400] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11.
I20260709 13:08:06.128715 21532 leader_election.cc:403] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.103972 25807 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:06.103757 25442 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:06.097906 25782 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:08:06.097546 25545 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:06.112643 25657 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.129436 25779 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:06.142036 25819 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:08:06.142766 21608 leader_election.cc:336] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.801s (SENT)
W20260709 13:08:06.143293 25812 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:08:06.143687 25534 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:06.127276 25803 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:06.125167 25797 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:06.144047 25442 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.120020 25789 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.149405 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:08:06.149766 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.150643 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 43754.6us
I20260709 13:08:06.160971 25827 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:06.145478 25807 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.139062 25780 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11.
I20260709 13:08:06.140829 25826 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:08:06.169556 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 120400us
W20260709 13:08:06.173151 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 65880.8us
W20260709 13:08:06.103909 25818 consensus_queue.cc:1175] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5727b19579474da6a12f79730b924770" responder_term: 10 status { last_received { term: 10 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 10 index: 9 } }
I20260709 13:08:06.175870 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:06.178364 21643 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
W20260709 13:08:06.183522 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.186306 21608 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.824s (SENT)
I20260709 13:08:06.186758 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.187608 21568 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:06.188004 21568 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:06.188786 21568 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.189625 21568 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.189636 25640 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:06.191028 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:06.191782 21562 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 11: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:06.192310 21565 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:06.193688 22212 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:06.194474 25640 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.195134 25833 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:06.196244 25792 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.196432 25821 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:08:06.196044 25803 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.196981 25653 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:06.196794 25792 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.175043 25779 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.138888 25783 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.200376 25442 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.208647 25792 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:06.210485 25805 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:08:06.183655 25540 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:06.218148 25774 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.768s	user 0.003s	sys 0.007s
W20260709 13:08:06.220533 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.221443 25568 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.225497 25661 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:06.249086 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.250926 21568 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:08:06.251573 21568 pending_rounds.cc:85] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 9
I20260709 13:08:06.251912 21568 pending_rounds.cc:107] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:08:06.252447 21568 raft_consensus.cc:2889] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:06.198042 25749 consensus_meta.cc:287] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.400s	user 0.011s	sys 0.007s
W20260709 13:08:06.330844 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 85823.4us
I20260709 13:08:06.175017 25415 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:06.183259 25711 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:06.258178 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.352005 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.353866 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:06.331800 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 145512us
I20260709 13:08:06.335893 21491 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.176846 25375 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:08:06.340687 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 139865us
I20260709 13:08:06.339986 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:06.357316 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 181350us
W20260709 13:08:06.360044 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.365891 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.366401 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.339468 24972 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:06.173305 25827 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.363317 21493 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
W20260709 13:08:06.357417 25774 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:08:06.375948 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.387362 21608 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.211s (SENT)
I20260709 13:08:06.389252 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.390086 25779 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.395733 25764 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:08:06.404803 25829 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:06.376446 25783 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:08:06.431110 25825 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.431810 25825 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.433944 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1650) took 1465 ms. Trace:
I20260709 13:08:06.434294 21489 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:08:06.439050 25828 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:08:06.440529 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2486) took 1206 ms. Trace:
W20260709 13:08:06.463171 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 120212us
I20260709 13:08:06.434352 21643 rpcz_store.cc:276] 0709 13:08:04.968564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.968688 (+   124us) service_pool.cc:224] Handling call
0709 13:08:04.969055 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:06.178768 (+1209713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.433675 (+254907us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000f3f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:06.433881 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2780531968}
I20260709 13:08:06.408982 25545 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:08:06.408555 25798 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:08:06.500106 25827 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:06.420830 25711 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:08:06.501322 25711 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:06.501736 25711 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:06.502710 25711 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:06.504247 25711 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.440917 21638 rpcz_store.cc:276] 0709 13:08:05.233944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.870457 (+636513us) service_pool.cc:224] Handling call
0709 13:08:05.870774 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.052618 (+181844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.052652 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.062419 (+  9767us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.149331 (+ 86912us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:06.149369 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.149442 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.440292 (+290850us) raft_consensus.cc:1685] finished
0709 13:08:06.440315 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.440460 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5505,"raft.queue_time_us":39467,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"thread_start_us":234612,"threads_started":2,"wal-append.queue_time_us":93706}
W20260709 13:08:06.506911 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 83204.7us
I20260709 13:08:06.514338 25749 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:06.515287 25482 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:06.515162 25749 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.515789 25482 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:06.516794 25482 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:06.517930 25482 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:06.517987 25749 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:06.434342 25825 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:06.444293 25797 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:06.421295 25764 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:06.527593 25764 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:06.530170 25764 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:06.510437 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:06.548496 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 174901us
I20260709 13:08:06.526054 25807 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.554666 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:06.559448 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2114) took 2246 ms. Trace:
I20260709 13:08:06.551108 25797 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:06.582418 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.563241 21488 rpcz_store.cc:276] 0709 13:08:04.309794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.347382 (+ 37588us) service_pool.cc:224] Handling call
0709 13:08:04.347761 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.613064 (+265303us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:04.924408 (+311344us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.235709 (+311301us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.236978 (+  1269us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.248210 (+ 11232us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.248372 (+   162us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:05.348402 (+100030us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b1800171340. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f
0709 13:08:05.350081 (+  1679us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b4800080358. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f 00007f98aeff9f37 00007f98af00e55c 00007f98af00e508 00007f98af00e488 00007f98af00e443 00007f98af00d6ec 00007f98adf37a96
0709 13:08:05.909568 (+559487us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b1800171340. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f
0709 13:08:05.910019 (+   451us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b4800080358. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f 00007f98aeff9f37 00007f98af00e55c 00007f98af00e508 00007f98af00e488 00007f98af00e443 00007f98af00d6ec 00007f98adf37a96
0709 13:08:06.213054 (+303035us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b1800171340. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98ad9da3c7 00007f98a9fec9a7 00007f98a9ffc0bf 00007f98a9ffc038
0709 13:08:06.213346 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.217263 (+  3917us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:06.245649 (+ 28386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.532008 (+286359us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000b8454. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:06.532081 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.556034 (+ 23953us) raft_consensus.cc:1685] finished
0709 13:08:06.556053 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.556169 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133162,"prepare.queue_time_us":1093165,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":116,"raft.queue_time_us":137419,"raft.run_cpu_time_us":9468,"raft.run_wall_time_us":867663,"spinlock_wait_cycles":416287232,"thread_start_us":526162,"threads_started":2,"wal-append.queue_time_us":443415}
W20260709 13:08:06.601327 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 214599us
W20260709 13:08:06.597323 21608 leader_election.cc:336] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.041s (SENT)
I20260709 13:08:06.602298 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.611848 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:06.616168 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.617897 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:06.618021 22243 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.623523 22247 raft_consensus.cc:1217] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Deduplicated request from leader. Original: 8.8->[9.9-9.9]   Dedup: 9.9->[]
I20260709 13:08:06.620704 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.624274 22247 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:06.633740 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:06.633991 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:06.619270 25764 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:06.637724 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.617132 25749 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.640632 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:06.643117 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:06.644127 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:06.651682 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:06.639083 25779 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:06.649243 25388 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.708406 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:06.706413 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58370.9us
W20260709 13:08:06.707558 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.755812 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.656596 25853 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.756942 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.642628 25764 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:06.760819 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.761250 25797 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.762178 25779 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.801518 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:06.804375 25844 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.096s	user 0.005s	sys 0.003s
W20260709 13:08:06.805608 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48728.1us
W20260709 13:08:06.807770 25845 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:08:06.807777 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 47042us
W20260709 13:08:06.811201 25848 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:08:06.811532 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.811123 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.813218 25792 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:06.813616 25792 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:06.813992 25792 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:06.761507 25853 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.844025 25764 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:06.797611 25852 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:08:06.859359 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48310.8us
I20260709 13:08:06.860576 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:06.824174 25786 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:06.869828 25764 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:06.885272 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.888494 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:06.890818 21488 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:08:06.892305 25749 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.892851 25749 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:06.893659 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:06.896648 25749 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:06.897514 25816 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.833s	user 0.004s	sys 0.000s
I20260709 13:08:06.897449 25749 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:06.883338 25829 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.900714 25829 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:06.903292 21641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2477) took 1687 ms (client timeout 1571 ms). Trace:
W20260709 13:08:06.903748 21641 rpcz_store.cc:269] 0709 13:08:05.216050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.247272 (+ 31222us) service_pool.cc:224] Handling call
0709 13:08:06.903023 (+1655751us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54002e2a54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:06.903184 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480713984}
I20260709 13:08:06.905058 25792 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:06.909468 25640 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.714s	user 0.006s	sys 0.006s
I20260709 13:08:06.883373 25779 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.913220 25836 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.487s	user 0.002s	sys 0.000s
I20260709 13:08:06.901306 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2488) took 1651 ms. Trace:
W20260709 13:08:06.924250 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 63788.5us
W20260709 13:08:06.924778 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.847630 25797 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:06.937857 21562 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:06.971171 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:06.969054 21639 rpcz_store.cc:276] 0709 13:08:05.256324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.911850 (+655526us) service_pool.cc:224] Handling call
0709 13:08:05.912252 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.912710 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.912748 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.913339 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.948821 (+ 35482us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:05.949042 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.949347 (+   305us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.896903 (+947556us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:06.900991 (+  4088us) raft_consensus.cc:1685] finished
0709 13:08:06.901014 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.901243 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22079,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":9742720,"thread_start_us":34552,"threads_started":1,"wal-append.queue_time_us":92148}
I20260709 13:08:06.985183 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:06.984833 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 88583.8us
I20260709 13:08:06.995579 21490 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:06.996639 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:06.938328 25640 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.997347 21488 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:07.000705 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:06.968475 25779 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.000028 25786 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 9 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:07.020241 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.007871 25797 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:06.995649 25388 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:08:07.012424 25764 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.024225 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:07.043330 25786 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:07.035494 25835 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.049137 25835 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.051534 25835 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:07.053905 25779 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:07.039956 25792 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:07.035859 25850 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.057106 25850 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.060174 25850 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:07.027256 25829 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:07.031006 25823 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.061720 25823 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.028271 25764 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:07.063484 25764 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.068819 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:07.069351 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.070571 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:07.073246 21567 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:07.085592 25823 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:07.085947 25797 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.087431 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:07.101423 21561 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:07.103421 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.105295 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.105985 21561 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:07.120110 25807 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:07.039469 25873 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.127662 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:07.130162 25872 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:07.080438 25780 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.134910 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:07.134816 25719 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:07.082299 25792 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.142985 25764 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:07.145411 25764 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:07.145476 21608 leader_election.cc:336] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.057s (SENT)
I20260709 13:08:07.146112 25534 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.146580 25534 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.147009 25534 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.155120 21565 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:07.146530 21608 leader_election.cc:336] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.062s (SENT)
I20260709 13:08:07.171698 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:07.157361 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 689) took 1176 ms. Trace:
I20260709 13:08:07.195925 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:07.215536 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 69021.5us
W20260709 13:08:07.216418 21608 leader_election.cc:336] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.081s (SENT)
I20260709 13:08:07.216883 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:07.087877 25386 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:08:07.232362 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:07.232811 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:07.232983 22243 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:07.231921 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:07.261179 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 124782us
I20260709 13:08:07.262826 21640 raft_consensus.cc:2410] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:08:07.270932 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 183601us
I20260709 13:08:07.271896 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:07.278923 21564 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:07.284435 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:07.286165 21638 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:07.287503 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.288365 21568 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:07.298280 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:07.300276 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:07.301496 21459 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:07.233208 25779 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:07.328258 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 111880us
I20260709 13:08:07.306985 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:07.311322 25853 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:07.314877 25868 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.239s	user 0.003s	sys 0.000s
I20260709 13:08:07.319052 25873 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:07.322957 25876 log.cc:927] Time spent T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:08:07.291054 25869 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:07.329360 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.360653 21608 leader_election.cc:336] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.190s (SENT)
I20260709 13:08:07.361241 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:07.332827 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:07.284018 25777 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.295051 25832 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:07.334671 25719 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:07.353528 21638 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:07.337311 25711 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.378257 25779 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:07.364022 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:07.374456 25388 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:07.374756 25818 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.380178 25818 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.385695 25818 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:07.371083 25780 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.388741 25780 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:07.390288 25870 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.390488 25780 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.391083 22245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5a34fd3290de493eb6bbe828dd742772"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:07.391863 22245 raft_consensus.cc:606] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:07.392197 22245 raft_consensus.cc:614] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:07.345682 25764 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:07.395107 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:07.365624 25827 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.406759 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.412010 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:07.416775 21561 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:07.416869 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:07.417737 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 57130.2us
W20260709 13:08:07.418467 21608 leader_election.cc:336] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.207s (SENT)
I20260709 13:08:07.419013 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:07.376227 25823 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.372925 25832 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:07.421538 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.387722 25719 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.423869 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:07.424854 21568 raft_consensus.cc:2368] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:07.389417 25711 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.430325 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.427764 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:07.431700 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.430451 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.435335 21568 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:07.445942 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:07.446599 21569 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.448336 21638 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:07.449554 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.451360 21568 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:07.450902 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:07.453058 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:07.454056 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.426977 25875 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.428112 25719 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.456856 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.397431 25388 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.462539 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.401329 25764 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:07.415807 25873 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:08:07.436802 25779 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.436316 25749 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:07.421909 25827 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:07.473256 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:07.480736 22240 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:07.474579 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:07.488343 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.446270 25824 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:07.471526 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.479414 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:07.480870 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:07.491917 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.430419 25823 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.501042 22242 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:07.461697 25640 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.459566 25806 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.503743 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.438153 25818 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:07.507673 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.515857 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.517370 21564 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:07.454977 25822 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:07.531803 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:07.535310 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.537269 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.502386 25824 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.502213 25873 consensus_queue.cc:1243] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:07.544333 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:07.545292 21486 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:07.549158 21569 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:07.501468 24972 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:08:07.551141 24972 consensus_queue.cc:1243] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:07.554958 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.511997 25806 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.512522 25875 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:07.510949 25866 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.547860 25824 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.495384 25779 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.546849 25843 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:07.502503 25749 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.558554 25806 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:07.586733 21608 leader_election.cc:336] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.518s (SENT)
I20260709 13:08:07.507750 25832 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:07.599598 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 394374us
I20260709 13:08:07.561225 25890 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.567262 25482 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:08:07.613131 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.614012 25780 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:07.614892 25388 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:07.622437 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 89344.3us
I20260709 13:08:07.643177 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:07.644193 21569 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.657174 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:07.659356 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:07.565529 25875 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.667301 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.709499 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:07.709682 21608 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.389s (SENT)
I20260709 13:08:07.712252 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:07.609736 25890 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:07.713637 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:07.565640 25866 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:07.714188 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.714287 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:07.717918 21490 raft_consensus.cc:2410] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:07.710258 21639 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:07.719947 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:07.665050 25832 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.723650 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:07.732122 21608 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.393s (SENT)
I20260709 13:08:07.730160 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.727592 21569 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:07.733574 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.734443 21569 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:07.617384 25534 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:07.739594 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.740001 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:07.747860 25891 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:08:07.775393 25749 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:07.749662 21641 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:08:07.777611 25534 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:07.778043 21641 pending_rounds.cc:85] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 10
I20260709 13:08:07.778340 21641 pending_rounds.cc:107] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:08:07.778599 21641 raft_consensus.cc:2889] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:07.779633 25895 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:07.781140 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:07.781833 21491 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:07.790015 25827 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:07.799122 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.802923 25777 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:07.803233 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 71156.3us
I20260709 13:08:07.803586 25777 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:07.806128 25777 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:07.805739 25824 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.596216 25843 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:07.752133 25866 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:07.753744 25875 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:07.808089 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:07.753530 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:08.356240 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:08.357448 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:08.358151 21562 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:07.750865 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:08.360337 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:07.763695 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:07.772037 25780 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:07.759688 25823 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:08.367101 25806 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.761s	user 0.005s	sys 0.009s
I20260709 13:08:07.806696 25777 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:07.759884 25779 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:07.762107 25861 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.863s	user 0.000s	sys 0.016s
W20260709 13:08:07.759366 25867 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.711s	user 0.009s	sys 0.002s
I20260709 13:08:07.721020 25890 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.431166 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2500) took 1802 ms. Trace:
W20260709 13:08:07.901929 25863 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.003s	user 0.013s	sys 0.004s
I20260709 13:08:08.038612 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:08.434652 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2691) took 2158 ms. Trace:
I20260709 13:08:08.435046 21563 rpcz_store.cc:276] 0709 13:08:06.276233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.638294 (+362061us) service_pool.cc:224] Handling call
0709 13:08:06.645991 (+  7697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.650730 (+  4739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.650761 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.651235 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.861887 (+210652us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:06.861945 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.862039 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.901489 (+1039450us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:08.434333 (+532844us) raft_consensus.cc:1685] finished
0709 13:08:08.434356 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.434582 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4341,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":5106,"spinlock_wait_cycles":56521600,"thread_start_us":127247,"threads_started":1,"wal-append.queue_time_us":228690}
W20260709 13:08:08.084878 25719 consensus_meta.cc:287] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.002s
I20260709 13:08:08.436993 25719 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:08.104650 21638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.042s	sys 0.084s
W20260709 13:08:08.441004 21638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.042s	sys 0.085s
I20260709 13:08:08.441725 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 705) took 1089 ms. Trace:
I20260709 13:08:08.442049 21638 rpcz_store.cc:276] 0709 13:08:07.352625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.494732 (+142107us) service_pool.cc:224] Handling call
0709 13:08:07.517091 (+ 22359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.517510 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.517551 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.543296 (+ 25745us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.441404 (+898108us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:08.441442 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.441503 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.441544 (+    41us) raft_consensus.cc:1685] finished
0709 13:08:08.441554 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.441670 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12085,"raft.queue_time_us":86,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":13647,"thread_start_us":866117,"threads_started":1,"wal-append.queue_time_us":336735}
I20260709 13:08:08.443428 25546 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:08.443920 21489 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:08.129560 25905 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.444679 25905 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.445114 25829 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.139048 21565 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:08.445611 25829 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.446256 21565 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:08.447230 21565 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.448175 21565 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.148903 21569 pending_rounds.cc:85] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 5
I20260709 13:08:08.449254 21569 pending_rounds.cc:107] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:08:08.449534 21569 raft_consensus.cc:2889] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.167505 25900 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.174818 25869 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.451479 25900 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.451786 25869 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.168984 21380 maintenance_manager.cc:643] P 8a31697310664f6da99c69fbc04b3926: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.870s	user 0.199s	sys 0.105s Metrics: {"bytes_written":30583,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":273677,"dirs.run_cpu_time_us":422,"dirs.run_wall_time_us":920,"drs_written":1,"lbm_read_time_us":456,"lbm_reads_lt_1ms":4,"lbm_write_time_us":320152,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":8,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":157277,"threads_started":2,"update_count":9,"wal-append.queue_time_us":8557}
I20260709 13:08:08.191251 25875 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.454074 25875 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:08.193537 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 469320us
I20260709 13:08:08.455634 21381 maintenance_manager.cc:419] P 8a31697310664f6da99c69fbc04b3926: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10325 bytes on disk
W20260709 13:08:08.194700 25853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.006s	sys 0.012s
I20260709 13:08:08.197959 25540 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:08:08.457978 25853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.006s	sys 0.012s
I20260709 13:08:08.458037 25540 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:08.458977 25540 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.460278 25540 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.460319 25365 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:08.226004 25764 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:08.230523 21561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.010s	sys 0.025s
W20260709 13:08:08.461828 21561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.011s	sys 0.025s
I20260709 13:08:07.193639 21635 rpcz_store.cc:276] 0709 13:08:05.980877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.005675 (+ 24798us) service_pool.cc:224] Handling call
0709 13:08:06.006307 (+   632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.006519 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:06.034265 (+ 27746us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.070242 (+1035977us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b1800445840. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b8223a 00007f98a9feca2a
0709 13:08:07.156907 (+ 86665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.156972 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:07.157041 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.157127 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.157292 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27457,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":2919,"raft.queue_time_us":36671,"spinlock_wait_cycles":15726848,"thread_start_us":86401,"threads_started":1}
I20260709 13:08:08.259115 25482 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.463310 25482 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.260686 25749 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.465193 25749 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.267956 25911 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.466315 25911 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.466461 21380 maintenance_manager.cc:643] P 8a31697310664f6da99c69fbc04b3926: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":290,"lbm_reads_lt_1ms":4}
I20260709 13:08:08.246634 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 892) took 1904 ms. Trace:
I20260709 13:08:08.443940 25546 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.467907 21560 rpcz_store.cc:276] 0709 13:08:06.342486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.809294 (+466808us) service_pool.cc:224] Handling call
0709 13:08:06.809638 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:06.971958 (+162320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.971989 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:06.972715 (+   726us) log.cc:844] Serialized 52 byte log entry
0709 13:08:07.114840 (+142125us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:07.114897 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.246189 (+1131292us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540028a5d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:08.246241 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.246286 (+    45us) raft_consensus.cc:1685] finished
0709 13:08:08.246298 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.246563 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1448,"raft.queue_time_us":27597,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":5775,"spinlock_wait_cycles":368960256,"thread_start_us":105741,"threads_started":1,"wal-append.queue_time_us":115635,"wal-append.run_cpu_time_us":3214,"wal-append.run_wall_time_us":1217145}
W20260709 13:08:08.295938 21642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.010s	sys 0.035s
W20260709 13:08:08.470970 21642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.011s	sys 0.035s
I20260709 13:08:08.471750 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 703) took 1131 ms. Trace:
I20260709 13:08:08.472148 21642 rpcz_store.cc:276] 0709 13:08:07.340214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.453672 (+113458us) service_pool.cc:224] Handling call
0709 13:08:07.467740 (+ 14068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.467998 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:07.711392 (+243394us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.471434 (+760042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.471482 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:08.471527 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.471592 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.471696 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":271034,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"thread_start_us":975161,"threads_started":2,"wal-append.queue_time_us":186373}
W20260709 13:08:08.299819 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 495585us
W20260709 13:08:08.474401 21608 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.620s (SENT)
I20260709 13:08:08.324692 21637 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:08.340742 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:08.475468 21568 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.475551 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2511) took 1277 ms. Trace:
I20260709 13:08:08.365212 25914 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:08.366488 25780 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.462553 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 918) took 1110 ms. Trace:
I20260709 13:08:08.476773 25914 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.477260 21561 rpcz_store.cc:276] 0709 13:08:07.352569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.575411 (+222842us) service_pool.cc:224] Handling call
0709 13:08:07.582960 (+  7549us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:07.583491 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.583538 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:07.618755 (+ 35217us) log.cc:844] Serialized 52 byte log entry
0709 13:08:08.462224 (+843469us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:08.462263 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.462331 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.462370 (+    39us) raft_consensus.cc:1685] finished
0709 13:08:08.462381 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.462498 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1645,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":4168,"thread_start_us":746175,"threads_started":1,"wal-append.queue_time_us":232166}
W20260709 13:08:08.471033 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.482303 25702 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.482975 25702 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.484311 25832 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.454557 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 625) took 1081 ms. Trace:
I20260709 13:08:08.484975 25832 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.485677 21489 rpcz_store.cc:276] 0709 13:08:07.372966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.373079 (+   113us) service_pool.cc:224] Handling call
0709 13:08:07.395621 (+ 22542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.444305 (+1048684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.454289 (+  9984us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000b7f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:08.454469 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410447616}
I20260709 13:08:08.462499 25365 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:08:08.495716 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.367918 25806 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.372545 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2661) took 3530 ms. Trace:
I20260709 13:08:08.375890 25843 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:08.388833 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 580770us
I20260709 13:08:08.516314 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:08.391083 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52342.1us
W20260709 13:08:08.400452 25879 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 1.091s	user 0.004s	sys 0.002s
I20260709 13:08:08.408301 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:08.552332 21643 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.408195 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:08.422400 21567 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:08.442952 25866 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:08.187721 25824 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:08.475909 21637 rpcz_store.cc:276] 0709 13:08:07.197976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.206973 (+  8997us) service_pool.cc:224] Handling call
0709 13:08:08.324168 (+1117195us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:08:08.324353 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.475284 (+150931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.475497 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40916736}
W20260709 13:08:08.502601 21608 leader_election.cc:336] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.554s (SENT)
I20260709 13:08:08.562179 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:08.502561 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 79597.2us
I20260709 13:08:08.431582 21634 rpcz_store.cc:276] 0709 13:08:06.628796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.814368 (+185572us) service_pool.cc:224] Handling call
0709 13:08:06.814671 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.815038 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.815067 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.815524 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.007649 (+192125us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:07.007687 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.007756 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.758750 (+750994us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:08.430857 (+672107us) raft_consensus.cc:1685] finished
0709 13:08:08.430882 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.431102 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":268,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"spinlock_wait_cycles":64630016,"thread_start_us":191725,"threads_started":1,"wal-append.queue_time_us":231128}
I20260709 13:08:08.526837 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:08.551129 25780 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.516105 25802 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:08.569165 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 66619.6us
I20260709 13:08:08.570205 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:08.571485 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:08.544286 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:08.557590 21568 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:08.514679 21566 rpcz_store.cc:276] 0709 13:08:04.842592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.357667 (+515075us) service_pool.cc:224] Handling call
0709 13:08:05.384379 (+ 26712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.451546 (+ 67167us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:06.508627 (+1057081us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18000c3340. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98ad9da3c7 00007f98a9fec9a7 00007f98a9ffc0bf 00007f98a9ffc038
0709 13:08:06.624568 (+115941us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.868986 (+244418us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.994082 (+125096us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.007970 (+ 13888us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.008117 (+   147us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:07.008163 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.008242 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.313532 (+305290us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b18000c3340. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:08:07.761482 (+447950us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:08.372283 (+610801us) raft_consensus.cc:1685] finished
0709 13:08:08.372311 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.372465 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21810,"prepare.queue_time_us":188036,"prepare.run_cpu_time_us":8423,"prepare.run_wall_time_us":78297,"raft.queue_time_us":193393,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":12117,"spinlock_wait_cycles":81809536,"thread_start_us":529652,"threads_started":4,"wal-append.queue_time_us":251842}
I20260709 13:08:08.515874 25534 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:08.564747 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2723) took 1007 ms. Trace:
I20260709 13:08:08.551767 25719 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:08.542448 25914 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:08.593166 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 91559.8us
I20260709 13:08:08.542979 25835 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:08.594990 25835 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.581091 21569 rpcz_store.cc:276] 0709 13:08:07.557274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.148276 (+591002us) service_pool.cc:224] Handling call
0709 13:08:08.148678 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:08.450211 (+301533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.450241 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:08.450774 (+   533us) log.cc:844] Serialized 52 byte log entry
0709 13:08:08.558823 (+108049us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:08.558881 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.558982 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.560460 (+  1478us) raft_consensus.cc:1685] finished
0709 13:08:08.560483 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.564663 (+  4180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3570,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":107561,"threads_started":1,"wal-append.queue_time_us":107908}
I20260709 13:08:08.597093 25835 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:08.575590 25843 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 13:08:08.601406 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 81701.1us
W20260709 13:08:08.602087 21392 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 242) took 15049 ms (client timeout 15000 ms). Trace:
I20260709 13:08:08.603775 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:08.574972 25777 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:08.566838 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 109277us
I20260709 13:08:08.558120 25834 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:08.584355 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:08.568856 25779 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:08.585284 25764 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.610105 21565 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:08.564004 25866 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.613252 21565 pending_rounds.cc:85] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:08:08.617321 21565 pending_rounds.cc:107] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:08.617676 21565 raft_consensus.cc:2889] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.618429 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2191) took 1016 ms. Trace:
I20260709 13:08:08.618811 21565 rpcz_store.cc:276] 0709 13:08:07.602446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.138610 (+536164us) service_pool.cc:224] Handling call
0709 13:08:08.138901 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.618188 (+479287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.618379 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.614496 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:08.620178 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:08.585894 25534 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.623952 25918 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:08.602509 21392 rpcz_store.cc:269] 0709 13:07:53.553166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.879918 (+326752us) service_pool.cc:224] Handling call
0709 13:08:08.602007 (+14722089us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:04.161386 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:04.162049 (+   663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:04.162105 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:08:04.162134 (+    29us) tablet.cc:662] Decoding operations
0709 13:08:04.163145 (+  1011us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:04.163241 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:04.163271 (+    30us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:08:04.164164 (+   893us) tablet.cc:701] Row locks acquired
0709 13:08:04.164202 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:08:04.164422 (+   220us) write_op.cc:270] Start()
0709 13:08:04.164565 (+   143us) write_op.cc:276] Timestamp: P: 1783602484164341 usec, L: 0
0709 13:08:04.164606 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:08:04.165379 (+   773us) log.cc:844] Serialized 3658 byte log entry
0709 13:08:04.802877 (+637498us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:05.485236 (+682359us) op_driver.cc:464] REPLICATION: finished
0709 13:08:05.889373 (+404137us) write_op.cc:301] APPLY: starting
0709 13:08:05.889480 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:05.890381 (+   901us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:05.890425 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:05.968943 (+ 78518us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:05.969218 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:08:05.969266 (+    48us) write_op.cc:312] APPLY: finished
0709 13:08:05.969618 (+   352us) log.cc:844] Serialized 71 byte log entry
0709 13:08:05.969816 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:05.969941 (+   125us) write_op.cc:454] Released schema lock
0709 13:08:05.969983 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:05.970410 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:05.970438 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":709926,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":330878,"apply.run_cpu_time_us":4342,"apply.run_wall_time_us":81025,"num_ops":9,"prepare.queue_time_us":343335,"prepare.run_cpu_time_us":7379,"prepare.run_wall_time_us":50928,"raft.queue_time_us":637194,"raft.run_cpu_time_us":68065,"raft.run_wall_time_us":193337,"replication_time_us":1293031,"spinlock_wait_cycles":42289792,"thread_start_us":819968,"threads_started":4,"wal-append.queue_time_us":358727,"wal-append.run_cpu_time_us":43984,"wal-append.run_wall_time_us":2448109}]]}
I20260709 13:08:08.603999 25546 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:08.582635 25802 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.636016 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:08.612084 25482 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:08.628284 25711 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:08.624330 25914 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.646509 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:08.648291 21634 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:08.648838 25764 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.649544 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:08.614346 25869 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:08.651875 21636 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:08:08.652686 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:08.653589 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:08.672550 21635 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:08.655236 25870 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.661763 21638 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:08.650611 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:08.673992 21637 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.640805 25780 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.619366 25900 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:08.627542 25911 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:08.689415 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:08.636705 25779 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:08.635063 25835 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:08.695129 25835 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:08.695734 25802 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:08.696061 25835 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.697427 25835 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.686615 25890 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.679267 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:08.679934 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48020.6us
I20260709 13:08:08.668982 25545 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:08:08.682108 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:08.703866 21488 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:08.682034 25780 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.684000 25870 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.638950 25913 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.669134 25918 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:08.687363 25875 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:08.687748 25806 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:08.688015 25866 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:08.701768 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:08.701560 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:08.707468 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 136039us
I20260709 13:08:08.713546 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:08.687376 25749 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:08.715493 21643 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:08.715875 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:08.716666 22240 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:08.718327 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:08.718999 22242 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:08.722942 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:08.705749 25534 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:08.722200 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:08.700836 25890 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:08.728031 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:08.729990 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:08.733312 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:08.737972 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:08.740046 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:08.740597 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:08.741664 25869 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.742313 25926 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.742991 25764 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.720510 25521 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:08.743573 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:08.749575 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:08.725063 25749 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.762724 21638 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.724639 25827 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:08.764736 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45688.3us
I20260709 13:08:08.737695 25875 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:08.744321 25913 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:08.777034 21637 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:08.777036 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:08.743793 25890 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:08.770798 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 171082us
I20260709 13:08:08.785135 22240 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:08.788144 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:08.765576 25521 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.762764 25900 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.742905 25926 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.780170 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:08.800536 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:08.772171 25827 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.798158 25780 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:08.737309 25866 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:08:08.800421 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 78802.6us
I20260709 13:08:08.804199 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:08.791848 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:08.811486 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:08.811937 21491 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:08.812273 21642 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:08.771147 25869 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:08:08.799302 25482 raft_consensus.cc:2764] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:08:08.778604 25929 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.803001 25521 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.805976 25777 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:08.818948 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:08.816654 21638 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:08.828008 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:08.807085 25827 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.788904 25875 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:08.806962 25914 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.848590 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:08.806715 25764 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:08.806914 25749 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.864302 25749 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.840642 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:08.866863 21642 raft_consensus.cc:2368] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13.
I20260709 13:08:08.867180 25829 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:08.844842 21635 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:08.809167 25913 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.868127 25913 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.868933 25870 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:08.871232 25913 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:08.866456 25749 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:08.876322 25777 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:08.877380 25777 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.817210 25900 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:08.879537 25903 log.cc:927] Time spent T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:08:08.881084 21423 debug-util.cc:398] Leaking SignalData structure 0x7b0800276500 after lost signal to thread 20385
W20260709 13:08:08.882121 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08003bec00 after lost signal to thread 21426
W20260709 13:08:08.883378 21423 debug-util.cc:398] Leaking SignalData structure 0x7b080034bb40 after lost signal to thread 21518
W20260709 13:08:08.883651 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc3a0 after lost signal to thread 21519
W20260709 13:08:08.884655 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0ba0 after lost signal to thread 21593
W20260709 13:08:08.885718 21423 debug-util.cc:398] Leaking SignalData structure 0x7b0800345560 after lost signal to thread 21667
W20260709 13:08:08.885967 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08003ec4c0 after lost signal to thread 21668
I20260709 13:08:08.815469 25780 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.858901 25914 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.887075 25780 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.887709 25914 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.889595 25780 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:08.849069 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 57326.6us
I20260709 13:08:08.891017 25702 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:08.891158 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:08.894337 25482 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:08.895078 25482 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:08.895735 25482 consensus_queue.cc:1243] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:08.835666 25832 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:08.839167 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.778393 25918 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:08.900025 25905 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:08.807224 25534 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:08.901203 25534 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:08.901587 25534 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:08:08.904871 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08003af340 after lost signal to thread 22277
W20260709 13:08:08.905347 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4520 after lost signal to thread 22278
W20260709 13:08:08.905747 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08001daa60 after lost signal to thread 25418
I20260709 13:08:08.875481 25875 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.866431 25926 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:08.906184 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:08.858664 25764 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:08.907343 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.858963 21490 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
W20260709 13:08:08.908425 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08001652e0 after lost signal to thread 25826
I20260709 13:08:08.912519 22212 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:08.912751 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08003677c0 after lost signal to thread 25841
W20260709 13:08:08.960458 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.902362 25534 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:08.953683 25921 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:08.931031 25764 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.931499 25905 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.930920 25711 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.953164 25929 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.931187 25843 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:09.010470 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.011406 21640 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:08.999511 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:08.953574 25482 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:09.005722 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:08.962527 25900 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:09.024883 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.017124 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:09.012908 21635 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:09.025563 21637 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:09.027101 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.020700 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.029762 21561 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:08.964387 25749 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.976341 25890 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:08.995997 25779 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:09.043643 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.048442 21560 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:09.046057 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:09.050154 21488 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.065912 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.023996 25921 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:09.112217 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:09.114271 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 88719.5us
I20260709 13:08:09.115599 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:09.011726 25905 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.051877 25534 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.119463 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.009106 25711 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.125638 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.129593 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.033355 25482 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.042600 25388 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:08:09.035490 25900 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.152123 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.046999 25749 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.042274 25941 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:08:09.063356 25779 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.055797 25890 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.013574 25929 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.173638 25938 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:09.187286 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 133478us
I20260709 13:08:09.183238 25944 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:09.195942 25941 consensus_queue.cc:1243] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:09.285765 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:09.265710 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:08:09.254771 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 87619.3us
I20260709 13:08:09.328217 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:08:09.327541 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 70036.4us
W20260709 13:08:09.257094 25942 log.cc:927] Time spent T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:08:09.334096 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:09.222579 25939 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:08:09.356706 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:09.277252 25943 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:08:09.218353 25944 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:09.276641 25890 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:09.278913 25945 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:08:09.278295 25900 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:09.280918 25911 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:09.271891 25711 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:09.387413 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:09.222185 25921 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:09.388621 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:09.273212 25827 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.365363 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:09.214994 25938 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.390223 22243 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:09.391135 25827 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:09.391537 25911 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:09.365929 21488 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
W20260709 13:08:09.283571 25950 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:09.273468 25482 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:09.323691 25926 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:09.292002 25928 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.392269 25827 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.327489 25870 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:09.327731 25913 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:09.374459 25944 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:09.371317 25540 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:09.419507 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:09.280838 25521 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:09.381021 25940 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:09.340723 25932 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:09.426590 21532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.001s	sys 0.013s
I20260709 13:08:09.425025 25926 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.385984 25890 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:09.392964 25900 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:09.430910 25832 consensus_queue.cc:1059] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:09.422029 25777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.007s	sys 0.021s
W20260709 13:08:09.428067 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 305895us
W20260709 13:08:09.453485 21532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.002s	sys 0.013s
I20260709 13:08:09.454499 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:09.386317 25914 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.466120 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:09.472800 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.443912 25913 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.474206 25905 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:09.477324 25911 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:09.479350 25953 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:08:09.459247 25940 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:09.483497 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.484683 22242 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:09.496605 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:09.508380 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.501336 25777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.007s	sys 0.022s
I20260709 13:08:09.524688 25711 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:09.434959 25870 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.533695 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:09.536140 22243 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:09.502766 25958 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.498199 25929 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:09.502626 25540 raft_consensus.cc:3055] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:09.544883 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:09.498660 25938 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:09.547824 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 165766us
I20260709 13:08:09.556186 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:09.560328 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.443912 25928 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:09.579713 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:09.581318 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:09.576570 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.583040 21634 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:09.584411 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:09.468205 25890 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:09.591274 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.504806 25900 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:09.599402 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:09.607563 25952 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 13:08:09.608771 25969 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:08:09.555328 25540 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:09.584789 25749 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:09.620509 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:09.584599 25823 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.611534 25920 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:09.583600 25827 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.640251 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.600504 25711 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:08:09.583401 25907 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:09.645913 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:09.647056 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 46915.7us
W20260709 13:08:09.637815 25764 consensus_meta.cc:287] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.001s
I20260709 13:08:09.655705 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:09.676172 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:09.676838 21488 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.678396 21492 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 10. Ops: []
I20260709 13:08:09.680514 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.681553 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.681867 25913 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:09.682911 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.679405 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:09.653373 25832 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:09.647384 25984 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:09.557433 25958 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:09.690663 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.692891 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.694074 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.697463 21486 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:09.701177 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.675808 25764 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.694260 25832 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.703353 25832 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.703503 25914 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:09.704164 25914 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:09.704639 25914 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.704866 25764 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:09.686364 25944 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:09.706898 25900 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:09.708634 25944 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:09.700398 25984 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.709432 25890 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:09.713719 25870 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:09.714371 25982 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:09.715044 25982 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.715830 25928 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:09.716903 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.717352 25926 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:09.717657 25982 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:09.687654 25920 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:09.719048 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.720214 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.721143 22245 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:09.722167 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.722321 25958 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:09.722852 21489 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:09.723773 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.724701 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.724962 21494 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:09.726163 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.727610 21486 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:08:09.732590 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53312.7us
I20260709 13:08:09.733582 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:09.737944 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.738701 21560 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:09.739271 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.739809 21490 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:08:09.739881 21566 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:09.742138 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.742432 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.742763 21485 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:09.743290 21566 raft_consensus.cc:2410] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:09.743139 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.745028 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.746385 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.750118 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.750568 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.751127 25984 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:09.716850 25940 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:09.752104 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.736342 25986 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:09.753777 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.754714 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:09.755411 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.762297 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.756121 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:09.741267 21488 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:09.763262 22246 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:09.757313 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.757531 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.764199 21562 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:09.766499 25986 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:09.767429 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.770494 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:09.771256 21639 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.774313 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:09.774300 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.775081 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.775760 21566 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:09.776517 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.777011 21566 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:09.777644 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.777530 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:09.774549 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.774495 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.780643 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:09.779474 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.779525 21563 pending_rounds.cc:85] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 5
I20260709 13:08:09.781505 21563 pending_rounds.cc:107] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:09.781589 21562 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:09.781814 21563 raft_consensus.cc:2889] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:09.782227 21457 leader_election.cc:400] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13.
I20260709 13:08:09.782496 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.780503 21566 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:09.782538 21457 leader_election.cc:403] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:09.785674 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.786497 21637 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:09.787561 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:09.780715 21564 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:09.793490 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.793713 21562 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:09.778637 25913 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:09.795481 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:09.797854 21487 raft_consensus.cc:2376] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13. Re-sending same reply.
I20260709 13:08:09.796309 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:09.796697 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:09.803107 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.800951 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:09.815740 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:09.834059 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:09.805534 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:09.778842 25940 raft_consensus.cc:2764] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:09.792359 25890 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.879921 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:09.876319 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.767498 25986 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.884625 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.797868 25829 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13.
I20260709 13:08:09.791450 25911 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:08:09.773723 25832 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:09.814991 24972 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:09.874727 25711 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:09.892935 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 87502.2us
I20260709 13:08:09.939080 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:09.875339 25984 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:09.931881 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:09.942828 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.945711 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.943753 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:09.946393 21643 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:09.924046 25900 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.967368 21493 raft_consensus.cc:2368] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14.
I20260709 13:08:09.969025 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.972532 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:09.935302 24972 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:09.975754 25963 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
I20260709 13:08:09.948200 25940 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.982509 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:09.937181 25920 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:10.009093 25806 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:10.011325 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:10.016121 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.034255 21637 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:10.034967 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.978118 24972 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.949055 25711 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.023496 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.966240 25982 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.044176 25987 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.044360 25982 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:10.045033 25991 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:10.045143 25987 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.046911 25985 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.025096 25832 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:10.026252 21643 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:10.047705 25985 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.049757 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:09.964515 25984 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:10.051838 25989 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:08:10.052681 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:10.053372 25990 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:08:10.053686 21491 raft_consensus.cc:2368] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10.
I20260709 13:08:10.054056 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:10.054634 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.053696 25984 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.057055 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:10.035627 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:10.049955 25890 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.050441 25982 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.063283 21532 leader_election.cc:400] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10.
I20260709 13:08:10.063697 21532 leader_election.cc:403] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:10.043356 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:10.050700 25975 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:10.064249 22246 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.064164 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.032763 25806 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:10.037892 25926 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.073046 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.067015 25984 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.065989 25975 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.079610 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:10.084983 25918 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:10.085454 25918 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:10.077425 25711 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.079154 25975 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.097854 22246 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:10.074117 25926 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.099433 25938 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.111915 25711 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:10.115067 25938 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.115236 25711 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.117401 25711 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:10.117684 25938 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.117786 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:10.118623 21568 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:10.086385 25918 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.123510 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.099409 21639 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:10.130141 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:10.131124 22246 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:10.134941 22245 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:10.134441 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:10.139782 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.141548 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.114195 25986 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:10.135116 25918 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.147379 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.149053 25806 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.149595 25832 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.150148 25806 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:10.151458 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:10.151469 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.152155 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:10.153254 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.152246 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2530) took 1154 ms. Trace:
I20260709 13:08:10.152150 21491 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:10.154150 21636 rpcz_store.cc:276] 0709 13:08:08.998257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.001109 (+  2852us) service_pool.cc:224] Handling call
0709 13:08:09.001506 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.217186 (+215680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.217232 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.217286 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:09.217362 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.152020 (+934658us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540021b954. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:10.152067 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.152190 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495450880}
I20260709 13:08:10.155193 25545 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.157848 25968 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:10.158468 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:10.154584 25711 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:10.160269 25987 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.161754 24972 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.157344 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.166518 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.168890 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:10.170149 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.169976 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.156497 25982 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.173961 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:10.174114 25982 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.174587 25982 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.174926 25711 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.175580 25711 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:10.156530 25986 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.164511 25779 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:10.178710 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.179320 25911 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:10.182188 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:10.187316 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.186244 25711 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:10.189018 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.188282 25779 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:08:10.182698 25545 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:10.173352 25987 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.199882 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.201392 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.186657 25968 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.202299 25870 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.205279 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.202610 25764 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.204896 25986 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:10.232230 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.235034 25807 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:10.200518 25711 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.245872 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:10.237769 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.247733 26001 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:10.206203 25853 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:08:10.250264 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.251444 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.252121 21491 raft_consensus.cc:2368] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:08:10.203150 25968 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.252645 25968 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.252899 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.259457 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.260143 21491 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:10.252998 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.261682 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:10.267956 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58904.1us
I20260709 13:08:10.274305 25984 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10.
I20260709 13:08:10.277401 25926 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:10.288102 22242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 596) took 1562 ms. Trace:
I20260709 13:08:10.288718 22242 rpcz_store.cc:276] 0709 13:08:08.725987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.726198 (+   211us) service_pool.cc:224] Handling call
0709 13:08:08.726592 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.516544 (+789952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.286705 (+770161us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54005a2b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:10.288035 (+  1330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742845824}
I20260709 13:08:10.274397 25982 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.294926 25913 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.310917 25779 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:10.312170 25779 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:10.312517 25779 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:10.313478 25779 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.310949 25913 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.296553 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:10.333806 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 131048us
I20260709 13:08:10.335247 25984 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.335368 25780 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.335521 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.335791 25984 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.336418 25711 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.336836 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:10.337697 25711 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.335536 21457 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:10.335916 25780 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.338641 25984 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.338685 25719 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:10.339650 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:10.341285 25719 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:10.341917 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:10.342515 21641 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.314769 25779 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:10.342207 25719 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.306355 25975 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.331995 25960 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:10.348145 25960 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.348655 25960 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.351315 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:10.354846 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:10.358918 21606 leader_election.cc:400] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:08:10.359266 21606 leader_election.cc:403] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:10.361500 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:10.324477 25926 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.419518 21494 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:08:10.422385 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.423607 25711 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:10.348035 25521 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.355604 25911 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:10.367684 25890 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:10.435309 21641 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
W20260709 13:08:10.479274 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53392.5us
W20260709 13:08:10.484040 25875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.006s	sys 0.007s
I20260709 13:08:10.425496 25900 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:10.417429 25968 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.430768 25911 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:10.500391 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 138960us
I20260709 13:08:10.502255 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:10.414523 25926 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.478080 25986 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:10.488807 25875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.006s	sys 0.007s
I20260709 13:08:10.479163 25749 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:08:10.549202 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.499204 25900 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.560248 21488 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:10.428449 25711 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.505504 25911 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:10.581248 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.508204 25870 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:10.609328 25780 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.615914 25982 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:10.618043 25926 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.621145 24972 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:10.558552 25984 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.622825 25984 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.623849 25985 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.625046 25984 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.625576 25956 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:10.625965 25956 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:10.627029 25956 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.627916 25968 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:10.630115 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:10.659798 21563 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:10.630987 26014 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.633173 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:10.634636 21488 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:10.640003 25890 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.568243 25900 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.649209 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:10.652865 21565 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:10.649386 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:10.668497 21566 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:10.676734 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:10.563798 25986 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.688804 25711 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:10.689064 25764 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:10.689576 25764 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.690356 25986 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:10.691723 25764 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:10.692220 25916 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.703128 21560 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:08:10.759182 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.704577 26003 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:10.720860 25968 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.862461 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:10.669574 25870 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.676184 26014 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.831393 25913 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:10.948786 26017 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.970961 25780 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:10.975282 25546 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:10.832741 25764 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:10.976019 25545 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:10.969512 25926 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:10.990006 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:10.709977 25916 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.037638 26016 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:10.943405 25987 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:11.045001 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.098040 21569 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:08:11.082355 25960 consensus_meta.cc:287] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.733s	user 0.006s	sys 0.014s
I20260709 13:08:11.057192 25985 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:11.056943 25982 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:11.082815 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.069069 26010 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:08:11.057507 25984 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:11.057386 25986 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.054740 25711 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:11.093654 25545 consensus_queue.cc:1243] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:08:11.102898 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 63448.7us
W20260709 13:08:11.110055 25911 consensus_meta.cc:287] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.000s
W20260709 13:08:11.104719 25779 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.762s	user 0.007s	sys 0.004s
I20260709 13:08:11.087853 25780 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:10.950178 26023 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:11.119980 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:11.133637 21639 raft_consensus.cc:2410] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:08:11.128137 21606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.000s	sys 0.032s
I20260709 13:08:11.082719 25968 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.135510 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:11.139067 21606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.000s	sys 0.033s
I20260709 13:08:11.096894 25926 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.070128 26003 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.104467 25987 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.116971 25982 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.123720 25984 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.101130 25764 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.132735 25711 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.116807 25985 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.157047 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.085959 26017 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.104681 25960 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.161990 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:11.190603 21564 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:11.162856 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:11.129412 25911 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.124806 25986 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:11.174191 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.158922 26019 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:08:11.157874 26018 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:08:11.160006 25995 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.105s	user 0.003s	sys 0.015s
I20260709 13:08:11.157346 26027 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:08:11.195351 25985 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:11.158398 26024 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:11.191814 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:11.137851 26023 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.143445 25779 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:08:11.157183 25875 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:11.152750 26022 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:11.202061 21562 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:11.116276 26016 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.209281 21564 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:11.199524 21568 raft_consensus.cc:1813] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Handling vote request from an unknown peer 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.293553 21568 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:08:11.294683 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:11.296109 21564 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:08:11.300221 25916 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:11.305523 21532 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.132:40323 timed out after 1.784s (SENT) [suppressed 17 similar messages]
I20260709 13:08:11.290902 26027 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:11.307734 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:11.310967 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 179951us
I20260709 13:08:11.313810 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:11.315192 25837 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:11.318864 22243 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:11.295089 26028 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.304414 26009 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:08:11.331337 25779 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.300298 25365 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:11.340306 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 183339us
I20260709 13:08:11.303953 26026 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:11.307893 25913 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:11.311393 26027 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:11.378703 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:11.381558 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2139) took 1690 ms. Trace:
W20260709 13:08:11.331343 26025 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:08:11.325237 25985 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:11.334581 25870 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.339725 25834 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.293742 25875 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.390532 21492 rpcz_store.cc:276] 0709 13:08:09.690872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.698962 (+  8090us) service_pool.cc:224] Handling call
0709 13:08:09.699324 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.732576 (+ 33252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.732608 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.738103 (+  5495us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.935942 (+197839us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:09.935999 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.936097 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.159425 (+1223328us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:11.346504 (+187079us) raft_consensus.cc:1685] finished
0709 13:08:11.346525 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.381470 (+ 34945us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24620,"raft.queue_time_us":26505,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5070,"spinlock_wait_cycles":14661888,"thread_start_us":139063,"threads_started":1,"wal-append.queue_time_us":202540}
I20260709 13:08:11.342514 25779 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:11.396942 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 91429.3us
I20260709 13:08:11.401741 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.406901 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:11.296846 26022 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.403106 25779 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.423050 26022 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.344199 26028 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.425782 26028 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:11.415920 26017 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.417614 26016 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.418183 25926 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:11.418809 25984 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.419409 25764 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.400229 26031 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.384027 25365 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.390304 26026 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.420164 25875 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.420426 25982 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.409173 25870 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.421195 25911 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.427085 21569 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:11.399649 26014 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.419538 25960 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:11.400781 25968 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:11.426775 25900 consensus_meta.cc:287] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.000s
I20260709 13:08:11.433132 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.434876 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.441350 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:11.444257 21564 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:11.398856 25985 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.430856 26022 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:11.463066 26029 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.467110 25900 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.435300 26017 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:11.435129 26034 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:11.440600 26031 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.477223 25779 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.479013 26035 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.479483 26033 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:11.480892 25365 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.435432 26016 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:11.482425 25940 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:11.506095 25940 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:11.507054 25940 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.507767 26031 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.508301 25940 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.490684 26029 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.485173 21564 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:11.511132 26033 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:11.486301 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 107665us
I20260709 13:08:11.514989 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.498299 21561 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:11.480894 26026 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.491695 26022 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.486438 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.516004 26033 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.529027 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.531467 26026 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.531755 25825 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.533155 26026 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:11.431599 26027 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.526363 26035 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.534471 26027 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.539083 25985 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:11.548513 25900 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.549588 25540 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:11.553740 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 111885us
I20260709 13:08:11.557529 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.560817 26033 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.562712 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.501163 26034 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.567111 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:11.573268 21561 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:11.573277 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.575407 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.556936 26026 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:11.585362 21490 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:11.585268 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.589673 21492 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:11.557981 26029 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:11.591583 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.587600 25928 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:08:11.583112 25900 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.550697 25540 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:11.595083 26036 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:08:11.595790 26043 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:08:11.598919 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.600458 26034 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.608987 21561 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:11.609278 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:11.610474 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.594575 26022 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.616246 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:11.572598 25365 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:11.591444 26026 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.619107 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:11.606639 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:11.611809 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2547) took 1851 ms. Trace:
I20260709 13:08:11.573731 26033 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:11.627830 21642 rpcz_store.cc:276] 0709 13:08:09.760079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.761216 (+  1137us) service_pool.cc:224] Handling call
0709 13:08:09.761453 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.761635 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:11.532643 (+1771008us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b18004488a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98ad9da3c7 00007f98a9fec9a7 00007f98a9ffc0bf
0709 13:08:11.532806 (+   163us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.611373 (+ 78567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.611424 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:11.611475 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.611542 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.611752 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29248,"prepare.queue_time_us":186326,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":6717,"raft.queue_time_us":843,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2483,"spinlock_wait_cycles":34741632,"thread_start_us":233639,"threads_started":2}
I20260709 13:08:11.625773 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.607192 25900 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:11.627444 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:11.634949 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.637246 22247 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:11.640760 21567 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:08:11.642066 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.649125 25779 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.639607 26033 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.652218 26033 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.652889 25914 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:11.653523 26015 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:11.654434 26015 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:11.654604 21639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 737) took 1303 ms (client timeout 1538 ms). Trace:
I20260709 13:08:11.654829 26015 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:11.655038 21639 rpcz_store.cc:269] 0709 13:08:10.350914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.351061 (+   147us) service_pool.cc:224] Handling call
0709 13:08:11.654402 (+1303341us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b5400143a54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:11.654545 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797153024}
I20260709 13:08:11.658314 21562 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:11.658622 25983 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:11.627174 25866 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:11.661188 25866 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:11.662096 25866 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:09.567283 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:11.705121 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:11.704697 21493 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 2137) took 1983 ms (client timeout 1617 ms). Trace:
I20260709 13:08:11.705816 22242 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
W20260709 13:08:11.706164 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.628299 26034 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:11.706946 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:08:11.705962 21493 rpcz_store.cc:269] 0709 13:08:09.679883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.680242 (+   359us) service_pool.cc:224] Handling call
0709 13:08:11.662987 (+1982745us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54000f5854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:11.663132 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648683264}
I20260709 13:08:11.689081 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.710827 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.710990 22240 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.711347 21485 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:11.711460 22247 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:11.664850 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.712391 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.695211 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.668397 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.713761 21641 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:11.714200 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:11.707124 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 81448.4us
I20260709 13:08:11.724018 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.724536 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:08:11.664561 21567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2200) took 1889 ms (client timeout 2276 ms). Trace:
I20260709 13:08:11.725253 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:11.725224 21567 rpcz_store.cc:269] 0709 13:08:09.751818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.751931 (+   113us) service_pool.cc:224] Handling call
0709 13:08:11.627241 (+1875310us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:08:11.641203 (+ 13962us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11886848}
I20260709 13:08:11.667135 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.726106 21638 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:11.663760 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.665405 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.665997 21489 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:11.666707 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:11.713191 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:11.714748 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.715497 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.715435 26045 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.716313 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.640930 25900 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.720048 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.735597 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:11.721949 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.722904 22240 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:11.667555 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.723433 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.669286 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.715691 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.728101 21487 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:11.737329 21634 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:11.728643 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.730576 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.731055 21488 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:11.732194 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.733731 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.736766 21642 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:11.738200 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:11.738332 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:11.740060 21634 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.740226 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:11.741631 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.736893 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.737949 21635 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:11.708528 26033 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.744673 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.747148 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:11.745467 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 78845.7us
W20260709 13:08:11.755579 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.727674 25779 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.756856 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.758529 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.726639 26034 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:11.758529 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.731371 26045 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.745188 26016 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.761328 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.769309 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.761969 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.735750 26022 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.763329 21642 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:11.757392 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:11.765494 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.711711 25983 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:08:11.770008 21488 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:11.774037 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.753324 25388 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:11.777428 25870 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.778110 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.759769 25779 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:11.779443 26011 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.140s	user 0.013s	sys 0.000s
I20260709 13:08:11.833356 21562 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:11.790036 26026 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.767062 25940 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:11.839021 25940 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:11.839349 25780 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.795670 26022 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:11.840857 25986 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:11.794641 25954 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:11.841459 25954 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:11.748183 26017 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:11.797622 26040 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:11.743405 26044 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:11.767465 26034 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.769284 26016 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:11.844908 26016 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.847589 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:11.848505 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2168) took 1722 ms. Trace:
I20260709 13:08:11.759479 26033 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.842257 25954 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:11.820114 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 54654.7us
I20260709 13:08:11.821597 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.824402 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.825397 21488 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:11.768432 26045 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.826447 25914 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:11.831782 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:11.832573 25779 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:11.836097 21457 connection.cc:256] RPC call timeout handler was delayed by -1.0062864120000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 13:08:11.838152 25711 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.838605 26026 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.839469 25940 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.952709 26015 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:11.820585 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 63284.1us
I20260709 13:08:11.954492 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:11.955484 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:11.848869 21491 rpcz_store.cc:276] 0709 13:08:10.126504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.265401 (+138897us) service_pool.cc:224] Handling call
0709 13:08:10.265803 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:10.267343 (+  1540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.267392 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:10.268868 (+  1476us) log.cc:844] Serialized 52 byte log entry
0709 13:08:10.345752 (+ 76884us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:10.345800 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.345875 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.843914 (+1498039us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b2400120c68. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6d7b9c4 00007f98a6d79acb 00007f98a6f34dc9 00007f98a6f34a55 00007f98a6f33fb0 00007f98a9baa488 00007f98a9baabe8 00007f98a9b82398 00007f98a9b7d76a 00007f98a9b7cbb6
0709 13:08:11.848258 (+  4344us) raft_consensus.cc:1685] finished
0709 13:08:11.848279 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.848455 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10315,"raft.queue_time_us":96,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":1919,"spinlock_wait_cycles":70542080,"thread_start_us":61860,"threads_started":1,"wal-append.queue_time_us":267542}
I20260709 13:08:11.958529 25711 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:11.959026 25711 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:11.959446 25711 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.848991 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.961719 21494 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:11.899333 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.899209 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.961912 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.963093 21492 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:11.963218 21491 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:08:11.849647 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.870083 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:11.849375 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.824173 25938 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:11.925875 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.962405 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:11.967057 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:11.943418 21637 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.968376 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.949152 21634 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:11.970221 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.826332 25911 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.965045 21490 raft_consensus.cc:2393] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:11.899333 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:11.971081 21634 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
I20260709 13:08:11.947453 22247 raft_consensus.cc:2376] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12. Re-sending same reply.
I20260709 13:08:11.876143 25932 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:11.973519 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:11.901882 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.865516 26029 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.878325 26023 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:11.958089 26027 raft_consensus.cc:2764] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:11.985891 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.943385 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:11.944973 26022 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.973248 25986 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.943717 25914 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:11.973855 25932 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:11.972290 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.982064 26015 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:11.982631 22244 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:11.974066 25911 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:12.006150 21634 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:11.973322 25780 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.980527 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:12.009639 21637 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:11.991364 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:11.979275 25540 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:12.011611 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:12.013623 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.977280 25870 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.007452 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:12.017225 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:11.981761 25954 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.008579 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:11.994053 25986 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.004520 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:12.014393 21640 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:12.012903 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.019588 22247 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:12.015084 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:12.004081 25914 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:11.994578 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51340.7us
I20260709 13:08:12.021556 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:12.021848 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:11.981879 26029 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:11.991712 26033 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.023008 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.023294 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:12.023497 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:12.020228 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:12.022020 21637 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:11.975764 25938 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.005641 26022 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:12.018996 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:12.008616 25911 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.023002 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:12.025660 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.026698 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:12.014950 25866 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.016562 26027 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.016052 26023 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.029145 25870 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.041508 21641 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.031702 26003 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.032656 26033 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:12.053404 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.057382 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.027551 25780 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.036065 21634 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:12.053930 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:12.055204 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.025146 26040 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.064813 26040 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:12.065052 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.020946 25986 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.018519 25764 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:12.065243 26040 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.060580 25835 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:12.078689 25835 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:12.062369 25780 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:12.079350 25780 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.079726 25835 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.083048 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.084208 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.084020 25711 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.085214 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.085779 21493 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:12.086125 25711 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.086158 25900 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.089385 25900 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.090160 21636 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:12.092360 21564 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:12.093384 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.094462 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:12.095155 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.061370 25956 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.023524 25719 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.028460 26022 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:12.070127 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:12.063047 26033 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.102353 26033 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.106402 25914 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.027443 26015 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:08:12.062673 25870 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.108994 25961 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.109295 25870 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.028014 25932 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.109697 26035 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.109604 25961 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.110235 25932 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.055997 26027 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:12.111604 26027 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.111971 25961 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.113862 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.071251 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:12.120411 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.120769 25961 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:12.121181 25961 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.121534 25961 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:12.122905 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.123299 25975 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.106599 25940 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:12.126963 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 55782.6us
I20260709 13:08:12.128259 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.128654 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.129655 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.129818 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.131393 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:12.132777 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2767) took 1397 ms. Trace:
I20260709 13:08:12.132637 25911 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.133812 21642 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:12.086580 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.097261 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.090157 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:12.134727 21492 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:12.043105 26026 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.136539 21635 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:12.137617 26029 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:12.099263 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.038182 25985 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:12.139467 25985 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.139863 25985 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.140306 21635 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:12.068387 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:12.140651 21568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2766) took 1411 ms (client timeout 1522 ms). Trace:
I20260709 13:08:12.141005 21637 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
W20260709 13:08:12.141057 21568 rpcz_store.cc:269] 0709 13:08:10.728819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.728940 (+   121us) service_pool.cc:224] Handling call
0709 13:08:12.140449 (+1411509us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54003237d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:12.140598 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302026496}
I20260709 13:08:12.099964 21565 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:12.016840 25540 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.133147 21560 rpcz_store.cc:276] 0709 13:08:10.734963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.851345 (+116382us) service_pool.cc:224] Handling call
0709 13:08:10.851763 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.149141 (+297378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.149176 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.149221 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:11.149266 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.132554 (+983288us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54000181d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:12.132601 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.132723 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682485504}
I20260709 13:08:12.128368 25779 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.144600 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.141513 21635 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:12.147279 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.147835 25979 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.144974 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.151710 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.096508 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.155779 25979 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.108686 25914 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.179334 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.164595 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:12.160658 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.176295 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:12.183085 25914 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:12.183732 26053 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:08:12.183655 25914 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:12.185528 25914 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.188570 25780 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.191519 25940 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.191725 21635 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:12.159240 26029 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.159921 26003 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:12.183152 25540 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.196587 26003 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:12.066975 26023 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.197605 26003 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.156004 25984 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.199664 25984 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:12.199986 21564 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:12.148554 25711 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.178889 25829 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:12.202013 25986 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.199728 25934 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:12.203971 25934 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:12.204213 25986 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.204589 25719 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:12.179051 25979 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.204919 25934 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.206068 25934 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.200166 26027 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.196105 25911 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.199718 26023 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.210285 21640 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:12.144532 26022 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:12.148741 25764 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.200184 25984 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.204962 25719 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:12.269979 25719 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.271848 25719 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.273221 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.274756 25540 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:12.275880 25540 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:12.276258 25940 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.231516 26027 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.276273 25540 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:12.278311 25540 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.280128 25540 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.232990 25938 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.282517 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:12.233232 25987 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.220927 26026 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.237074 21643 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:12.218853 25780 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.296310 25934 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.248287 25961 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.319080 21637 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:12.038117 26016 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.252203 25956 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.216724 25970 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:12.224571 25928 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:08:12.333642 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:12.334414 21642 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:12.255200 25984 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.262704 25979 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.274452 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:12.338428 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64036.4us
I20260709 13:08:12.345291 21643 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:12.347680 21490 raft_consensus.cc:2368] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:08:12.349888 21487 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:12.352952 25961 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:12.353675 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.354108 26016 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.356338 25984 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.357237 25914 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.358970 25911 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.359457 25911 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.359846 25911 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.360584 25979 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.363415 21634 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:12.365456 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 204049us
I20260709 13:08:12.368275 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.165251 26034 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.294456 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:12.288007 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 114674us
I20260709 13:08:12.247407 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2166) took 2125 ms. Trace:
I20260709 13:08:12.371971 21489 rpcz_store.cc:276] 0709 13:08:10.122210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.262045 (+139835us) service_pool.cc:224] Handling call
0709 13:08:11.665788 (+1403743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.726868 (+ 61080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.247186 (+520318us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000f5850. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:12.247331 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3227618048}
I20260709 13:08:12.250947 25870 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:12.338480 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 165477us
W20260709 13:08:12.395776 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.401993 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 107590us
I20260709 13:08:12.406905 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.408839 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.411947 21639 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:12.412307 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:12.412472 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 260812us
I20260709 13:08:12.412570 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.413618 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.414633 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.414641 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.415163 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.359467 26040 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.364351 25928 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:12.335672 25956 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.422080 21636 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:12.423918 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.427757 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:12.428494 22242 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:12.429391 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:12.429610 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.431130 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.431874 21561 raft_consensus.cc:2368] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:12.432515 22247 raft_consensus.cc:2410] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:12.433418 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.433835 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:12.434549 22246 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 8: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:12.435300 25779 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.437172 26034 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.439348 25914 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.440251 25934 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:12.440704 25934 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:12.441463 25934 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.420676 25984 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:12.425388 25987 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.444558 26045 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.445393 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:12.445585 25956 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.425719 25928 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.366282 26033 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.425211 25780 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:12.447721 25780 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.448235 25928 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.449874 25870 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.450033 25780 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.448331 26033 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.426100 26027 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.422528 25546 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.433121 26032 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:08:12.451771 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.452152 25985 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.440086 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.456188 21490 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:12.460157 26040 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.461165 22244 raft_consensus.cc:2368] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14.
I20260709 13:08:12.458460 21568 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 9: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:12.442610 25934 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.468358 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.466219 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.469801 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.556187 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.557504 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.493286 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:12.558754 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.559125 21638 raft_consensus.cc:2410] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:12.559747 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:12.491966 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 68651us
I20260709 13:08:12.501412 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:12.509713 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:12.505221 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:12.512017 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 55160.5us
W20260709 13:08:12.512171 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 85072.4us
W20260709 13:08:12.512935 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.565577 21485 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:12.568282 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.541046 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:12.466554 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.565670 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.569017 21493 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.569301 21566 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:12.569797 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.570312 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.470116 25911 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.491364 26045 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.521385 25985 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.565893 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:12.571615 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.523481 26022 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.572710 21635 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:12.572772 25911 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.566498 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.516892 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.573704 26022 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:12.468909 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.563033 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:12.574972 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.567018 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.570832 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.557296 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.576153 21565 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:12.576187 21494 raft_consensus.cc:2410] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:12.489955 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:12.538939 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:12.577052 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.567978 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:12.577271 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 62647.4us
I20260709 13:08:12.566926 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.496618 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:12.577330 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.578270 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.469187 21641 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:12.503032 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:12.571545 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.505415 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:12.579871 21566 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:12.580332 21564 raft_consensus.cc:2368] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14.
I20260709 13:08:12.581511 21564 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:08:12.539301 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:12.553934 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:12.577798 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.585435 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.539625 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:12.587795 21562 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:12.589304 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 86416.3us
I20260709 13:08:12.597747 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.599257 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.603051 21608 leader_election.cc:400] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:12.603544 21608 leader_election.cc:403] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.605016 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:12.606343 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.612978 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.614775 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:12.615483 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.469861 25702 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.147s
I20260709 13:08:12.611066 26033 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:12.618407 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:12.619935 25830 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:12.621567 25830 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:12.622951 26046 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:12.623383 26046 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:12.624300 26046 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.625805 26046 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.627187 25782 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:12.627632 25782 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:12.628576 25782 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.629920 25782 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.632786 25870 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.633625 25956 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.635511 26034 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.637995 25702 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:12.638412 25960 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:12.638850 25960 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:12.639642 25960 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.640969 25960 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.649066 21565 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:12.656570 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:12.530457 25983 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:12.658978 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46304.5us
I20260709 13:08:12.595227 25365 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:12.672164 25365 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:12.672701 25365 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.675094 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:12.675792 22246 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.469962 26040 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:12.669255 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:12.681023 26040 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.682499 21606 leader_election.cc:400] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:08:12.682930 21606 leader_election.cc:403] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.684000 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:12.684659 21636 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.681337 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:12.685217 25956 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.594036 25985 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.686426 21637 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:12.686596 25985 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:12.687089 25985 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.598814 26022 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:12.690858 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:12.594854 26059 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:12.699458 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:12.606376 25827 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:08:12.600669 25911 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.695751 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:12.655380 25780 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.607044 26057 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:12.693526 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 78141.2us
I20260709 13:08:12.731616 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.732031 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:12.732435 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.733014 21487 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.738055 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:12.708773 21636 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:12.699056 25987 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.711946 26033 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:12.705866 26059 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:12.696691 25983 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.747767 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.745208 25780 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.748984 25966 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.768579 26057 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.761817 26033 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:12.756987 26059 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.771059 25983 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:12.771958 26027 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.748090 25984 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:12.735845 25911 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.751993 26034 raft_consensus.cc:2764] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:08:12.767120 26040 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:12.775161 25966 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.790411 22246 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:12.783504 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.797963 21487 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:12.801826 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.797020 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:12.805320 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:12.811539 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 79590.6us
I20260709 13:08:12.812227 21532 leader_election.cc:400] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14.
I20260709 13:08:12.812633 21532 leader_election.cc:403] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.795929 25966 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.814970 21493 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:12.814524 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:12.813954 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:12.807950 25779 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:12.819264 25779 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:12.820200 25779 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.815986 26003 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.826943 25938 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.807835 25914 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:12.831640 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:12.807833 26057 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:12.834112 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.833820 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.834463 25938 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.837867 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:12.838101 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.978041 21487 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:12.978864 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:12.980443 26003 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14.
I20260709 13:08:13.128003 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:13.132045 25961 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.132562 25961 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:13.133432 25961 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.143126 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:13.143834 22246 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:12.839641 26033 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:12.983409 25984 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.166337 21389 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 10 to 11, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 11 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:13.168220 21388 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 246) took 31749 ms (client timeout 15000 ms). Trace:
W20260709 13:08:13.168898 21388 rpcz_store.cc:269] 0709 13:07:41.418349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.467487 (+ 49138us) service_pool.cc:224] Handling call
0709 13:08:13.167926 (+31700439us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":434101,"reported_tablets":50}
I20260709 13:08:13.178900 21567 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:13.181761 25975 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:13.182749 21569 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:13.184124 21564 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:13.188030 21564 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:13.134737 25961 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.197808 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:13.198848 21564 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:13.199203 25837 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.199985 25837 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:13.201079 25837 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.210909 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:13.216938 21562 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:13.219087 26016 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:13.222575 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 408099us
I20260709 13:08:12.997924 26059 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:12.998926 25956 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9.
I20260709 13:08:13.002818 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:12.979694 25365 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.011284 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:12.998374 25985 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.004715 25966 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.081596 25780 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:13.220710 26016 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.263036 25780 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.264647 26016 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:13.265300 25780 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:13.082502 25911 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:13.084887 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 755) took 1182 ms. Trace:
I20260709 13:08:13.249346 26070 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.274411 25966 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:13.249617 25979 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:13.098534 21634 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:13.099910 21639 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:13.106392 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:13.277972 21641 raft_consensus.cc:2410] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:13.279083 21568 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:13.122479 21493 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.239998 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:13.281178 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:13.240185 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:13.222241 25954 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.258172 21640 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:13.082367 26034 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:13.270037 21635 rpcz_store.cc:276] 0709 13:08:11.902756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.193524 (+290768us) service_pool.cc:224] Handling call
0709 13:08:12.193795 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.573111 (+379316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.047554 (+474443us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54002e1654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:13.084830 (+ 37276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870978944}
W20260709 13:08:13.086098 26066 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.245s	user 0.013s	sys 0.000s
I20260709 13:08:13.272743 25985 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:13.273308 25365 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:13.257887 25829 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:08:13.274514 26070 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.092279 25914 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.282760 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:13.310961 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:13.312148 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:13.283433 21486 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:13.313318 21635 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:13.293635 21643 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:13.295095 26016 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:13.299823 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:13.291311 25911 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.333348 22246 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:13.302196 21641 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:08:13.334136 21641 pending_rounds.cc:85] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 10
I20260709 13:08:13.334421 21641 pending_rounds.cc:107] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:08:13.334940 21641 raft_consensus.cc:2889] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:13.304155 21493 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:13.321594 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:13.340921 21566 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.285591 25954 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:13.359500 21493 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:13.366166 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:13.352032 25779 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.285135 25975 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:08:13.332549 25956 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:13.334381 26040 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.375423 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:13.297501 26034 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.380072 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:13.382272 25825 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:13.384078 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:13.384789 21569 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:13.386111 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:13.390834 21635 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:13.332254 25938 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:13.371155 25782 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:08:13.389035 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:13.387005 25780 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:13.368368 25985 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:13.395196 25830 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:13.398440 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:13.403389 21566 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:13.403146 25830 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:13.404202 25780 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.404654 26057 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.388653 26046 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:08:13.393745 26071 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.408761 25780 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:13.439512 25970 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:13.440006 25970 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:13.441098 25970 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.407011 25985 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.398573 25954 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.453088 25966 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:13.442667 25970 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.466337 25966 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:13.474242 26034 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:13.468895 26070 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:13.475548 26077 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:08:13.477022 26073 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:13.477944 25985 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:13.480645 26059 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:13.508425 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:13.524313 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.526847 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 169036us
W20260709 13:08:13.535683 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 229837us
I20260709 13:08:13.405844 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:13.540310 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 134401us
I20260709 13:08:13.548455 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:13.530282 21459 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:13.554680 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 184648us
I20260709 13:08:13.550022 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:13.556874 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 184414us
I20260709 13:08:13.559306 25365 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:13.563067 25546 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:13.434916 25830 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.577898 25830 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:13.470310 25954 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.589426 25802 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:13.590240 25802 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:13.599211 25870 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.475781 25966 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:13.612747 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 63025.9us
I20260709 13:08:13.615584 26072 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.607039 26027 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 13:08:13.612319 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 82166.9us
I20260709 13:08:13.617832 25365 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:13.600389 25780 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.618546 25546 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.614611 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:13.625201 26059 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:13.628146 26059 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.620541 26029 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:13.613792 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:13.631353 26059 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:13.638865 25780 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.622256 25870 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:13.643752 25966 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.647831 25782 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:13.648579 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 100465us
I20260709 13:08:13.649988 25938 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.654100 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:13.655405 25802 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.657505 25975 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.692934 25975 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.693657 25802 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.694231 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:13.695353 26027 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.695997 25975 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:13.658145 25365 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:13.697170 22242 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:13.626740 25546 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:13.697867 25365 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.699620 25546 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.700901 25870 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.701725 25546 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.635172 25984 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:13.703065 25984 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.705487 25984 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:13.707769 26046 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:13.708637 26046 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.659896 26072 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.665390 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:13.655414 25521 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.711040 25521 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:13.711392 21486 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:13.712428 25521 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.713081 26046 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:13.714120 25521 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.674005 25979 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.715050 25979 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:13.716291 25979 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.718083 25979 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.636210 26029 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:13.719820 26029 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.721263 26029 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.724207 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:13.725191 21566 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:08:13.676081 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 66222.2us
I20260709 13:08:13.738703 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:13.740837 25975 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:13.742386 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:13.742966 25975 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.677275 25954 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.674077 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:13.678731 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 366512us
I20260709 13:08:13.680483 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:13.681583 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:13.686241 26083 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:13.690373 25782 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:13.696259 26027 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.698045 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:13.759074 26083 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.763008 21642 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:13.763424 26083 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:13.767868 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 86541.8us
I20260709 13:08:13.769845 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:13.771133 25941 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.772166 25941 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:13.772676 25941 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.773208 25941 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.775825 25782 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.777328 25782 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.827499 21567 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:13.838201 26034 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:13.838968 26034 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.839898 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:13.841259 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 60817.2us
I20260709 13:08:13.842216 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:13.842866 25954 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:13.839324 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 100799us
I20260709 13:08:13.843485 26022 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.855226 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:13.841747 26034 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:13.824740 26059 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.864713 25954 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:13.865235 25546 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.865706 25911 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:13.866281 25911 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:13.865926 25546 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.866748 25911 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.868482 25546 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:13.869300 25938 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:13.883152 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 185321us
I20260709 13:08:13.884305 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:13.886201 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:13.888804 25914 consensus_meta.cc:287] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.013s
I20260709 13:08:13.889554 25914 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:13.890748 21565 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:13.892045 25780 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.897838 25830 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.899767 25830 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.903718 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:13.904230 25830 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:13.904690 21565 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:13.907964 22212 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:08:13.908097 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 66077.1us
I20260709 13:08:13.909041 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:13.909979 26034 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.910036 21565 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:13.911934 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:13.917655 25782 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.920089 25941 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:13.921118 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.922945 26084 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.923734 26084 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:13.926340 26084 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:13.929251 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:13.931144 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:13.931994 21636 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:13.931951 25825 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:13.939090 26034 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.940579 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:13.941028 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:13.941514 21565 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:13.941970 26034 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.944558 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:13.945508 21486 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:13.920710 25966 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:13.948540 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:13.918326 25782 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.955703 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:13.961503 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 93459.6us
I20260709 13:08:13.953056 26034 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.953039 25782 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.957706 26084 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:13.960455 25521 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.974725 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:13.975482 21565 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:13.980746 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:13.981741 21489 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.967962 26034 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.983448 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:13.984333 21488 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:13.985226 26034 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:13.981659 26071 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.981088 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:13.986472 21567 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
W20260709 13:08:13.989092 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 103086us
I20260709 13:08:13.990521 26029 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.990660 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:13.966471 25966 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.999176 26071 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:14.000056 26071 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.995425 25941 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.005427 25966 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:13.992075 26029 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:13.971697 26084 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.012792 26029 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.016362 26083 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.024103 25782 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.025391 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:14.026944 25365 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.033939 25365 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.027227 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:14.028208 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:14.009581 21489 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:14.036492 21564 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:14.035461 21567 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:14.035765 21459 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.040930 26029 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:14.041492 26029 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.041781 25365 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.042032 26029 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.043586 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.044341 21488 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:14.045015 26083 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:14.042551 25365 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:14.045998 25365 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:14.046428 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.047140 25365 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.002604 26071 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.050194 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.053931 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.056113 25546 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.056643 25546 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.057029 25546 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.058491 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:14.059159 21560 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.061591 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.060148 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:14.063301 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 122462us
I20260709 13:08:14.064275 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:14.065845 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:14.065893 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:14.066713 21569 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:14.066912 25782 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.067154 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:14.066952 26046 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:14.067729 22246 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.067888 26057 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.068140 26034 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:14.068571 26034 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:14.068652 26083 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.069002 26034 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.035079 26084 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.069205 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:14.063326 21643 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.072749 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:14.073197 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82648.5us
I20260709 13:08:14.074872 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:14.076174 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.076874 21488 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:14.068158 26046 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:14.080029 25914 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:14.080143 26046 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.082464 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:14.083418 25914 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:14.086253 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.086740 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.089126 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:14.089861 22247 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.094031 25546 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.088505 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:14.095180 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.098486 26096 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.098454 26034 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.099119 26096 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.099494 26096 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.102051 21643 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:14.102380 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.103098 21635 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:14.104475 25911 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.106528 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:14.107100 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.108067 26083 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.108543 26083 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.108649 22246 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:14.119504 26096 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.119872 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.123932 21642 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:14.110870 25970 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:14.125229 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.125442 25970 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:14.125985 21643 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:14.114207 21560 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:14.108945 26083 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.125993 25970 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.129696 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.117290 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.131889 25966 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:14.132313 25966 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.132694 25966 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.142974 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.102409 22247 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:14.120332 25521 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.121429 21636 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:14.141695 22212 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:08:14.121965 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56255.6us
I20260709 13:08:14.122215 25546 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:14.151994 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.154434 21488 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:14.151850 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:14.156320 21567 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.110481 26029 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.162343 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.109596 26034 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:14.165366 22244 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:14.166265 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:14.166424 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:14.167574 21564 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.165408 25911 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:14.172605 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:14.173132 21636 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.149801 26096 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.172369 21642 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:14.171774 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:14.187947 26029 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.188812 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:14.189539 21560 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.188871 26067 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.190845 26029 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.175560 25830 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:08:14.191196 26067 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.191766 25830 consensus_queue.cc:1243] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:14.191591 26029 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.193540 26067 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.194264 26029 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:14.202186 21560 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:14.204085 21486 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:14.206948 21636 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:14.208189 21459 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.209385 21567 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:14.216711 21636 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:14.210246 21608 leader_election.cc:400] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14.
I20260709 13:08:14.182619 25911 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:14.182310 26070 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:14.224035 26070 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:14.225023 26070 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.218446 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:14.216564 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.211949 21488 pending_rounds.cc:85] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 8
I20260709 13:08:14.221060 25546 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:14.213614 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:14.211165 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:14.227542 21565 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:14.221124 25521 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.223290 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:14.227622 21488 pending_rounds.cc:107] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:08:14.232872 21488 raft_consensus.cc:2889] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.219574 26067 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:14.194741 25966 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.241907 21459 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.244479 25521 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:14.255136 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 84408.3us
I20260709 13:08:14.256059 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:14.256914 26022 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:14.257493 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:14.258558 26022 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.231273 26034 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.231213 25938 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:14.235003 25911 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:14.266888 25911 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.268770 25966 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.274075 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:14.274374 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:14.275239 21486 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:14.237533 25970 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.297117 25521 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.298772 25970 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.299472 26083 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.302296 26083 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:14.299513 26029 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:14.304214 26029 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.281617 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:14.304311 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:14.304600 26029 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.304926 21642 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.304999 21567 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:14.303359 25938 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:14.278853 26067 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:14.290290 21564 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:14.310720 22244 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:14.297214 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:14.312889 21566 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.314848 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:14.307991 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:14.319090 22244 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:14.323686 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:14.329934 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.330232 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.331001 21634 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:14.331205 21640 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:14.332376 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:14.331835 22212 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:14.334656 21486 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:14.335351 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:14.335992 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.336058 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:14.336861 21643 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.342758 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:14.347537 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.348536 21639 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:14.355607 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.356379 21641 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:14.357074 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:14.358021 26059 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:14.361121 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:14.361402 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:14.372965 21566 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
W20260709 13:08:14.373831 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 59082.4us
W20260709 13:08:14.376394 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 62049.6us
I20260709 13:08:14.307622 25938 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.370426 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.383237 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.345530 26085 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:14.388417 22244 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.358573 26059 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.359323 26083 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.359814 25979 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:14.378043 26071 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:14.400960 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:14.401962 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:14.406366 21637 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.408206 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.412047 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:14.413525 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 52490.5us
I20260709 13:08:14.402506 21486 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:14.403019 25914 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:14.373066 26057 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.395182 26085 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.427239 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.395007 26083 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.428256 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.430691 25540 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:14.439368 25365 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:14.440065 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.428589 25546 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.443951 25914 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:14.453716 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.416266 26022 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.463261 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:14.464134 21566 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.434300 26085 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.466346 26022 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.464784 26057 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.469762 25975 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:08:14.470342 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52876.6us
I20260709 13:08:14.470976 21486 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:14.448617 26083 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.475986 26059 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.478886 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:14.457629 25954 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:14.480731 25540 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:14.481087 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:14.481685 26034 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:14.496019 21642 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:14.496049 21643 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:14.496510 22244 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:14.506832 21640 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:14.478348 25975 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:14.461494 25546 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.448158 26067 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.471557 25966 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:08:14.518163 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:14.519702 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:14.462940 26084 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.502074 25954 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:14.530915 21566 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:14.510715 26059 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:14.535406 26096 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:14.568543 26059 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:14.568634 26096 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:14.569070 26059 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.569413 25975 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.569604 26096 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.570839 25975 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.571039 26096 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.547029 26084 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:14.535156 25780 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.548312 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:14.548566 25540 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.555747 26101 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.555112 25914 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.556839 25954 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:14.563050 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 82112.2us
I20260709 13:08:14.564402 22242 raft_consensus.cc:2368] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10.
I20260709 13:08:14.565717 26057 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.566188 26071 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:14.567804 26022 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:14.568063 25546 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.580837 21566 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.581797 26083 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:14.609074 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 140081us
I20260709 13:08:14.610122 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:14.583406 25780 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:14.585218 26085 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.615765 21637 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:14.627066 26022 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:14.627640 26022 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.629663 26022 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:14.631669 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:14.632455 26083 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:14.633289 21641 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:14.634068 21566 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:14.635892 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:14.637019 25521 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:14.637533 25521 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:14.639170 22247 raft_consensus.cc:2368] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:14.638777 25521 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.640202 26085 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.642887 26029 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.643572 21606 leader_election.cc:400] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:14.643936 21606 leader_election.cc:403] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.644102 21487 raft_consensus.cc:2368] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
I20260709 13:08:14.645135 26029 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.646881 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:14.647465 21640 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.647985 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.648561 21642 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:14.651057 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:14.651710 26107 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:14.650411 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:14.654670 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:14.656068 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:14.656237 26022 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:14.651736 21564 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.650949 22244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:14.658349 21640 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:14.664187 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:14.663239 26083 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:14.681764 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:14.682468 21488 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.684491 26034 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.685400 26034 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:08:14.680177 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 152440us
I20260709 13:08:14.690624 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.691445 21643 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:14.691725 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.676270 26084 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:14.676491 25979 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.698007 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:14.692647 21641 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:14.699097 21640 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.697404 21532 leader_election.cc:400] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10.
I20260709 13:08:14.697966 25702 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.701725 22244 raft_consensus.cc:606] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:14.703877 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:14.706729 25911 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:14.707157 25911 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:14.709213 21640 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:14.700243 21532 leader_election.cc:403] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.663462 26022 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.725435 21493 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.718237 21564 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:14.708021 25911 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.722162 26084 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:14.724061 26113 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:14.735462 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.723237 25979 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:14.741405 21489 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:14.749850 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:14.751736 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.752406 21493 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:14.743580 25979 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.752722 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:14.752099 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.755097 21489 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:14.756278 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:14.757687 21643 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:08:14.762823 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 72040.3us
I20260709 13:08:14.765651 26022 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:14.766054 25911 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.778666 21643 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:14.776089 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 120033us
I20260709 13:08:14.780594 26084 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.751533 26071 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 9. Current term is 10.
I20260709 13:08:14.753541 25966 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.803416 25966 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.803884 25966 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.805033 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:14.751448 25914 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.799101 25780 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:08:14.807582 25914 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.760902 25702 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:14.746868 26059 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.809231 25702 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:14.809932 25914 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.810247 25702 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.800091 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:14.800621 26114 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.801012 26057 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:14.752681 26113 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:14.786448 26101 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:14.811714 21491 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.819273 26101 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:14.819682 26101 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:14.820611 26101 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.824599 26113 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:14.811951 26114 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.826294 26114 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.829113 21491 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:14.796379 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:14.813961 21488 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:14.781714 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:14.815501 25782 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:08:14.812438 26057 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:14.835562 26057 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:14.810731 26059 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:14.836561 26057 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:14.839162 26057 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.847594 22244 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:14.848650 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:14.849996 21532 leader_election.cc:400] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
I20260709 13:08:14.850416 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:14.850344 21532 leader_election.cc:403] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.851118 22247 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:08:14.852147 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.843055 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:14.854272 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.856024 21636 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:14.857456 21491 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:14.859648 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:14.861261 21392 catalog_manager.cc:5697] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 11, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:14.858965 26022 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:14.850381 26113 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.868471 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:14.864780 21392 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 13, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 13 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:14.870569 21642 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:14.865841 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:14.872119 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:14.854547 26125 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:14.882483 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 101271us
I20260709 13:08:14.884449 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:14.886243 21643 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:14.887192 21490 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:14.882925 26113 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.955787 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:14.888727 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:14.889858 25914 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.918931 26122 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.954113 21491 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:14.865428 26059 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.988422 21566 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:14.995887 22244 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:14.923365 26119 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:08:14.998816 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:14.911245 25782 raft_consensus.cc:993] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:14.887045 26071 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:15.015408 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 126755us
I20260709 13:08:15.028882 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:15.014597 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 83903.5us
I20260709 13:08:15.031397 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:14.987337 26113 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.890569 26096 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 13:08:15.027431 26071 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:15.033932 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:15.034441 25830 raft_consensus.cc:1081] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:15.019781 26057 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:15.043524 21392 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 11, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.039426 26071 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.045265 21566 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:15.043524 21568 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:14.996954 25979 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.046262 26034 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:15.037377 25780 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:15.056874 26127 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:15.057734 26102 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:15.059882 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 69023.1us
I20260709 13:08:15.019217 26123 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:08:15.025489 26114 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.043890 25540 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:15.044238 26057 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.066401 21569 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:15.066167 25825 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:15.069176 26101 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.106078 26133 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:15.060876 25780 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:15.107259 25780 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:15.109606 21640 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:15.110011 21640 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:15.110776 21640 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.111724 21640 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.114343 21490 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:15.096887 21639 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:15.098084 26114 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:15.104512 26129 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:15.053279 26034 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:15.116847 21566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:36572
I20260709 13:08:15.117615 21566 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:15.116851 26129 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.117990 21566 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.117067 26034 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.114193 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:15.088053 26057 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.124565 26133 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:15.125154 26133 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.030089 26022 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:15.021301 25914 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:15.170306 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 92508.1us
W20260709 13:08:15.185269 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 84088.9us
I20260709 13:08:15.196491 26133 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:15.184759 21392 catalog_manager.cc:5697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.216567 21640 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:15.227453 21640 pending_rounds.cc:85] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 6
I20260709 13:08:15.227799 22247 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:15.227818 21640 pending_rounds.cc:107] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:15.228595 21640 raft_consensus.cc:2889] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.051959 26122 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.232295 21392 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 9, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.232959 21566 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:15.240638 25365 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:15.241504 25365 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:15.242954 25540 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:15.244338 25540 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.246516 25702 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:15.249673 25365 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:15.252470 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 75363.9us
I20260709 13:08:15.262501 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:15.263486 22247 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:15.265722 25938 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.277459 21392 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.290305 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:15.291332 21488 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:15.291458 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:15.294734 21566 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:15.291554 21392 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.299505 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:15.306663 21568 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:15.307446 21565 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:08:15.315819 26141 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:15.313972 21392 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 14, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 14 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.323734 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:15.229359 26096 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:08:15.353125 21392 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 10 to 11, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.231854 26133 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:08:15.297705 25975 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.368728 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:15.375059 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 175356us
I20260709 13:08:15.352459 26125 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:15.377693 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:15.379665 21489 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.266574 25938 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.372676 21392 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 10, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 10 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:15.400163 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 110240us
I20260709 13:08:15.363539 26129 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:15.403940 21566 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:15.411188 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:15.411849 22247 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:15.412159 22247 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:15.415752 21491 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:15.410976 21392 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.417596 21565 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:15.377811 25546 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:15.379468 26125 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:15.418677 22247 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:15.422550 21494 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:15.435478 21392 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 6 to 8, term changed from 7 to 9, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 9 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:15.374948 25975 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.419520 25979 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:15.424280 25546 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:15.437137 25966 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.004s
I20260709 13:08:15.438192 26125 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.413534 26110 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.185s
W20260709 13:08:15.448285 21389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 144) took 18799 ms (client timeout 15000 ms). Trace:
I20260709 13:08:15.458598 21392 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.377701 26022 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:15.471989 26144 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:08:15.473776 26148 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:08:15.476946 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44805.4us
I20260709 13:08:15.479976 21392 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.488035 21392 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 11, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.452800 25914 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:15.456295 25546 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.518013 21565 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:15.526536 21392 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:15.457407 25966 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.547257 21489 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
W20260709 13:08:15.536953 26124 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:15.508069 26046 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:08:15.536931 26145 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.565512 21487 raft_consensus.cc:2368] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13.
I20260709 13:08:15.548298 21392 catalog_manager.cc:5697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 8, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 8 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:08:15.569830 26138 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.338s	user 0.003s	sys 0.000s
I20260709 13:08:15.571252 26149 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:08:15.572319 26135 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:15.572921 26135 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:15.579276 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.589043 21392 catalog_manager.cc:5697] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 11, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.590520 21392 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.591794 21392 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 9, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.593093 21392 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:15.558604 25914 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.607184 25914 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:15.609411 25914 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:15.611130 26135 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:15.611661 26156 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:15.612435 26156 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:15.616529 26059 consensus_meta.cc:287] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.002s
I20260709 13:08:15.617003 26059 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
W20260709 13:08:15.617796 26113 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.000s
W20260709 13:08:15.466105 21389 rpcz_store.cc:269] 0709 13:07:56.446982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.449659 (+  2677us) service_pool.cc:224] Handling call
0709 13:08:15.230809 (+18781150us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:13.576987 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:13.578697 (+  1710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:13.578901 (+   204us) write_op.cc:435] Acquired schema lock
0709 13:08:13.578972 (+    71us) tablet.cc:662] Decoding operations
0709 13:08:13.579791 (+   819us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:13.579925 (+   134us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:13.579986 (+    61us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:13.580445 (+   459us) tablet.cc:701] Row locks acquired
0709 13:08:13.580516 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:08:13.580826 (+   310us) write_op.cc:270] Start()
0709 13:08:13.581064 (+   238us) write_op.cc:276] Timestamp: P: 1783602493580732 usec, L: 0
0709 13:08:13.581122 (+    58us) op_driver.cc:348] REPLICATION: starting
0709 13:08:13.616282 (+ 35160us) log.cc:844] Serialized 539 byte log entry
0709 13:08:13.905301 (+289019us) op_driver.cc:464] REPLICATION: finished
0709 13:08:14.154100 (+248799us) write_op.cc:301] APPLY: starting
0709 13:08:14.154218 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:14.297558 (+143340us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:14.394065 (+ 96507us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:14.435654 (+ 41589us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:14.435923 (+   269us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:14.435983 (+    60us) write_op.cc:312] APPLY: finished
0709 13:08:14.436345 (+   362us) log.cc:844] Serialized 25 byte log entry
0709 13:08:14.436543 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:14.436620 (+    77us) write_op.cc:454] Released schema lock
0709 13:08:14.436691 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:14.437130 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:14.437158 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1587077,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":248432,"apply.run_cpu_time_us":10861,"apply.run_wall_time_us":283021,"cfile_cache_hit":2,"cfile_cache_hit_bytes":2088,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":2,"lbm_read_time_us":37165,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":9,"num_ops":1,"prepare.queue_time_us":405936,"prepare.run_cpu_time_us":11633,"prepare.run_wall_time_us":51559,"raft.queue_time_us":273801,"raft.run_cpu_time_us":25995,"raft.run_wall_time_us":74895,"replication_time_us":323985,"spinlock_wait_cycles":84608,"thread_start_us":726484,"threads_started":4,"wal-append.queue_time_us":11723,"wal-append.run_cpu_time_us":24449,"wal-append.run_wall_time_us":1812154}]]}
I20260709 13:08:15.635129 21567 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
W20260709 13:08:15.631393 26137 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 13:08:15.626693 26034 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:08:15.631628 26122 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:15.622756 26139 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.644826 25975 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:15.645364 25938 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:15.646557 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 322888us
W20260709 13:08:15.645947 26071 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.000s
I20260709 13:08:15.665640 21636 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:15.667199 21636 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:15.588117 26145 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:15.646210 26156 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:15.639516 26113 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.671096 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:15.675125 21637 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:08:15.664808 25780 consensus_meta.cc:287] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.004s
W20260709 13:08:15.665114 26057 consensus_meta.cc:287] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.001s
I20260709 13:08:15.594298 21392 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 10, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 10 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.647710 26034 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.679005 25780 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:15.683063 26113 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:15.683530 25780 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:15.679715 26057 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.690081 26057 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:15.655939 26139 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.668632 26022 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:15.704541 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 167004us
I20260709 13:08:15.711756 21494 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:15.708528 21392 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 10, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 10 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:15.712541 21494 pending_rounds.cc:85] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 10
I20260709 13:08:15.712982 21494 pending_rounds.cc:107] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:15.713361 21494 raft_consensus.cc:2889] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.669147 26071 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.720940 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:15.721122 21392 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:15.723882 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:15.676934 26125 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.728888 26129 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:15.729389 26129 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:15.729776 26129 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.730927 26133 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:15.734381 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:15.735208 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:15.735541 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:15.735798 21634 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.741096 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:15.742172 21392 catalog_manager.cc:5697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 11, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.746455 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:15.725085 26152 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.755091 21569 raft_consensus.cc:2410] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:15.755268 21637 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:15.756888 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:15.771836 21568 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.759277 26034 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:15.763175 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:15.719969 26046 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:15.764338 21564 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:15.766364 26101 consensus_meta.cc:287] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.661s	user 0.006s	sys 0.006s
I20260709 13:08:15.715257 26022 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:15.769196 26132 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.534s	user 0.000s	sys 0.003s
I20260709 13:08:15.754720 21639 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:15.787591 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:15.790482 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 53731.8us
W20260709 13:08:15.769269 26143 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.285s	user 0.002s	sys 0.000s
I20260709 13:08:15.806746 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:15.807888 21564 raft_consensus.cc:2368] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:15.806895 21489 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:15.816511 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:15.824801 21637 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:15.824957 21491 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:15.825148 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:15.826522 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:15.788543 26152 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:15.829465 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:15.800889 25970 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.789310 21392 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 2 to 5, term changed from 7 to 11, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131), VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129), VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130), VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:15.830632 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:15.840322 21636 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:15.847007 21569 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.846891 21563 raft_consensus.cc:2368] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:15.846858 21642 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:15.846531 21560 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:15.854018 21642 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:15.819443 25365 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:15.858886 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:15.853951 21392 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 10, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 10 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.824397 26101 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:15.866521 21489 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:15.879406 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:15.876860 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:15.884768 22244 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:15.886188 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:15.888131 21562 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:15.888635 21392 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 11, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 11 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:15.889827 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:15.894912 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:15.898170 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:15.899232 21640 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:15.895498 21392 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 8, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 8 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.901602 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:15.902477 21642 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:15.904610 21642 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.904857 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:15.900352 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:15.908835 21636 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:15.910679 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:15.912089 21563 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:15.840278 25970 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:15.913210 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:15.915517 22244 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:15.914916 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:15.916230 21640 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.916535 21392 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:15.918048 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:15.918821 21636 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 6: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:15.918908 21392 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 10, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 10 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:15.921901 21392 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:15.902020 26125 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:15.926062 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:15.933041 21636 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.934346 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:15.940809 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:15.941684 22244 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:15.945218 21642 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:15.900863 26057 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:15.888283 25365 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:15.948948 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:15.953213 21532 leader_election.cc:400] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13.
I20260709 13:08:15.954988 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:15.956184 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:15.962985 21635 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:15.963382 21532 leader_election.cc:403] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.962885 21642 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:15.964221 21638 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:08:15.959770 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 73709.1us
I20260709 13:08:15.966460 21636 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:15.969851 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:15.970515 21489 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:15.926388 26139 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:15.972191 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:15.973927 21489 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:15.976610 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:15.944866 26113 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.977792 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:15.978390 21640 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:15.944046 26156 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.972839 21608 leader_election.cc:400] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:15.983428 21608 leader_election.cc:403] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:08:15.981148 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 104387us
I20260709 13:08:15.991211 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:15.982896 21487 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:15.970773 26109 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 13:08:15.965463 26071 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.000130 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:16.000938 21489 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.979857 26125 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:16.001657 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:16.007241 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:15.964870 25975 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:08:16.005844 21608 leader_election.cc:400] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:15.982209 26113 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.982101 26139 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.009137 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:16.009558 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:15.972052 25954 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:15.971426 25780 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:08:16.001140 26153 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 13:08:16.003553 26101 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:16.049185 26147 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:16.049760 26147 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.050122 26147 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.051754 26180 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.053244 26161 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:08:16.055608 26174 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 13:08:16.005990 25702 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.998410 25830 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:08:16.071411 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:16.072038 21491 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.998751 26156 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.076340 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.077316 21486 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:16.071887 26059 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:08:16.061519 21489 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:16.014320 26113 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.011606 25914 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:16.054163 26129 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.013357 26071 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:16.039476 25546 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.004s
I20260709 13:08:16.019953 26149 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:16.020399 26165 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.091934 21568 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:16.090883 26166 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:16.093641 26166 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:16.094949 26166 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.089986 26129 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:16.090308 21641 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:16.086023 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.090219 26071 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:16.101351 21564 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:16.005738 26135 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:08:16.112740 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 103681us
I20260709 13:08:16.115111 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:16.101770 25914 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:16.125662 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.071105 26125 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:16.129946 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.020010 26139 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.139869 21491 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:16.141314 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.141538 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:16.103730 26149 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.113520 26180 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.147300 21564 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:16.078483 26179 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:16.149750 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:16.089092 25546 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.176589 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:16.140995 26135 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.172062 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:16.142518 26159 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.091665 25702 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.187850 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:16.198987 21634 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:16.146113 26151 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.205812 21569 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:16.220069 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:16.221151 21569 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:16.222230 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.206439 21488 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:16.224227 25546 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.227006 26071 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.229034 26057 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:16.229830 26057 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.183146 25970 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:16.231786 26171 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:08:16.233160 26022 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.188831 26193 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.234150 26125 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.234833 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:16.235174 26193 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.236537 26101 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.237056 21565 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:16.237462 26193 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.238093 26193 raft_consensus.cc:2764] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:16.240573 26139 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.243067 25914 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.181270 26180 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.171216 25979 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:08:16.189517 26159 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.197710 26135 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.202361 26123 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:08:16.246627 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.157531 26113 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.247510 21563 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:16.233208 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.256587 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:16.196553 25975 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:16.124351 26165 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:16.275496 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 281379us
I20260709 13:08:16.241889 26147 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:16.267935 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 69561.4us
I20260709 13:08:16.279455 26146 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:16.281044 25702 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.281508 26159 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.277944 25979 consensus_queue.cc:1243] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:16.247387 26129 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:16.151675 26149 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.277738 26180 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:16.284416 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 107935us
I20260709 13:08:16.315433 26152 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:16.316149 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:16.317363 26180 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:16.213181 25966 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.318974 26139 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.319412 26139 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:16.319788 26139 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.319818 26057 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.323359 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.325357 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.326056 21492 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:16.326692 22247 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.328780 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.329407 21486 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:16.333595 26165 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.334208 21494 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:16.335641 26145 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.339823 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.344343 22247 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:16.297488 21491 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:16.299280 21560 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:16.292320 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:16.241945 26156 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.283191 26185 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:16.283237 25365 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.307142 25975 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:16.307350 22245 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 6.
I20260709 13:08:16.343461 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:16.352792 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48035.5us
I20260709 13:08:16.298731 26197 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:16.361379 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:16.302320 26146 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:16.364444 21492 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.361205 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:16.327476 26147 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.372718 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:16.378942 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:16.379624 21634 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:16.380743 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:16.381331 21642 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.380956 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:16.386195 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:16.366567 26156 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.390172 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:16.391086 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:16.391710 21643 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:16.395045 21636 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:16.383121 26071 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:16.396500 26147 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.399123 26146 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.383987 26129 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:16.368359 26197 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.411302 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:16.404853 21567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2871) took 1445 ms (client timeout 1794 ms). Trace:
I20260709 13:08:16.412930 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:16.385948 26133 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.413532 21565 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:16.453550 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.453823 21564 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:16.447243 21642 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:16.455431 26059 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:16.456074 26059 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:16.456372 26198 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.456920 26198 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.457069 26059 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.459677 26135 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.460678 26113 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:16.461124 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 168920us
I20260709 13:08:16.411825 26147 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.461537 26165 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.388217 25975 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.387646 26166 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:16.396014 26156 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.465032 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:16.465448 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:16.462221 21567 rpcz_store.cc:269] 0709 13:08:14.959914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.998528 (+ 38614us) service_pool.cc:224] Handling call
0709 13:08:16.404612 (+1406084us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400017cd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:16.404760 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369264384}
I20260709 13:08:16.470608 26022 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.475912 26147 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.491138 26022 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.461993 25702 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.411432 25546 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:16.475333 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.475975 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:16.412463 26071 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.366897 26185 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.464267 26146 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:16.485615 26169 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.607s	user 0.001s	sys 0.000s
I20260709 13:08:16.515928 26185 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.497352 21492 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:16.518916 26022 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:16.498206 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:16.478755 26198 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.475594 26165 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:16.535269 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 66687.2us
I20260709 13:08:16.479959 26166 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:16.550814 26166 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.532842 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 1031) took 1111 ms. Trace:
I20260709 13:08:16.544879 26142 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:16.554171 26142 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.554626 26129 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.500065 26139 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.497810 26156 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.560920 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:16.498052 25702 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.557710 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:16.553942 21566 rpcz_store.cc:276] 0709 13:08:15.408902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.409302 (+   400us) service_pool.cc:224] Handling call
0709 13:08:15.409597 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.562958 (+153361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.563011 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.596333 (+ 33322us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.777270 (+180937us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:15.777318 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.777388 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.484808 (+707420us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:16.519506 (+ 34698us) raft_consensus.cc:1685] finished
0709 13:08:16.519528 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.519766 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28039,"raft.queue_time_us":157703,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":43695,"spinlock_wait_cycles":15300480,"thread_start_us":242234,"threads_started":2,"wal-append.queue_time_us":184159}
I20260709 13:08:16.472697 26109 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:08:16.467625 26133 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.499697 26135 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:16.540642 26165 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.529078 26071 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.500016 26113 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:16.532560 26145 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:16.482733 26159 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:16.579558 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 169752us
I20260709 13:08:16.610375 21642 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:16.513319 25546 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:16.607904 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 50285.5us
I20260709 13:08:16.579214 26163 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:16.608711 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.582052 26198 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.558676 25365 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:08:16.613821 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:16.618693 25365 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.619153 25365 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.620334 26142 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:16.616117 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 94799.1us
I20260709 13:08:16.557626 26149 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.624460 26149 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.624739 21639 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:16.620433 26197 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.625079 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:16.625757 21560 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:16.627243 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:16.627996 21640 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:16.628413 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.628861 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:16.628919 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.629781 21562 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:16.630509 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.630936 26139 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.632272 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:16.632863 26159 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.633541 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:16.633628 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:16.628439 26205 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:08:16.635015 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:16.605386 25979 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:16.639707 25979 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.641999 25979 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.642800 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.650218 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:16.650599 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:16.650964 21635 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:16.577761 25702 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.609792 26123 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:16.657246 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:16.674939 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:16.675091 21635 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.672207 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:16.672516 21567 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:16.609393 26022 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:16.682967 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:16.612802 26145 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:16.652108 25365 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.685786 26198 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:16.714105 26022 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.719399 26197 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.719997 26197 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.720584 26201 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:16.721129 26201 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.721493 26022 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.722122 26197 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.692289 21639 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:16.671239 26204 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.727257 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.673660 26159 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.607951 26135 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.682026 26034 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:16.759335 21635 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:16.762180 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.714318 26185 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:16.695731 26123 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:16.726548 26204 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.727880 26179 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:16.662132 26147 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.775763 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.768059 21490 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:16.780953 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.763048 26101 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:16.766259 26067 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:16.849761 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:16.644873 26163 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.786068 26185 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.868393 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.870043 26185 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.871060 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.871829 21492 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:16.873991 26196 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:16.874977 26145 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.876266 26109 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.877012 26163 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.876808 26109 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.777796 26156 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.878918 26204 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:16.880658 26156 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.882172 26109 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.770452 26034 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.866550 26067 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.884141 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.884546 26034 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.884810 21569 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:16.885020 26067 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.790244 26179 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.886996 21567 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 4.
I20260709 13:08:16.845898 26059 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:16.891646 26147 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.894474 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.895380 21563 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:16.900014 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 717) took 1050 ms. Trace:
I20260709 13:08:16.900578 21487 rpcz_store.cc:276] 0709 13:08:15.845845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.846116 (+   271us) service_pool.cc:224] Handling call
0709 13:08:16.895594 (+1049478us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540029a4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:16.895738 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283524480}
I20260709 13:08:16.913224 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:16.916428 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.926252 25365 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.931640 25546 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:16.933766 21491 raft_consensus.cc:2368] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:08:16.892088 26179 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:16.940027 25365 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:16.874607 26196 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.955260 26196 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:16.956434 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.907076 26123 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.957118 21563 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:16.961130 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:16.898298 26059 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:16.972139 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:16.973098 21563 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:16.963959 26196 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.978082 26179 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:16.967523 26133 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:16.987236 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.987941 21485 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:16.988705 26192 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:16.989296 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:16.989617 26192 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.985821 25365 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 13:08:16.991369 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 790524us
I20260709 13:08:16.996798 25914 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:16.985986 26179 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:16.997592 25914 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.000311 26179 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:17.000644 25914 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:17.003473 26215 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.376s	user 0.004s	sys 0.000s
I20260709 13:08:17.004238 26059 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:17.005326 26212 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.377s	user 0.000s	sys 0.002s
I20260709 13:08:17.005321 26192 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:17.006341 26151 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 13:08:17.007388 26135 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.008824 26165 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.009505 26151 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13.
I20260709 13:08:17.015363 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.016407 21489 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:16.979518 26196 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.018726 25702 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:16.988745 26214 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
I20260709 13:08:17.025276 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:17.026086 22247 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.026906 22245 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:17.029201 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.023447 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:17.031816 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.031903 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:17.032797 22242 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.034281 22247 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:17.040915 25782 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:17.041591 26167 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:17.041747 25782 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.042263 26167 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.044903 26167 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.044986 25782 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.022073 26190 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.046327 26190 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.047465 22246 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:17.051180 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.051936 22245 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 6.
I20260709 13:08:17.055061 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.057875 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.061272 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.065287 21568 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:17.074748 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.075021 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:17.075745 22247 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:17.079607 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.080605 21634 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:17.080787 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:17.098857 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.099172 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.103468 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 2896) took 1098 ms. Trace:
I20260709 13:08:17.106092 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1698) took 1137 ms. Trace:
I20260709 13:08:17.107865 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.109030 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:17.109254 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1699) took 1140 ms. Trace:
I20260709 13:08:17.111055 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.111799 21640 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:17.113791 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:17.106559 21494 rpcz_store.cc:276] 0709 13:08:15.968690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.976260 (+  7570us) service_pool.cc:224] Handling call
0709 13:08:17.105900 (+1129640us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b540002e9d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:17.106028 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815557504}
I20260709 13:08:17.020479 26196 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.109910 21488 rpcz_store.cc:276] 0709 13:08:15.968995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.977483 (+  8488us) service_pool.cc:224] Handling call
0709 13:08:17.109084 (+1131601us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54002cbd54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:17.109195 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520933120}
W20260709 13:08:17.164978 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 56019.4us
I20260709 13:08:17.168298 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:17.171283 21486 raft_consensus.cc:2368] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13.
I20260709 13:08:17.178831 21494 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:17.196648 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:17.199980 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:17.200932 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:17.104104 21568 rpcz_store.cc:276] 0709 13:08:16.005470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.121392 (+115922us) service_pool.cc:224] Handling call
0709 13:08:17.103188 (+981796us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54000a0d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:17.103378 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010690304}
I20260709 13:08:17.229202 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.229952 22247 raft_consensus.cc:2368] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15.
I20260709 13:08:17.178402 26133 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:17.164176 26192 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:17.231844 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2897) took 1186 ms. Trace:
I20260709 13:08:17.185431 26142 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:17.241156 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.245280 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.245993 22247 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:17.195951 26160 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.237584 21565 rpcz_store.cc:276] 0709 13:08:16.045465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.287493 (+242028us) service_pool.cc:224] Handling call
0709 13:08:16.411071 (+123578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.453052 (+ 41981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.227817 (+774765us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400017cd0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:17.231774 (+  3957us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273701760}
I20260709 13:08:17.241621 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:17.260183 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.174472 26151 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:08:17.198233 26190 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:17.164112 26022 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:08:17.228464 26034 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.233832 25540 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.275231 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.236049 26133 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.264832 26198 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.269834 26192 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:17.318104 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.330060 21532 leader_election.cc:400] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13.
I20260709 13:08:17.330585 21532 leader_election.cc:403] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:17.330935 26188 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:17.331528 26188 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:17.332381 26188 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.334412 26145 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:17.335036 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:17.298981 26185 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.298427 26125 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:17.345935 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 54825.4us
W20260709 13:08:17.345544 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 148986us
I20260709 13:08:17.313014 25540 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.355165 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:17.315176 26133 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:17.319403 26198 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.272578 26160 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.359984 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:17.360677 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:17.384701 21566 raft_consensus.cc:2368] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13.
I20260709 13:08:17.380210 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.361948 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.390079 22242 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:17.389245 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:17.389074 22243 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:17.407016 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 713) took 1582 ms. Trace:
W20260709 13:08:17.367539 26231 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:08:17.366254 26222 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.513s	user 0.002s	sys 0.008s
I20260709 13:08:17.357398 26142 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:17.361074 26225 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:17.409170 21493 rpcz_store.cc:276] 0709 13:08:15.807694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.807798 (+   104us) service_pool.cc:224] Handling call
0709 13:08:16.642196 (+834398us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b5800011198. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebdeee 0000000000375939 00007f98aef311e0 00007f98aeffa0c4 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:08:16.642389 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.673157 (+ 30768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.673205 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.673270 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:16.673316 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.389328 (+716012us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b540002e4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:17.389402 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.389573 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74556800}
I20260709 13:08:17.361266 26121 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:17.413230 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:17.403081 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:17.363055 25825 raft_consensus.cc:2764] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:17.415963 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:17.373478 25540 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.363147 26159 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.416594 22247 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:17.409260 21486 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:17.417004 21457 leader_election.cc:400] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15.
I20260709 13:08:17.417237 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:17.363692 26101 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:17.434209 21561 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:17.358863 26165 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.412890 26085 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:17.372251 25702 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.447234 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:17.415686 25914 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:17.415879 26153 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.420804 26181 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:17.424325 26121 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:17.446199 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:17.392535 26198 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:17.423463 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46693.5us
I20260709 13:08:17.373133 26125 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.467453 26125 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:17.374716 26185 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.468003 26160 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.425473 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:17.469712 21562 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:17.440507 26101 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:17.433923 26151 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:17.432502 21457 leader_election.cc:403] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:17.464988 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:17.477761 21566 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.460430 21565 pending_rounds.cc:85] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:08:17.478808 21565 pending_rounds.cc:107] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:17.479127 21565 raft_consensus.cc:2889] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:17.475479 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:17.480679 21561 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:17.424707 26142 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.433930 25938 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:08:17.483971 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 68820.3us
I20260709 13:08:17.470903 26145 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:08:17.481045 26071 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.865s	user 0.013s	sys 0.000s
I20260709 13:08:17.458554 26085 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.472065 26121 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:17.420670 26192 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.479293 26125 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:17.486480 26172 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 1.630s	user 0.005s	sys 0.011s
I20260709 13:08:17.459689 25914 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.484280 26151 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:17.505096 21561 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:17.485543 26165 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.471555 26181 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.490999 25546 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.474531 26153 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.532931 21566 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:17.515302 26125 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.495028 26071 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.523377 25966 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.517210 26238 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:17.607686 26210 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.108s	user 0.004s	sys 0.020s
I20260709 13:08:17.608335 26153 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:17.615893 25966 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.619051 26242 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.617996 26071 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.618763 26238 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.564069 25938 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.622543 21569 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:17.568024 26125 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:17.619644 26242 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.644250 26242 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:17.619048 26201 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.638487 26238 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:17.645396 26238 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.645938 26238 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.638988 25938 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.634069 26240 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.648306 26238 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:17.648500 25938 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:17.639545 26181 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:17.640583 25966 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:17.641671 22246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:17.640921 26179 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.646319 26217 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.013s	user 0.009s	sys 0.002s
I20260709 13:08:17.649350 26179 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.642062 26165 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15.
I20260709 13:08:17.648051 26240 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.556775 25546 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:17.669827 26228 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.295s	user 0.002s	sys 0.000s
I20260709 13:08:17.692766 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:17.717372 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 281305us
I20260709 13:08:17.720305 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:17.722860 21486 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:17.725337 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.732297 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:17.744997 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 384428us
I20260709 13:08:17.746483 21606 leader_election.cc:400] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:08:17.747750 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:17.790395 21606 leader_election.cc:403] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:17.748559 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.751384 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.791409 21488 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:17.772083 22246 raft_consensus.cc:606] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:17.774864 21486 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:17.777665 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.778430 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.793609 22242 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:17.749167 26181 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.731788 26165 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:17.800348 21493 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:17.786131 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.752573 26179 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:17.672669 26151 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:17.814697 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 68385.3us
I20260709 13:08:17.824419 21491 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:17.828315 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.829945 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.831806 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.832590 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.828480 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:17.817176 26129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.189s	user 0.020s	sys 0.037s
I20260709 13:08:17.836066 21493 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.837811 21486 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:17.839644 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.809738 26085 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:17.808669 26188 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.840962 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.823973 26179 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.844400 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1749) took 1461 ms. Trace:
I20260709 13:08:17.845894 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.810102 26165 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:17.849247 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:17.845770 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:17.850418 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.851624 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:17.859987 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.860926 22240 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:17.861182 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:17.840313 26129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.021s	sys 0.038s
I20260709 13:08:17.863214 25780 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.863309 26129 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:17.863745 25780 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.864220 25780 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:17.865129 26216 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.231s	user 0.006s	sys 0.005s
W20260709 13:08:17.865932 26246 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:08:17.850376 26059 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:17.867246 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.867489 21639 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:17.867304 26059 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.868602 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.869591 26240 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:17.869807 26059 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.870910 25914 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.843436 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.817556 26142 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.862534 25546 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:17.872888 21487 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:17.872784 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:17.879385 26241 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:17.872762 26165 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.881253 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:17.882164 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:17.882911 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:17.884646 26196 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.004s
I20260709 13:08:17.817761 26181 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.872910 26135 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:08:17.871624 26188 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.888177 25951 raft_consensus.cc:993] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:17.886256 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.889556 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:17.802456 26198 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.837528 26071 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:17.890758 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.871641 21490 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:17.914328 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:17.915493 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.856443 21638 rpcz_store.cc:276] 0709 13:08:16.377551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.380383 (+  2832us) service_pool.cc:224] Handling call
0709 13:08:16.389701 (+  9318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.460945 (+ 71244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.460981 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.461513 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.999601 (+538088us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b18003d0ba0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:08:17.221517 (+221916us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:17.221556 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.221627 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.650417 (+428790us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:17.838619 (+188202us) raft_consensus.cc:1685] finished
0709 13:08:17.838648 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.838937 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65079,"raft.queue_time_us":65286,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":4945,"spinlock_wait_cycles":27043968,"thread_start_us":221731,"threads_started":1,"wal-append.queue_time_us":813439}
I20260709 13:08:17.870434 26059 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:08:17.905267 26133 consensus_meta.cc:287] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.003s
I20260709 13:08:17.909272 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:17.913226 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.867340 26034 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.910593 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.904377 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:17.920004 26238 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:17.947656 26238 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.948578 26181 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:17.917757 25966 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:17.949476 25966 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:17.949797 26238 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:17.920715 26257 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.923424 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:17.924801 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 442911us
I20260709 13:08:17.950819 26257 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.952030 21459 leader_election.cc:400] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13.
I20260709 13:08:17.952342 21459 leader_election.cc:403] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:17.953274 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:17.953626 26257 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:17.920089 26109 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:17.954367 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:17.925774 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:17.955389 26109 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:17.924921 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:17.956365 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:17.957299 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:17.958002 21639 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.925356 26213 raft_consensus.cc:1081] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:17.958693 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:17.900178 26142 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.943779 26071 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.968700 21459 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:17.969360 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 60227.3us
I20260709 13:08:17.970196 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:17.946099 26198 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:17.903075 26196 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:17.949903 25966 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:17.954982 26122 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.933620 26022 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.934320 26188 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:17.886199 26125 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.937884 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:17.978121 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:17.984253 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:17.971356 26059 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:18.001303 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 63528.8us
I20260709 13:08:17.971201 26109 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.006088 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:18.001387 21637 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:18.002910 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:17.971808 25365 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.977509 25938 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:18.017799 21635 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:18.019299 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:17.960650 26133 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.968283 26034 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:17.967723 26142 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.020165 21493 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:18.003194 26059 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.072422 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:18.026124 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:08:18.022011 21562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.001s	sys 0.012s
I20260709 13:08:17.998361 26110 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:18.017477 26129 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:18.017988 26198 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.112102 26059 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.112325 26181 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.112386 26153 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:18.112984 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 86948us
I20260709 13:08:18.113375 25938 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.025944 26257 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:18.113905 26142 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:18.114627 25365 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:18.115996 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:18.116783 26256 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:18.117614 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:18.000867 26022 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:18.118450 21562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.005s	sys 0.014s
I20260709 13:08:18.131244 21640 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:18.125016 26198 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:18.133275 26159 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.000s
I20260709 13:08:18.137014 21639 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:18.140583 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:18.073582 25546 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.149271 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:18.079619 26196 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:18.132609 26133 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:18.110029 26167 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:08:18.149724 26121 consensus_meta.cc:287] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.002s
I20260709 13:08:18.139348 26181 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:18.179405 26181 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.147032 26257 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:18.182314 26257 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:18.186928 26252 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:08:18.155371 26256 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:18.134322 26129 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.192459 21635 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:18.178278 26121 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.156343 26109 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:18.162611 26198 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.166163 26159 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13.
I20260709 13:08:18.211504 21635 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:18.150316 25938 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.148175 26153 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.175364 26185 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:18.188325 26256 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.199672 26265 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:18.202971 26102 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:18.165508 25365 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.205796 26034 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:18.260350 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2269) took 1373 ms. Trace:
I20260709 13:08:18.260829 21569 rpcz_store.cc:276] 0709 13:08:16.887345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.887552 (+   207us) service_pool.cc:224] Handling call
0709 13:08:16.887836 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.634328 (+746492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.260076 (+625748us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54000a2154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:18.260282 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689102080}
I20260709 13:08:18.245553 26071 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:18.267491 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 289413us
I20260709 13:08:18.272786 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:18.254510 26125 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:18.289021 26194 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.290022 26194 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.278283 26109 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:08:18.278726 26253 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:08:18.280954 25546 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:18.323745 26121 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:18.329555 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45495.2us
I20260709 13:08:18.337572 22246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:18.338488 22246 raft_consensus.cc:606] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:18.317795 26022 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:18.324937 25546 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:08:18.347142 25540 consensus_meta.cc:287] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.908s	user 0.012s	sys 0.004s
I20260709 13:08:18.347601 26194 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:18.351469 26270 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:18.355525 26153 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:18.339180 26125 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:18.351649 26267 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:18.327234 26165 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.413836 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:18.347620 25540 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.417459 26122 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13.
I20260709 13:08:18.418458 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:18.433481 21486 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:18.343889 26129 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:18.436880 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:18.438011 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:18.440317 21487 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:18.362844 25938 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:18.442152 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:18.433144 26192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.017s	sys 0.041s
I20260709 13:08:18.443076 21485 raft_consensus.cc:2410] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:08:18.438849 26101 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.954s	user 0.010s	sys 0.004s
I20260709 13:08:18.445926 21490 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:08:18.442454 26269 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:08:18.448253 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2910) took 1101 ms. Trace:
I20260709 13:08:18.439205 25365 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:18.444576 26192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.018s	sys 0.041s
I20260709 13:08:18.449133 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:18.455636 25365 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:18.451045 21567 rpcz_store.cc:276] 0709 13:08:17.346755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.455811 (+109056us) service_pool.cc:224] Handling call
0709 13:08:17.464158 (+  8347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.785313 (+321155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.785358 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.811151 (+ 25793us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.219859 (+408708us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:18.219908 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.219994 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.448074 (+228080us) raft_consensus.cc:1685] finished
0709 13:08:18.448094 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.448208 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10031,"raft.queue_time_us":18879,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":663879,"threads_started":2,"wal-append.queue_time_us":471428}
I20260709 13:08:18.455789 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:18.457203 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2697) took 1363 ms. Trace:
I20260709 13:08:18.419521 26125 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.457629 21641 rpcz_store.cc:276] 0709 13:08:17.093653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.093807 (+   154us) service_pool.cc:224] Handling call
0709 13:08:17.229329 (+135522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.447224 (+217895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.447255 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.459988 (+ 12733us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.783455 (+323467us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:17.783513 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.783609 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.122409 (+338800us) raft_consensus.cc:1685] finished
0709 13:08:18.122429 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.447785 (+325356us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54000f3f50. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:18.457128 (+  9343us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2505,"raft.queue_time_us":184834,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":3708,"spinlock_wait_cycles":310695808,"thread_start_us":501391,"threads_started":2,"wal-append.queue_time_us":590521}
I20260709 13:08:18.469199 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:18.469846 21641 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:18.470824 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:18.471463 21641 raft_consensus.cc:2368] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15.
I20260709 13:08:18.477617 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:18.480782 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:18.450129 26101 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.487607 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:18.491437 21641 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:18.492740 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:18.493693 21641 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:18.467067 26125 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:18.525554 26281 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:08:18.542819 26283 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:18.488600 26257 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.545997 25970 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:18.546461 25970 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:18.449914 25546 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.552249 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:18.577729 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:18.554543 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:18.556046 21643 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:18.476387 26067 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:18.565275 21635 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:18.585827 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:18.568622 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 598497us
I20260709 13:08:18.552098 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:18.571702 21560 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:18.554976 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:18.593127 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:18.594177 21560 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:18.596575 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:18.571345 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:18.598004 22243 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:18.572286 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:18.568161 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2912) took 1220 ms. Trace:
I20260709 13:08:18.603631 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:18.604441 21566 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 6.
I20260709 13:08:18.605610 21561 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:18.612174 21567 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:18.613797 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:18.561594 25780 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 13:08:18.618567 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:18.568372 25966 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.000s
W20260709 13:08:18.559079 26266 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.360s	user 0.003s	sys 0.000s
I20260709 13:08:18.599717 21565 rpcz_store.cc:276] 0709 13:08:17.347320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.458359 (+111039us) service_pool.cc:224] Handling call
0709 13:08:17.460222 (+  1863us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:17.491994 (+ 31772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.492029 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:17.492591 (+   562us) log.cc:844] Serialized 52 byte log entry
0709 13:08:17.838403 (+345812us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:17.972833 (+134430us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.567351 (+594518us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b1800116980. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:08:18.567606 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.567711 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.567769 (+    58us) raft_consensus.cc:1685] finished
0709 13:08:18.567888 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.568080 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8415,"prepare.queue_time_us":138346,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":615849,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":180,"spinlock_wait_cycles":6065920,"thread_start_us":332134,"threads_started":1,"wal-append.queue_time_us":514359}
I20260709 13:08:18.565006 26101 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:18.561990 26211 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:18.547180 26257 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:18.585070 26188 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:18.595482 26125 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.671738 25966 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.670717 21606 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:18.692678 21488 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:18.693181 26257 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:18.695550 25966 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:18.667562 26242 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:18.690804 26125 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.667845 26259 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:18.616559 26129 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:08:18.700825 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:18.661147 26142 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:18.702514 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:18.669059 26211 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:18.548058 25970 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.661336 25780 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.698971 26192 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:18.721396 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 249016us
I20260709 13:08:18.668987 26151 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:18.717970 26179 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.830s	user 0.013s	sys 0.000s
I20260709 13:08:18.725076 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:18.702953 26242 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:18.720737 25966 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:18.722133 25365 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:18.707551 26259 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.735003 25970 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.737327 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:18.739389 26262 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:18.712634 26101 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:18.753360 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:18.750757 26179 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:08:18.799014 22243 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:08:18.707563 26187 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:08:18.726091 26211 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.726164 26291 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:18.813220 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 75961.9us
I20260709 13:08:18.777774 26242 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:18.766433 26198 consensus_meta.cc:287] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.000s
W20260709 13:08:18.777148 26059 consensus_meta.cc:287] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.633s	user 0.014s	sys 0.000s
I20260709 13:08:18.784314 25780 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:18.717549 26142 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.786999 26159 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:18.796612 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 71606.8us
I20260709 13:08:18.839605 21457 leader_election.cc:400] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15.
I20260709 13:08:18.840046 21457 leader_election.cc:403] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:18.797115 26101 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:18.809442 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:18.810205 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:18.842562 21567 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:18.776501 25966 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:18.741405 26192 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.845607 26192 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:18.846167 25966 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:18.822770 21565 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:18.749064 26151 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.852772 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:18.831743 25546 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:18.855378 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 252299us
I20260709 13:08:18.821386 26290 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:18.828590 26179 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:18.860252 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:18.840691 26211 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.864959 21566 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:18.864248 21561 raft_consensus.cc:2410] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:18.871196 21634 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:18.832875 26198 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.858031 25979 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.827473 26262 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.832613 26059 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.855947 25780 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:18.906730 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:18.863324 26290 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:18.911746 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48259.5us
I20260709 13:08:18.912667 21567 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:18.865424 26256 consensus_meta.cc:287] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.001s
W20260709 13:08:18.910398 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 318966us
I20260709 13:08:18.857702 26109 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:18.862268 26181 consensus_meta.cc:287] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.682s	user 0.007s	sys 0.007s
I20260709 13:08:18.921214 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:18.927788 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:18.916898 21561 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:18.865692 26257 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.893877 26192 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:18.931191 21561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:36572
I20260709 13:08:18.930096 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:18.930624 21560 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:18.895027 25365 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.937345 26259 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:18.937456 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2915) took 1584 ms. Trace:
I20260709 13:08:18.922155 26109 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.939263 26109 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.930558 26188 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.942938 26192 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.945428 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:18.872233 26179 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.964603 21561 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.965054 21561 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.920205 26290 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:18.938092 21562 rpcz_store.cc:276] 0709 13:08:17.353262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.470428 (+117166us) service_pool.cc:224] Handling call
0709 13:08:17.470726 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.507296 (+ 36570us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:17.515875 (+  8579us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.558413 (+1042538us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:18.625908 (+ 67495us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:18.625961 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:18.626028 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.937122 (+311094us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b540028a0d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:18.937197 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.937381 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":551115,"prepare.queue_time_us":16300,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":505249,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9117,"spinlock_wait_cycles":95810688,"thread_start_us":639730,"threads_started":1,"wal-append.queue_time_us":637615}
I20260709 13:08:18.955679 26298 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:18.951326 26145 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:18.922484 25780 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.960320 26201 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:18.960772 26262 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:18.943970 26135 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.961617 26109 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.963210 26192 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:18.963764 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.988169 25780 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:18.989413 26109 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:18.973206 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 100859us
I20260709 13:08:18.991782 25979 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15.
I20260709 13:08:18.945699 26125 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:18.955077 26188 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.984671 26059 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:18.964478 25540 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:18.942487 26257 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:18.997342 21561 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.925083 26256 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:18.916342 26101 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.005672 21560 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:19.006253 26145 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:19.007084 26201 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:19.009099 26192 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:19.010612 26059 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:19.012075 26198 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:19.014146 26179 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:19.015341 26151 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:19.015278 26301 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:19.016698 26142 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:18.943689 26181 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:19.028008 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 155408us
I20260709 13:08:19.029762 26201 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:19.033875 21636 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:19.050223 26295 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:08:19.051347 26292 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:08:19.051489 26201 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.053033 26201 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.035790 26101 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.033151 26059 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.060230 26256 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.060786 26059 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:19.063349 26181 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:19.065673 26257 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:19.071054 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.036746 26188 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:19.071926 26188 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:19.072746 26188 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.031659 26192 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:19.077430 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 86560.2us
W20260709 13:08:19.085331 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 164057us
W20260709 13:08:19.086429 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 118584us
I20260709 13:08:19.087359 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:19.088752 26301 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.089143 26301 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:19.089515 26301 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.089946 26280 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:19.090309 25966 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.091498 26280 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:19.092303 26280 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:19.092592 25966 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.092628 26280 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:19.094689 26280 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.097451 26192 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:19.098330 26294 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:08:19.100378 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:19.077596 26257 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.103368 26159 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:19.103193 26257 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.105810 26257 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:19.124270 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 81938.8us
I20260709 13:08:19.125042 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:19.128655 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.129328 21494 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:19.134212 21494 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:19.134737 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.134902 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.135015 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:19.135562 21486 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.136515 26181 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:19.137369 26181 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:19.137681 26181 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:19.142021 21489 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:19.142302 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.143970 26173 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.144501 26173 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.147109 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:19.153676 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:19.154875 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.156003 21491 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:19.157106 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:19.157987 21494 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:19.159438 26299 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:19.159905 26299 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:19.160290 26299 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:19.155215 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.164415 21489 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:08:19.124408 26165 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.138525 26181 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.171417 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:19.169309 21486 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:19.177387 21490 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:08:19.178922 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 188108us
I20260709 13:08:19.179406 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.170295 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:19.132148 26280 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.184551 21563 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:19.185760 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:19.186391 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.182636 22212 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:19.180951 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.187131 21485 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:19.146623 26173 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:19.191659 26142 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:19.192040 21491 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:19.192236 26142 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.193418 21491 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:19.194655 21491 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:19.194962 26142 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:19.166859 26145 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.196213 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:19.196610 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 1762) took 1315 ms. Trace:
I20260709 13:08:19.196960 21634 rpcz_store.cc:276] 0709 13:08:17.880778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.880930 (+   152us) service_pool.cc:224] Handling call
0709 13:08:19.196430 (+1315500us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b540009c754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:19.196528 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088314752}
I20260709 13:08:19.203523 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:19.203882 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.209371 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.170543 26187 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:19.210707 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.216169 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:19.216344 21486 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:19.218890 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:19.217772 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:19.179953 26304 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.180958 26109 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.224210 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:19.231177 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:19.232875 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:19.225293 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:19.196280 26145 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.236505 26145 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:19.226368 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.241335 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:19.243670 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:19.198232 26213 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.244573 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:19.270690 21634 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:19.271566 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:19.272645 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:19.273336 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:19.247026 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:19.170116 26290 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.248837 26167 raft_consensus.cc:993] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:08:19.253149 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.255890 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.298532 21490 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:19.294576 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:19.296136 21492 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:19.297487 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 109093us
I20260709 13:08:19.259536 26240 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:19.199574 26194 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:19.263890 21561 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.265370 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:19.228953 26298 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:08:19.198462 26308 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:19.274888 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:19.215754 26187 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:19.303467 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:19.299527 21638 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:19.307094 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:19.223351 26101 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:19.312669 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.216567 26181 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.189514 26153 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:08:19.311728 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:19.352689 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:19.314199 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:19.269562 25780 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:19.315071 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:19.315454 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:19.333169 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.336090 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:19.342931 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.243232 26159 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:19.345551 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:19.356854 21489 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:19.245550 26151 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:19.367700 21643 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:19.313252 26179 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:19.358078 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:19.350632 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49692.4us
I20260709 13:08:19.374593 21638 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:19.374660 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:19.359666 21635 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:19.296376 26198 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:19.303316 26125 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:19.334300 26257 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:19.343622 26187 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.344769 26289 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:19.387662 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.437451 21491 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:19.392038 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:19.352363 26085 raft_consensus.cc:1081] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:08:19.269937 26109 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.295960 26242 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.342689 26256 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:08:19.268213 26304 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.374012 26179 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:19.350025 26129 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:08:19.358235 26211 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:08:19.371331 26291 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:08:19.432305 26257 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:19.434772 26288 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:19.480772 26288 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:19.480996 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.481972 26288 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.478096 21639 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:19.483685 26288 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.482376 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.437261 26289 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:19.485229 26289 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:19.490924 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.491549 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.492767 26299 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.343042 26308 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.495322 26301 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.495908 26308 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.497687 26301 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.463441 26179 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:19.501427 26257 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.432044 26311 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.503111 26311 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:19.503618 26311 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.424906 26125 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.507565 26188 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.508361 26242 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.509150 26125 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.354193 26101 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.515159 22245 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:19.520887 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:19.522531 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.524034 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:19.527045 21563 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:19.535162 21486 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:19.550669 21635 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:19.553961 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:19.580526 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:19.582873 21635 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:19.583802 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:19.584730 21643 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:19.512357 26101 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.586176 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:19.586685 21635 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:19.516044 26198 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:19.588455 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 69130.2us
W20260709 13:08:19.589623 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.592715 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58361.9us
W20260709 13:08:19.583226 26284 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:08:19.593493 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:19.584399 26269 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:19.580869 26296 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:19.586622 26194 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:08:19.607127 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 174316us
I20260709 13:08:19.597010 26280 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.613078 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:19.584326 26289 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.627992 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:19.597710 26198 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.636794 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:19.607952 26330 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:19.623451 26280 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:19.697968 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 54757.8us
I20260709 13:08:19.644501 26129 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:19.822011 21642 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:19.642387 26167 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:19.832653 21490 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:19.821646 26129 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.825877 26167 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.856752 21642 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:19.841150 21608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.548s (SENT) [suppressed 1 similar messages]
W20260709 13:08:19.881328 26322 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:08:19.838048 25970 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.833503 26327 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.844501 26244 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:08:19.855069 26315 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:08:19.892130 21642 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:19.850462 26304 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:19.957291 26198 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.876915 26330 raft_consensus.cc:3055] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:19.959264 26330 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:19.960155 26330 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.961369 26330 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:19.848691 26187 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.964219 21492 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:19.964891 26187 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:19.965152 26067 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:19.965710 26067 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:19.967752 26067 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:19.974025 21489 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:19.853245 26129 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:19.922329 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.943638 26289 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:19.888585 25970 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:19.983789 25970 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:19.989410 21485 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:08:19.947306 26331 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:08:19.816545 26194 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:19.951134 26314 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 13:08:19.855351 26167 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:19.967857 26213 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.000s
I20260709 13:08:19.999135 26213 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:20.000150 22242 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:19.902820 21642 pending_rounds.cc:85] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 6
I20260709 13:08:20.003539 21642 pending_rounds.cc:107] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:19.981420 26198 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:20.004099 21642 raft_consensus.cc:2889] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:19.892704 26280 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:20.012391 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:20.039804 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.918442 26311 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.048138 21637 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:20.059365 26198 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:20.064121 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:20.040781 26329 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:20.075937 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:20.060019 26198 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.083648 21637 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:08:20.085436 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 476668us
W20260709 13:08:20.080217 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.091398 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.087317 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:20.095798 21637 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:20.099952 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:20.108839 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.105599 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:20.115065 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 273993us
I20260709 13:08:20.116259 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.117621 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.118824 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.120019 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.120589 22241 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:20.121598 22241 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:20.121673 26317 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:20.123015 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:20.123822 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.124262 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:20.124990 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.126130 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:20.129246 21636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:36050
I20260709 13:08:20.129805 21636 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.130164 21636 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.131353 26324 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:20.131918 26324 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.134435 26324 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:20.136840 26334 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:20.137192 21636 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.137449 26334 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.123147 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:20.149092 26311 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:20.151160 26198 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:20.153224 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:20.113449 26179 consensus_meta.cc:287] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.614s	user 0.012s	sys 0.000s
I20260709 13:08:20.106678 25970 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:20.122253 26317 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.076853 26329 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.165381 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.167809 21562 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:20.168834 26275 consensus_queue.cc:1059] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:20.170465 26142 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:20.172573 26299 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:20.172673 26288 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:20.174768 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 927766us
I20260709 13:08:20.223516 26167 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.225133 26151 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:20.142947 26067 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.101200 26213 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:08:20.227541 26213 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:20.227938 26213 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:08:20.162958 26181 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.803s	user 0.008s	sys 0.004s
I20260709 13:08:20.106958 26280 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:08:20.191085 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2949) took 1017 ms. Trace:
I20260709 13:08:20.229049 21569 rpcz_store.cc:276] 0709 13:08:19.173951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.176469 (+  2518us) service_pool.cc:224] Handling call
0709 13:08:19.197030 (+ 20561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.197294 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:19.227184 (+ 29890us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.190693 (+963509us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.190746 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:20.190826 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.190891 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.191024 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":874894,"prepare.queue_time_us":53790,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":858078,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":22727936,"thread_start_us":117771,"threads_started":1,"wal-append.queue_time_us":139450}
I20260709 13:08:20.163556 25546 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:08:20.198613 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.112694 26325 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:20.234850 26325 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:20.237080 26323 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.771s	user 0.002s	sys 0.008s
I20260709 13:08:20.240222 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1739) took 1114 ms. Trace:
I20260709 13:08:20.240593 21488 rpcz_store.cc:276] 0709 13:08:19.125574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.125732 (+   158us) service_pool.cc:224] Handling call
0709 13:08:19.126083 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:19.166758 (+ 40675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.166820 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:19.185820 (+ 19000us) log.cc:844] Serialized 52 byte log entry
0709 13:08:19.344547 (+158727us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:19.586385 (+241838us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.595431 (+  9046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.595533 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.236408 (+640875us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:20.239890 (+  3482us) raft_consensus.cc:1685] finished
0709 13:08:20.239980 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.240161 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68258,"prepare.queue_time_us":153276,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":43363,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":13999,"spinlock_wait_cycles":19307264,"thread_start_us":309643,"threads_started":2,"wal-append.queue_time_us":169553}
I20260709 13:08:20.244683 26275 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:20.245154 26275 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:20.245805 26125 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:20.173550 26179 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:20.214072 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.199826 22244 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:20.220577 21636 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:20.226662 26151 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:20.227347 26298 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:20.189510 26145 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:20.177469 26240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.012s	sys 0.025s
I20260709 13:08:20.272966 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.224040 26262 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:08:20.309049 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 117928us
I20260709 13:08:20.291082 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.246182 26275 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.246217 26125 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:20.314186 26125 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.315454 26125 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:20.294636 26240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.013s	sys 0.026s
I20260709 13:08:20.315995 26240 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:20.300590 26179 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:20.292343 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.293823 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.311695 26280 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:20.321379 26173 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:20.312397 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.310981 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:20.325893 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.326574 21562 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:20.330320 21565 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:20.330994 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2948) took 1157 ms. Trace:
I20260709 13:08:20.321962 26173 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.295334 26145 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:20.360689 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.331413 21567 rpcz_store.cc:276] 0709 13:08:19.173682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.176036 (+  2354us) service_pool.cc:224] Handling call
0709 13:08:19.176307 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.361533 (+185226us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:19.361567 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.388089 (+ 26522us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.626946 (+238857us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:19.627003 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.322115 (+695112us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b54003eb054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:20.322175 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.322224 (+    49us) raft_consensus.cc:1685] finished
0709 13:08:20.322238 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.330911 (+  8673us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30984,"raft.queue_time_us":935033,"raft.run_cpu_time_us":6284,"raft.run_wall_time_us":15934,"spinlock_wait_cycles":141680000,"thread_start_us":304983,"threads_started":2,"wal-append.queue_time_us":213042}
I20260709 13:08:20.314128 26275 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.386653 25780 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:20.345165 26110 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:20.568481 26110 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.568899 26110 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.569757 26353 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:20.332665 26345 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:08:20.570317 26353 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.372867 26145 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.572499 26353 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:20.219601 26129 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.576716 26129 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:20.578970 25780 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:20.499257 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.317250 26305 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:20.316921 26240 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:20.589360 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.551880 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.590845 21567 raft_consensus.cc:2393] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:20.556084 25970 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:20.556205 26259 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.558894 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.566493 21562 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:20.568293 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.585721 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.598075 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.599148 21562 raft_consensus.cc:2410] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:08:20.330431 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:20.600121 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 269733us
I20260709 13:08:20.601405 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:20.604041 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.606370 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:20.545779 26151 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:20.613052 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.612100 26345 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.613976 26345 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.615124 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.616669 26345 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:20.616614 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.617781 21561 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:20.618353 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.619179 21568 raft_consensus.cc:2410] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:08:20.619037 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.611829 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:20.621405 26280 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:20.622478 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.624606 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:20.625267 21488 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:20.587783 26305 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:20.627925 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:20.628525 21488 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.632498 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:20.609012 26187 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:20.641746 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.609696 26067 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:20.647933 21640 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:20.624670 26289 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:20.653421 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:20.659135 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:20.659974 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.609189 26291 consensus_queue.cc:1059] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:08:20.661922 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.602990 25970 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.676666 26289 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.677217 26289 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.678701 21567 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:20.679426 26289 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:20.680657 26311 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:20.682646 21569 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:20.684206 21488 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:20.640103 26194 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:20.685652 26194 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:20.686086 26194 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.687034 26242 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:20.687578 26242 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:20.688614 26242 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.689996 26242 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.608824 26259 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.638722 26329 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:20.691558 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2953) took 1514 ms. Trace:
I20260709 13:08:20.692081 21563 rpcz_store.cc:276] 0709 13:08:19.176861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.204100 (+ 27239us) service_pool.cc:224] Handling call
0709 13:08:19.244028 (+ 39928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.527509 (+283481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.691261 (+1163752us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400129154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:20.691476 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625131264}
I20260709 13:08:20.693097 26259 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:20.695111 21565 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:20.675843 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.649896 26187 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.699492 26187 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.700686 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.701776 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.702545 21567 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:20.703440 22245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 644) took 1518 ms. Trace:
I20260709 13:08:20.703972 22245 rpcz_store.cc:276] 0709 13:08:19.184802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.184927 (+   125us) service_pool.cc:224] Handling call
0709 13:08:19.189470 (+  4543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.515727 (+326257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.703109 (+1187382us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540016f154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:20.703332 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743032704}
I20260709 13:08:20.706176 26290 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:20.706699 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.707589 21562 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:20.715824 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.704783 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.732642 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.750505 21562 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:20.626236 26151 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.757869 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.759920 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.764504 26059 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:20.766953 26321 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:20.767407 26351 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:08:20.767051 26059 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.767714 26321 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:20.768896 26354 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:08:20.769563 26059 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:20.769958 26321 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:20.771272 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2967) took 1254 ms. Trace:
I20260709 13:08:20.771675 21560 rpcz_store.cc:276] 0709 13:08:19.516775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.518208 (+  1433us) service_pool.cc:224] Handling call
0709 13:08:19.518553 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.205931 (+687378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.205967 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.206495 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.418922 (+212427us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:20.439901 (+ 20979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.440020 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.771018 (+330998us) raft_consensus.cc:1685] finished
0709 13:08:20.771041 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.771209 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":686899,"raft.queue_time_us":689416,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":211484,"threads_started":1,"wal-append.queue_time_us":404236}
I20260709 13:08:20.773566 21564 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:20.775229 26320 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.398s	user 0.007s	sys 0.005s
I20260709 13:08:20.779956 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.781250 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.781688 25970 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:20.781904 26327 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:20.781924 21560 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:20.782428 26327 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.783116 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.782864 26305 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.783213 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.783932 26305 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.778991 26194 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.784250 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.791872 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.792845 21565 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:20.792646 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.786860 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:20.787703 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.733088 26280 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:20.788188 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:20.788733 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:20.788911 22245 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:20.789525 21635 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:20.789758 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.790459 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:20.797648 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.785696 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.795096 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.793437 21560 raft_consensus.cc:2376] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15. Re-sending same reply.
I20260709 13:08:20.808075 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:20.808481 21563 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:20.811532 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:20.812225 21494 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:20.816236 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:20.816948 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.817144 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:20.817622 21640 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.816989 22242 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 13: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:20.820801 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:20.829991 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:20.809799 26257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.265s	user 0.003s	sys 0.019s
I20260709 13:08:20.835244 26280 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:20.836098 26344 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
I20260709 13:08:20.835677 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:20.836815 21638 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:20.838354 26289 raft_consensus.cc:3055] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:20.845322 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:08:20.831847 26257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.004s	sys 0.020s
I20260709 13:08:20.847877 21640 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:20.851711 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:20.857072 26173 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:20.860196 26145 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.861594 21568 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:20.841437 26288 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.871111 26288 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.872659 26317 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:20.853856 26324 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:20.855479 26352 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:20.849089 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.840478 26289 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:20.885026 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:20.886219 26352 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:20.888854 26352 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.889478 26352 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.888311 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:20.892899 26324 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.894879 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:20.894899 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:20.895831 21487 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
W20260709 13:08:20.897830 21486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 2259) took 1680 ms (client timeout 1788 ms). Trace:
I20260709 13:08:20.863466 26145 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:20.898275 21486 rpcz_store.cc:269] 0709 13:08:19.217354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.217463 (+   109us) service_pool.cc:224] Handling call
0709 13:08:20.897660 (+1680197us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400020b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:20.897775 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609121024}
I20260709 13:08:20.894131 25966 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:20.901976 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:20.855844 26110 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.876785 26288 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:20.902705 25966 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:20.907718 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.908241 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:20.899967 26275 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:20.916911 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.931208 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:20.935452 21636 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:20.908118 26363 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.941596 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.943626 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:20.959697 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:20.960388 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:20.961196 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:20.961474 26145 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:20.963945 26059 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:20.964053 26135 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:20.964887 26135 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:20.965390 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.965829 26135 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.946666 26151 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:20.954947 26198 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:20.975463 26198 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:20.975903 26198 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.958559 26362 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:20.976979 26362 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.979208 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:20.909479 26289 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:20.980338 26289 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.979250 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.969473 26109 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:20.984510 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.985209 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:20.987543 21492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 2260) took 1751 ms (client timeout 2285 ms). Trace:
I20260709 13:08:20.987799 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:20.983736 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:20.988950 22243 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:20.991379 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:20.992201 21564 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
W20260709 13:08:20.988016 21492 rpcz_store.cc:269] 0709 13:08:19.235774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.312404 (+ 76630us) service_pool.cc:224] Handling call
0709 13:08:20.987375 (+1674971us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b540013bad4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:20.987488 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428787968}
I20260709 13:08:21.013217 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:21.015372 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 203356us
I20260709 13:08:20.930300 26275 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.018615 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.020512 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.029929 21640 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:21.031989 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.032610 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:20.951685 26277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.470s	user 0.010s	sys 0.026s
I20260709 13:08:21.033255 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.033447 26259 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.033993 26059 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.029167 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:21.034925 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:21.007692 26135 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.973902 26167 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:20.946233 26363 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:20.971484 26325 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:20.986922 26327 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.040175 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:21.070915 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.063709 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.018086 26301 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:21.079547 22247 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:21.087213 22247 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:21.049665 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:21.036485 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.038056 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:21.089622 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51654.5us
I20260709 13:08:21.038355 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:21.053526 21634 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:21.017576 26151 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.038437 25780 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:21.080227 26277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.599s	user 0.012s	sys 0.028s
I20260709 13:08:21.037855 26194 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:21.088407 22247 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.116673 22247 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.110745 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.037660 26109 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 13:08:21.112895 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 74468.1us
I20260709 13:08:21.113823 26325 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.031364 26145 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:21.119696 26145 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.113617 26155 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:21.121976 26145 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:21.123111 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:21.127264 26325 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.128232 26334 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:21.128957 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:21.132907 26366 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:21.136430 25780 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.137310 25780 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.143493 25780 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:21.148378 26102 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:21.148798 26102 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:21.149614 26102 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.152415 26352 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:21.133098 26317 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:21.158197 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 47538us
I20260709 13:08:21.159731 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.084975 26305 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.158824 25780 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:21.278712 26198 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.281302 26198 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:21.283865 25780 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.285122 25780 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.287171 25780 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:21.291671 26304 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:21.292191 26304 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:21.293401 21568 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:21.293150 26304 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.294421 26304 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:21.296008 26213 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.297351 26213 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.300164 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.302224 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.303747 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.304394 21485 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:21.303735 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:21.308879 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 271856us
I20260709 13:08:21.134428 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.134292 26192 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.150671 26102 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.161880 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:21.314975 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 153213us
I20260709 13:08:21.317653 26192 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.155066 26362 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:21.176896 26110 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:21.194201 25966 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:21.038862 26240 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.185s
I20260709 13:08:21.167315 26059 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:21.239241 26371 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 13:08:21.240554 26327 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:21.243762 26329 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.246038 26325 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.315793 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.322566 26329 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.323534 26385 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.324003 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.324939 26329 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:21.254644 26363 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:21.325233 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.325706 26059 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.326382 26059 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.255921 22247 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:21.256137 26275 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:21.257100 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.146464 26187 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.321957 26240 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:21.329620 26240 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:21.330545 26240 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.331056 26187 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:21.322120 26301 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:21.332082 21493 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:08:21.333863 26301 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.338965 26155 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:21.339072 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 204762us
I20260709 13:08:21.340250 26259 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:21.340866 26259 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.341264 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.331840 26240 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.344517 22245 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:21.345292 26242 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:21.345927 26242 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.335356 25780 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:08:21.348001 26071 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:21.348479 26071 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:21.349444 26071 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.350622 26071 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.352675 26242 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:21.355422 26259 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:21.355846 26385 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.358412 26155 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.365782 21637 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:21.367172 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.369005 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:21.369891 26329 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:21.370054 26242 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:21.370661 26242 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:21.370468 26329 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.371775 26242 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:21.373200 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.373433 26329 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:21.374584 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:21.377039 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:21.384742 22245 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:21.387003 22247 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:21.335407 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:21.388150 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52813.2us
I20260709 13:08:21.388645 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:21.388864 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:21.389299 22247 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:21.390017 26059 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:21.390446 26059 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:21.391139 26059 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.390524 26135 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:21.392066 26135 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:21.393245 26192 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.393078 26135 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:21.396721 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 356629us
I20260709 13:08:21.401515 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:21.403268 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:21.404126 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:21.404767 21493 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.409026 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:21.411813 26325 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.412492 26325 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.413126 26325 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.415182 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:21.416033 26329 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.417618 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:21.417992 21493 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:21.418473 26329 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.410699 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:21.423959 26242 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.424172 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:21.425602 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:21.425961 26329 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:21.426560 26280 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.426633 26325 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:21.427640 26329 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:21.428747 26329 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.431376 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:21.433346 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 119643us
I20260709 13:08:21.433569 26059 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.434532 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:21.436607 26325 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:21.437023 26325 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.437397 26325 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.437600 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.438275 21637 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:21.440732 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.443059 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:21.444345 21637 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:21.446900 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:21.447767 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:21.448356 26240 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.448659 22245 raft_consensus.cc:2368] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11.
I20260709 13:08:21.445492 26325 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.450764 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.451870 26305 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.452701 26325 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:21.456542 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.458279 26059 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:21.458118 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:21.459899 26325 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.462844 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:21.463912 21637 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.466523 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.467689 22247 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:21.467908 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.468938 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:21.469542 22247 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:08:21.470118 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.470245 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:21.470486 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.471133 21568 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:21.472800 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:21.473526 22247 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.474459 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.473541 21493 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:21.475306 21640 raft_consensus.cc:2410] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:21.476138 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:21.477984 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.478746 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.479405 21634 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:21.479410 21566 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:21.480756 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.480948 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.481742 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:21.482564 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:21.481849 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:21.483709 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.484851 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.485488 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.485988 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:21.486382 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.487212 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.487443 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:21.487994 21636 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.488273 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.486690 21562 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:21.491488 21560 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:21.478139 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:21.492297 21639 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:08:21.482690 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.492738 21639 pending_rounds.cc:85] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 5
I20260709 13:08:21.493036 21639 pending_rounds.cc:107] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:21.493273 22247 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:21.493285 21639 raft_consensus.cc:2889] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.495189 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:21.495765 22238 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.497727 26275 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:21.498183 26275 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.498513 26275 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.487121 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.499234 21634 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:21.500008 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:21.500558 21486 raft_consensus.cc:2376] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14. Re-sending same reply.
I20260709 13:08:21.500626 21492 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:21.501793 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:21.503083 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:21.503597 21392 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 237) took 12625 ms (client timeout 15000 ms). Trace:
I20260709 13:08:21.504316 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:21.502647 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:21.505264 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.506300 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.507018 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:21.507555 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.507630 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.508343 21491 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:21.508358 21488 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:21.510813 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.511096 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:21.494421 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:21.516139 21486 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:21.516635 22243 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:21.516165 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:21.517607 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.518528 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:21.518639 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.518813 21566 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:21.519774 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:21.520771 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.521310 21566 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:21.522010 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:21.523062 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.523291 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:21.524478 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:21.523437 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:21.525581 21561 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.526099 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:21.526862 21486 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:21.527477 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.528036 21494 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 11. Ops: []
I20260709 13:08:21.514940 26383 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:21.529428 26383 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.523999 26304 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:21.510916 26290 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:21.533955 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.537159 21637 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:21.540419 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.535295 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:21.542627 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:21.530267 21390 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 6 to 13, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 13 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:21.554607 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.561007 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.559868 21636 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:21.562235 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.562721 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.563398 21566 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:21.565991 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.564652 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:21.569103 22243 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:21.572842 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.573930 21567 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:21.574450 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.504490 26370 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:21.575054 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.575565 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.576715 21562 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:08:21.577539 21494 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:21.578081 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:21.579402 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:21.580600 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:21.583237 21457 leader_election.cc:400] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11.
I20260709 13:08:21.583667 21457 leader_election.cc:403] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:21.583865 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:21.578826 21488 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:21.586208 21564 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:21.532879 26329 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:21.589911 22238 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:21.590287 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.595358 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:21.611876 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:21.588778 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:21.609233 21564 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:08:21.616423 21564 pending_rounds.cc:85] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 7
I20260709 13:08:21.616773 21564 pending_rounds.cc:107] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:08:21.617089 21564 raft_consensus.cc:2889] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.610455 21561 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:21.620549 21492 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:21.541919 26071 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.625083 21457 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:21.625186 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.542673 26301 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:21.622536 26192 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:21.631569 26192 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:21.632005 26192 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.626405 26327 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:21.632051 26333 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:21.632882 26327 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.627424 26198 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.633368 26327 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.627848 25966 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11.
I20260709 13:08:21.635842 26329 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:08:21.643915 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.531886 26290 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.609712 26240 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:21.599785 26059 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:21.503980 21392 rpcz_store.cc:269] 0709 13:08:08.878482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.878710 (+   228us) service_pool.cc:224] Handling call
0709 13:08:09.522956 (+644246us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b5400002490. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebe640 00007f98afd95b76 00007f98afe9fc3e 00007f98ae3602a4 00007f98ae360232 00007f98ae360161 00007f98ae3600dc 00007f98ae35f392 00007f98a831d48c 00007f98a831c8c6
0709 13:08:21.503524 (+11980568us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:16.452842 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:16.457000 (+  4158us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:16.457039 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:08:16.457058 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:16.848137 (+391079us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:16.854599 (+  6462us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:16.857870 (+  3271us) tablet.cc:685] Acquiring locks for 32 operations
0709 13:08:16.880875 (+ 23005us) tablet.cc:701] Row locks acquired
0709 13:08:16.880891 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:16.881047 (+   156us) write_op.cc:270] Start()
0709 13:08:16.881187 (+   140us) write_op.cc:276] Timestamp: P: 1783602496880995 usec, L: 0
0709 13:08:16.881206 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:16.882562 (+  1356us) log.cc:844] Serialized 12667 byte log entry
0709 13:08:18.083448 (+1200886us) op_driver.cc:464] REPLICATION: finished
0709 13:08:18.344129 (+260681us) write_op.cc:301] APPLY: starting
0709 13:08:18.354230 (+ 10101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:18.672301 (+318071us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:18.672440 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:19.105425 (+432985us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b1800304240. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9d210ec 00007f98a9d23af7 00007f98a9d24fb0 00007f98ada391bb 00007f98ada805d4 00007f98ad92c8da 00007f98ad92f3cb 00007f98ad92efd3 00007f98ada2de34
0709 13:08:19.242481 (+137056us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:19.428447 (+185966us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=64,mrs_lookups=0
0709 13:08:19.436846 (+  8399us) write_op.cc:312] APPLY: finished
0709 13:08:19.480954 (+ 44108us) log.cc:844] Serialized 276 byte log entry
0709 13:08:20.820284 (+1339330us) spinlock_profiling.cc:243] Waited 72.4 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a6ed80ac 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b
0709 13:08:21.115714 (+295430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:21.116050 (+   336us) write_op.cc:454] Released schema lock
0709 13:08:21.116124 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:21.118938 (+  2814us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:21.118970 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2318638,"reported_tablets":40,"spinlock_wait_cycles":10750720,"child_traces":[["op",{"apply.queue_time_us":250174,"apply.run_cpu_time_us":89690,"apply.run_wall_time_us":2781947,"cfile_cache_hit":130,"cfile_cache_hit_bytes":137759,"num_ops":32,"prepare.queue_time_us":59641,"prepare.run_cpu_time_us":54095,"prepare.run_wall_time_us":632984,"raft.queue_time_us":656814,"raft.run_cpu_time_us":49614,"raft.run_wall_time_us":235267,"replication_time_us":1202000,"spinlock_wait_cycles":177544448,"thread_start_us":2486369,"threads_started":5,"wal-append.queue_time_us":1985823,"wal-append.run_cpu_time_us":78021,"wal-append.run_wall_time_us":1594439}]]}
I20260709 13:08:21.660910 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:21.638197 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:21.629683 26145 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.648721 26347 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:21.677322 26394 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:08:21.727566 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 102436us
I20260709 13:08:21.730018 26289 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:21.731174 26325 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.731863 26187 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.733309 21487 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:21.636889 26329 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:21.744741 26355 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.081s	user 0.000s	sys 0.003s
W20260709 13:08:21.747341 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 86502.8us
W20260709 13:08:21.746687 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 84250.3us
W20260709 13:08:21.751142 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 113061us
I20260709 13:08:21.626236 26370 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.622877 26242 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:08:21.771872 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:21.742835 26059 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:21.744365 26240 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:21.740353 26071 raft_consensus.cc:2764] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:08:21.771675 21390 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 8 to 9, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.793388 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:08:21.798051 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.797899 21390 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.774242 26059 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.770570 26347 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.770910 26067 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:21.845363 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46191.2us
I20260709 13:08:21.796991 26155 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:21.896672 26155 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:21.796084 26363 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:21.899068 26363 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:21.900244 26363 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.901995 26363 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.755029 26192 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.852421 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:21.903605 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51238.1us
I20260709 13:08:21.904577 26192 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:21.904946 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:21.905187 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.758025 26135 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:08:21.907491 26067 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.908188 26067 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:21.909334 25966 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.856885 26275 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.911408 22238 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:21.911656 26275 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:21.860428 26370 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:21.869794 21487 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:21.911469 26290 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:21.800266 26383 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:21.914307 21491 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:21.915735 26067 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:21.916133 26067 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:21.879487 26102 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:21.917003 26067 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.917559 26102 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:21.875171 21390 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 6 to 7, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 7 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.763127 26325 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:21.894734 26396 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:21.895183 26402 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.905365 21562 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:21.892400 26240 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.919613 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.881809 26280 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.921332 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:21.918678 26102 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:21.927142 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 181121us
I20260709 13:08:21.932847 21567 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.933889 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:21.848997 26165 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:21.898007 26155 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:21.955084 21486 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:21.950770 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:21.928435 26192 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:21.965197 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:21.935395 26383 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.949725 26067 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.958061 25780 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:21.949954 26334 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.927081 26352 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:22.003782 26405 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.982079 26165 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:21.962366 26192 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:22.006982 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:08:21.998744 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.931236 26327 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:21.978722 25966 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:21.998320 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 349061us
I20260709 13:08:21.934846 26402 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:22.017270 21390 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 8 to 11, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.010514 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:22.016120 21567 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:22.017268 21562 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:22.018970 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:21.968575 26301 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:08:21.966655 26071 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:08:22.033816 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:22.044492 21390 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.007493 25780 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:22.047746 22244 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:22.006487 26165 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:22.061010 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.029208 26102 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:22.061371 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:22.012848 26360 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:22.062465 21390 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 8 to 9, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 9 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:22.007720 26334 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:22.067093 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.070752 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.014314 26321 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:08:22.055454 26405 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:22.061115 26305 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:22.067541 26280 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:22.089912 21643 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:22.081329 26244 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:22.090463 25780 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:22.071018 26360 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:22.094020 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:22.073484 26242 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:22.104954 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45093.4us
I20260709 13:08:22.088120 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.093747 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:22.110337 26244 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:22.092787 26405 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.100965 21390 catalog_manager.cc:5697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 8 to 10, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 10 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.114389 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:22.097795 26198 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:22.102561 26290 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.122540 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:22.081672 26324 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:08:22.105449 26360 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.103655 26305 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:22.125447 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:22.142114 22245 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:22.120740 26418 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:22.131187 26290 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:22.105140 26242 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:22.118384 26198 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:22.143512 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:22.147351 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:22.149305 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:22.150687 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:22.131963 26334 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:22.121338 26321 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:22.119465 26405 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.134163 26059 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:22.161515 21635 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:22.162215 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:22.162124 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:22.162118 26244 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:22.159396 26242 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.160858 26198 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.124090 26325 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:22.169137 21636 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.165081 26327 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:22.243314 21636 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:22.252965 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:22.253845 21567 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:22.214335 26244 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.170212 26321 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:22.225924 26334 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:22.299144 26244 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.229475 26280 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:22.245345 26290 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:22.314023 26379 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:22.289868 26305 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:22.338409 26280 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:22.363616 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:22.363916 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 275861us
I20260709 13:08:22.365703 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.320149 26334 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:22.366921 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.349375 26290 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.422523 26324 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:22.436764 25546 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:22.437451 25546 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:22.438756 21519 heartbeater.cc:646] Failed to heartbeat to 127.19.231.190:34603 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.231.190:34603 timed out after 15.000s (SENT)
I20260709 13:08:22.439543 26370 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.440075 26370 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:22.444237 26363 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.001s
I20260709 13:08:22.362519 26402 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:22.448601 25546 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:22.428757 26417 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:08:22.368050 26327 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:22.156944 26418 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:22.427971 26290 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:22.469745 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 347299us
I20260709 13:08:22.471608 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:22.367766 26424 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:22.477012 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:22.442694 26370 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:22.495692 21492 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:08:22.421238 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 54346.3us
I20260709 13:08:22.501123 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.509845 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.511901 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.476271 26301 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:22.536523 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.537403 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:22.538093 21492 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:22.539163 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:22.539755 21490 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:22.536803 21487 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:22.548225 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:22.549284 21563 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:22.550876 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:22.537671 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:22.518715 26418 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:22.552117 21494 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.552241 26418 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:22.514315 26327 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.557471 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:22.522401 26059 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:22.515792 26324 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:22.483980 26424 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:22.538884 26240 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:22.557281 26301 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:22.573808 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.553647 26325 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.565410 26363 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:22.556224 26135 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:08:22.570498 26324 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:22.642675 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 2990) took 1140 ms. Trace:
I20260709 13:08:22.539564 26334 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:22.643308 21566 rpcz_store.cc:276] 0709 13:08:21.501809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.568761 (+ 66952us) service_pool.cc:224] Handling call
0709 13:08:21.569077 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.757598 (+188521us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:21.796697 (+ 39099us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.015366 (+218669us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.015664 (+   298us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.015728 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:22.015798 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.641513 (+625715us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54003eb054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:22.642503 (+   990us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.642619 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57326,"prepare.queue_time_us":97041,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":89,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":11507,"spinlock_wait_cycles":432915200,"thread_start_us":212640,"threads_started":1,"wal-append.queue_time_us":260429}
I20260709 13:08:22.653167 21494 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:22.639699 26324 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.651808 26370 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.671463 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 135013us
W20260709 13:08:22.669231 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 192282us
I20260709 13:08:22.632465 26363 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:22.678748 21486 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:22.675724 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.689591 26325 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.691183 26329 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:22.694133 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:22.694303 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:22.695036 26259 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:22.699333 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 121796us
I20260709 13:08:22.699644 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.703847 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.703528 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:22.708676 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:22.698055 26259 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:08:22.700047 26422 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:22.711802 26259 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:22.712226 26259 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:22.713032 26259 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:22.714274 26259 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:22.717715 26429 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:08:22.713836 26192 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:22.719856 26192 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:22.729278 26067 consensus_meta.cc:287] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.000s
I20260709 13:08:22.677634 26370 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:22.681770 26135 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:08:22.708134 26290 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:22.707552 26240 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:22.708011 26325 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:22.710418 26288 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:22.744204 22244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:22.746634 21491 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:22.734007 26402 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.755110 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:22.780149 21562 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 4.
I20260709 13:08:22.716475 26327 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:08:22.781574 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:22.746198 22244 raft_consensus.cc:606] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
W20260709 13:08:22.778816 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 70182.1us
I20260709 13:08:22.788087 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:22.795204 22246 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 16: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:22.809468 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:22.748296 26288 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.825898 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:22.779496 26437 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.737545 26198 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:22.829857 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:08:22.857402 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 68829.6us
W20260709 13:08:22.855548 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 75070.7us
I20260709 13:08:22.858585 26325 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:22.859375 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.823501 26288 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.891989 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:22.897398 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:22.904028 22244 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:22.919400 21562 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:22.814749 26445 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:22.787101 26402 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:22.856577 26442 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:22.808694 26416 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:08:22.940477 21482 tablet_service.cc:1558] Processing DeleteTablet for tablet 377467a782f94dd2b6e76b88920dfb8b with delete_type TABLET_DATA_TOMBSTONED (TS 5a34fd3290de493eb6bbe828dd742772 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:43140
W20260709 13:08:22.922310 26426 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:08:22.941581 21494 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:22.958979 22244 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:08:22.863049 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:22.862526 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:22.965651 21566 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
W20260709 13:08:22.948875 26102 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.877s	user 0.011s	sys 0.002s
W20260709 13:08:22.991467 26360 consensus_meta.cc:287] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.832s	user 0.002s	sys 0.011s
I20260709 13:08:23.007505 26360 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.010996 22239 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 7.
W20260709 13:08:22.996068 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64786us
I20260709 13:08:23.011068 21490 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:22.941102 26198 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:23.010499 26360 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.020051 26059 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:23.020839 26059 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:23.027422 26405 consensus_meta.cc:287] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.804s	user 0.012s	sys 0.000s
I20260709 13:08:23.027982 26405 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:22.946843 26445 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:22.968011 26240 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:23.019157 21492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:22.897197 26334 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:08:22.942543 26424 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.039193 21492 raft_consensus.cc:606] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:23.105573 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:23.112510 21564 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:23.113636 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:22.859386 26434 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:08:23.116425 26444 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:08:23.032673 26370 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.036434 26240 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.124892 26240 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.951861 26363 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:23.129770 26242 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.900s	user 0.011s	sys 0.000s
I20260709 13:08:23.030772 26405 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:22.948382 26442 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.133512 26442 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.135684 26402 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:23.031880 26445 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.171749 22244 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:22.865465 26437 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.254859 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:23.130366 26242 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:23.262991 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.142552 26059 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.213560 26334 consensus_queue.cc:1243] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:23.269016 21564 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:23.269351 21564 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:23.264012 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 366715us
W20260709 13:08:23.251411 26192 consensus_meta.cc:287] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.005s
I20260709 13:08:23.261291 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:23.258119 22244 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 5.
I20260709 13:08:23.185065 26442 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:23.269819 21564 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.281111 21564 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.252431 26432 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.259461 26382 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.136065 26240 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.285107 22212 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:23.278349 25966 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:23.217613 26324 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.270951 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:23.311209 25966 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:23.318218 25966 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.291085 26432 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.320370 26432 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.278717 26071 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.323889 26071 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.324577 26437 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.325382 26192 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:23.325891 26192 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.323056 26325 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:23.327220 26325 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:23.328122 26288 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.341178 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:08:23.306881 26259 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.592s	user 0.012s	sys 0.000s
W20260709 13:08:23.351697 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 66710.5us
I20260709 13:08:23.353912 21564 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:23.354441 21564 pending_rounds.cc:85] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:08:23.354710 21564 pending_rounds.cc:107] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 12.7
W20260709 13:08:23.354983 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.355403 21564 raft_consensus.cc:2889] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:23.356662 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:23.357335 21564 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:23.358819 21564 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:23.274745 26327 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:08:23.365656 21560 raft_consensus.cc:2410] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:08:23.363407 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 78298.7us
I20260709 13:08:23.370193 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:23.328142 26325 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:23.367774 21608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.038s	sys 0.035s
I20260709 13:08:23.380281 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:08:23.380904 21608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.038s	sys 0.035s
I20260709 13:08:23.381608 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:23.376523 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:23.283080 26441 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:08:23.363137 26437 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.288236 26442 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.363097 26334 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:23.379889 26259 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.368260 26310 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:23.311278 26382 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:23.391855 26244 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.065s	user 0.011s	sys 0.003s
I20260709 13:08:23.428174 26244 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.395042 26067 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:08:23.429965 26382 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.389567 26059 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:23.430980 26059 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:23.431393 26059 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:23.413552 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:23.392639 26457 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:08:23.418736 26242 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:23.392760 26363 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:23.421253 26324 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:23.422281 26442 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.410017 26334 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.424888 26240 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:23.439787 26432 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.440410 26334 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.441392 26432 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.442407 26165 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.430590 26244 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.426285 26459 tablet_replica.cc:333] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:08:23.412626 26310 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:23.427193 26453 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:08:23.433094 22244 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
W20260709 13:08:23.433305 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.434077 21486 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:08:23.436378 26363 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.387094 26289 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:08:23.436721 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 55216.7us
I20260709 13:08:23.398149 26405 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.442291 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:23.389799 26135 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:08:23.425063 26192 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.443956 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:23.444628 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:23.395509 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:23.457839 22245 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:23.443799 26288 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.457909 21564 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:23.406950 26437 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.449667 26310 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.464293 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:23.451882 26363 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.446913 26165 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.460001 26452 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:23.475237 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:23.475960 21564 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.478297 21491 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:23.479115 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:23.479362 21487 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:23.480226 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:23.480787 21493 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.480652 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:23.481349 21487 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.483175 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:23.478689 21491 pending_rounds.cc:85] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 10
I20260709 13:08:23.483915 21491 pending_rounds.cc:107] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:23.483914 21489 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:23.484396 21491 raft_consensus.cc:2889] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:23.465531 26242 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:23.464607 26352 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:23.490808 21487 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:23.468384 26460 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:23.492267 21493 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:23.497269 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:23.499297 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:23.504706 21564 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:23.505722 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:23.506623 21564 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:23.491775 26288 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:23.504827 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:23.505966 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:23.509456 26448 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:23.509969 26448 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.510360 26448 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.511001 26463 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:23.511616 26463 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:23.512603 26463 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:23.516043 26465 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:23.507970 26288 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:23.516697 26288 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.517573 26432 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.486622 26464 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.551537 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:23.562963 26468 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.563617 26468 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.567360 26432 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:23.567543 26466 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.567911 26432 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.568404 26432 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.636370 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:23.731853 26333 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.563053 26458 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:23.493637 26452 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.733471 26458 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.734864 26165 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.735466 26452 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.735932 26458 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.736192 26452 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:23.737156 26469 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:23.737591 26437 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.738045 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:23.501603 26352 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.733472 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:23.765753 21564 raft_consensus.cc:2410] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:23.737735 26469 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.499400 26242 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.637243 26464 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:23.695499 26135 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:23.643232 26468 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.500586 26460 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.790951 26460 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:23.778074 26289 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.792052 26289 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.796458 26352 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.797127 26242 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:23.804454 26478 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:23.805399 26478 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.787647 26469 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:23.788126 26464 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:23.860760 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 362451us
W20260709 13:08:23.850606 25966 consensus_meta.cc:287] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.004s
I20260709 13:08:23.568212 26466 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.901062 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:23.901714 21564 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.732671 26333 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.903885 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:23.912384 26464 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.914618 26478 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:23.915983 26470 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.808486 26135 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:23.949968 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 170559us
I20260709 13:08:23.957944 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:23.907637 26188 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:23.962973 21564 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:23.916790 26470 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.908281 26289 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:23.966910 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 63131.9us
I20260709 13:08:23.968792 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:23.970588 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:23.969565 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:23.964637 26188 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:23.987804 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:23.988497 26188 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:23.989125 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:23.989785 26188 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.990278 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:23.995402 26059 consensus_meta.cc:287] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.003s
I20260709 13:08:23.907115 25966 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:23.960932 26352 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:23.961237 26242 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.006119 21564 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:24.007202 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.011407 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:23.955009 26474 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
W20260709 13:08:24.002674 26451 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.970s	user 0.010s	sys 0.019s
I20260709 13:08:23.971899 26480 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:24.000336 26059 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.008960 26324 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.002135 26469 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:24.031186 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 793) took 1250 ms. Trace:
I20260709 13:08:24.048043 22239 rpcz_store.cc:276] 0709 13:08:22.781106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.781293 (+   187us) service_pool.cc:224] Handling call
0709 13:08:24.030927 (+1249634us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54005ffd54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:24.031074 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512682880}
W20260709 13:08:24.029266 26310 consensus_meta.cc:287] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.002s
I20260709 13:08:24.010174 26467 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.053404 26059 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.053500 25966 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.049841 26480 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:24.020232 26135 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.049131 26324 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.059966 26470 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:24.058722 26448 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.540s	user 0.004s	sys 0.005s
I20260709 13:08:24.085813 26448 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.086431 26402 raft_consensus.cc:993] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:24.086853 26324 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.086973 26402 raft_consensus.cc:1081] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:24.088168 26448 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:24.061786 26363 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.590s	user 0.000s	sys 0.009s
I20260709 13:08:24.089396 26440 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:24.090378 22239 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:24.009681 26352 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.090883 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.091078 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:24.034920 26333 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.092212 26333 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.092438 26352 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.092749 26333 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.068773 26301 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:24.095048 26301 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:24.096367 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.096179 26301 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.096688 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.097405 26301 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.097791 22240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:24.098398 22240 raft_consensus.cc:606] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:24.044849 26460 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:24.069591 26435 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:24.015544 26458 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:24.100281 26460 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.100953 26458 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.102011 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.102389 26460 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.031479 26474 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.080407 26403 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.024801 26466 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.072563 26422 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:24.105141 26422 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.107167 26458 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:24.073542 26288 consensus_meta.cc:287] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
I20260709 13:08:24.107975 26288 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.074566 26342 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:24.075878 26432 consensus_meta.cc:287] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:08:24.008369 26242 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.082502 26467 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.083129 26480 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.090013 26440 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.091663 22238 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.094067 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.065210 26329 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:24.089227 26363 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.103284 26474 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.103533 26403 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.080869 26469 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:24.080637 26310 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.119450 26329 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:24.112788 26333 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.118067 26432 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.136387 26440 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:24.142112 26325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.016s	sys 0.026s
I20260709 13:08:24.117452 26342 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.152690 26467 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.154102 26432 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.150678 26469 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.150238 26474 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.211086 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:24.212584 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:24.229600 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.231034 21485 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:24.232875 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:24.233892 22241 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.236318 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.236430 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.265475 26165 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:24.240427 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.240198 22243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6859210b204263aedc975d7586330c"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:24.242198 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.247598 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.250332 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:24.254102 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.253916 22238 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:24.284973 22241 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:24.260077 26059 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.286176 26059 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.289950 26059 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.263361 26242 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.264245 26244 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.291595 26244 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.265892 26288 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.236778 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.266314 26290 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:24.296219 26244 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.296303 26290 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.267747 26324 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:24.271183 26310 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:24.147380 26325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.017s	sys 0.026s
I20260709 13:08:24.272621 26329 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.273954 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.276269 26363 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.258809 25546 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:24.279019 26403 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.312057 21561 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:24.314213 26290 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.281850 26165 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.315310 21493 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:24.308475 22243 raft_consensus.cc:606] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:24.321166 26165 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:24.160970 26422 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.322676 26167 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:24.324049 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 74702.1us
I20260709 13:08:24.329447 26480 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:24.329311 26167 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.330495 26480 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.331154 26466 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:24.331797 26466 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.332086 26435 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.332959 26435 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.334065 26480 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.334900 26482 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.335121 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.317025 26059 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:24.336862 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 126364us
I20260709 13:08:24.325838 22243 raft_consensus.cc:614] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:24.336306 21487 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:24.332340 26466 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.338493 26352 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.340317 26242 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.340569 26452 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.341173 26242 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.341440 26452 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.342990 25546 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.344453 26467 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:24.344959 26474 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:24.345371 25546 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.347283 26470 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:24.345755 26474 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.348652 26470 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.335834 26491 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.349756 26342 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.350692 26491 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.323886 26472 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.335804 26482 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.362488 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.363610 22243 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
W20260709 13:08:24.364140 21560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2340) took 1502 ms (client timeout 1985 ms). Trace:
W20260709 13:08:24.364720 21560 rpcz_store.cc:269] 0709 13:08:22.861789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.891674 (+ 29885us) service_pool.cc:224] Handling call
0709 13:08:24.363649 (+1471975us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54000a2154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:24.363921 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079442176}
W20260709 13:08:24.359126 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 70062us
I20260709 13:08:24.362241 26329 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.375658 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.380927 26460 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.345316 26467 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.385686 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.386111 26467 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.389170 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1780) took 1696 ms. Trace:
I20260709 13:08:24.390861 26242 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.391611 26482 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.390923 26352 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.392860 26422 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.365374 26472 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.393191 26452 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.382012 26460 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.412302 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.412842 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.394084 21565 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:24.397017 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3017) took 1842 ms. Trace:
I20260709 13:08:24.413511 26460 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.413787 22247 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 6: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:24.397169 26474 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.377135 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:24.417474 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 1114) took 1635 ms. Trace:
I20260709 13:08:24.395048 21494 rpcz_store.cc:276] 0709 13:08:22.692377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.693445 (+  1068us) service_pool.cc:224] Handling call
0709 13:08:22.693722 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.950983 (+257261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.388387 (+1437404us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540005c3d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:24.388884 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569594624}
W20260709 13:08:24.418644 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61279.4us
I20260709 13:08:24.402523 21568 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:24.420905 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.421348 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.403589 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.422883 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.423487 26110 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:24.420912 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.424288 21494 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:24.418090 21565 rpcz_store.cc:276] 0709 13:08:22.782404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.783028 (+   624us) service_pool.cc:224] Handling call
0709 13:08:24.393076 (+1610048us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:08:24.393494 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.417077 (+ 23583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.417392 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391808}
I20260709 13:08:24.429426 26059 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.432719 26059 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.436816 21561 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:24.435241 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:24.441052 26102 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:24.441537 26102 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.441916 26102 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:24.447008 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.404757 26472 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.405592 26352 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.413854 21569 rpcz_store.cc:276] 0709 13:08:22.554276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.554422 (+   146us) service_pool.cc:224] Handling call
0709 13:08:22.554869 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.625300 (+ 70431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.625347 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.625403 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:22.625449 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.396436 (+1770987us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b54001f9fd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:24.396514 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.396784 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161396608}
I20260709 13:08:24.416785 26435 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.456440 21489 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:08:24.376423 26480 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.461865 21568 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 5.
I20260709 13:08:24.462260 22243 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:08:24.449563 26467 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.464043 26467 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.464854 21568 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:24.465723 21567 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:24.467873 26467 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.469870 26459 raft_consensus.cc:2243] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:24.470634 26467 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.471879 26467 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.475847 26467 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.469111 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.468062 26071 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.483395 22243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:24.484128 22243 raft_consensus.cc:606] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:24.484505 22243 raft_consensus.cc:614] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:24.495015 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1779) took 1811 ms. Trace:
I20260709 13:08:24.495535 21486 rpcz_store.cc:276] 0709 13:08:22.683230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.683343 (+   113us) service_pool.cc:224] Handling call
0709 13:08:22.683788 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:23.450938 (+767150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.494350 (+1043412us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b540029a4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:24.494754 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724754688}
I20260709 13:08:24.499508 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.500808 21567 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:24.499985 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 756) took 1678 ms. Trace:
I20260709 13:08:24.502413 21490 rpcz_store.cc:276] 0709 13:08:22.820992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.822459 (+  1467us) service_pool.cc:224] Handling call
0709 13:08:22.822980 (+   521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.015804 (+192824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.498645 (+1482841us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54002c9f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:24.499786 (+  1141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431843584}
I20260709 13:08:24.522315 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.526533 22247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
W20260709 13:08:24.531848 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet c670f1ebdec3444e9e371f0fca10d38d: Illegal state: Replica 5a34fd3290de493eb6bbe828dd742772 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:24.537592 26167 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.539410 21488 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:24.540481 21635 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:24.540658 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.541985 21560 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:08:24.542400 21643 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:24.534763 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.529389 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.545849 21568 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:24.552896 26165 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.554018 26304 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:24.554477 26304 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:24.539412 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:24.561349 21567 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:08:24.562279 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.546929 26437 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:24.567317 26437 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.569092 21636 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 5: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:24.570199 26437 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.571983 21642 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:24.572435 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:24.555864 26304 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.563949 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:24.580410 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 185688us
I20260709 13:08:24.581604 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.529814 26480 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.582005 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.586956 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.595799 21490 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:24.576550 26491 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.598452 21563 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:24.576578 26470 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.598695 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3047) took 1138 ms. Trace:
I20260709 13:08:24.584590 26165 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:24.604096 21565 rpcz_store.cc:276] 0709 13:08:23.460076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.431121 (+971045us) service_pool.cc:224] Handling call
0709 13:08:24.587788 (+156667us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:08:24.588090 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.598192 (+ 10102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.598238 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:24.598309 (+    71us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:24.598363 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.598455 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.598621 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38171008}
I20260709 13:08:24.613729 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.614813 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:24.609141 26445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.016s	sys 0.037s
W20260709 13:08:24.621263 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.626984 26301 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.627619 26301 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.629983 26301 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.631050 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.631748 26459 raft_consensus.cc:2272] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:24.631814 21567 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:24.635290 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:24.620807 26445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.016s	sys 0.037s
I20260709 13:08:24.624853 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.631078 21641 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:24.643684 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:24.644285 21562 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:24.644513 21642 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:24.624006 26304 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.650070 21565 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:24.651681 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.652561 21489 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:24.652693 26352 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.657749 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.658939 21560 raft_consensus.cc:2410] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:24.666364 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.665318 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.672478 21494 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:24.674512 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:24.660279 26102 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.689111 26102 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.689889 22247 raft_consensus.cc:606] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:24.690379 22247 raft_consensus.cc:614] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:24.692027 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.692544 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.693157 21487 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:24.702064 21489 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:24.703361 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:24.711015 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 160469us
I20260709 13:08:24.727818 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:24.710748 26240 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:24.730014 26240 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.727135 26352 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:24.749728 26240 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.767426 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:24.771523 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.771507 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.752691 26167 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:08:24.763659 26329 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.776410 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:24.775853 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:24.791143 22243 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:24.729550 26459 ts_tablet_manager.cc:1916] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:24.850948 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.782501 26352 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:24.853205 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.857172 22245 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.857537 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:24.857669 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 50853.2us
W20260709 13:08:24.863659 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 251030us
I20260709 13:08:24.863917 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:08:24.854658 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 89723.6us
I20260709 13:08:24.780157 21563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:36572
I20260709 13:08:24.871167 21563 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:24.871492 21563 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.873585 22242 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:24.873832 22243 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:24.877436 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.877667 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.875805 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:24.880097 21562 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:24.881170 26342 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:24.883204 21565 raft_consensus.cc:2410] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:24.883322 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.884012 22240 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:24.873049 26447 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:24.856788 26480 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:24.858665 26352 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:24.892000 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:24.892961 26441 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:24.893414 26441 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:24.892976 21642 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:08:24.894901 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.891050 21457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.131:41367 timed out after 1.691s (SENT) [suppressed 24 similar messages]
I20260709 13:08:24.867707 26329 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.900841 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:24.903457 22242 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:08:24.906498 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.907035 26135 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.907583 26135 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.910002 26135 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.910473 26135 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.910933 26435 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.920096 26435 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.921020 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.921653 21567 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:24.922276 26435 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:24.922586 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:24.920392 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:24.904481 26447 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:08:24.939567 26507 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 13:08:24.971657 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 82363.4us
I20260709 13:08:24.945732 26441 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:24.926615 26325 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.917521 26321 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:24.961154 22243 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:24.931367 26334 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:24.963146 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:24.974054 21562 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:08:24.975148 22245 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:24.930073 26135 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:24.982425 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:24.973892 21561 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:25.007263 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:25.008074 21562 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.009570 26447 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.012331 26135 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:25.013454 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 50417.4us
I20260709 13:08:25.014778 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3049) took 1412 ms. Trace:
I20260709 13:08:25.015255 21569 rpcz_store.cc:276] 0709 13:08:23.602509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.454735 (+852226us) service_pool.cc:224] Handling call
0709 13:08:24.455411 (+   676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.455981 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.456039 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.456694 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.561593 (+104899us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:24.561634 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.561703 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.014440 (+452737us) raft_consensus.cc:1685] finished
0709 13:08:25.014472 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.014679 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1463,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":168,"thread_start_us":104447,"threads_started":1,"wal-append.queue_time_us":217439}
I20260709 13:08:25.016404 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:25.017154 22244 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:25.017977 21641 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.018081 26503 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.024053 26352 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.026124 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:25.026569 26480 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:25.025758 26433 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:08:25.031713 26198 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:25.032111 26198 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:25.032753 26321 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.033293 26198 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.034495 26198 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.035722 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.037124 22212 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:25.037321 26433 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:25.044581 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.047046 21488 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:25.050705 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.037760 26325 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.054724 26484 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:25.057673 26325 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:25.058132 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.058900 21487 raft_consensus.cc:2368] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8.
I20260709 13:08:25.059053 26441 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.059158 26440 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:25.059711 26440 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:25.060195 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:25.060882 26440 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.057520 21568 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:25.068825 26484 raft_consensus.cc:993] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:25.069929 26484 raft_consensus.cc:1081] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
W20260709 13:08:25.077147 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet cc9f5258ae3f4790a9bc1813d73ec987: Illegal state: Replica 5a34fd3290de493eb6bbe828dd742772 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:08:25.080701 26504 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.432s	user 0.005s	sys 0.004s
W20260709 13:08:25.082587 26506 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.421s	user 0.009s	sys 0.003s
W20260709 13:08:25.084235 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet 4d6d6e481fd941658a227093848691fa: Illegal state: Replica 5a34fd3290de493eb6bbe828dd742772 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:25.084854 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3046) took 1625 ms. Trace:
I20260709 13:08:25.086414 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.087316 21637 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:25.087702 21636 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:25.088780 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:25.089272 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet 545ee5e8315344d387b7e32a6fe5984b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:25.089730 21643 raft_consensus.cc:2410] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:25.085424 21564 rpcz_store.cc:276] 0709 13:08:23.459225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.214553 (+755328us) service_pool.cc:224] Handling call
0709 13:08:24.421559 (+207006us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b540031f028. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef86ebc 00007f98aefbc08c 00007f98aefa693b 00007f98aefa63d2 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c
0709 13:08:24.421698 (+   139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.422370 (+   672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.422401 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.447436 (+ 25035us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.547778 (+100342us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:24.751684 (+203906us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.752280 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.752392 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.081824 (+329432us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:25.084421 (+  2597us) raft_consensus.cc:1685] finished
0709 13:08:25.084452 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.084634 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22463,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":11169,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":2667,"spinlock_wait_cycles":50920576,"thread_start_us":265906,"threads_started":2,"wal-append.queue_time_us":193558}
I20260709 13:08:25.091339 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.093318 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.095258 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.095861 26329 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:25.096053 21636 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.097080 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.099169 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.106243 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:25.038697 26321 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:25.037827 26334 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:25.108395 26334 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:25.106590 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:25.107475 21641 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:25.109838 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:25.110735 21562 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:25.110725 21560 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.040832 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:25.026059 26352 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.109517 26334 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.117873 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.118693 21640 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 11: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:25.119074 26449 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.119606 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:25.120193 21493 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:25.120487 26449 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:25.120867 26449 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:25.121237 26449 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.118626 26334 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:25.122665 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 81911.2us
I20260709 13:08:25.123263 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:25.124050 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.125048 26321 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.125583 26321 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.127911 26321 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:25.130563 26329 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.131261 22247 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:25.134913 26329 consensus_queue.cc:1059] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:25.135778 22212 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:25.136143 26480 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:25.136516 26480 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:25.137831 26345 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:25.138392 26345 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:25.137442 26480 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.139120 26480 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:25.141830 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.142422 21564 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:25.124643 21637 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:25.142966 26345 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.146701 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:25.147990 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:25.148562 21568 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:25.151744 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:25.154166 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:25.155210 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:25.156469 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:25.157065 21569 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:25.158694 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:25.159912 21568 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:25.160398 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:25.161226 22244 raft_consensus.cc:2368] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8.
I20260709 13:08:25.162173 21642 raft_consensus.cc:2410] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:25.165964 26240 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.168901 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.169664 21486 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
W20260709 13:08:25.171442 26466 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.805s	user 0.014s	sys 0.000s
I20260709 13:08:25.171901 26466 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.174561 26466 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:25.175786 22245 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:25.177178 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:25.178275 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:25.180178 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:25.180639 21493 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:08:25.180804 21568 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.185508 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.186295 21641 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:25.186226 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.186942 21640 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:25.187081 21564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:36572
I20260709 13:08:25.187829 21564 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.188264 21564 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.188292 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.189644 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:25.190469 21561 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:25.191355 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.192951 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.193722 21640 raft_consensus.cc:2410] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:25.196223 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.174391 26449 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.197096 22247 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:25.113073 21563 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.204867 21568 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:25.205274 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:25.205726 21565 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:25.205941 21493 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.208249 21567 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:25.213955 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:25.214385 21560 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
W20260709 13:08:25.216467 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.218299 21563 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:25.205897 26445 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:08:25.218698 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:25.219916 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 332504us
I20260709 13:08:25.209343 22212 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:25.223345 21636 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:25.206275 26198 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:25.206151 26325 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:25.229187 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:25.229683 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.221719 26102 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:25.232327 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:25.233183 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.233664 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.234516 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.236557 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.238559 21636 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:25.232376 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.239630 21487 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:25.240497 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.234072 21459 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:25.248345 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.206043 26304 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:08:25.250157 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:25.251194 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.253274 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.229817 26198 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:25.254889 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.255141 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.238162 26317 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:25.256860 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.232832 26325 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:25.247941 26102 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:25.285655 26317 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:25.289186 26317 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.290133 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:25.291327 26240 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:25.291767 26067 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:25.292152 26067 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.292500 26067 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.286968 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.257587 26198 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.299827 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.298208 21641 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:25.286252 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:25.315138 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 54957.8us
I20260709 13:08:25.317546 21486 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:25.319437 26449 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:25.325273 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.266335 26325 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:25.332213 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46096.5us
I20260709 13:08:25.328610 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:25.343385 21643 raft_consensus.cc:2410] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:08:25.336845 21564 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.349126 21637 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:25.347654 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:25.355036 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.361915 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.341871 26290 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:25.365989 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.367759 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.380378 21637 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 5.
I20260709 13:08:25.371721 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:25.358843 26321 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:25.383868 21486 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
W20260709 13:08:25.394047 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.399008 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2344) took 1512 ms. Trace:
I20260709 13:08:25.347731 26449 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:08:25.400651 26102 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.404182 26480 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:25.370963 26290 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:25.412993 21493 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:25.400007 26240 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:25.421195 26290 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.399493 21566 rpcz_store.cc:276] 0709 13:08:23.841115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.480837 (+639722us) service_pool.cc:224] Handling call
0709 13:08:24.502854 (+ 22017us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:24.503743 (+   889us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:24.714427 (+210684us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800292720. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98ad9da3c7 00007f98a9fec9a7 00007f98a9ffc0bf
0709 13:08:24.714562 (+   135us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.857199 (+142637us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:24.887850 (+ 30651us) log.cc:844] Serialized 78 byte log entry
0709 13:08:24.888009 (+   159us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:24.888236 (+   227us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.889731 (+  1495us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.889978 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.899883 (+  9905us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.052693 (+152810us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b1800292720. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:08:25.066471 (+ 13778us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b1800292720. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef5522 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:08:25.352896 (+286425us) raft_consensus.cc:1685] finished
0709 13:08:25.352925 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.353118 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":951,"prepare.queue_time_us":244436,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":141,"raft.queue_time_us":8335,"raft.run_cpu_time_us":487,"raft.run_wall_time_us":8697,"spinlock_wait_cycles":14165888,"thread_start_us":123786,"threads_started":2,"wal-append.queue_time_us":491304}
I20260709 13:08:25.400977 26329 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:25.439184 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 91651.1us
I20260709 13:08:25.414726 26321 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.421054 26334 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:25.453995 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.463594 21636 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:25.464910 21564 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:25.444945 26165 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:25.468969 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.424929 26067 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.479605 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:25.480408 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:25.473491 26440 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.498660 21494 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:25.503032 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.505200 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.505874 21641 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:25.512262 26067 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:25.513371 26067 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:25.513872 26067 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:25.514752 26135 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:25.515224 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.515368 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:25.516111 21635 raft_consensus.cc:2393] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:25.515332 26135 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.517153 26447 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:25.517792 26447 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:25.520768 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:25.524178 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.524766 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.533641 26301 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.486328 26165 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.534273 26301 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.535827 26165 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:25.537052 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.537201 26067 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.538404 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.518889 26447 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.539675 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.542655 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.543900 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:25.544643 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.554955 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.536464 26301 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:25.567309 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:25.593864 21642 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:25.600436 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.609148 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:25.609112 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.610392 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.614902 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.615742 21636 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:25.614352 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.617815 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:25.618278 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.619037 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.559821 26321 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:25.624958 21641 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 6.
I20260709 13:08:25.625905 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.629446 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.599438 26135 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:25.633095 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:25.636749 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.636023 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.644261 21636 raft_consensus.cc:2368] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6.
I20260709 13:08:25.647656 21641 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:25.597716 26290 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.651889 21642 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:25.655822 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.750381 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.753425 21639 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:25.659224 26445 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:25.761906 21639 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:25.762163 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 129256us
I20260709 13:08:25.763139 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:25.764636 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:25.765415 26445 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:25.771087 26290 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:25.780830 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 336237us
I20260709 13:08:25.781225 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:25.782290 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.757316 26135 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.779332 26480 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:25.793828 21638 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.043s	sys 0.070s
W20260709 13:08:25.798090 21638 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.043s	sys 0.070s
I20260709 13:08:25.801787 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:25.805681 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 325301us
I20260709 13:08:25.813776 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:25.792579 26135 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.791384 26325 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:25.826464 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.813261 26480 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:25.829099 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.829818 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.833680 21642 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:25.832854 21640 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:25.832132 21641 raft_consensus.cc:2376] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14. Re-sending same reply.
I20260709 13:08:25.820231 26445 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:25.834410 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.814018 26198 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.846412 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:25.845837 26480 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:25.853314 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.825994 26165 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:08:25.853761 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.855795 21641 raft_consensus.cc:2410] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:08:25.853613 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.839107 26445 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:25.856190 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56257.9us
I20260709 13:08:25.859668 21643 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:25.860177 26523 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:25.859580 26480 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.858435 21636 raft_consensus.cc:2376] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15. Re-sending same reply.
I20260709 13:08:25.833146 26459 ts_tablet_manager.cc:1929] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:08:25.872841 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.880227 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.881464 21641 raft_consensus.cc:2410] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:25.866206 26445 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.888955 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:25.892045 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:25.889920 21639 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:25.891554 21459 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:25.894181 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:25.895112 21641 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:25.899412 26524 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:25.901774 26198 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:25.902012 26325 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:25.904191 26240 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:25.904755 26240 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:25.905658 26240 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:25.907367 26522 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:08:25.909618 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:25.911043 21634 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:25.893093 26459 log.cc:1199] T 377467a782f94dd2b6e76b88920dfb8b P 5a34fd3290de493eb6bbe828dd742772: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/wals/377467a782f94dd2b6e76b88920dfb8b
I20260709 13:08:25.916499 26459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43140 (request call id 0) took 3084 ms. Trace:
I20260709 13:08:25.917200 26135 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:25.916882 26459 rpcz_store.cc:276] 0709 13:08:22.922585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.940126 (+ 17541us) service_pool.cc:224] Handling call
0709 13:08:23.425681 (+485555us) ts_tablet_manager.cc:1151] Deleting tablet 377467a782f94dd2b6e76b88920dfb8b
0709 13:08:23.425836 (+   155us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:25.347643 (+1921807us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:25.826494 (+478851us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:25.916389 (+ 89895us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1026966,"tablet-delete.queue_time_us":433809,"thread_start_us":348931,"threads_started":1}
I20260709 13:08:25.877278 26530 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:25.918999 26530 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:25.920083 26530 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.921366 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:25.922313 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:25.923156 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:25.923851 26462 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:25.924559 26067 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:25.925108 26067 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:25.925985 26067 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:25.926837 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 132776us
I20260709 13:08:25.924590 26462 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:25.930263 26462 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.934984 26342 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:25.935578 26352 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.935673 26342 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:25.937137 26342 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:25.938280 26240 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.924010 26527 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:25.945748 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 58599.9us
I20260709 13:08:25.960346 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:25.961280 21561 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:25.961585 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:25.962092 21568 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:25.962177 21562 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.966009 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:25.968225 26301 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:25.969245 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.969062 26301 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:25.971357 21560 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:25.966599 21565 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.973469 26301 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:25.973691 26317 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:25.974304 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.974220 26317 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:25.969753 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.938714 26342 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.976526 26317 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:25.978957 26135 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:25.979715 26135 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:25.980343 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 52307.4us
I20260709 13:08:25.991374 21562 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:25.962338 21561 pending_rounds.cc:85] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 10
I20260709 13:08:25.919590 21376 catalog_manager.cc:5028] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): tablet 377467a782f94dd2b6e76b88920dfb8b (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:08:26.010079 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:26.020799 21568 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:25.952535 26329 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:26.002657 21561 pending_rounds.cc:107] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:08:26.025517 21561 raft_consensus.cc:2889] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:26.025681 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.027191 21532 leader_election.cc:400] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8.
I20260709 13:08:26.027680 21532 leader_election.cc:403] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:26.035415 21376 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 115969us
I20260709 13:08:25.983661 26447 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:25.983929 26135 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.011163 26527 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:08:26.057472 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47534.8us
I20260709 13:08:26.063707 26135 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.067489 26334 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.071219 26334 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.071098 26135 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.073467 26334 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:26.073910 26135 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.070401 26165 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.067605 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.002110 26321 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:08:26.076063 21637 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:08:26.082742 26441 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:26.083359 26301 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8.
I20260709 13:08:26.083017 21388 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 8 to 11, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:26.048458 26484 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:08:26.085266 21388 catalog_manager.cc:5697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 8 to 10, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 10 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:26.088492 21642 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:26.059545 26480 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:26.091579 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 153701us
I20260709 13:08:26.063268 21641 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:26.104493 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:26.050590 26447 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:26.085284 26345 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.131246 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 72968.9us
W20260709 13:08:26.133029 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 85491.1us
W20260709 13:08:26.126148 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 143547us
I20260709 13:08:26.114831 26447 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.134563 21565 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
W20260709 13:08:26.136143 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 66410.5us
I20260709 13:08:26.136584 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.106006 26165 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:26.151404 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.130656 26480 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:26.159376 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:26.135387 26546 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.139091 26290 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:26.155977 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 93505us
W20260709 13:08:26.156889 26440 consensus_meta.cc:287] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.655s	user 0.014s	sys 0.000s
I20260709 13:08:26.138916 26345 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.177233 26290 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.177677 26445 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.090754 26527 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.183656 26290 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:26.184594 26345 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.166286 26325 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:26.186650 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:26.194253 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.195052 26445 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:26.196146 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.197003 26480 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:26.197778 26480 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.195662 26445 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.141743 26542 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:26.191017 26301 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:26.203868 26301 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:26.204289 26542 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:26.204794 26542 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:26.204937 26301 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.206501 26301 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:26.194414 21566 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:26.192157 21388 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 4 to 13, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 13 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:26.214519 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.216360 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:08:26.188544 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.205750 26542 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.223018 26445 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:26.226908 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.210011 26462 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.240922 26462 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.241945 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:26.242537 21635 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:26.243144 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.244495 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.244679 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.245316 21641 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:26.245509 21485 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 13: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:26.246291 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.246759 26165 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.246888 21642 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:26.243144 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:26.247473 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.247792 21643 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.247951 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.248597 21637 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:26.248773 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.249156 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.249488 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.249800 26549 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:26.250252 26549 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.250630 26549 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:26.247206 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.251150 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.251688 21487 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:26.192625 26325 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.252640 26325 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:26.252843 26554 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:26.253415 26554 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.179766 26546 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.255751 26554 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.255805 26480 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:26.256490 26546 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.238945 26198 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.257586 26198 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.258000 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:26.259399 26542 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.259722 26198 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:26.252242 26550 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:26.230873 26329 raft_consensus.cc:2764] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:08:26.250270 21638 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:26.250422 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:26.230548 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 78059us
I20260709 13:08:26.272814 21635 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:26.277129 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:26.278741 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:26.278880 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:26.279477 22245 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:26.282078 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:26.282115 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.287096 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.287259 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.297667 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:26.302282 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.304489 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.304754 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.311450 21642 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:26.305629 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.312381 21637 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:26.304513 26552 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.285953 26329 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.316992 26329 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.316064 21388 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 11 to 12, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 12 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.285282 26546 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:26.318884 26198 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:26.287974 21635 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:26.316192 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.319262 26329 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:26.319335 26198 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.320003 26198 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:26.319685 21388 catalog_manager.cc:5697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.322253 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.321401 26329 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:26.321903 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:26.322917 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 173086us
I20260709 13:08:26.323220 22245 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:26.285105 26445 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:26.321239 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:26.322486 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 72139.8us
I20260709 13:08:26.324419 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.323616 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:26.325904 22242 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:26.325599 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.329762 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.330448 21635 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:26.330982 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.335505 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.336249 21637 raft_consensus.cc:2368] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6.
I20260709 13:08:26.341321 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.343432 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.346889 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:26.347360 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.347851 21643 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:26.348773 21459 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:26.329270 26527 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:26.327104 26445 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:26.333407 26240 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.351116 22247 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:26.335228 26552 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.356632 22247 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:26.343214 26334 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:26.367534 21388 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 6 to 10, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 10 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.363387 26527 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:26.390020 26198 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.390224 26527 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.356349 26445 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.355684 26462 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:26.356602 26240 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.393949 26135 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.351716 26329 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.392813 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.349781 26321 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.398916 21388 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:26.407186 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82841.1us
I20260709 13:08:26.407445 26321 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.408097 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.409902 26321 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.410240 26342 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:26.413529 26550 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:26.366870 26433 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:26.394186 26554 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:08:26.400096 26352 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:26.415637 26352 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:26.416194 26462 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:08:26.417512 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.340231 26447 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.420214 21388 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 5 to 7, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 7 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:26.422255 21388 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.424265 21388 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:26.427512 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 80240.2us
I20260709 13:08:26.428221 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:26.428977 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 89337.8us
I20260709 13:08:26.404716 22247 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.433444 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:26.433455 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:26.398958 26532 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:26.435082 22247 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.405985 26240 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.440402 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:26.440683 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:26.432514 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:26.443341 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.447290 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.416523 26352 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.448082 21568 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
W20260709 13:08:26.452225 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.452800 26382 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.457484 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.461426 21482 tablet_service.cc:1558] Processing DeleteTablet for tablet 377467a782f94dd2b6e76b88920dfb8b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:43140
I20260709 13:08:26.465134 21532 leader_election.cc:400] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6.
I20260709 13:08:26.465525 21532 leader_election.cc:403] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:08:26.466674 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.471426 21488 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:26.480811 26198 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:26.437770 26329 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:26.481685 26329 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.482105 26329 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:26.483237 21390 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 247) took 18304 ms (client timeout 15000 ms). Trace:
I20260709 13:08:26.437278 26532 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:26.488626 26532 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.462513 26301 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:26.489483 26445 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.490523 26301 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6.
I20260709 13:08:26.491236 26301 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.492799 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.493023 26542 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:26.435473 26554 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:26.496501 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:26.500357 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45211.9us
I20260709 13:08:26.503340 22247 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
W20260709 13:08:26.506539 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 111311us
W20260709 13:08:26.517486 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 50879.9us
I20260709 13:08:26.518571 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.521377 26565 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:26.417672 26135 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.523783 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.541821 21561 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:26.549510 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:26.483647 21390 rpcz_store.cc:269] 0709 13:08:08.178744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.178986 (+   242us) service_pool.cc:224] Handling call
0709 13:08:26.483016 (+18304030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:22.490271 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:22.627015 (+136744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:22.629356 (+  2341us) write_op.cc:435] Acquired schema lock
0709 13:08:22.631052 (+  1696us) tablet.cc:662] Decoding operations
0709 13:08:22.713726 (+ 82674us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:22.713788 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:22.713828 (+    40us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:08:22.714564 (+   736us) tablet.cc:701] Row locks acquired
0709 13:08:22.714584 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:22.714773 (+   189us) write_op.cc:270] Start()
0709 13:08:22.714936 (+   163us) write_op.cc:276] Timestamp: P: 1783602502714723 usec, L: 0
0709 13:08:22.714965 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:08:22.717024 (+  2059us) log.cc:844] Serialized 3326 byte log entry
0709 13:08:23.914281 (+1197257us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:24.159638 (+245357us) op_driver.cc:464] REPLICATION: finished
0709 13:08:24.164034 (+  4396us) write_op.cc:301] APPLY: starting
0709 13:08:24.164150 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:24.303693 (+139543us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:24.303774 (+    81us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:24.658253 (+354479us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:24.658756 (+   503us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:08:24.661599 (+  2843us) write_op.cc:312] APPLY: finished
0709 13:08:24.665436 (+  3837us) log.cc:844] Serialized 81 byte log entry
0709 13:08:24.669392 (+  3956us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.672474 (+  3082us) write_op.cc:454] Released schema lock
0709 13:08:24.672560 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:24.673186 (+   626us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.673215 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":296175,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":4104,"apply.run_cpu_time_us":21375,"apply.run_wall_time_us":509051,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37535,"num_ops":8,"prepare.queue_time_us":229667,"prepare.run_cpu_time_us":55012,"prepare.run_wall_time_us":384878,"raft.queue_time_us":96585,"raft.run_cpu_time_us":1375,"raft.run_wall_time_us":5321,"replication_time_us":1444461,"spinlock_wait_cycles":161175424,"thread_start_us":307243,"threads_started":4,"wal-append.queue_time_us":216808,"wal-append.run_cpu_time_us":62957,"wal-append.run_wall_time_us":2764442}]]}
W20260709 13:08:26.523908 26546 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:26.561991 26563 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:26.558967 26301 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:26.562064 26553 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:26.563815 26466 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:26.564330 26553 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:26.564715 26553 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.565075 26553 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:26.566329 26561 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:08:26.567608 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.567706 26564 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:26.571736 26352 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:26.574863 26553 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.577173 26553 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.430228 26462 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.587560 26290 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:26.588155 26290 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:26.590374 21566 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:26.547767 26067 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:26.589207 26290 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.608165 26290 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:26.615357 21608 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.650s (SENT)
I20260709 13:08:26.505882 26549 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.637780 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:26.499056 26382 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.646270 26552 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:26.659868 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:08:26.686345 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 71037.7us
I20260709 13:08:26.697005 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:26.697742 22244 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:26.614749 26532 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.707995 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.702057 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.703140 21643 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:26.708899 21635 raft_consensus.cc:2410] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 13:08:26.709790 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 160358us
I20260709 13:08:26.721092 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:26.721334 22242 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:26.649840 26325 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.728565 21642 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:26.725819 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:26.729882 21638 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
W20260709 13:08:26.734884 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 242140us
I20260709 13:08:26.714409 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:26.748879 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:26.750166 26301 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.750661 26301 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.750813 26135 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.751116 26301 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:26.712677 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet eae01b9fdd5340dc9416e5834263a4d6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5a34fd3290de493eb6bbe828dd742772 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:26.759467 21376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 60560.6us
I20260709 13:08:26.760181 26325 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:26.761587 26329 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.763995 26329 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:26.760237 26532 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.767364 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.770205 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:26.770882 26532 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.771764 26532 raft_consensus.cc:2764] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:26.776199 21376 catalog_manager.cc:5028] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): tablet 377467a782f94dd2b6e76b88920dfb8b (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:08:26.732957 26198 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:26.780725 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.782653 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:26.782769 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:26.734191 26447 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:26.795645 26382 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:26.785094 26135 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:26.798257 26135 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:26.766657 26240 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.799312 26135 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.801194 26240 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:26.789698 26329 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:26.802193 26329 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:26.802665 26549 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.784628 26198 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.801563 26445 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:26.785424 26466 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.822170 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:26.824892 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 372374us
I20260709 13:08:26.825809 26563 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.822781 26240 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.819613 26198 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.826993 26572 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.827580 26549 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.843760 26549 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.845243 26301 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.846268 26549 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:26.810588 26447 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:26.847170 26447 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.849452 26447 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.853063 26240 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.838990 26563 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:26.858161 26563 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:26.859385 26582 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:26.803223 26329 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.830309 26573 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:26.831326 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:26.832257 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:08:26.836414 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45484.2us
I20260709 13:08:26.840641 21488 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:26.821604 26527 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:26.869123 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.866456 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:26.858501 26301 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:26.868886 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:26.863339 26572 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:26.877739 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46474.3us
I20260709 13:08:26.878821 26564 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:26.895561 26564 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:26.895663 26240 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:26.896696 26564 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.898106 26564 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.879731 26547 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:26.880064 26466 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:26.898819 26546 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:08:26.899490 26466 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.880725 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:26.881587 26565 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.867820 26342 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.882014 26570 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:26.878823 26575 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:08:26.883630 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:26.892731 21532 leader_election.cc:400] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 5 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 5. Current term is 6.
I20260709 13:08:26.899963 26466 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:26.907099 26575 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:26.907336 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:26.907701 26575 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:26.908316 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.865393 26573 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:26.909577 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:26.915503 21568 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:26.877138 26382 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:26.930102 21566 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:26.937312 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:26.900732 26572 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.909355 26569 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.909691 26573 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:26.904861 26547 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:26.904558 26565 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:26.956346 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48083.6us
W20260709 13:08:26.940975 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.944988 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:26.909502 26290 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:26.927992 26382 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:26.953658 21564 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:08:26.939589 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 47034us
I20260709 13:08:26.875170 26527 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.908636 26575 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.947870 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:26.974591 26560 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:26.975167 21490 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:26.975318 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.975302 26560 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.975876 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:26.962527 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:26.966512 21561 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:26.939046 26583 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.980840 21493 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:26.982877 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.988813 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:26.993362 26447 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.993796 26447 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:26.994432 26447 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.994917 26135 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:26.995626 26582 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:26.996078 26582 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:26.997067 26582 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.958652 26565 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.014955 26583 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.015455 26583 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.963773 26382 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:27.009362 26527 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:26.993723 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:26.923812 26342 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:26.991020 21487 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:27.022228 21562 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:27.022579 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:27.031906 26135 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:27.033434 26135 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.035048 26549 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:26.986215 26165 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:27.056982 21608 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.985s (SENT)
I20260709 13:08:27.061792 26547 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.060122 26572 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.062027 26582 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.067473 26572 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:27.073159 26342 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:27.057754 26165 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.089650 26165 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:27.051550 26301 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:27.094966 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.098948 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.104655 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.020694 26198 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:27.109395 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 133550us
I20260709 13:08:27.110589 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:27.112891 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.113991 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 58547.6us
I20260709 13:08:27.115212 21532 leader_election.cc:400] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8.
I20260709 13:08:27.112157 26290 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:27.143659 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:27.144102 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 87169.5us
I20260709 13:08:27.153595 21459 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:27.111011 26165 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:08:27.122503 26560 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:27.121886 26527 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:08:27.120765 26466 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.146167 26570 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:27.184085 26530 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:27.211334 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.212987 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:27.211283 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 64503us
I20260709 13:08:27.215973 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:27.217881 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:27.220201 26564 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:27.220533 26580 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:27.220970 26275 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.222754 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:27.223811 26585 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:08:27.224419 21490 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:27.224231 26290 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.225474 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.213640 26596 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:27.210954 26546 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.234002 26546 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.236224 26546 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:27.237036 21562 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:27.237972 26583 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.239122 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.239871 21568 raft_consensus.cc:2393] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 11: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:27.239817 21564 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:27.241804 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.242990 26582 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:27.243741 21494 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:27.245005 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:27.246680 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.249022 26198 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:27.214690 26342 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.250710 26342 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.212875 26530 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:27.251858 26530 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.251951 26565 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.252926 26342 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:27.256322 26466 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:27.259214 26564 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.260651 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:27.262710 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.242481 26447 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.269410 26564 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:27.269982 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.265941 26382 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.268519 26275 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.278849 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:27.271435 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 52403.1us
I20260709 13:08:27.281647 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:27.279655 21564 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:27.282930 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.282666 26596 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:27.288372 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:27.289106 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.289950 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:27.290583 21562 raft_consensus.cc:2410] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:27.292243 21487 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:27.254623 26565 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:27.289528 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:27.293771 21489 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:08:27.299598 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:27.278599 26329 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.303319 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.307675 26572 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:27.308239 26572 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.308674 26572 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.290968 26466 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:27.311050 26466 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:27.311695 26466 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.311008 26329 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.315336 26329 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:27.315744 26556 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:27.317672 26573 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.318022 26556 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:27.307713 26583 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:27.318763 21565 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:27.318914 26596 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.329841 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.331776 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.334141 21561 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:27.335788 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:27.336654 21638 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.299199 26582 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:27.342176 21562 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:27.344178 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.345084 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.347193 21563 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.348022 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:27.303455 26484 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:27.279083 26550 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:08:27.364823 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.370186 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:27.373665 21569 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:27.370541 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:27.374555 22247 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.377347 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.380645 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:27.355085 26484 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.387166 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:27.388649 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:27.390429 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.391937 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.393103 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.367233 26580 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.397768 22247 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:08:27.404979 21565 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:27.435668 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.436841 21562 raft_consensus.cc:2410] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:27.440429 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.392997 26484 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.441110 21569 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:27.451009 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:27.453178 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.453967 21487 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:27.452777 21563 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:27.454918 21565 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:27.479096 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.408347 26275 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:08:27.502499 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.456923 26588 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:08:27.533627 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.453168 26582 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:27.410629 26580 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.432608 26583 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 13:08:27.554266 26600 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:27.594091 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.554311 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:27.596849 26580 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:27.560739 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.597939 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.598332 21569 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:08:27.601007 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.601265 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.602029 21562 raft_consensus.cc:2368] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:08:27.447206 26595 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:08:27.603178 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:27.603817 21642 raft_consensus.cc:2376] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16. Re-sending same reply.
I20260709 13:08:27.457173 26382 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:27.587821 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:27.605055 21641 raft_consensus.cc:2376] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13. Re-sending same reply.
I20260709 13:08:27.590229 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:27.611367 21635 raft_consensus.cc:2410] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:27.612247 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:27.613402 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:27.614331 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:27.615135 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:27.615896 21643 raft_consensus.cc:2368] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12.
I20260709 13:08:27.616892 21643 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:27.618161 21643 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:08:27.618470 21643 pending_rounds.cc:85] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 8
I20260709 13:08:27.619118 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:27.621227 21634 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:27.626029 26572 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.626466 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:27.603870 26595 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:27.657956 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:27.666541 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:27.650144 21641 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:27.654124 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.658725 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:27.698318 21562 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.698807 21636 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.657102 22247 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:27.657636 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:27.662904 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:27.658602 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:27.649266 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.653496 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.703976 21563 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:27.618692 21643 pending_rounds.cc:107] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:27.705396 21643 raft_consensus.cc:2889] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:27.658027 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:27.713165 22245 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:27.714159 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:27.714828 22238 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:27.714913 26532 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:27.715416 26532 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:27.716341 26532 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.714921 26198 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.717754 26198 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.719926 26198 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:27.720625 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.720494 26466 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.665926 26447 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:27.721582 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 22b45f3e8b8e428ea4709e7e9ee43868 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5a34fd3290de493eb6bbe828dd742772 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:27.654950 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.564864 26329 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.722177 26595 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:27.663210 21561 pending_rounds.cc:85] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 5
I20260709 13:08:27.729501 21561 pending_rounds.cc:107] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:08:27.729779 21561 raft_consensus.cc:2889] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:27.723059 22244 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:27.677531 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.734517 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.728724 21638 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
W20260709 13:08:27.636067 26599 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:08:27.631655 26591 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
W20260709 13:08:27.632447 26602 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:08:27.631213 26597 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
W20260709 13:08:27.750265 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.737838 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.758337 21563 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:27.741669 21638 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:27.722640 26466 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:27.742200 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:27.631865 26240 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.640257 26325 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.744693 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.635141 26573 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:27.782104 21638 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:27.758992 21636 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
W20260709 13:08:27.733695 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 346634us
I20260709 13:08:27.760856 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.765354 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.785542 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.786231 21565 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:27.765877 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.775415 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:27.768567 21457 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06b5fb42c147456889a1843340b22720. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.733338 26198 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:27.780417 21490 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:27.788187 21566 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:27.779858 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.788499 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.795739 21641 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:27.788688 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:27.792985 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:27.792100 21563 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:27.732604 26530 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.736507 26329 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.806476 21562 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:27.901645 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:27.900975 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:27.901943 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 113341us
I20260709 13:08:27.902271 21489 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.902567 21563 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:27.902827 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:27.796348 21569 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:27.903474 21642 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:27.903497 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.905390 21563 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:27.906454 21639 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:27.907805 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.910766 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:27.911056 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:27.911887 22241 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:27.913445 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:27.913962 22241 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.918944 21567 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:27.921479 22241 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:27.928088 21564 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:27.929360 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.935344 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:27.942008 26572 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:27.780884 26240 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:27.944506 26560 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:27.944983 26560 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:27.945622 26240 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:27.945837 26560 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.948486 26530 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:27.949070 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:27.950376 26329 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:27.815306 26325 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:27.953099 26325 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:27.953768 26560 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.953577 26609 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:27.956499 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.910979 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:27.979686 21562 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:27.960247 21569 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: [11.7-12.8]
I20260709 13:08:27.970060 21563 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:27.971274 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 68552.3us
I20260709 13:08:27.968447 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.003916 21490 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.004580 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.014079 22244 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:28.017839 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49534.7us
I20260709 13:08:28.021821 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:27.910250 26583 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:28.017498 22241 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:28.017554 22247 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:27.969738 26329 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.980593 26549 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:28.021445 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:28.032567 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.032384 26549 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:28.031824 26583 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:28.033433 26583 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.034974 26549 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:28.031960 26329 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:28.036616 26607 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:08:28.018594 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:28.038849 26240 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:28.039577 26240 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:28.042351 26240 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:28.045156 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:28.045552 26240 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.045785 26550 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.046271 26240 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:28.047235 26240 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:28.029417 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:28.037954 26329 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:28.044788 21608 leader_election.cc:400] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:08:28.052414 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.046638 26550 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.055378 26550 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:28.018175 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.056777 26549 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.059615 26329 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.061657 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.062599 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:27.979945 26570 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:28.027038 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 301738us
I20260709 13:08:28.069036 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.074942 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:28.085516 21488 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:28.075321 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:28.086845 21643 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:28.088227 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:28.090242 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:28.090451 21490 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.092658 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.093611 21640 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:28.029040 26552 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:28.099679 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:28.096306 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:28.097744 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:28.101241 21635 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.789883 26595 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:28.106081 21641 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:28.102766 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.013535 26530 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:08:28.065742 26329 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.113855 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:28.085721 26549 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.115509 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.118173 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:28.065564 26240 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:28.122012 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:28.111626 26342 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:28.127547 26342 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.128103 26342 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.112790 26573 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.103500 26572 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.131206 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:28.133252 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:28.134532 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:28.139194 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.139699 26329 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:28.140441 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:28.141295 26329 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:28.142022 21638 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:28.143558 21638 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:08:28.148094 21569 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:28.116039 26352 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:28.149304 21569 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:28.149770 26552 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:28.150821 21643 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:28.151257 26606 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:28.148669 21638 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.151749 26606 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:28.152204 26606 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.152933 21638 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:28.153396 21567 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.154603 21638 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:08:28.157307 26484 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.701s	user 0.009s	sys 0.001s
I20260709 13:08:28.157749 26484 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.158799 22247 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:28.159754 26466 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:28.160197 26466 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:28.161171 26466 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.163493 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:28.168318 22244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:28.169010 22244 raft_consensus.cc:606] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.170676 21489 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:28.175266 21566 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:28.177985 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.181926 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:28.158710 21643 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:28.188511 21566 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:28.190518 21567 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:28.185050 21563 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:28.194516 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 117225us
I20260709 13:08:28.162554 26466 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:28.214241 21635 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:28.191929 26548 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:28.258389 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46165.4us
I20260709 13:08:28.260250 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.264604 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:28.202921 26198 consensus_queue.cc:1243] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:08:28.271775 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55819.5us
I20260709 13:08:28.273021 21457 leader_election.cc:400] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12.
I20260709 13:08:28.221547 26484 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:28.280639 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.150754 26552 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.293774 22247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
W20260709 13:08:28.283126 26607 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:28.308058 26603 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.307662 26530 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:28.309834 26542 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.310367 26542 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:28.311453 26542 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:28.332258 26595 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.340369 21639 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.294590 22247 raft_consensus.cc:606] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:28.341331 21639 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:28.282735 26447 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.350955 26484 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.351670 26484 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.359503 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:28.290086 26612 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.283978 26527 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:08:28.263917 26240 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:28.264714 26548 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:28.373736 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 255209us
I20260709 13:08:28.284289 26556 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:08:28.372284 26532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.008s	sys 0.020s
I20260709 13:08:28.387965 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.377374 21639 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:28.379024 26575 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.379035 26484 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:28.401285 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.415388 21639 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:28.400013 26532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.008s	sys 0.020s
I20260709 13:08:28.373592 26612 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.412076 26067 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:08:28.436887 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.437458 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.411648 26618 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.438476 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.420486 26240 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:28.446854 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 170337us
W20260709 13:08:28.449213 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 327517us
I20260709 13:08:28.419827 26575 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:28.452338 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.451707 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 174861us
I20260709 13:08:28.439247 26624 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:28.437098 26067 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:28.436448 26628 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.456059 26573 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:28.456969 26575 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:28.443007 26198 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:28.461910 26573 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:28.462361 26573 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:28.447276 26352 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:08:28.466740 26067 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.468061 26067 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.461313 26619 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:08:28.473058 26573 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:28.474375 26573 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.474557 26636 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:28.475739 26636 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:28.476055 26636 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:28.476771 26636 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:28.477921 26636 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:28.479183 26614 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:08:28.464310 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:28.504209 21639 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:28.504222 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.505338 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.511933 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:28.512585 22244 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:28.514597 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48699.8us
W20260709 13:08:28.515704 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.521157 26290 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.521626 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.522538 22244 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:28.523720 21635 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:28.534027 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:28.508181 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.537174 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:28.538193 21635 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:28.538630 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:28.540395 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:28.546936 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:28.551132 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:28.552053 22244 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:28.551209 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:28.552922 22247 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:28.552733 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.522279 26290 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:08:28.555711 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:28.546896 26325 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:28.560590 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.560798 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:28.557976 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.559867 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:28.562093 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.557729 26352 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.564457 26632 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.564414 26596 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.567415 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.461201 26547 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:08:28.569370 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.574862 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:28.575176 26644 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:28.575681 21636 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:08:28.576602 26629 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:08:28.576719 26596 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:28.571005 26632 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:28.579495 26616 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:08:28.575591 26644 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.557307 26550 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:28.580710 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:28.596006 22241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d086ed254594401ae567a7d3681c987"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:28.604040 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:28.627218 22241 raft_consensus.cc:606] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:28.632558 22241 raft_consensus.cc:614] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:28.627489 22242 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:28.460901 26624 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.555794 26633 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:28.566284 26603 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:28.565912 26352 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.602710 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:28.634413 26612 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:28.626626 26575 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:08:28.598742 26632 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.633488 26550 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.636993 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:28.642913 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:28.601188 26619 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:28.646565 21562 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:28.573609 26643 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.574218 26198 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:28.597698 26527 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:08:28.634723 26621 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 13:08:28.635511 26560 consensus_meta.cc:287] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.001s
I20260709 13:08:28.671506 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:28.658535 26550 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.675658 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2864) took 1061 ms. Trace:
I20260709 13:08:28.659035 26619 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.654321 21636 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:28.654474 21490 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.609014 26644 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:28.648725 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 88970.2us
W20260709 13:08:28.670176 26623 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.242s	user 0.000s	sys 0.002s
I20260709 13:08:28.580873 26569 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:08:28.667601 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:28.715386 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47909.8us
I20260709 13:08:28.663414 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:28.716150 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 135587us
I20260709 13:08:28.676087 21634 rpcz_store.cc:276] 0709 13:08:27.609846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.621994 (+ 12148us) service_pool.cc:224] Handling call
0709 13:08:27.622313 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.679732 (+ 57419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.679766 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.680387 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:08:28.069901 (+389514us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:28.393053 (+323152us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.393278 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.393349 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.670562 (+277213us) raft_consensus.cc:1685] finished
0709 13:08:28.670586 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.670732 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57006,"prepare.queue_time_us":29093,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":60106,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":16048,"thread_start_us":683176,"threads_started":2,"wal-append.queue_time_us":590472}
I20260709 13:08:28.641108 26570 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:08:28.650584 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 90074.1us
I20260709 13:08:28.718142 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.700213 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:28.573256 26556 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:08:28.720515 22245 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:28.700439 26619 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.703527 26560 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:08:28.755560 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 55439us
I20260709 13:08:28.669232 26632 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
W20260709 13:08:28.758975 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 43788.4us
I20260709 13:08:28.700006 26641 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:28.723155 26102 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:28.762096 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44071.4us
I20260709 13:08:28.768157 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.773157 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:28.770807 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 187820us
W20260709 13:08:28.779573 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 63369.6us
I20260709 13:08:28.780629 26656 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.781390 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:28.782291 22247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:28.782486 26612 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:28.782899 26612 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.781286 26656 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.783419 26612 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:28.785089 26656 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:28.782932 22247 raft_consensus.cc:606] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:28.791405 26639 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:08:28.792025 26573 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.792299 26653 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:28.792531 26573 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:28.792870 26653 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.793421 26573 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:28.795138 26532 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:28.795545 26532 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:28.796394 26532 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:28.797601 26532 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.800298 26646 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:28.800766 26646 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.775889 26352 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:28.801663 26352 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.802009 26352 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.770500 26647 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:28.802935 26647 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.803277 26647 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:28.803417 26549 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.002s
I20260709 13:08:28.803920 26549 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.801131 26646 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.817574 21485 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:28.804664 21569 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:28.758090 26560 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:28.808717 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.811484 21566 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:28.807441 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:28.825857 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2390) took 1182 ms. Trace:
I20260709 13:08:28.828210 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3131) took 1091 ms. Trace:
I20260709 13:08:28.829713 21561 rpcz_store.cc:276] 0709 13:08:27.643035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.662588 (+ 19553us) service_pool.cc:224] Handling call
0709 13:08:27.662963 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.743422 (+ 80459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.743451 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.743922 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:08:28.200880 (+456958us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:28.200927 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.201005 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.825524 (+624519us) raft_consensus.cc:1685] finished
0709 13:08:28.825558 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.825768 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":293065,"threads_started":1,"wal-append.queue_time_us":598028}
I20260709 13:08:28.829900 21560 rpcz_store.cc:276] 0709 13:08:27.736328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.916581 (+180253us) service_pool.cc:224] Handling call
0709 13:08:27.917033 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.917349 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.917375 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.918252 (+   877us) log.cc:844] Serialized 513 byte log entry
0709 13:08:28.103667 (+185415us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:28.103710 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.103774 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.827907 (+724133us) raft_consensus.cc:1685] finished
0709 13:08:28.827941 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.828132 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":179758,"threads_started":1,"wal-append.queue_time_us":365497}
I20260709 13:08:28.761474 26633 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:28.774106 26165 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:28.801136 26342 consensus_meta.cc:287] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.001s
W20260709 13:08:28.920266 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 85595.1us
I20260709 13:08:28.794710 26573 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:28.930498 26645 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:08:28.931092 26572 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:28.931265 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 124460us
I20260709 13:08:28.931648 26653 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:28.926608 26575 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.935177 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 215901us
I20260709 13:08:28.935474 22244 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:08:28.947635 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 174577us
I20260709 13:08:28.995733 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.996989 26628 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.997503 26628 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:28.998523 26628 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:28.950109 26583 consensus_meta.cc:287] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.916s	user 0.004s	sys 0.007s
I20260709 13:08:28.999922 26628 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.972741 26603 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:29.000414 26583 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.001474 21493 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.984894 26612 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:28.988430 26595 consensus_meta.cc:287] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 13:08:28.992352 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:29.017395 21639 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:28.969359 26550 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.006924 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.008455 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:28.932446 26643 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:29.014540 21493 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:28.924204 26546 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:28.991888 26640 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:08:28.761874 26198 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.016004 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:29.019160 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:29.045691 21494 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:29.046609 21490 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:29.049259 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.049578 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:29.056262 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:29.060755 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53470.9us
I20260709 13:08:29.061573 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:29.015612 26329 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.943157 26342 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:29.083630 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.078827 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1822) took 1096 ms. Trace:
I20260709 13:08:29.091576 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.083300 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:29.068864 26542 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.070938 26633 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.092267 21561 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 8.
I20260709 13:08:29.091665 21485 rpcz_store.cc:276] 0709 13:08:27.981915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.982028 (+   113us) service_pool.cc:224] Handling call
0709 13:08:29.078501 (+1096473us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54002774d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:29.078677 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496477056}
W20260709 13:08:29.077764 26466 consensus_meta.cc:287] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.867s	user 0.007s	sys 0.002s
I20260709 13:08:29.077473 26352 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.078073 26548 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:29.041765 26572 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:08:29.041126 26165 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:29.045538 26560 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.023411 26569 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:29.066594 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:29.076028 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:29.093364 21565 raft_consensus.cc:2376] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10. Re-sending same reply.
W20260709 13:08:29.141774 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 75249.7us
I20260709 13:08:29.143811 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.144611 21561 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:29.082108 26440 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:29.011283 26575 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.023334 26382 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:08:29.041405 26547 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:08:29.063090 26603 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:29.119315 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.085695 26612 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:29.136885 22245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 815) took 1111 ms. Trace:
W20260709 13:08:29.137413 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 75945.3us
I20260709 13:08:29.165627 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:29.130476 26640 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:29.138236 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.088884 26329 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.083096 26652 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:08:29.139542 26646 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.178313 26447 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:29.178748 26447 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:29.179104 26646 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:29.179298 26240 consensus_meta.cc:287] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.732s	user 0.007s	sys 0.002s
I20260709 13:08:29.179790 26240 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:29.179616 26447 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.180272 26240 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.180636 26646 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:29.181129 26646 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.160607 26440 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.182449 26440 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:29.187675 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.172533 21569 raft_consensus.cc:2376] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12. Re-sending same reply.
W20260709 13:08:29.083484 26630 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:08:29.085291 26550 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:29.088017 26606 consensus_meta.cc:287] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.935s	user 0.011s	sys 0.000s
I20260709 13:08:29.065681 26624 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:29.160501 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.141604 21566 raft_consensus.cc:2376] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13. Re-sending same reply.
I20260709 13:08:29.078562 26660 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:08:29.161638 26618 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:29.167294 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:29.137892 26556 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:29.169328 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:29.164904 22245 rpcz_store.cc:276] 0709 13:08:28.025701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.025847 (+   146us) service_pool.cc:224] Handling call
0709 13:08:28.068734 (+ 42887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.725123 (+656389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.136672 (+411549us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54005fdcd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:29.136810 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498305280}
I20260709 13:08:29.171470 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.139592 26325 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:29.175673 26165 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.087903 26644 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.088459 26583 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:29.255076 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 236018us
I20260709 13:08:29.180652 26447 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:29.250016 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 80809.6us
I20260709 13:08:29.173470 26532 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:29.253966 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 86786.7us
I20260709 13:08:29.191295 26603 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:29.191428 26546 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.191380 26462 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:29.251909 26067 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.783s	user 0.014s	sys 0.006s
W20260709 13:08:29.262884 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 211799us
W20260709 13:08:29.256368 26640 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:29.255214 26549 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:29.245709 26618 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:29.267354 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:29.266906 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.138679 26647 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.187076 26654 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:08:29.272025 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:29.270404 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.296527 21561 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:29.276803 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:29.297254 21569 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.162113 26569 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.273696 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:29.258116 26530 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:29.258641 26240 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:29.252367 26624 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:29.312422 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:29.312927 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:29.298774 21639 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:08:29.265621 26462 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:29.266956 26646 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:29.195740 26641 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:29.313047 21636 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:29.312258 21643 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:29.311466 22242 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:29.322840 21639 pending_rounds.cc:85] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 6
I20260709 13:08:29.269799 26325 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:29.324033 21641 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:29.313937 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:29.246502 26606 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.328263 21639 pending_rounds.cc:107] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:08:29.335224 21639 raft_consensus.cc:2889] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:29.263319 26661 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:08:29.337713 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:29.308954 26657 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:29.340643 22244 raft_consensus.cc:2368] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12.
I20260709 13:08:29.341588 21640 raft_consensus.cc:2368] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13.
I20260709 13:08:29.337097 21487 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:29.343151 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:29.267627 26546 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.312495 26549 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:29.347911 22241 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:29.326036 26580 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:29.350267 21565 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:29.332757 26548 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:29.353919 26663 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:08:29.338923 26530 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:29.313079 26067 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:08:29.294183 26653 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 13:08:29.380499 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.352106 26632 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:29.378152 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.360692 26647 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:29.364575 26569 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:29.348881 26657 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:29.385391 26657 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.387895 26352 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:29.361776 26575 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:29.370067 26530 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.361336 26644 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:29.392956 26635 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:29.393486 26635 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:29.367261 26549 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.326323 26624 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.339351 26646 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:08:29.402431 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:29.355590 26527 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:29.339720 26325 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.398025 26447 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:29.415503 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:29.417636 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:29.421897 22244 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.359035 26580 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:29.375588 26606 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:29.420941 21457 leader_election.cc:400] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12.
I20260709 13:08:29.368801 26546 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:29.423707 21563 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:29.399860 26633 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:29.430680 21457 leader_election.cc:403] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:29.453640 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:29.461022 22241 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:29.456446 22244 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:29.352509 26618 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.421027 26575 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:29.466746 26661 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12.
I20260709 13:08:29.467015 26618 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.467240 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.467594 26661 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:29.467969 26661 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:29.351873 26662 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.280s
I20260709 13:08:29.462533 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.409348 26527 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:29.374089 26440 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.483516 21569 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:29.430462 26067 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:29.497323 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.498569 21493 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:29.352324 26603 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.447019 26652 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:29.504237 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:29.506726 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.355212 26641 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.359907 26462 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.429044 26569 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
W20260709 13:08:29.496443 26642 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.947s	user 0.000s	sys 0.009s
I20260709 13:08:29.430732 26447 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.521502 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:29.504392 26551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.005s	sys 0.016s
I20260709 13:08:29.513639 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.496896 26546 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.498376 26067 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:29.534082 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.523950 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.535351 21493 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:29.497066 26556 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 13:08:29.523072 26551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.006s	sys 0.016s
I20260709 13:08:29.480294 26633 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.542608 26669 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:29.545732 21493 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [13.7-14.8]
W20260709 13:08:29.533726 26573 consensus_meta.cc:287] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.000s
I20260709 13:08:29.549530 26681 ts_tablet_manager.cc:933] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:08:29.578897 21562 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:29.579844 26573 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:29.539090 26067 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.580606 26573 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.540505 26569 consensus_queue.cc:1243] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 549b31ac31b6428994b45938abc223a7 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:29.587271 26606 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.592775 26606 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.506803 26661 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.537958 26546 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.517606 26652 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.587944 26352 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:29.588573 26669 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:29.537350 26580 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.598199 26552 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:29.605021 26619 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.837s	user 0.007s	sys 0.005s
I20260709 13:08:29.617532 21635 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:29.619290 26670 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.619968 26670 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:29.626312 26542 consensus_meta.cc:287] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.000s
I20260709 13:08:29.627553 26648 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:08:29.628060 26325 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:29.628731 21560 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:29.630077 26624 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:29.631242 26573 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:29.633678 21493 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:29.631598 26669 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.643101 26652 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:29.644241 26440 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:29.637375 26633 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:29.645603 26447 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:29.637467 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:29.637455 26606 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:29.616134 26619 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.657914 26619 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:29.659116 26643 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.001s
I20260709 13:08:29.659634 26643 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.658748 26660 raft_consensus.cc:2955] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:29.665213 21639 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:29.665176 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:29.665977 21643 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:29.669700 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:29.670274 21640 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
W20260709 13:08:29.675160 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.688042 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:29.741581 22247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:29.742372 22247 raft_consensus.cc:606] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:29.742861 22247 raft_consensus.cc:614] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:29.745699 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:29.746073 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 58184.5us
I20260709 13:08:29.746383 21490 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:29.746929 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:29.745718 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:29.747344 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 83437.8us
W20260709 13:08:29.746131 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 70265.7us
I20260709 13:08:29.748842 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:29.750306 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.752211 21642 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 9: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:29.752506 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:29.753118 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:29.753813 26686 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:29.754632 26686 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:29.754870 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 80851.9us
I20260709 13:08:29.755201 26686 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:29.756064 26686 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.758708 26693 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:29.759739 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.762650 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:29.763252 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:29.763404 26606 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:29.753212 26670 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:29.776409 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:29.777217 22245 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:29.760680 26102 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:29.663233 26641 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:29.765031 26447 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:29.765304 26548 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:29.744433 26624 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:29.809803 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.811525 21492 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:29.784010 26643 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.632774 26661 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.769326 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:29.801635 26662 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:29.818747 26643 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.824594 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:29.825350 21492 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.826399 26643 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:29.765561 21561 raft_consensus.cc:2955] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:29.770448 22242 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:29.830178 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.770081 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:29.753830 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:29.833230 21642 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:29.781365 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:29.789113 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.793149 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:29.796144 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:29.793231 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:29.613307 26352 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:29.843428 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.632966 26552 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.813087 22241 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:29.779333 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:29.879772 21636 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:29.772742 26560 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:29.839471 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:29.888044 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:29.888226 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48885.6us
I20260709 13:08:29.842437 21640 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:29.843742 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.801913 26641 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.801875 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.889829 21490 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:29.890988 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:29.849155 21643 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:29.842813 26198 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:29.801236 26606 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:29.853081 26657 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:29.813050 26624 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:29.842947 26662 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:29.852826 26633 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:29.876169 26546 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:29.876621 26552 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:29.876942 26696 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:29.877743 21494 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:29.886826 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:29.893851 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49181.2us
W20260709 13:08:30.005260 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 118524us
I20260709 13:08:29.921792 26352 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:29.890034 26603 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.927775 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:29.963203 26657 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:29.935595 21532 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.857s (SENT) [suppressed 19 similar messages]
I20260709 13:08:29.926966 21493 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:29.961489 21492 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:29.962177 26572 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.878083 26165 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.920723 22244 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:29.962375 26641 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:29.928262 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:30.012290 21486 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:29.922994 26067 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.023481 21457 leader_election.cc:400] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13.
I20260709 13:08:30.023803 21457 leader_election.cc:403] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:30.011719 26628 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.015502 26657 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.962620 26198 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.040365 21488 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:30.040165 22244 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:08:30.042761 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:30.038121 26628 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.048945 26628 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.051815 26632 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:30.052379 26632 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.045115 26532 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:08:30.022099 26165 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:30.056375 21487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 1824) took 2027 ms (client timeout 1857 ms). Trace:
W20260709 13:08:30.056828 21487 rpcz_store.cc:269] 0709 13:08:28.028890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.029100 (+   210us) service_pool.cc:224] Handling call
0709 13:08:30.056185 (+2027085us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b5400020654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:30.056308 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236793600}
I20260709 13:08:30.057787 26165 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.043187 26662 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.059312 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:30.060148 21634 raft_consensus.cc:2393] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:30.063828 26624 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.043392 26681 tablet_copy_client.cc:323] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:08:30.034282 26275 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13.
W20260709 13:08:30.067795 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet eae01b9fdd5340dc9416e5834263a4d6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5a34fd3290de493eb6bbe828dd742772 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:30.011279 26619 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:08:30.075812 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.019090 26572 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.080034 26606 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:30.081090 26572 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.081909 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:30.023118 26556 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:30.086148 26067 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.088747 26198 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.090586 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:30.100397 26694 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.276s	user 0.002s	sys 0.012s
I20260709 13:08:30.104377 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:30.105437 26546 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:30.106043 26546 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.106521 26546 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.116039 22244 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:30.120065 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:30.110608 26618 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.005s
I20260709 13:08:30.133064 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:30.146330 26527 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.147840 26527 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.047147 26647 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 13:08:30.163633 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 142240us
I20260709 13:08:30.164238 21635 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:08:30.167099 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:30.180908 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3160) took 1372 ms. Trace:
I20260709 13:08:30.192902 21563 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:30.184923 21568 rpcz_store.cc:276] 0709 13:08:28.808869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.810316 (+  1447us) service_pool.cc:224] Handling call
0709 13:08:28.810741 (+   425us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:28.923287 (+112546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.923321 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:28.932112 (+  8791us) log.cc:844] Serialized 78 byte log entry
0709 13:08:29.261199 (+329087us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:29.271682 (+ 10483us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.271930 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.271998 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.644327 (+372329us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b1800427a20. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:08:30.092873 (+448546us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b1800427a20. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:08:30.180617 (+ 87744us) raft_consensus.cc:1685] finished
0709 13:08:30.180648 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.180850 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25909,"prepare.queue_time_us":29490,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":36,"raft.queue_time_us":30542,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":190,"spinlock_wait_cycles":20534912,"thread_start_us":327486,"threads_started":1,"wal-append.queue_time_us":340082}
I20260709 13:08:30.110548 26635 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.279189 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.284871 21565 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:30.286620 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:30.287505 21568 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.290843 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:30.184383 26647 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:30.180107 26198 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 13:08:30.284662 26643 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.296186 26643 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.298619 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:30.299533 21492 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:30.298485 26643 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.274842 26290 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.289251 26547 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.323298 26628 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.330543 21492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:30.339538 21492 raft_consensus.cc:606] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:30.322494 26342 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:30.341841 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.333901 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:30.343256 21563 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.334755 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:30.335861 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.336915 21485 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:08:30.337522 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.345999 21485 pending_rounds.cc:85] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 12
I20260709 13:08:30.346230 21565 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:30.346256 21485 pending_rounds.cc:107] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:08:30.347342 21485 raft_consensus.cc:2889] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.347468 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:30.348552 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.336947 21568 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:30.330938 26290 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.359423 21642 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:30.360487 21459 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:30.370311 21563 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:30.344493 26660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43144 (request call id 3) took 3516 ms. Trace:
I20260709 13:08:30.388500 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:30.340248 26547 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.387773 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:30.383723 26583 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:30.358114 21503 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet 06b5fb42c147456889a1843340b22720 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:08:30.358438 26653 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:08:30.429903 26547 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:30.431018 21503 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet 06b5fb42c147456889a1843340b22720 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-06b5fb42c147456889a1843340b22720
I20260709 13:08:30.431085 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:30.432121 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:30.432797 21492 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:30.431135 21634 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:30.434118 21634 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:30.434897 21634 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.435883 26628 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.436149 21634 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.399712 26661 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:30.403681 26583 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:30.437430 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:30.439572 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51882.8us
I20260709 13:08:30.442366 26648 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:30.445380 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:30.442342 26644 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:30.408793 26594 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:30.445470 26648 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:30.446182 21486 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.452260 21567 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:30.419042 26653 consensus_queue.cc:1243] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:08:30.460918 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.399643 26546 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.447019 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:30.430591 26547 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 13:08:30.467618 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.468225 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:30.469410 21492 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:30.441699 26661 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.444082 26618 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:30.458041 26644 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:30.484807 26595 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.503650 26595 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.507050 21634 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:08:30.509208 26595 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.514290 26647 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:30.514951 26647 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:30.515897 26711 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:08:30.517148 21532 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.018s	sys 0.054s
W20260709 13:08:30.517519 21532 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.019s	sys 0.054s
W20260709 13:08:30.517798 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 582217us
I20260709 13:08:30.517189 26647 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.520299 26569 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.521178 26556 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.520932 26569 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.521673 26556 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.383558 26660 rpcz_store.cc:276] 0709 13:08:26.823292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.823593 (+   301us) service_pool.cc:224] Handling call
0709 13:08:26.880830 (+ 57237us) log.cc:844] Serialized 513 byte log entry
0709 13:08:27.034454 (+153624us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b18000773e0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9f3bb0b 00007f98a9fc0b63 00007f98a9fe8752 00007f98aefa8d29
0709 13:08:30.337013 (+3302559us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7187,"raft.queue_time_us":16033,"raft.run_cpu_time_us":2172,"raft.run_wall_time_us":5670,"spinlock_wait_cycles":8141184,"thread_start_us":139587,"threads_started":1,"wal-append.queue_time_us":269798,"wal-append.run_cpu_time_us":10914,"wal-append.run_wall_time_us":1472573}
I20260709 13:08:30.523298 26569 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.523749 26556 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.524014 22245 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:30.523855 26648 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.526773 26546 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.526935 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:30.527310 21503 tablet_copy_source_session.cc:215] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:30.526950 21492 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:30.530354 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:30.531617 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:30.533049 21634 pending_rounds.cc:85] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 7
I20260709 13:08:30.533432 21634 pending_rounds.cc:107] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:30.533676 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:30.536582 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:30.533735 21634 raft_consensus.cc:2889] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.537235 21487 raft_consensus.cc:2376] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11. Re-sending same reply.
I20260709 13:08:30.472947 26102 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:30.540041 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.472973 26552 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.483402 26661 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.545425 22212 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:30.549583 21488 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:08:30.544869 26646 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:08:30.498895 26618 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.550607 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:30.558588 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:30.563848 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:30.564661 21563 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:30.564901 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.542065 26102 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.541877 26609 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:30.566166 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:30.569095 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:30.569605 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.569968 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.570923 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:30.571187 21562 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.565675 26693 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.566269 26624 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:30.572037 26693 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.572685 26644 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.573166 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:30.573925 26644 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.574231 26693 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.574313 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.565860 26603 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:30.575127 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.575234 26603 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.575551 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.576239 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.576665 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.577414 26603 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:30.553646 26198 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.553488 26606 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:30.578117 26198 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.578686 26606 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.580608 26198 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.580919 26606 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.581167 26198 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.577325 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:30.553277 26552 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.582998 26290 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.548808 26628 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:30.586329 26632 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.003s
I20260709 13:08:30.546872 26572 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:30.548560 26643 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.548718 26647 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:30.552800 26325 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.555670 26618 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.591573 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.593001 21486 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:30.593775 21560 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.485123 26583 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:30.588477 26619 consensus_queue.cc:1175] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5727b19579474da6a12f79730b924770" responder_term: 12 status { last_received { term: 12 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 12 index: 6 } }
I20260709 13:08:30.601603 21488 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:30.565973 26342 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:30.587688 26102 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.646803 21562 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:30.647917 21560 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:30.594938 26693 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.594297 26198 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.694058 26198 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.644397 26572 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.696969 26572 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.644291 26643 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.699568 26643 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.646529 26647 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.658604 26342 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:30.703040 26647 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:30.645941 26325 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.630347 26628 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.705690 26325 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.706166 26628 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.616003 26632 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.708832 26632 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:30.684201 26706 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.278s	user 0.000s	sys 0.005s
I20260709 13:08:30.702410 26342 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.710119 21636 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:08:30.683554 26583 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.710539 21636 pending_rounds.cc:85] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 9
I20260709 13:08:30.711144 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:30.712473 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:30.713095 21637 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:30.714970 22242 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:30.718864 21641 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:08:30.724478 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.725492 21568 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:30.727376 21638 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:30.727861 26618 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.728446 21636 pending_rounds.cc:107] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:08:30.728830 21636 raft_consensus.cc:2889] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.729131 21634 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:30.730144 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:30.731940 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:30.732625 21635 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:30.731303 26618 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.736686 26102 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.741233 26198 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.743896 26198 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.746843 26102 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.756264 26462 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:30.777956 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:30.785514 26546 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.786145 26546 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.788390 26546 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.778738 21493 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:30.793668 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.794274 21569 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
W20260709 13:08:30.797271 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.805596 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.806373 26635 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.807035 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.807771 21562 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:30.808380 26681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b5fb42c147456889a1843340b22720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:30.808849 26722 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:30.810688 26662 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:30.811256 26662 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.812496 26722 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:30.813691 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.568149 26657 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.815021 21569 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: [13.7-14.8]
I20260709 13:08:30.818193 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:30.819111 21486 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.817806 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.823150 21637 pending_rounds.cc:85] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 6
I20260709 13:08:30.823613 21637 pending_rounds.cc:107] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:30.823926 21637 raft_consensus.cc:2889] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.824298 21637 pending_rounds.cc:107] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:30.824601 21637 raft_consensus.cc:2889] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.823110 21568 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:30.832556 21634 raft_consensus.cc:2955] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:30.675748 26693 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:30.835055 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 276527us
I20260709 13:08:30.851890 21642 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:08:30.848475 21486 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:30.855785 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:30.862080 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:30.862914 21635 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:30.845671 26624 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:30.724506 26661 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.832988 26583 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.868877 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:30.885494 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:30.886638 26542 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.887199 26542 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.887629 26542 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.803246 26546 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:08:30.833173 26662 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:30.891078 26447 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:30.891736 26447 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.892190 26447 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.899278 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:30.901145 26677 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:30.902139 26677 consensus_queue.cc:1243] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:30.903267 26677 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:30.903743 26677 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:30.909673 26677 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.857542 26693 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.911456 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:30.912787 26580 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:30.913477 26580 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:30.901451 26556 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:30.915146 26556 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.914633 26580 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:30.915692 26556 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:30.863055 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:08:30.919672 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56737.6us
I20260709 13:08:30.920631 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:30.921537 26662 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:30.922235 26198 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:30.922984 26662 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:30.923671 26677 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.925387 26662 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:30.928673 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.938489 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.922045 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:30.940574 26646 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:30.870371 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 325564us
I20260709 13:08:30.959563 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:30.970293 26689 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.971267 26689 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:30.973747 26689 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:30.984556 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:30.985575 21569 raft_consensus.cc:2410] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:30.996999 22241 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:08:31.017139 21388 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 243) took 16892 ms (client timeout 15000 ms). Trace:
I20260709 13:08:31.017814 26575 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.023622 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 355756us
I20260709 13:08:31.025885 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.026623 21487 raft_consensus.cc:2368] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:31.027180 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.028517 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:31.029295 21490 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.029450 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:31.031435 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.027292 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.033834 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:31.029353 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 458560us
I20260709 13:08:31.036022 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.038839 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:31.042387 21560 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:31.043321 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.046742 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:31.044006 21635 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:31.069115 21491 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:31.071094 21494 raft_consensus.cc:2368] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:31.075290 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.075985 21635 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:31.077425 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:31.082811 21490 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:31.084424 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:31.085448 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.086058 21635 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:31.094687 22241 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:08:30.867646 26636 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.212s
I20260709 13:08:31.107254 26542 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.110318 22245 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:31.133070 21638 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:30.882529 26596 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.208s
I20260709 13:08:31.079739 26652 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:30.832347 26722 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.093914 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:31.115443 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:31.018141 21388 rpcz_store.cc:269] 0709 13:08:14.124801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.125126 (+   325us) service_pool.cc:224] Handling call
0709 13:08:31.016966 (+16891840us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:26.797031 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:26.797733 (+   702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:26.797786 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:08:26.797808 (+    22us) tablet.cc:662] Decoding operations
0709 13:08:26.798981 (+  1173us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:26.799079 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:26.799108 (+    29us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:08:26.799985 (+   877us) tablet.cc:701] Row locks acquired
0709 13:08:26.800038 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:08:26.800205 (+   167us) write_op.cc:270] Start()
0709 13:08:26.800357 (+   152us) write_op.cc:276] Timestamp: P: 1783602506800140 usec, L: 0
0709 13:08:26.800379 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:26.801022 (+   643us) log.cc:844] Serialized 4039 byte log entry
0709 13:08:27.555848 (+754826us) op_driver.cc:464] REPLICATION: finished
0709 13:08:28.122397 (+566549us) write_op.cc:301] APPLY: starting
0709 13:08:28.122528 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:28.471836 (+349308us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:28.471959 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:28.724850 (+252891us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:28.776950 (+ 52100us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:08:28.818200 (+ 41250us) write_op.cc:312] APPLY: finished
0709 13:08:29.023757 (+205557us) log.cc:844] Serialized 97 byte log entry
0709 13:08:29.311896 (+288139us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:29.339424 (+ 27528us) write_op.cc:454] Released schema lock
0709 13:08:29.345045 (+  5621us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:29.412550 (+ 67505us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:29.414191 (+  1641us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":121109,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":544977,"apply.run_cpu_time_us":48980,"apply.run_wall_time_us":1258047,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45887,"num_ops":10,"prepare.queue_time_us":187835,"prepare.run_cpu_time_us":71705,"prepare.run_wall_time_us":166250,"raft.queue_time_us":184889,"raft.run_cpu_time_us":138977,"raft.run_wall_time_us":522198,"replication_time_us":656277,"thread_start_us":879410,"threads_started":5,"wal-append.queue_time_us":601420,"wal-append.run_cpu_time_us":11989,"wal-append.run_wall_time_us":2300627}]]}
I20260709 13:08:31.023921 26583 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.024139 26575 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.087204 26606 raft_consensus.cc:2764] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:08:31.142333 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 92845.6us
I20260709 13:08:31.069522 26689 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:08:31.094475 26662 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.138137 26727 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.137598 26686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.345s	user 0.026s	sys 0.098s
W20260709 13:08:31.169019 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 75491.9us
I20260709 13:08:31.144165 26652 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.074678 26632 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:08:31.084306 26572 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:08:31.188081 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.194317 21489 raft_consensus.cc:2410] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:31.133916 26556 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.204325 21635 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:31.194295 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:31.147810 26669 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.149536 26198 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:31.206571 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:31.209488 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:31.213815 21640 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:31.214061 21641 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:08:31.194689 26686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.027s	sys 0.106s
I20260709 13:08:31.194530 26619 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.211261 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.194497 26652 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:31.223317 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.223464 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:31.224298 21635 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.225948 21606 leader_election.cc:400] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:31.226708 21606 leader_election.cc:403] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:31.227193 21485 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:31.217305 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:31.210058 26644 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:31.185310 26067 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:31.202584 26646 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.196278 26552 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:31.186269 26530 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:31.222543 26275 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:08:31.220053 26703 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:31.206851 26603 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
W20260709 13:08:31.259406 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 176866us
I20260709 13:08:31.168061 26624 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.232708 26725 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:31.219377 26198 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.305805 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.307643 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.246498 26657 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:31.232311 26619 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:31.260535 26736 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:08:31.192184 26662 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.304080 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.245893 26644 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:31.262583 21641 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:31.293570 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:31.235834 26669 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:31.315534 26729 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:08:31.316453 26572 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:31.263236 26275 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:31.319762 26693 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.307241 26542 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:31.226147 26726 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 13:08:31.376727 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 134234us
W20260709 13:08:31.323931 26731 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:08:31.327278 26732 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.216s	user 0.001s	sys 0.001s
I20260709 13:08:31.328378 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.333371 21635 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:31.333598 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.254844 26703 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:08:31.289368 26728 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:08:31.262529 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:31.258469 26606 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.354605 21494 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:08:31.354425 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 60961.1us
I20260709 13:08:31.388207 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:31.390570 21606 leader_election.cc:400] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:31.390884 21606 leader_election.cc:403] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:31.318971 26730 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:08:31.391673 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:31.204612 26727 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.362352 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.304744 26725 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.374399 26275 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:31.370584 26693 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:31.256899 26165 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:08:31.334221 26661 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:31.246083 26067 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.371090 21568 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.341043 26575 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:31.410240 21638 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:31.309746 26643 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:08:31.371529 26644 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.279255 26647 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:31.380025 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.418275 21486 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:31.380707 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:31.383234 21634 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:31.388147 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.388015 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:31.363056 26618 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11.
I20260709 13:08:31.246309 26646 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.392877 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:31.364884 26724 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:31.254243 26530 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.429217 26646 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:31.397616 26606 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.368057 26572 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:08:31.401564 21642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.005s	sys 0.014s
I20260709 13:08:31.400024 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:31.356323 26677 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:08:31.288838 26580 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:08:31.362425 26447 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.439600 26275 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.446934 26275 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:31.411722 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.448253 21636 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:31.449190 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:31.451951 26741 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:08:31.409269 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 81304.9us
W20260709 13:08:31.456619 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.400892 26669 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:31.418776 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:31.460695 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:31.461601 21563 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:31.403636 26725 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.424559 21568 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:31.427047 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:31.396765 21641 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:31.414577 26643 consensus_queue.cc:1243] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:31.433421 26198 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:31.434386 26646 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:31.435552 26067 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:31.423373 26647 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:31.436394 26462 consensus_meta.cc:287] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.680s	user 0.012s	sys 0.000s
I20260709 13:08:31.436507 26619 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:31.488924 21636 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:31.441120 21642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.005s	sys 0.014s
I20260709 13:08:31.434775 26547 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:31.420635 26703 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.494055 26703 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:31.458576 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.478703 26636 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.483595 26447 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:31.501781 26647 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:31.508528 26530 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:31.509238 26727 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:31.509670 26662 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:31.492034 26650 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.510450 26650 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.513167 21490 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:31.518769 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.519701 21490 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
W20260709 13:08:31.471402 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44439.9us
I20260709 13:08:31.522217 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.522517 26606 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:31.522938 21493 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:31.523418 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:31.524991 26447 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:31.525403 26447 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:31.525805 26447 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.527801 26575 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:31.528860 21494 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:31.413836 26738 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:08:31.440397 26726 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:31.476677 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 214269us
I20260709 13:08:31.477461 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.433451 26749 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:31.487128 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:31.551959 21564 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.487739 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.484256 26669 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:31.471510 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:31.560667 21565 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:31.482111 26746 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:08:31.535187 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:31.546473 21562 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:31.553783 21563 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:31.548993 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:31.466871 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.564455 21561 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:31.566154 21490 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:31.543006 26635 consensus_meta.cc:287] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.000s
I20260709 13:08:31.567837 21494 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:31.579239 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.584625 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.585547 21492 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:31.586493 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.587852 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.568079 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:31.589699 26165 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.590176 26165 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.590580 26165 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:31.600031 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51161.8us
I20260709 13:08:31.601238 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:31.602458 26727 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.602870 26198 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:31.578837 26462 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:31.605742 26669 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.609189 26660 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.609889 26660 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.611271 21489 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:31.586396 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:31.613759 21566 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.619294 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:31.635663 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:31.650394 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:31.651302 21641 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:31.659540 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 58482.8us
I20260709 13:08:31.660590 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:31.663836 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:31.666709 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.667650 21563 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:31.669376 21564 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:31.672003 21641 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:31.672260 21565 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:31.672932 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:31.673228 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:31.674283 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.674366 21641 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.674583 21636 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:31.689908 21639 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:31.692104 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:31.672055 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 253344us
I20260709 13:08:31.695143 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:31.667716 26606 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:31.706852 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.666491 26643 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:31.708557 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.711074 26746 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:31.700806 26723 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:31.720710 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.734925 26198 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.735062 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.736423 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.737172 21569 raft_consensus.cc:2368] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:31.737970 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.721386 21487 pending_rounds.cc:85] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 10
I20260709 13:08:31.738607 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.739665 21562 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:31.740722 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.742038 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:31.720952 26738 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:31.714658 26532 raft_consensus.cc:993] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:31.744273 26532 raft_consensus.cc:1081] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:31.722232 26462 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.722716 26754 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:31.662251 26724 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:31.750651 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:31.751526 21569 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:31.662122 26662 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:31.727600 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:31.723543 21641 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:31.731520 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.561251 26652 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.738965 21487 pending_rounds.cc:107] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:08:31.754839 21568 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:31.722852 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.666354 26644 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:08:31.704658 26749 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.753407 21494 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:31.771932 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.755102 21487 raft_consensus.cc:2889] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:31.780773 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:31.781724 22238 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
I20260709 13:08:31.755810 21564 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:31.754745 21569 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:31.746979 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.785635 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:31.785843 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 58327.5us
I20260709 13:08:31.724059 26572 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:31.770706 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.770944 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:31.772593 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.791090 21636 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:31.791306 21488 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:31.792032 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:31.728344 26689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.013s	sys 0.008s
I20260709 13:08:31.786604 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:31.748987 26325 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:31.794010 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:31.813369 21564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:40994
I20260709 13:08:31.795858 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:31.804941 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.798514 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.806020 21568 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:31.815317 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:31.813980 21564 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.816210 21564 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.816318 21636 raft_consensus.cc:2368] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14.
I20260709 13:08:31.817449 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:31.818145 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:31.819288 26750 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:08:31.819891 21562 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:31.821049 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:31.819334 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:31.824729 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:31.812536 26325 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:31.797506 26689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.014s	sys 0.008s
I20260709 13:08:31.786592 26646 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:31.750528 26165 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.830168 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:31.836521 22241 raft_consensus.cc:2393] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:31.828298 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:31.777628 26662 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.796937 26755 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.876976 21642 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:31.806388 26644 consensus_queue.cc:1243] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:31.850826 26760 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:08:31.829335 26198 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.827142 26749 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:31.832193 26325 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.770315 26462 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.829442 26647 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:31.752856 26723 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:31.894438 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2902) took 1185 ms. Trace:
I20260709 13:08:31.894829 26462 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:31.895334 26723 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:31.894879 21639 rpcz_store.cc:276] 0709 13:08:30.709118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.714909 (+  5791us) service_pool.cc:224] Handling call
0709 13:08:30.715168 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.690459 (+975291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.894191 (+203732us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b540024ca54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:31.894379 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241251584}
I20260709 13:08:31.900301 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:31.900609 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:31.900972 21567 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.865054 21564 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.837780 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:31.788765 26725 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:31.813222 26754 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:31.862329 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:31.867107 26643 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:31.834545 26572 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:31.876789 21566 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
W20260709 13:08:31.830608 21457 consensus_peers.cc:597] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d46f34ab738d4d38b09f9d1228d68c7d. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:31.912346 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 81836.3us
I20260709 13:08:31.913570 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:31.914685 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:31.919595 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:31.886811 26766 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:31.889907 21563 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:31.891518 26165 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:31.891921 26662 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:31.911363 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49153us
I20260709 13:08:31.972236 26198 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:31.973865 21635 raft_consensus.cc:2368] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13.
I20260709 13:08:31.974318 26725 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:31.975919 26652 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:31.980693 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 66106.8us
W20260709 13:08:31.982980 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.982266 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 148413us
W20260709 13:08:31.979765 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61161.8us
I20260709 13:08:32.060165 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:32.109859 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:32.110562 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:32.020424 21567 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
W20260709 13:08:31.981931 26681 consensus_meta.cc:287] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.003s
I20260709 13:08:31.879976 26724 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.234225 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:32.246307 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 186231us
I20260709 13:08:32.247845 21608 leader_election.cc:400] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:32.172802 26766 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:32.249987 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:32.056432 26635 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:32.057323 26754 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:32.272723 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet eae01b9fdd5340dc9416e5834263a4d6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5a34fd3290de493eb6bbe828dd742772 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:32.275034 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:32.277941 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:32.282851 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:32.125203 26744 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:32.292583 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 182783us
I20260709 13:08:32.294064 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:32.315781 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:32.318135 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:32.318826 21488 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.320041 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:32.325711 22238 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:08:32.328879 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51094.2us
I20260709 13:08:32.270278 26652 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:32.233669 26762 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:32.337625 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:32.324839 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:32.344471 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:32.244454 26198 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:32.293394 26647 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:32.346000 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:32.280557 26725 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:32.314126 26744 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.339383 26755 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:32.343837 26662 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:32.380064 26652 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.345573 21564 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.363385 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:32.394742 22238 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:32.407037 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 43784.2us
I20260709 13:08:32.408761 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:32.431452 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.367574 26760 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:32.441910 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:32.452313 21532 leader_election.cc:400] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14.
I20260709 13:08:32.452718 21532 leader_election.cc:403] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:32.446318 21488 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:32.377311 26644 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:32.390821 26765 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:08:32.391860 26447 consensus_meta.cc:287] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.866s	user 0.013s	sys 0.000s
I20260709 13:08:32.383085 26746 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:32.345893 26643 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:08:32.509173 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:32.432403 26744 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.425570 26726 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:32.426586 26652 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:32.516248 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.335043 26766 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:32.449829 26760 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.446928 26572 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:32.525071 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:32.470650 26552 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:32.470211 26325 consensus_meta.cc:287] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
I20260709 13:08:32.564683 21488 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:32.566452 21488 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:32.569803 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 2395) took 1544 ms. Trace:
I20260709 13:08:32.570358 21485 rpcz_store.cc:276] 0709 13:08:31.025188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.025318 (+   130us) service_pool.cc:224] Handling call
0709 13:08:32.569529 (+1544211us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002779d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:32.569730 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448137472}
I20260709 13:08:32.550666 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60044 (request call id 819) took 3189 ms. Trace:
I20260709 13:08:32.567340 21488 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.454335 26767 raft_consensus.cc:2764] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:32.367990 26762 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.556748 26769 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.563138 26760 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.443572 26755 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:32.578233 21488 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.621344 26755 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:32.575326 26198 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.624117 26766 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:32.625237 26771 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:08:32.584506 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 202705us
I20260709 13:08:32.628660 26762 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.511435 26447 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.630873 26447 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.573323 26325 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.631649 21486 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:32.632040 21641 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:32.632691 21488 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:32.633015 26325 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:32.633106 26777 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:32.634001 26777 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:32.578027 26774 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:32.580443 26726 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:32.640291 26572 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.550034 26746 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:32.568164 26662 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.642948 26776 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14.
W20260709 13:08:32.656895 21639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.001s	sys 0.005s
W20260709 13:08:32.665161 21639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.001s	sys 0.005s
I20260709 13:08:32.672791 26746 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:32.471143 26754 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:32.664603 26780 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:32.703681 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2938) took 1003 ms. Trace:
I20260709 13:08:32.577894 26681 rpcz_store.cc:276] 0709 13:08:29.315840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.315998 (+   158us) service_pool.cc:224] Handling call
0709 13:08:29.585859 (+269861us) ts_tablet_manager.cc:934] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
0709 13:08:30.800069 (+1214210us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:31.354257 (+554188us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:31.364617 (+ 10360us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:32.250760 (+886143us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:32.346351 (+ 95591us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:32.469790 (+123439us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:32.505378 (+ 35588us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":28057,"tablet-copy.queue_time_us":201509,"thread_start_us":388658,"threads_started":2}
I20260709 13:08:32.709795 26681 tablet_copy_client.cc:806] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:32.710486 26681 tablet_copy_client.cc:670] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:32.711445 26777 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:32.713099 26556 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.711050 26780 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:32.718699 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 209572us
I20260709 13:08:32.704236 21643 rpcz_store.cc:276] 0709 13:08:31.699968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.389381 (+689413us) service_pool.cc:224] Handling call
0709 13:08:32.389785 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.390044 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:32.390362 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.703174 (+312812us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.703233 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:32.703280 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.703348 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.703532 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2009,"prepare.queue_time_us":139,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":31,"raft.queue_time_us":1731,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7265,"thread_start_us":310683,"threads_started":1}
I20260709 13:08:32.725287 26776 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:32.725891 26776 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.730655 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:32.669229 26662 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:32.732398 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:32.733008 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2936) took 1074 ms. Trace:
I20260709 13:08:32.730149 26776 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.733349 21639 rpcz_store.cc:276] 0709 13:08:31.658967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.897779 (+238812us) service_pool.cc:224] Handling call
0709 13:08:31.898091 (+   312us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:31.901465 (+  3374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.901493 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:31.909668 (+  8175us) log.cc:844] Serialized 78 byte log entry
0709 13:08:32.665902 (+756234us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:32.691390 (+ 25488us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.691634 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.691718 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.732780 (+ 41062us) raft_consensus.cc:1685] finished
0709 13:08:32.732801 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.732955 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25749,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":5783,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":77756,"thread_start_us":686559,"threads_started":1,"wal-append.queue_time_us":739073}
I20260709 13:08:32.736227 26780 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:32.739351 21640 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:08:32.741422 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2929) took 1123 ms. Trace:
I20260709 13:08:32.742175 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:32.744781 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:32.722424 22210 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:32.747939 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1847) took 1021 ms. Trace:
I20260709 13:08:32.748380 21486 rpcz_store.cc:276] 0709 13:08:31.726472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.726808 (+   336us) service_pool.cc:224] Handling call
0709 13:08:31.727133 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.632082 (+904949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.747666 (+115584us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54002774d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:32.747873 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079650176}
I20260709 13:08:32.750370 26780 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:32.750813 26780 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:32.751219 26780 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.753583 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:32.756487 21569 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:32.756289 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:32.757330 21563 raft_consensus.cc:2410] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:32.742548 26726 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:32.758147 26652 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.759521 21565 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:32.760502 26652 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.760797 26660 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.733928 26662 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:32.741894 21636 rpcz_store.cc:276] 0709 13:08:31.617932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.841858 (+223926us) service_pool.cc:224] Handling call
0709 13:08:31.864038 (+ 22180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.893790 (+ 29752us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:31.896035 (+  2245us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.173694 (+277659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.173752 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:32.173799 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.741132 (+567333us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54001153d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:32.741191 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.741354 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65994,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":66146,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":27383,"spinlock_wait_cycles":67920640,"thread_start_us":211651,"threads_started":1,"wal-append.queue_time_us":486303}
W20260709 13:08:32.794700 21635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 1877) took 1400 ms (client timeout 1628 ms). Trace:
W20260709 13:08:32.795398 21635 rpcz_store.cc:269] 0709 13:08:31.385384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.387707 (+  2323us) service_pool.cc:224] Handling call
0709 13:08:32.785053 (+1397346us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400296154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:32.785239 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274472704}
I20260709 13:08:32.804029 21635 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:08:32.809209 21638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 957) took 1622 ms (client timeout 2022 ms). Trace:
W20260709 13:08:32.809689 21638 rpcz_store.cc:269] 0709 13:08:31.186842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.186980 (+   138us) service_pool.cc:224] Handling call
0709 13:08:32.809006 (+1622026us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400114ed4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:32.809145 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430245632}
I20260709 13:08:32.819861 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:32.825588 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:32.826462 22242 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.836141 22244 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:08:32.782094 26749 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:08:32.837150 22242 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:32.849089 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:32.801532 26760 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.852411 26760 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.853061 21564 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:32.852705 26780 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:32.855525 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2442) took 1145 ms. Trace:
I20260709 13:08:32.856029 21568 rpcz_store.cc:276] 0709 13:08:31.710551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.755783 (+ 45232us) service_pool.cc:224] Handling call
0709 13:08:31.756121 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.815815 (+ 59694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.855204 (+1039389us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54001d8154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:32.855449 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114291584}
I20260709 13:08:32.858484 21563 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:32.859735 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:32.860589 22245 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:32.806687 26744 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:32.844901 26612 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:08:32.876643 26686 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:32.877192 26686 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:32.867184 26722 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.880100 26583 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:32.868093 26693 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.391s	user 0.031s	sys 0.033s
I20260709 13:08:32.882663 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3232) took 1428 ms. Trace:
I20260709 13:08:32.867044 26792 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.878077 26686 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:32.884306 21560 rpcz_store.cc:276] 0709 13:08:31.454620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.454896 (+   276us) service_pool.cc:224] Handling call
0709 13:08:31.463338 (+  8442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.473140 (+  9802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.473190 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.473251 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:31.473300 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.882477 (+1409177us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b540031f6d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:32.882514 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.882617 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21865344}
I20260709 13:08:32.885775 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 965) took 1696 ms. Trace:
I20260709 13:08:32.890247 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2927) took 1273 ms. Trace:
I20260709 13:08:32.887612 21634 rpcz_store.cc:276] 0709 13:08:31.189156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.231007 (+ 41851us) service_pool.cc:224] Handling call
0709 13:08:31.233940 (+  2933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.419265 (+185325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.885501 (+1466236us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400143a54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:32.885708 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342269824}
I20260709 13:08:32.890722 21642 rpcz_store.cc:276] 0709 13:08:31.617112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.618936 (+  1824us) service_pool.cc:224] Handling call
0709 13:08:32.890079 (+1271143us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400295c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:32.890186 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555911552}
W20260709 13:08:32.884224 26693 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.424s	user 0.031s	sys 0.033s
I20260709 13:08:32.895568 26686 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.889029 26780 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:32.908087 26739 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 1.592s	user 0.013s	sys 0.011s
I20260709 13:08:32.909670 26744 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:32.906683 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44069.9us
I20260709 13:08:32.912556 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1848) took 1183 ms. Trace:
I20260709 13:08:32.912902 21491 rpcz_store.cc:276] 0709 13:08:31.729410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.729737 (+   327us) service_pool.cc:224] Handling call
0709 13:08:31.730030 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.910343 (+1180313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.910375 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.910417 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:32.910448 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.912344 (+  1896us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002783d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:32.912387 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.912502 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2713997568}
I20260709 13:08:32.889791 26792 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:32.914887 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2931) took 1296 ms. Trace:
I20260709 13:08:32.915279 21640 rpcz_store.cc:276] 0709 13:08:31.618564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.852470 (+233906us) service_pool.cc:224] Handling call
0709 13:08:31.852802 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.739798 (+886996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.914625 (+174827us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540029fc54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:32.914827 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2038273408}
I20260709 13:08:32.915056 26738 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:32.916484 26738 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:32.917230 26738 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.918776 26738 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:32.924868 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2411) took 1345 ms. Trace:
W20260709 13:08:32.925669 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.921710 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 2939) took 1221 ms. Trace:
I20260709 13:08:32.927214 21641 rpcz_store.cc:276] 0709 13:08:31.700312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.771704 (+ 71392us) service_pool.cc:224] Handling call
0709 13:08:32.921511 (+1149807us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b540009d654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:32.921651 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958438784}
I20260709 13:08:32.927934 26762 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.928480 26762 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.931134 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:32.931919 21493 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:32.925524 21487 rpcz_store.cc:276] 0709 13:08:31.579112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.579925 (+   813us) service_pool.cc:224] Handling call
0709 13:08:31.580404 (+   479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:31.780846 (+200442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.780897 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:31.781720 (+   823us) log.cc:844] Serialized 52 byte log entry
0709 13:08:31.827519 (+ 45799us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:32.175514 (+347995us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.175918 (+   404us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.923730 (+747812us) spinlock_profiling.cc:243] Waited 993 us on lock 0x7b18000bc0e0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:08:32.923926 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.924538 (+   612us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000b8454. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:32.924588 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.924629 (+    41us) raft_consensus.cc:1685] finished
0709 13:08:32.924641 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.924812 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":747153,"prepare.queue_time_us":783024,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":7659,"raft.queue_time_us":686590,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":42728,"spinlock_wait_cycles":325907712,"thread_start_us":356523,"threads_started":2,"wal-append.queue_time_us":102914}
I20260709 13:08:32.932986 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:32.933612 21486 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.934727 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:32.941219 26798 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:08:32.943297 21560 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:32.943845 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1882) took 1112 ms. Trace:
I20260709 13:08:32.944350 21639 rpcz_store.cc:276] 0709 13:08:31.831448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.740635 (+909187us) service_pool.cc:224] Handling call
0709 13:08:32.810650 (+ 70015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.811097 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.811131 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:32.811625 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.825214 (+ 13589us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:32.825261 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.825338 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.942396 (+117058us) raft_consensus.cc:1685] finished
0709 13:08:32.942426 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.943494 (+  1068us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b5400114ed0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:32.943765 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1548,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":160308096,"thread_start_us":13268,"threads_started":1,"wal-append.queue_time_us":51680}
I20260709 13:08:32.946897 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:32.949222 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.950507 26752 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 1.215s	user 0.005s	sys 0.013s
I20260709 13:08:32.919756 26606 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:32.951506 26606 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.956038 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:32.956892 21561 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:32.958232 21486 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:32.958333 26583 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.963019 26583 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.930667 26762 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.964798 26799 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:32.959311 26686 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:32.967163 26686 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.968302 26801 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:32.969277 26686 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.969087 26801 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:32.971055 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.971334 26583 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.961668 26703 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:32.972314 26703 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:32.973064 26773 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 13:08:32.960341 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:32.977916 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:32.979219 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:32.983160 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:32.989953 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 2937) took 1330 ms. Trace:
I20260709 13:08:32.987200 26799 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:08:32.987836 26636 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:32.991540 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:32.992264 22245 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.994309 26801 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.958745 26792 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:32.991667 26636 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:32.995721 26636 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.997347 26624 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:32.997745 26624 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:32.987716 26067 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:32.998482 26067 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:32.999404 26067 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:32.990556 21637 rpcz_store.cc:276] 0709 13:08:31.659276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.898917 (+239641us) service_pool.cc:224] Handling call
0709 13:08:31.899388 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.899706 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.899733 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.900634 (+   901us) log.cc:844] Serialized 513 byte log entry
0709 13:08:32.312569 (+411935us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:32.312604 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.312670 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.972150 (+659480us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:32.987290 (+ 15140us) raft_consensus.cc:1685] finished
0709 13:08:32.987311 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.989878 (+  2567us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7048448,"thread_start_us":411611,"threads_started":1,"wal-append.queue_time_us":554033}
I20260709 13:08:32.998556 26624 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.005776 22245 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:33.009191 26198 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:33.013109 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.014027 21641 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:33.012449 21637 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:33.016640 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.027315 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.025349 21568 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.015722 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:33.028782 21642 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.029342 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:33.030417 21569 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 11: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:33.032075 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:33.032852 21569 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.022195 26198 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.035336 21639 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:33.014051 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:33.035993 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.036522 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:33.040730 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:33.041709 21491 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.043799 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.044189 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.035844 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:33.044476 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:33.046975 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:33.049444 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:33.050624 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.051025 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.052835 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:33.053591 21634 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.055392 21638 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:32.989888 26762 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.055440 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.055498 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:33.056865 26198 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:33.057973 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:33.061659 21637 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:33.061786 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:33.062341 21640 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:33.014955 26624 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.011008 26693 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:33.067452 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.008898 26749 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:33.004197 26703 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:33.007893 26742 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.069072 21641 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
W20260709 13:08:33.070776 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.035426 26556 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.077984 21642 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:33.052022 26662 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:33.085455 21634 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
W20260709 13:08:33.086933 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 136187us
I20260709 13:08:33.099514 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.103370 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.062644 26762 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:33.002051 26606 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.109956 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:33.112488 26462 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:33.112977 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:33.113111 26462 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:33.114059 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:33.114991 26675 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.115422 26675 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:33.115752 26675 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.116046 26532 raft_consensus.cc:2955] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:33.043502 26646 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:08:33.128940 21569 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:33.068821 26693 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:33.128134 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.131467 21640 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:33.133424 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 115077us
I20260709 13:08:33.133544 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.137542 26636 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:33.143371 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 1880) took 1387 ms. Trace:
I20260709 13:08:33.143826 21643 rpcz_store.cc:276] 0709 13:08:31.756502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.720765 (+964263us) service_pool.cc:224] Handling call
0709 13:08:32.721166 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.721609 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:32.721638 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:32.722089 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.004080 (+281991us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b180035c680. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:08:33.076120 (+ 72040us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:33.076175 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.076261 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.143063 (+ 66802us) raft_consensus.cc:1685] finished
0709 13:08:33.143083 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.143307 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":341,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"spinlock_wait_cycles":55216896,"thread_start_us":71803,"threads_started":1,"wal-append.queue_time_us":416284}
I20260709 13:08:33.119876 26762 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.147090 26693 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.148460 26693 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.088719 26742 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.131073 26650 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:33.107477 26556 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.157684 21487 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:33.132695 26764 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.532924 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:33.181556 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44746.7us
I20260709 13:08:33.189360 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:33.190357 21568 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:33.158983 26764 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.199501 26198 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:33.200040 26198 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:33.207952 21459 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.208176 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:33.210824 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 77357.7us
I20260709 13:08:33.211676 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.213148 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:33.141251 26636 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:33.081437 26749 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.220685 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.218801 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:33.225589 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.226286 26652 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.209190 26198 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.206367 26799 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:33.226435 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.265970 26165 raft_consensus.cc:2764] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:33.266999 26165 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:33.267501 26165 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:33.268409 26165 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.259743 26466 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.270758 26662 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:33.222879 26462 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.253962 26754 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.271826 26754 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:33.272344 26754 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.276728 26646 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:33.276923 26675 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.271230 26662 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:08:33.312250 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 43886.1us
I20260709 13:08:33.214516 26650 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:33.303990 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.285297 21491 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:33.217757 26603 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:08:33.219337 26657 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:33.318503 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53091us
I20260709 13:08:33.319931 26799 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:33.392102 21560 raft_consensus.cc:2410] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:33.319986 26636 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.321075 26764 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:33.322031 26760 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:33.335723 26749 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:33.336979 26675 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:33.287480 26606 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:33.341392 26762 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.228258 26583 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:08:33.344674 26742 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:33.349828 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.209721 26447 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:33.386363 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:33.416785 21563 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:08:33.342998 26650 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.355687 26556 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:33.414331 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 195661us
W20260709 13:08:33.411459 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 203320us
I20260709 13:08:33.414369 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.421882 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:33.400244 26657 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:33.425669 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.425624 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:33.400589 26760 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:33.445798 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:33.446331 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:33.449769 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:33.453814 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:33.443504 26724 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.452239 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.456068 21637 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:33.458921 26646 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.462662 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.463351 21637 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
W20260709 13:08:33.466346 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.468175 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:33.468699 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:33.469281 21492 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.471058 26646 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.471827 26646 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.474941 26744 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:33.475521 26744 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.466720 26725 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.476550 26725 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.477710 26744 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:33.480842 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 254484us
I20260709 13:08:33.481587 21491 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:33.482872 21635 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.452883 26780 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.487914 21487 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:33.485086 21491 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.394749 26662 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.481582 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.491894 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.494057 26693 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.494547 26693 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:33.494953 26693 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.423327 26447 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.502367 26572 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:33.503059 26572 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.504040 26447 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:33.478590 26657 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.505106 26572 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:33.507184 26606 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:33.507756 26606 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:33.508958 26812 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:08:33.510051 26606 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:33.421164 26764 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
W20260709 13:08:33.515457 26806 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:08:33.525020 21492 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:33.423451 21636 raft_consensus.cc:2955] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:33.478664 26725 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:33.535301 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.479732 26556 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:33.536659 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 328749us
I20260709 13:08:33.538504 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:33.483630 26722 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.418028 26466 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
W20260709 13:08:33.536196 26786 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:08:33.545974 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.541836 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.538391 21635 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:33.576081 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.540509 26606 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:33.578763 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:33.579057 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:33.581408 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:33.590049 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:33.584810 21636 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.586951 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:33.588201 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:33.592612 21491 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:33.593391 22244 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.595038 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:33.595824 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:33.598160 21494 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.599483 21561 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:33.600636 21491 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:08:33.574697 26814 log.cc:927] Time spent T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:08:33.625236 22242 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.519692 26693 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.607136 26198 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.611963 26675 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.613642 26744 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:33.615028 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:33.615078 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:33.616801 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.621728 22244 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:33.632140 21643 raft_consensus.cc:2368] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13.
W20260709 13:08:33.633426 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 165313us
I20260709 13:08:33.641749 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:33.644232 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.618269 26660 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:33.648680 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:33.550099 26556 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.660046 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:33.661621 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44908.5us
I20260709 13:08:33.665683 22244 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:33.664767 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:33.601423 26686 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:33.619429 26606 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:33.648741 26786 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:08:33.648154 26773 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:33.713027 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.713738 21643 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:33.715205 21643 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:33.717314 26825 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:33.717974 26825 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.719405 26650 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:33.660279 26724 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.720234 26825 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:33.720738 26825 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.721125 26825 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:33.707949 26532 consensus_meta.cc:287] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.004s
I20260709 13:08:33.678201 21459 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.709779 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:33.705230 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.725773 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 300185us
W20260709 13:08:33.712230 26816 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:08:33.734387 26606 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.735502 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:33.647804 26675 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.737341 26646 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.744287 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:33.655493 26725 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.749109 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:33.749992 21639 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:33.668047 26744 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:33.667956 26067 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:33.779603 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 101485us
I20260709 13:08:33.579404 26760 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.781260 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:33.756500 26762 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:33.794903 26583 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:33.795114 26660 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:33.798991 26818 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:08:33.755584 26686 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:33.799443 26817 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:08:33.799654 26825 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:33.799894 26754 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.007s
I20260709 13:08:33.850540 26754 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.852325 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:33.852785 26754 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:33.801366 26675 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:33.813925 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:33.782609 26798 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:33.819088 21492 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:33.821297 21643 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:33.786098 26530 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:33.837910 26816 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:33.839074 26826 ts_tablet_manager.cc:933] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
I20260709 13:08:33.839006 26603 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:33.840755 26556 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:33.842411 26652 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:33.830879 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:33.846949 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:33.854617 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:33.878129 22244 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:33.856657 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:33.859527 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45688.4us
I20260709 13:08:33.879290 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.825101 26661 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:33.862704 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:33.885463 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 54724.8us
I20260709 13:08:33.886523 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:33.863487 26675 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.845774 26660 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.888952 21459 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:33.902256 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.846436 26583 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:33.925279 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:33.877332 26652 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:33.932147 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45697.8us
I20260709 13:08:33.881851 26661 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:33.880366 26754 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:33.934618 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45726.8us
I20260709 13:08:33.885130 26532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43144 (request call id 4) took 3296 ms. Trace:
W20260709 13:08:33.944316 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.887814 26466 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:33.931720 26796 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:33.909264 26556 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:33.968423 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:33.880359 26603 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:33.931082 26530 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.952477 26661 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.945849 26762 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.972613 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:33.984143 21606 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:33.960021 21459 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:33.927620 26830 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:08:33.951203 26462 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:33.970117 26556 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.993443 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:33.970338 26825 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:34.008610 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:34.008814 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:33.973253 26693 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:33.975358 26677 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:34.022755 26677 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:34.023243 26677 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.023362 26837 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:34.007777 26725 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:34.026417 26725 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:33.989526 26652 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.027343 26725 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.029078 26693 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:33.962471 26532 rpcz_store.cc:276] 0709 13:08:30.587611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.587789 (+   178us) service_pool.cc:224] Handling call
0709 13:08:30.741659 (+153870us) log.cc:844] Serialized 513 byte log entry
0709 13:08:31.854997 (+1113338us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b54001b29a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f57dbe 00007f98a9f62930 00007f98a9f628d8 00007f98a9f62858 00007f98a9f62813 00007f98a9f61a9c 00007f98afe4d626 00007f98afe47dd8 00007f98a9f9e7cb 00007f98a9fa12c0
0709 13:08:33.883956 (+2028959us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6469,"raft.run_cpu_time_us":2127,"raft.run_wall_time_us":2127,"spinlock_wait_cycles":185801984,"thread_start_us":256815,"threads_started":1,"wal-append.queue_time_us":426071,"wal-append.run_cpu_time_us":10761,"wal-append.run_wall_time_us":1673516}
I20260709 13:08:34.029793 26693 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.031373 26532 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:34.031419 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 71523.1us
I20260709 13:08:33.972698 26572 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:33.906494 26744 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:33.974750 26838 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:34.047969 21491 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:34.019170 26831 log.cc:927] Time spent T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:34.097389 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:34.098476 21487 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:34.099242 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:34.100014 21568 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:34.019937 26603 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.108091 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:34.007573 26755 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:34.108346 22245 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:34.010263 26462 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.102092 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:34.020555 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:34.021633 26660 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:33.963223 26754 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:34.115178 21568 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:34.033051 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:34.031984 26693 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:33.979592 26762 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.110013 21564 raft_consensus.cc:2955] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:08:34.038179 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 71734.2us
I20260709 13:08:33.976570 26646 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:08:34.093501 26833 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:08:34.094476 26839 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:34.037081 26825 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.095062 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:34.013388 26556 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.106632 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:33.995087 26835 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:34.107811 21489 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.110941 26198 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:34.111070 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 90591.6us
I20260709 13:08:34.112751 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:33.974388 26624 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.116370 21641 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:33.982362 26542 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:08:34.116683 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:34.223281 21568 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:34.122399 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:34.122733 21532 leader_election.cc:400] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13.
I20260709 13:08:34.095345 26677 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:34.224673 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 102053us
I20260709 13:08:34.127800 21566 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:34.128751 21560 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:33.937463 26686 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:34.130939 22238 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:34.233594 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:34.233664 21487 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:34.114714 26650 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:34.125896 26762 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.114902 26462 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.227231 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:34.230384 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:34.231151 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:34.234995 26198 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:34.236713 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 100108us
I20260709 13:08:34.047276 26572 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.237349 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:34.239212 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 116882us
I20260709 13:08:34.239523 21565 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:34.239862 21568 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:34.271100 21568 pending_rounds.cc:85] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:08:34.271389 21568 pending_rounds.cc:107] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:34.270823 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:34.271672 21568 raft_consensus.cc:2889] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.273123 22210 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:34.276485 21493 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:34.277384 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.108883 26838 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.278465 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:34.279389 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52250.1us
I20260709 13:08:34.130729 26764 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 13:08:34.285867 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:34.287551 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:34.291954 21491 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:34.294503 26198 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.294919 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:34.297549 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:34.275125 26841 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.215272 26530 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:08:34.273957 26532 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.274549 26826 tablet_copy_client.cc:323] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
W20260709 13:08:34.303442 26842 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:08:34.242648 26603 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:08:34.303910 26342 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:34.310894 21391 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 145) took 21075 ms (client timeout 15000 ms). Trace:
I20260709 13:08:34.238463 26835 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:34.311900 26848 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:08:34.311620 26764 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:34.320447 21391 rpcz_store.cc:269] 0709 13:08:13.196718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.196907 (+   189us) service_pool.cc:224] Handling call
0709 13:08:13.671984 (+475077us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5400002490. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebe0b2 00007f98afe37a89 00007f98afdcfda6 00007f98afda1088 00007f98afe9f37e 00007f98ae3602a4 00007f98ae360232 00007f98ae360161 00007f98ae3600dc
0709 13:08:34.237300 (+20565316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17369,"reported_tablets":25,"spinlock_wait_cycles":57288448}
I20260709 13:08:34.321316 26764 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.321672 26764 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:34.324047 26838 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.324451 26835 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.322552 26764 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:34.324679 26661 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:34.325989 26764 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.326116 21485 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:34.299229 26760 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:08:34.332132 26836 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.296423 26828 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:34.278126 26466 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.285168 26749 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.299249 26830 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:34.298883 26851 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.300856 26580 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.270232 26650 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:34.360864 26843 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.334s	user 0.005s	sys 0.000s
I20260709 13:08:34.387838 26825 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.383298 26851 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.392863 26851 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.379357 26850 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.394039 26850 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.372072 26835 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.397620 26835 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:34.400301 26835 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:34.333315 26841 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.403882 26841 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.396944 26850 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.431298 26862 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.432143 26862 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.364177 26830 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:34.377475 26828 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:34.405169 26725 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.380394 26749 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:34.446908 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 207199us
I20260709 13:08:34.357199 26836 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.451589 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:34.457459 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:34.460347 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 113838us
I20260709 13:08:34.452718 26862 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:34.477241 26836 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:34.481005 26462 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.449070 26828 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.486088 26828 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:34.487319 26572 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.488175 26851 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.457057 26754 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:34.495257 21487 raft_consensus.cc:2368] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18.
I20260709 13:08:34.454372 26725 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.510198 26725 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:34.457980 26693 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.496982 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:34.455232 26841 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:08:34.523824 26693 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.497979 26850 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:34.524878 26738 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:34.525805 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:34.498098 26572 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:34.490469 26677 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:34.516027 26650 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:34.516371 26662 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.542909 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.520339 26556 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:34.455015 26749 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.521392 26830 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:34.522746 26661 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:34.528683 26825 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:34.550802 26825 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:34.552073 26749 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:34.551997 26825 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.554219 26556 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:34.531490 26462 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.545554 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:34.543563 26646 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:34.549348 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.557004 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.550562 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:34.556674 21642 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:34.557062 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.549789 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.558434 21641 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:34.558916 21640 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:34.533331 26725 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:08:34.560784 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.561647 26725 consensus_queue.cc:1243] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:34.559896 26646 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.607312 26646 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:34.608584 26840 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.526s	user 0.003s	sys 0.000s
I20260709 13:08:34.614665 26762 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.646497 26762 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.647387 26583 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:34.647944 26869 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:08:34.769990 21486 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.776023 21488 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:34.819332 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:34.819834 21567 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:34.819722 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:34.820518 21567 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:34.820902 21560 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:34.821219 21562 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:34.822810 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:34.822356 21567 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.823164 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:34.825254 21567 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.831769 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:34.845575 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.846940 26603 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.847520 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.847770 26546 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:34.848233 26606 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:34.849442 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.848930 26546 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:34.849287 26606 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:34.847802 26603 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.851498 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.852308 26606 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.852476 21638 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:34.853592 26603 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.854257 26603 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.857429 26546 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:34.858734 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.862195 26603 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.859937 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.870759 21641 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:34.875217 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:34.876444 21635 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:34.879875 26662 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:34.908659 26841 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.857656 26572 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:34.916692 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:34.911312 26749 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.919648 21563 pending_rounds.cc:85] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:08:34.920156 21563 pending_rounds.cc:107] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:34.880640 26662 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.909912 26841 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:34.920485 21563 raft_consensus.cc:2889] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.927973 26572 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.930006 21635 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:34.934871 26572 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.935434 26749 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.936251 26869 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:34.937477 26869 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:34.927634 26603 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:34.940871 26749 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:34.953578 26841 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:34.955291 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:34.956027 21635 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:34.956774 26725 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.957336 26725 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.957731 26725 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:34.958974 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 43991.1us
I20260709 13:08:35.002286 21567 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:08:34.963500 26869 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.003155 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.002686 21567 pending_rounds.cc:85] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 7
I20260709 13:08:35.008006 21567 pending_rounds.cc:107] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:08:35.008244 21567 raft_consensus.cc:2889] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.971413 21560 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:35.013281 21642 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:35.017091 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:35.001106 26749 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.029445 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.030843 21643 raft_consensus.cc:2410] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:35.031419 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.032140 21638 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:08:35.033082 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.034718 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.035470 21636 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
W20260709 13:08:35.038030 26858 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.682s	user 0.003s	sys 0.026s
I20260709 13:08:35.023989 26841 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:35.039666 26841 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.038173 21636 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:08:35.041887 21636 pending_rounds.cc:85] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 6
I20260709 13:08:35.042197 21636 pending_rounds.cc:107] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:35.042457 21636 raft_consensus.cc:2889] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:35.043838 26838 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:35.044320 26838 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:35.045698 26838 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.046520 26841 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.047163 26838 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.048090 26662 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:35.051054 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.051767 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:35.052042 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 79819.3us
I20260709 13:08:35.052584 21642 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:35.058928 26198 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:35.060000 26198 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.061044 26198 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:35.026477 26869 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:35.074870 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.075506 26652 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.078729 26820 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.078578 26869 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.079694 26820 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:35.082018 26869 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:35.085750 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.055364 26749 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.104105 26841 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:35.111078 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:35.100317 26820 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.113691 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:35.120975 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.107787 26662 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:08:35.124485 26841 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.127018 21567 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:35.128134 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:35.090556 26869 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.122638 21635 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:35.136632 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:35.139740 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:35.131554 26662 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.144650 26662 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.146306 26841 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.148139 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 829) took 1115 ms. Trace:
I20260709 13:08:35.143790 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2424) took 1165 ms. Trace:
I20260709 13:08:35.148665 21490 rpcz_store.cc:276] 0709 13:08:34.032329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.033944 (+  1615us) service_pool.cc:224] Handling call
0709 13:08:34.039385 (+  5441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.039598 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:34.118207 (+ 78609us) log.cc:844] Serialized 14 byte log entry
0709 13:08:35.054764 (+936557us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b180026af40. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:08:35.107139 (+ 52375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:35.116869 (+  9730us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:35.147611 (+ 30742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.147745 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.147943 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21752,"prepare.queue_time_us":232536,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":76,"raft.queue_time_us":868146,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":290,"spinlock_wait_cycles":6929792,"thread_start_us":231286,"threads_started":2,"wal-append.queue_time_us":257609}
I20260709 13:08:35.157804 26869 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.158407 26662 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.160579 26869 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:35.161594 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.163214 21563 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:35.152482 21486 rpcz_store.cc:276] 0709 13:08:33.978252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.979538 (+  1286us) service_pool.cc:224] Handling call
0709 13:08:33.989147 (+  9609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.771275 (+782128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.143312 (+372037us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54000b7054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:35.143630 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793908096}
I20260709 13:08:35.171037 26749 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.155514 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:35.180076 26198 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.183517 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:35.136684 26820 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.185983 26820 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.188426 26820 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.189033 26820 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.189405 26820 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.189774 26820 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.195672 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:35.197630 26749 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.198424 26749 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.200958 26749 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.205026 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.214982 26724 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.216082 26724 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.220341 26725 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.143838 26067 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:08:35.223498 26725 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.223695 26799 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.226214 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:35.228693 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:35.234472 21641 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:35.240968 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:35.242048 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:35.242496 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:35.243835 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.243701 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:35.244246 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:35.245123 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:35.247586 26198 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:35.254379 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.257462 22244 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:35.257799 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:35.258591 26823 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:35.254186 21485 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:35.260576 26799 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.260763 21392 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:35.254994 26838 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:35.263024 21492 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:35.263641 26838 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:35.264611 26861 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.909s	user 0.014s	sys 0.005s
W20260709 13:08:35.264859 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 50549.4us
I20260709 13:08:35.264786 26838 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.265925 26572 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:35.266597 26572 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:35.267524 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 72280.3us
I20260709 13:08:35.268689 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:35.252731 26749 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.269132 26872 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.270378 26872 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.271800 26799 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.272806 26872 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.273377 26872 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.273947 26872 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.274194 22244 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:35.276993 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:35.277740 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:35.278272 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:35.279294 22245 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:35.281286 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:35.270021 26749 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.268946 26572 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.291826 22244 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:35.291890 21487 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:35.299152 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 837) took 1204 ms. Trace:
I20260709 13:08:35.262509 21392 catalog_manager.cc:5697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.299674 21488 rpcz_store.cc:276] 0709 13:08:34.094279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.117103 (+ 22824us) service_pool.cc:224] Handling call
0709 13:08:34.117410 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.776722 (+659312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.284786 (+508064us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b5400276ad4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:35.299092 (+ 14306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513081216}
I20260709 13:08:35.304185 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:35.308771 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.311044 26869 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.311776 26869 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.312567 21392 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:35.315214 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.315703 26886 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.315943 21641 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:08:35.316273 26886 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.318771 26572 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.318897 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:35.319444 26724 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.320003 21561 raft_consensus.cc:2410] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:35.320712 21494 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:35.321264 26872 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:35.321852 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.321985 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:35.314179 21392 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:35.322610 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:35.324894 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:35.324755 21392 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:35.326934 26572 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:35.327975 21491 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:35.327677 26572 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.325273 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:35.303550 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 853234us
I20260709 13:08:35.263648 26820 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.346820 26886 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.347550 21485 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:35.347779 21489 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:35.348647 26646 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:35.349414 26646 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.348747 26885 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.351260 26885 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.350435 26823 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:35.350704 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:35.343750 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 868328us
I20260709 13:08:35.326685 21392 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 16, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:35.381568 26830 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.368947 26572 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:35.399111 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 130600us
I20260709 13:08:35.400869 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:35.402036 26820 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.413806 21459 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:35.416402 26447 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:08:35.419173 21564 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:35.416808 26856 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:08:35.386729 26823 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.428592 26856 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:35.429014 26856 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:35.429677 26823 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.415995 26659 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.431401 26659 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:35.431789 26659 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.430033 26856 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.433441 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:35.433503 26856 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.435055 26572 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.436213 26636 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:35.436657 26636 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:35.437031 26636 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.411525 26869 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.414309 26646 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.421887 26838 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:35.443771 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:35.417006 26885 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:35.467610 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:35.473661 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:35.471544 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:35.486266 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:35.452941 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51499.4us
I20260709 13:08:35.505438 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:35.508491 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:35.508910 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:35.533026 21567 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:35.512552 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:35.517982 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:35.481227 21562 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:35.470378 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:35.467342 21640 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:35.512926 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:35.507946 21569 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:08:35.467417 21641 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:08:35.542601 21635 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.508136 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:35.496065 26659 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.467164 21392 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:35.518489 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:35.486037 26891 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:08:35.554409 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.553030 21643 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:35.510573 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:35.511643 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:35.516997 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:35.470036 26820 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.537602 26838 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.508823 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:35.570350 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.565879 21563 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.506718 26888 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:35.486545 26681 tablet_copy_client.cc:538] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:35.579334 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:35.577032 26466 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.487078 26890 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.605629 21564 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:08:35.614185 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.574853 26820 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.592330 21392 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 12, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 12 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:35.617625 26662 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:08:35.583947 26838 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.580232 26636 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.624641 26662 consensus_queue.cc:1243] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:35.633455 26820 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:35.624612 26572 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:35.634753 26572 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.635212 26572 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.602151 26888 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.637964 26646 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:35.638490 26646 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:08:35.639400 26894 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 13:08:35.642930 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 157034us
I20260709 13:08:35.644531 26827 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:35.645494 26102 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:35.646600 26827 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:35.647040 26827 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:35.639725 26646 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.651194 26749 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.651451 26646 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.623111 26447 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:35.652782 26447 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.653314 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:35.654212 22238 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:35.648196 26827 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:35.663259 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 111508us
I20260709 13:08:35.664183 21392 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:35.665238 21635 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:35.602931 26869 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:08:35.671396 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.672096 21642 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:08:35.676295 21392 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 13, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:08:35.715124 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.709756 26659 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.724941 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:35.723445 21392 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:35.714453 26447 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.739198 21489 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:35.676291 26890 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.736654 26827 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.740823 26780 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.759214 26780 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.762616 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.763332 21638 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:08:35.763873 26572 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.761521 26780 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:35.770076 26636 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.734346 26888 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.771852 26659 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.775472 21503 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet d46f34ab738d4d38b09f9d1228d68c7d from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
W20260709 13:08:35.788424 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 87376.4us
W20260709 13:08:35.777381 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.743713 21392 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 16, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 16 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.772645 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:35.778553 26466 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:35.793496 21563 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
W20260709 13:08:35.799300 26897 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:08:35.799460 21503 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet d46f34ab738d4d38b09f9d1228d68c7d from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-d46f34ab738d4d38b09f9d1228d68c7d
I20260709 13:08:35.798457 21392 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 15, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 15 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.815074 21486 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:35.805729 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:35.810914 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.806054 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:35.825256 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:35.794632 26780 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:35.827389 21563 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:35.805685 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:35.814006 26901 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:08:35.797034 26572 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:35.830540 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:35.801028 26659 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.838639 26102 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:35.828881 26780 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.831653 26636 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.849766 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.850836 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:35.851258 22238 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:35.847659 26823 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.852998 21392 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:35.847173 26780 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.856958 26852 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:08:35.859048 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:35.859257 26342 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:35.861495 26885 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:08:35.855685 26823 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.842837 26466 consensus_queue.cc:1059] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:08:35.855999 26888 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.870604 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:35.866061 21392 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 12, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 12 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.879148 21392 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:35.868237 26669 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:35.873742 26447 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:35.873116 26823 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.881167 21459 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:35.857467 26636 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.874502 26888 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:35.887006 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:35.886225 21392 catalog_manager.cc:5697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 10 to 13, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:35.872771 26749 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:08:35.882197 26669 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:35.880234 26572 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:35.872573 26342 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.890822 26888 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:35.900305 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48123.7us
I20260709 13:08:35.897168 26885 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:35.904476 21392 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:35.905378 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:35.895745 26652 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:35.903216 26067 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.896965 26800 raft_consensus.cc:3055] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:35.911809 26800 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:35.912107 26889 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:35.896122 26838 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:35.896736 26572 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.914992 26067 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.919910 26067 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:35.910395 21392 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 12, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 12 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.907677 26885 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:35.909746 26652 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:35.923656 26885 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.922897 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:35.913578 26889 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:35.923797 26652 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.924121 26572 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.934217 26636 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:35.915038 26822 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:08:35.933296 26852 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:35.937863 26342 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:35.922223 26659 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:35.929275 26905 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:08:35.945514 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:35.947526 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:35.949602 26852 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:35.943006 26887 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.924921 26838 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:35.955075 26852 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:35.958966 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:35.961175 26889 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.962625 26889 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.965214 26681 tablet_bootstrap.cc:492] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
W20260709 13:08:35.969899 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55454.1us
W20260709 13:08:35.975957 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61740.1us
I20260709 13:08:35.931072 26800 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:35.977532 26822 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:08:35.982666 22238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:35.983608 22238 raft_consensus.cc:606] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:35.984045 22238 raft_consensus.cc:614] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:35.985853 21503 tablet_copy_source_session.cc:215] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:35.975854 26342 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:35.999553 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.995383 26890 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:36.036374 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 133436us
I20260709 13:08:35.982288 26447 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:35.958508 26669 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.042514 22238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:36.042883 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.043707 22238 raft_consensus.cc:606] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:36.044274 22238 raft_consensus.cc:614] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:36.051620 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.057471 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:36.057852 21486 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:08:36.055717 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:36.062001 26342 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.062755 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:36.062685 26342 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.063701 21563 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:36.065220 26342 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.071902 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:36.073546 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:36.076869 26909 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:36.080394 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:36.066862 26669 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.070950 26852 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.100081 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:36.101322 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.102475 26907 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.104686 26830 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:36.105439 26830 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:36.105928 26830 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.106626 26826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46f34ab738d4d38b09f9d1228d68c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:36.115187 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:36.117003 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.118028 21486 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:36.094740 26652 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.132321 22240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:36.132973 22240 raft_consensus.cc:606] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:36.133325 22240 raft_consensus.cc:614] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:36.137303 26823 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.155318 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.160502 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:36.170830 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.172415 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 100580us
I20260709 13:08:36.173885 21568 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:36.174135 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:36.129093 26830 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:36.180509 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 125058us
I20260709 13:08:36.181427 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:36.171811 26342 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.125422 26852 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.195137 26067 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:36.180689 26913 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:36.213132 21485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:36.214607 21485 raft_consensus.cc:606] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:36.214985 21485 raft_consensus.cc:614] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:36.217711 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:36.217970 26909 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:36.129957 26447 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.221518 26652 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.222028 26906 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:08:36.233362 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.194381 26869 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:36.217283 26800 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.195602 26342 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.216490 26913 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.214270 26838 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:08:36.252496 22240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
W20260709 13:08:36.253603 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 72302.9us
I20260709 13:08:36.234861 26909 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:36.253360 22240 raft_consensus.cc:606] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:36.239312 26914 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:08:36.260084 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58391us
I20260709 13:08:36.243620 26342 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.261873 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:36.259487 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:36.264627 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.243254 26913 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.257956 26909 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:36.243767 26869 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.268072 26915 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:36.279019 26915 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:36.279479 26915 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:36.268500 26466 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.270344 26067 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:08:36.282941 26823 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:36.283267 26067 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:36.283634 26067 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:36.284142 26869 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:36.284495 26067 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.284838 26913 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.285732 26067 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.288466 26852 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.293592 26822 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:36.294066 26822 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:36.271657 26888 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.295158 26822 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.296511 26822 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.296775 26888 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:36.300354 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:36.304863 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:36.306006 22240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:36.306604 22240 raft_consensus.cc:606] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:36.307225 22240 raft_consensus.cc:614] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:36.307097 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:36.269650 26907 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:08:36.314620 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49079.5us
I20260709 13:08:36.330585 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:36.329259 26906 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:08:36.333628 26906 consensus_queue.cc:1243] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:36.308131 26889 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:36.344058 26914 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:36.344642 26914 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.344444 26889 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.346585 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:36.348515 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:36.355221 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:36.356364 26659 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:36.357465 26659 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:36.358765 26659 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.370849 26067 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.311523 26913 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:36.315515 26919 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:36.371721 26067 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.373113 26067 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.379640 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:36.307675 26885 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.390151 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:36.369833 26890 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.392006 21485 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:36.395442 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.396716 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:36.398510 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:36.399329 21640 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:36.404871 21489 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:36.405081 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:36.405463 21642 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:08:36.405848 21642 pending_rounds.cc:85] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 8
I20260709 13:08:36.406221 21642 pending_rounds.cc:107] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:08:36.406564 21642 raft_consensus.cc:2889] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:36.357646 26572 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.405716 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:36.376287 26659 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.376312 26919 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:36.411548 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:36.410043 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.414680 21638 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:36.416455 21634 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:36.419288 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:36.419994 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.421432 26067 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.425213 21489 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:36.427484 26749 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.427914 26749 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:36.428265 26749 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.429584 26885 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:36.431291 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:36.431919 22244 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.419672 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:36.432849 26572 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.435038 21564 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:36.414415 26780 consensus_meta.cc:287] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.547s	user 0.014s	sys 0.001s
I20260709 13:08:36.438652 26780 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.440210 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:36.442608 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.440999 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:36.394328 26823 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.448428 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:36.448549 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:36.442063 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:36.449112 21635 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.449170 22240 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.450224 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:36.455358 26067 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.456944 21490 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:36.458595 21638 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:36.460599 21486 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:36.458999 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:36.422926 26919 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.420969 26913 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:36.470213 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.453336 26572 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:36.386135 26909 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:08:36.480435 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.483697 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.510s (SENT) [suppressed 2 similar messages]
W20260709 13:08:36.484664 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet eae01b9fdd5340dc9416e5834263a4d6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5a34fd3290de493eb6bbe828dd742772 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:36.490325 26909 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.460481 26889 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:36.465982 26466 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.463411 26915 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.487730 26572 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.494961 22244 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:36.448108 26636 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:08:36.498974 21532 leader_election.cc:400] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18.
I20260709 13:08:36.506636 21532 leader_election.cc:403] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.458128 26823 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.510665 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:36.511338 21643 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.515645 21635 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:36.474545 26838 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:36.523900 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.476382 26913 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.529075 21491 raft_consensus.cc:2410] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:36.536962 26826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60044 (request call id 839) took 3101 ms. Trace:
I20260709 13:08:36.545516 26915 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:36.548532 21489 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:36.549409 26929 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:36.549902 26342 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.549980 26929 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.552500 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.554140 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.554800 26888 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:36.555243 26888 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:36.556094 26888 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.557065 26913 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.557335 26888 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.555235 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.565332 21490 raft_consensus.cc:2410] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:08:36.521590 26909 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18.
I20260709 13:08:36.506985 26827 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:36.579782 21564 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:36.581650 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.583398 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 105652us
I20260709 13:08:36.583859 21643 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:36.584930 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:36.585237 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.499531 26466 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.586869 22240 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:36.587055 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.562947 26838 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.601253 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.586247 26913 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.619359 26913 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.602180 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.537696 26826 rpcz_store.cc:276] 0709 13:08:33.435207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.435360 (+   153us) service_pool.cc:224] Handling call
0709 13:08:33.876064 (+440704us) ts_tablet_manager.cc:934] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
0709 13:08:35.034762 (+1158698us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b4c000ee380. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a82aea20 00007f98a82bfa29 00007f98a82c013f 00007f98a82842ab 00007f98a82b1f3c 00007f98a82b2461 00007f98a82b2768 00007f98ae0382eb 00007f98aef5dd3b 00007f98aef58008 00007f98aef57405
0709 13:08:36.105163 (+1070401us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:36.209226 (+104063us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:36.209365 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:36.535234 (+325869us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:36.535861 (+   627us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:36.536465 (+   604us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:36.536808 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":139500,"spinlock_wait_cycles":60809088,"tablet-copy.queue_time_us":379089,"thread_start_us":336273,"threads_started":2}
I20260709 13:08:36.620160 26838 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:36.600530 21488 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:36.622591 26913 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:36.615574 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 98207.3us
I20260709 13:08:36.639827 26572 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:36.585618 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 101949us
I20260709 13:08:36.625656 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:36.628175 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.622027 21494 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:36.647897 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.654994 21568 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:36.660002 21493 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:36.626616 26887 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.623895 26928 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:36.622668 26826 tablet_copy_client.cc:806] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:36.575125 26799 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:08:36.679502 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:36.681557 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.687139 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.626776 26749 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.688371 21642 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:36.748620 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 123026us
I20260709 13:08:36.653280 26908 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:08:36.764374 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.687556 26838 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.765139 21488 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:36.776578 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.796790 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.677806 26887 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.797989 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.748720 26572 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:36.801051 21491 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:36.777607 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.778724 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:36.802119 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.779413 26466 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:36.779897 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.780001 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:36.780833 26800 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:36.781584 26780 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.783481 26749 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:36.787158 26823 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:36.794775 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 115590us
W20260709 13:08:36.777277 26927 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.226s	user 0.000s	sys 0.004s
I20260709 13:08:36.779117 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.806950 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:36.756698 26826 tablet_copy_client.cc:670] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:36.825340 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.826520 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.836571 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:36.679984 26928 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.842259 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:36.845414 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.845417 21487 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.847460 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.810830 26800 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:36.811837 26908 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:36.799010 26572 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.851593 26342 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.859700 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:36.865757 21494 raft_consensus.cc:2410] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:08:36.836880 26823 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:36.867010 26823 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:36.867403 26823 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.867980 26466 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:36.868290 26572 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.868414 26466 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:36.862986 26908 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.853216 26838 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:36.870436 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.840804 26929 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:36.869475 26466 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.871968 26887 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.872552 26888 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:36.872963 26888 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:36.860455 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:36.877575 21642 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
W20260709 13:08:36.862613 26822 consensus_meta.cc:287] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.566s	user 0.002s	sys 0.011s
I20260709 13:08:36.883924 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.884611 21494 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:36.886164 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:36.886807 21561 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
W20260709 13:08:36.892236 26914 consensus_meta.cc:287] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
I20260709 13:08:36.877565 26799 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:36.892974 26914 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.894491 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.896729 21489 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:08:36.895457 21485 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:36.896732 26838 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.899932 26838 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:36.900317 26838 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.860674 26928 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:36.902537 26799 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.903807 26908 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:36.904701 26799 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:36.864410 26800 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.907047 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:36.907204 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:36.907510 21564 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:36.909309 26909 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.909682 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:36.910043 26909 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:36.910519 26915 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:36.916976 26800 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.917229 26915 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.920506 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.920769 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.921450 21492 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:08:36.922430 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.921465 21489 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:36.923138 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.923520 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.924126 21492 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:36.924258 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.924901 21493 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:36.925042 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:36.925822 21491 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:36.926724 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.912552 26466 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.913187 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:36.873873 26888 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:36.935504 26067 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:36.928038 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 105595us
I20260709 13:08:36.884344 26681 tablet_bootstrap.cc:492] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.944751 21487 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:36.948437 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:36.957211 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:36.957063 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:36.964044 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.966907 26919 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.957023 26572 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:08:36.968173 21568 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:36.959144 26909 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:36.970309 26913 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:36.971172 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:36.975553 26681 tablet_bootstrap.cc:492] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:08:36.976740 26681 ts_tablet_manager.cc:1403] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 1.012s	user 0.050s	sys 0.033s
I20260709 13:08:36.934535 26822 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:36.988795 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:36.990101 26928 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:36.990679 26928 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:36.991333 26929 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.991909 26929 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:36.993180 26928 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:36.994300 26929 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:36.999310 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61785.9us
I20260709 13:08:37.000447 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:37.001322 26914 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:37.002187 26822 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.003175 26944 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:37.003760 26944 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:08:37.004472 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.005162 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:37.004683 26944 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.005873 21641 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:37.008033 26067 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:37.002399 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:37.010922 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:37.014101 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:37.014999 21635 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:37.015861 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:37.019958 21490 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:37.018803 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:37.024755 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.020056 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.026264 21568 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:37.027017 26067 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:37.027381 26067 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:37.004818 26822 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:37.012080 26888 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:37.037593 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:37.016932 26342 consensus_queue.cc:1059] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:08:37.038355 22247 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:37.038939 26749 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:37.039747 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:37.040670 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:37.041271 22242 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:37.037618 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:37.019543 26941 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:37.029544 26914 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:08:37.050243 26941 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:37.051254 26941 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.056344 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:37.024930 26945 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.058094 26945 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.058492 26945 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.059646 26572 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:37.060200 26572 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:37.061093 26572 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:37.067201 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:37.070210 26342 raft_consensus.cc:3055] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:37.070673 26342 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:37.077373 26780 raft_consensus.cc:993] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:37.077936 26780 raft_consensus.cc:1081] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:37.027721 26913 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:08:37.100018 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 70648.2us
I20260709 13:08:37.100306 26950 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:37.100929 26950 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:37.103138 26950 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:37.103729 21532 consensus_peers.cc:597] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fad88e2e67d44f7adb559c0a8eb0af8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.104743 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.106379 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:37.108917 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:37.015334 26823 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:37.116947 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:37.092849 26919 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:37.123198 26919 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.116153 26681 raft_consensus.cc:359] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:37.125788 26681 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:08:37.119479 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:37.126475 26681 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:37.127080 26823 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:37.127707 26823 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:37.129271 26681 ts_tablet_manager.cc:1434] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.152s	user 0.004s	sys 0.004s
I20260709 13:08:37.129920 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:37.130514 22241 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.122078 26838 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.125360 26919 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.142515 26067 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:37.143343 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:37.144405 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:37.135401 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:37.135967 22245 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:37.161252 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:37.162161 22244 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:37.105293 26950 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:37.164439 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:37.166025 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.167366 22212 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:37.138882 26823 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.145782 26928 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.180382 26067 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:37.181252 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 72422.9us
I20260709 13:08:37.159263 26907 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:37.182421 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:37.168812 26826 tablet_copy_client.cc:538] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:37.192466 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.182075 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:37.197906 22241 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:37.200958 22242 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:37.174642 26929 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.176306 21561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:36572
I20260709 13:08:37.168691 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-06b5fb42c147456889a1843340b22720 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:08:37.205626 21561 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.206084 21561 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:37.209544 21637 raft_consensus.cc:1217] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[10.6-13.8]   Dedup: 10.6->[11.7-13.8]
W20260709 13:08:37.210376 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 66082.8us
I20260709 13:08:37.202412 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:08:37.216799 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.218680 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:37.217674 21642 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:37.210035 21637 pending_rounds.cc:85] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 6
I20260709 13:08:37.220042 21637 pending_rounds.cc:107] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:37.220319 21637 raft_consensus.cc:2889] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:37.224252 21560 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:37.238910 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-06b5fb42c147456889a1843340b22720 on tablet 06b5fb42c147456889a1843340b22720 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:08:37.252681 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:37.253384 21641 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:37.255198 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:37.257414 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.185111 26907 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:37.262931 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.264973 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:37.265722 21636 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.259316 26838 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:37.199586 26944 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.260968 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:37.267206 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.220343 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.238945 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:37.208019 26915 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:37.276444 26067 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.179978 26823 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:37.278964 26929 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.274814 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:37.285452 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:37.286196 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 93803.2us
I20260709 13:08:37.286688 21566 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:37.287124 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:37.269472 26749 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.288769 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.267808 26913 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:37.267450 26907 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.304107 22238 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:37.298609 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.298233 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.276006 26636 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.306363 26636 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.291751 26928 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:37.283578 26929 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:37.286350 26915 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:37.314407 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:37.295810 26889 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:37.283355 26921 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:08:37.281409 26930 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:08:37.327224 21392 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 238) took 12244 ms (client timeout 15000 ms). Trace:
W20260709 13:08:37.335373 26952 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:37.313570 26928 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.343747 21561 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.317127 26929 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.363226 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:37.367202 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:37.319124 26889 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:37.318286 26913 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:37.293071 26342 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.356645 26749 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:37.387379 21561 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:37.364140 26928 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.310314 26945 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.392719 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:37.393934 26067 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:37.401697 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.403257 26067 consensus_queue.cc:1243] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 549b31ac31b6428994b45938abc223a7 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:37.404024 26067 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:37.386373 26889 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.404414 26067 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:37.407397 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:37.391479 26749 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:37.420773 26067 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.422600 26067 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.429527 26959 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:37.409015 26887 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:37.430215 26959 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:37.452006 26887 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:37.452488 26959 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.452948 26887 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:37.432087 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.408432 26915 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.456053 21568 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:37.455706 26913 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.457783 26780 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:37.458940 26948 raft_consensus.cc:3055] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:37.423837 26749 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.459369 26948 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:37.460290 26948 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.461458 26948 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:37.438668 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:37.441684 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:37.442081 22247 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:37.444525 26342 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:37.445341 26944 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:37.329551 21392 rpcz_store.cc:269] 0709 13:08:25.075544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.075824 (+   280us) service_pool.cc:224] Handling call
0709 13:08:37.319653 (+12243829us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:36.112225 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:36.113053 (+   828us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:36.113121 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:08:36.113164 (+    43us) tablet.cc:662] Decoding operations
0709 13:08:36.134735 (+ 21571us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:36.134868 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:36.134899 (+    31us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:08:36.162164 (+ 27265us) tablet.cc:701] Row locks acquired
0709 13:08:36.162205 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:08:36.162444 (+   239us) write_op.cc:270] Start()
0709 13:08:36.162641 (+   197us) write_op.cc:276] Timestamp: P: 1783602516162353 usec, L: 0
0709 13:08:36.162685 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:08:36.163740 (+  1055us) log.cc:844] Serialized 7677 byte log entry
0709 13:08:36.532235 (+368495us) op_driver.cc:464] REPLICATION: finished
0709 13:08:36.768868 (+236633us) write_op.cc:301] APPLY: starting
0709 13:08:36.768990 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.820958 (+ 51968us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.821096 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.965187 (+144091us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.965596 (+   409us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:08:36.965652 (+    56us) write_op.cc:312] APPLY: finished
0709 13:08:36.966153 (+   501us) log.cc:844] Serialized 172 byte log entry
0709 13:08:36.966367 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.966562 (+   195us) write_op.cc:454] Released schema lock
0709 13:08:36.966670 (+   108us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.967178 (+   508us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.967210 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":172304,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":228168,"apply.run_cpu_time_us":33018,"apply.run_wall_time_us":198329,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83471,"num_ops":19,"prepare.queue_time_us":117772,"prepare.run_cpu_time_us":20979,"prepare.run_wall_time_us":185486,"raft.queue_time_us":177963,"raft.run_cpu_time_us":11237,"raft.run_wall_time_us":145038,"replication_time_us":369364,"thread_start_us":339865,"threads_started":4,"wal-append.queue_time_us":150976}]]}
I20260709 13:08:37.437098 26945 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:37.464316 21566 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:37.464370 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 57059.8us
I20260709 13:08:37.485288 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:37.466109 21639 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:37.473924 26823 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:37.450300 21390 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 10 to 13, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 13 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:37.478402 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.483893 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:37.489486 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 202386us
I20260709 13:08:37.451646 26889 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.555033 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:37.555418 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:37.513338 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.578303 22243 raft_consensus.cc:2368] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14.
I20260709 13:08:37.579808 21390 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.483762 26929 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:37.583069 26929 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:37.583429 26930 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:37.583983 26930 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.585996 26930 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:37.587728 26889 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:37.592482 26971 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.593163 26971 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.545503 26888 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:37.599134 21494 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:08:37.599761 21494 pending_rounds.cc:85] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 13
I20260709 13:08:37.600010 21494 pending_rounds.cc:107] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:08:37.600227 21494 raft_consensus.cc:2889] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:37.601563 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:37.603611 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:37.603408 21390 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 6 to 8, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 8 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.604348 21486 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:37.605571 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:37.605103 21390 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 16, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:37.606182 21486 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:37.608039 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:37.599257 21636 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:37.545503 26466 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:08:37.610212 26826 tablet_bootstrap.cc:492] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:08:37.610769 26971 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:37.619302 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:37.481276 26944 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.620949 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:37.621861 21485 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:37.626996 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:37.628542 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:37.629112 21564 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.628090 21486 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:37.617225 26888 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:37.650326 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.647194 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.648803 21485 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:37.657168 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.657454 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.660641 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.664711 26823 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:37.665393 26823 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:37.667667 26823 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:37.691628 21636 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:37.695760 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:37.697187 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46972.4us
I20260709 13:08:37.707958 21566 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:37.688090 21390 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.710851 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:37.711932 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.714536 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.715853 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:37.717691 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.720849 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.721110 26067 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.721892 21561 raft_consensus.cc:2393] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:37.735589 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.744661 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.709856 26659 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.716965 26830 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:37.755756 26067 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.719113 26921 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:37.760470 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:37.761060 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.740038 26822 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:37.800165 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.717208 26799 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:08:37.756934 26969 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.760344 26921 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.801292 21390 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 7 to 8, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 8 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:37.812512 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.815080 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.816208 21561 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:37.787292 26830 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:37.815622 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:37.813532 26921 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.829687 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:37.832517 21390 catalog_manager.cc:5697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.837486 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:37.819491 26970 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:37.842389 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.843482 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:37.844877 21562 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:37.784466 26928 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:37.844944 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 93936.9us
I20260709 13:08:37.851159 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.847748 21390 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.851914 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:37.831933 26889 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.858384 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:37.853842 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.861059 26749 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.862674 26928 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:37.863330 26749 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:37.799667 26888 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:37.875974 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:37.858438 26976 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:37.852691 26978 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.888993 21390 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 16, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.887835 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:37.886199 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.870754 26971 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.889905 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:37.874797 26928 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.891470 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:37.867870 26889 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:37.892777 26971 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:37.915210 26971 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.915323 21390 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 15 to 16, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.894739 21639 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:08:37.920886 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.921797 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.921475 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:37.888262 26929 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.923410 21390 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.888494 26976 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:37.914340 26907 consensus_meta.cc:287] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.008s
I20260709 13:08:37.890420 26944 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:37.944315 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52910.5us
W20260709 13:08:37.908983 26980 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:37.890798 26978 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:37.927794 21564 raft_consensus.cc:2410] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
W20260709 13:08:37.951865 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.897476 26889 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.955991 21390 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 11 to 13, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:37.957682 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:37.897307 26856 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.987958 21565 raft_consensus.cc:2410] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:08:37.990217 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:37.893527 26659 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:08:37.935499 26972 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:08:37.993964 26342 consensus_meta.cc:287] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.001s
I20260709 13:08:38.010082 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:38.011474 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:38.012903 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:38.013195 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:38.016263 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:38.016551 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:38.017750 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:38.021127 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:37.991353 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:38.024286 21635 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:38.026105 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:38.027101 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:38.028388 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:38.030911 21565 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:38.028400 21562 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:38.044279 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 159787us
I20260709 13:08:38.044608 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:38.039264 26067 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.045315 21564 raft_consensus.cc:2393] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:38.045523 26067 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.044317 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:38.042553 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:38.048219 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 56986.2us
I20260709 13:08:38.048401 26067 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:38.049738 21635 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:38.052421 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:38.052783 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:38.053102 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:38.053699 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.054186 22241 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:38.055351 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.055968 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:38.056209 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:37.953859 26822 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.056087 21494 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:08:38.055472 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.054121 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:38.057492 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:38.064303 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.059583 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.064476 22244 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:38.064455 21643 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:37.953190 26976 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:38.061131 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:37.986174 26978 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.062685 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:37.992635 26856 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.057862 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:38.056499 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:38.056962 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:38.066475 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 145081us
I20260709 13:08:38.069730 21492 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:37.963811 26907 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:38.056118 26975 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.410s	user 0.003s	sys 0.000s
I20260709 13:08:38.073086 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.071768 21490 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.076419 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:38.077311 21643 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:38.079172 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.079802 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:38.080188 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:38.065687 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.079108 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:37.908339 26830 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.072415 26856 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:38.108664 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:38.079195 26800 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.111191 26800 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.113873 26800 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:38.093528 26749 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.117369 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:38.062541 26659 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.121059 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:38.093168 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.128528 22238 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:38.095615 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:38.125612 21643 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:08:38.035171 26930 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:38.057178 26982 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.092226 21634 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:38.120498 26067 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:38.137375 21487 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:38.051316 26921 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.139809 21488 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:38.141948 26921 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:38.142230 22247 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 8.
I20260709 13:08:38.133283 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:38.071581 26941 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:38.134256 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:38.134929 21490 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:38.130895 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:38.145944 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.144327 22243 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
W20260709 13:08:38.147888 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 67775.6us
I20260709 13:08:38.149084 21489 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:38.150926 22241 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 7.
I20260709 13:08:38.155367 21568 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.155630 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:38.160405 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 75985.9us
I20260709 13:08:38.161872 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.162357 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:38.163764 21562 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:38.164266 21562 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:38.165568 21634 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:38.166932 21643 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:38.163093 21565 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:38.173868 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:38.165160 21562 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.175608 21562 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.177222 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:38.178804 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:38.150223 26941 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.180120 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:38.180819 21638 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:38.153632 26749 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:38.213191 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.220268 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:38.213488 21562 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:38.153259 26572 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:38.217317 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:38.222422 21643 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:08:38.131963 26908 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:08:38.252174 21487 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:38.154903 26950 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:08:38.175874 26636 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:38.212056 26823 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.221657 26964 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:38.186183 26941 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.228147 26956 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:38.274718 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.272063 26997 ts_tablet_manager.cc:933] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:38.280709 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:38.283699 26992 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:38.218169 26913 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:38.218276 26945 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:08:38.275293 26572 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.274938 26964 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.305953 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.274718 26956 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:38.323931 21487 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:08:38.289395 26749 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:38.292769 26659 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:38.283780 26940 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
W20260709 13:08:38.338956 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 185814us
I20260709 13:08:38.341738 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.344426 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:38.345902 21457 leader_election.cc:400] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14.
I20260709 13:08:38.347177 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.321108 26964 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:38.361864 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.362237 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.364231 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.358610 21491 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:08:38.327603 26956 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.273142 26636 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.366307 21494 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
W20260709 13:08:38.367522 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 205697us
I20260709 13:08:38.331079 26659 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.327419 26907 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:38.371696 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.373068 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:38.374676 26659 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.376922 26636 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:38.382591 26998 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.383487 26998 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.318368 26959 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:08:38.391173 22245 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:38.415794 21492 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
W20260709 13:08:38.425022 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 246303us
I20260709 13:08:38.373138 26969 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:38.370580 26749 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:38.428476 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64333.9us
W20260709 13:08:38.431885 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 53901.5us
I20260709 13:08:38.462890 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.460793 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.415264 26998 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.464504 21487 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:38.424476 26997 tablet_copy_client.cc:323] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.130:41371
I20260709 13:08:38.483222 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:38.515550 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 168746us
I20260709 13:08:38.463198 26969 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:38.423743 26978 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.462567 27003 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:38.620555 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.465535 26823 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:08:38.633420 26991 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:38.634328 26991 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.635076 27008 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:38.635895 27008 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:38.636644 27004 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:08:38.639918 26999 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:08:38.679478 21568 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:38.640700 26969 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.638729 27008 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:38.690778 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.693439 26978 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:38.698966 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.611379 27003 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:38.728696 26823 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:38.729281 26659 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.751629 21486 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:38.761741 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.757176 27003 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.754276 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.764338 21486 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:38.767119 21485 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:08:38.751212 26889 consensus_meta.cc:287] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.002s
I20260709 13:08:38.767853 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.764690 26823 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.771361 21485 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:38.772351 26659 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:38.772890 21485 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:08:38.778827 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 236900us
W20260709 13:08:38.770001 26856 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.000s
I20260709 13:08:38.779884 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:38.783231 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 320424us
I20260709 13:08:38.773150 26823 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:38.776585 26572 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:38.797480 26572 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.774149 26889 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.787285 27014 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:38.783805 26749 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:38.786579 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:38.791935 26971 consensus_meta.cc:287] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.876s	user 0.011s	sys 0.000s
I20260709 13:08:38.799350 26749 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.799904 26971 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.800670 26889 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:38.801894 26749 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:38.802702 26971 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:38.794270 26976 consensus_meta.cc:287] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.002s
I20260709 13:08:38.803750 26976 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.804951 21636 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:08:38.807331 26976 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:38.810887 26945 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:38.811586 26945 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.813899 26945 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:38.784525 26856 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.820078 21493 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:08:38.822047 26964 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:38.835870 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 56107.9us
I20260709 13:08:38.838192 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:38.824558 26964 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:38.836181 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 369367us
I20260709 13:08:38.841049 27019 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:38.835592 26945 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:38.834553 26941 consensus_meta.cc:287] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.000s
W20260709 13:08:38.842190 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55677.1us
I20260709 13:08:38.841338 27014 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:38.846020 26749 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.841634 27019 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.848018 27019 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:38.848188 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 864) took 1409 ms. Trace:
I20260709 13:08:38.847503 27014 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.848600 21490 rpcz_store.cc:276] 0709 13:08:37.439083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.441427 (+  2344us) service_pool.cc:224] Handling call
0709 13:08:38.847978 (+1406551us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b540009f1d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:38.848103 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396786048}
I20260709 13:08:38.853997 26956 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.846294 26945 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.859429 26945 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:38.840415 26969 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.864274 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.865309 26998 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:38.865362 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:38.867372 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:38.862695 26978 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.870976 21637 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:38.872963 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.874517 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.874703 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.875352 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.875751 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.875908 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:38.876389 21488 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:38.876757 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:38.879688 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:38.879963 26976 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.866009 26998 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:38.885159 26998 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:38.891068 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.872761 26749 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:38.880180 26822 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.845799 26941 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.886207 27003 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.897524 21490 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:38.903748 26856 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:38.904295 26976 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.905074 22247 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:38.906841 26956 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:38.869796 26969 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.964669 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:38.965423 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:38.915874 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:38.966254 21642 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.965473 21568 raft_consensus.cc:2368] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14.
I20260709 13:08:38.916657 26822 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:38.920852 27021 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:38.921309 26749 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:38.878990 26978 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.881212 27014 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.919767 26998 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.953387 21488 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:08:38.958676 26722 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.961288 27003 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:38.971187 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 75889.9us
W20260709 13:08:38.975751 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 94618.5us
I20260709 13:08:38.977846 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.979868 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:38.982381 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:38.981566 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:38.986212 21565 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:38.990721 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:38.999187 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:39.006392 21642 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:39.000136 21565 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:39.008740 27008 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:38.970361 26976 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:38.996269 27014 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.978982 26956 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:08:39.051383 21459 leader_election.cc:400] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14.
I20260709 13:08:39.051950 21459 leader_election.cc:403] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:39.000252 27003 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.998965 26659 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.041990 26822 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:39.042601 27031 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:38.985044 26722 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.042863 27032 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:39.043485 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:39.043561 26749 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.087435 27013 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:39.072474 27031 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:39.087926 27013 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.088008 27031 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.088361 27013 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.044113 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:39.046963 26969 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.051208 26945 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.090170 21568 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.082934 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:38.976500 27021 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.086036 26995 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14.
W20260709 13:08:39.094115 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 111772us
I20260709 13:08:39.093665 21459 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:39.106468 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:39.110157 22245 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:39.077131 26659 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.115934 21568 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:39.116215 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:39.117080 22243 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
W20260709 13:08:39.117835 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 127222us
I20260709 13:08:39.097013 27032 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:39.115958 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:39.093833 26822 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:08:39.111532 26995 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:39.098326 26945 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.141060 21564 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:39.142939 27012 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:39.143843 26659 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.135931 26995 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:39.145777 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:39.143586 27012 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.145112 26722 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:39.145238 26995 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.154961 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:39.154310 27039 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:39.162161 27039 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.163151 27012 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:39.164418 27039 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.164271 27034 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:39.167783 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 1945) took 1144 ms. Trace:
I20260709 13:08:39.168270 21636 rpcz_store.cc:276] 0709 13:08:38.023066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.026881 (+  3815us) service_pool.cc:224] Handling call
0709 13:08:39.167560 (+1140679us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b540021b954. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:39.167681 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750984448}
I20260709 13:08:39.171819 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1915) took 1039 ms. Trace:
I20260709 13:08:39.172256 21493 rpcz_store.cc:276] 0709 13:08:38.132349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.132521 (+   172us) service_pool.cc:224] Handling call
0709 13:08:38.132866 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.820544 (+687678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.171535 (+350991us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b5400020b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:39.171754 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579820288}
I20260709 13:08:39.175247 27032 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.176241 27012 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:39.177187 26067 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:39.177554 26067 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:39.178694 26976 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.179113 21579 tablet_copy_service.cc:140] P 5727b19579474da6a12f79730b924770: Received BeginTabletCopySession request for tablet 6fad88e2e67d44f7adb559c0a8eb0af8 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36572)
I20260709 13:08:39.179703 21579 tablet_copy_service.cc:161] P 5727b19579474da6a12f79730b924770: Beginning new tablet copy session on tablet 6fad88e2e67d44f7adb559c0a8eb0af8 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36572: session id = 549b31ac31b6428994b45938abc223a7-6fad88e2e67d44f7adb559c0a8eb0af8
I20260709 13:08:39.181429 27021 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.181999 26945 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:39.176870 27012 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.184746 27012 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.184727 26780 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:39.164662 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1909) took 1103 ms. Trace:
I20260709 13:08:39.178278 26067 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.188553 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:39.187036 27019 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.191781 26572 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:39.192404 27019 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:39.193823 26987 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.170s	user 0.034s	sys 0.064s
I20260709 13:08:39.187446 21489 rpcz_store.cc:276] 0709 13:08:38.060895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.061007 (+   112us) service_pool.cc:224] Handling call
0709 13:08:38.071278 (+ 10271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.151145 (+ 79867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.164396 (+1013251us) spinlock_profiling.cc:243] Waited 73.5 ms on lock 0x7b540030d9d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:39.164602 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169081728}
I20260709 13:08:39.199417 26067 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.203114 21642 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.207504 26929 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:39.207975 26929 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:39.208961 26929 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.210171 26929 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:39.214956 26978 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.219009 26941 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:39.219309 27031 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.221565 27031 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:39.225265 26991 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:39.226666 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:39.232728 27013 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.245230 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.246261 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.267372 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.267910 21634 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:08:39.264106 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:39.265872 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:39.270599 22244 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:39.271095 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:39.281852 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.285892 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:39.286711 22243 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:39.289049 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:39.284055 22245 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:39.235507 26995 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.292789 26995 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:39.271312 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:39.294178 21489 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:39.299546 27027 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:39.300220 27027 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.303419 21560 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.267120 26941 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:39.268664 26830 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.335655 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:39.318640 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:39.325836 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.328338 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:39.330385 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.338207 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:39.330662 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:39.332906 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.339258 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:39.269306 27002 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:39.318470 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 199072us
I20260709 13:08:39.336864 21639 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:39.342676 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:39.346696 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:39.354894 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:39.344314 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.355685 21638 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.356781 22245 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:08:39.359889 26942 raft_consensus.cc:2764] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:08:39.363224 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.363339 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.364334 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:39.365247 21492 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:39.367205 21493 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:39.344976 26944 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.368893 22247 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:39.373533 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.373849 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:39.374352 21494 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:39.341672 27002 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:39.345227 26945 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.356261 26971 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:39.358112 26991 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:39.379944 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:39.383579 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.397080 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.384809 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:39.397684 21487 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.392951 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.394475 21641 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:39.395838 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.358450 26822 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.412174 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:39.397627 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:39.400403 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.411621 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.412081 21489 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:39.415674 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:39.418097 21640 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:39.341410 26941 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.423692 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:39.429107 21636 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.426275 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:39.415591 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:39.429596 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:39.345523 26830 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.431870 26067 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:39.390887 27002 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.436271 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:39.436971 21566 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.427038 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:39.438005 21492 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:39.357848 27031 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:08:39.430166 21635 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:39.443145 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:39.433187 21494 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:08:39.435699 26067 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:39.391152 27030 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:39.439733 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:39.440366 21641 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:39.440537 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:39.444540 26067 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.441838 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.450913 21640 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:39.394598 27027 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.450976 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:39.425091 26978 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.459127 21489 raft_consensus.cc:2368] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17.
I20260709 13:08:39.378736 26944 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.425887 26971 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:39.464136 22243 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:39.466238 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:39.472388 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.439610 26991 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:39.457844 27014 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:39.447532 27003 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.447688 27030 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:39.476450 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.463877 21579 tablet_copy_source_session.cc:215] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:39.478843 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.484366 21560 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:39.476161 27012 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:39.485518 27012 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.486548 27030 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:39.431535 26822 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:39.482290 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.504285 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 161171us
I20260709 13:08:39.505518 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:39.506286 26942 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.506560 21492 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:39.512898 21638 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:39.514266 21639 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: [15.9-16.10]
I20260709 13:08:39.487977 27012 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.525497 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:39.549036 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:39.637372 21566 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
W20260709 13:08:39.638738 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 154022us
I20260709 13:08:39.640311 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:39.545958 26942 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.549124 26889 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.572827 26800 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.547116 27013 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:39.649192 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 173734us
I20260709 13:08:39.658629 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:39.658133 21459 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:39.658116 26067 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:39.667083 26067 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:39.669453 26067 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:39.653048 26982 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.674221 26067 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.675209 26800 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:39.675658 27049 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:08:39.675834 26800 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.678251 26800 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:39.667078 26959 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.679584 21569 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.679651 26830 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:39.665004 26945 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:39.698873 26830 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:39.699774 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 150829us
I20260709 13:08:39.657236 26942 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.706462 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:39.714696 27061 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:08:39.716352 27017 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:39.716665 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.716971 27017 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.717499 21635 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:08:39.722244 27051 log.cc:927] Time spent T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
W20260709 13:08:39.727496 27046 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:08:39.713472 26945 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:39.730080 26945 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:39.731165 26945 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.657505 26991 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.666090 26971 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.703884 26961 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:08:39.764194 26942 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:39.705876 26830 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.710548 26941 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:39.767737 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.768621 21637 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:39.769166 26826 tablet_bootstrap.cc:492] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:39.770152 26826 tablet_bootstrap.cc:492] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:08:39.771335 27017 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:39.760437 27061 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:39.776644 27061 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.767554 26830 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:39.791203 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:39.781251 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 108799us
I20260709 13:08:39.796068 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:39.781420 26826 ts_tablet_manager.cc:1403] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 2.171s	user 0.045s	sys 0.018s
I20260709 13:08:39.797448 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:39.796926 26067 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.798424 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.801596 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.758114 26921 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:08:39.808569 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:39.796842 26822 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.780896 27030 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.825313 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.828356 27014 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:39.827971 26826 raft_consensus.cc:359] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:39.832023 27061 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:39.799788 27071 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:39.835989 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.837093 21491 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:39.837982 27017 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:39.838532 27017 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.839016 27017 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:39.840804 27062 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.141s	user 0.000s	sys 0.002s
I20260709 13:08:39.845232 27030 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:39.805948 26908 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:39.832176 27002 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:39.848439 21643 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:39.852032 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:39.829171 26826 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:08:39.853999 27071 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:39.859578 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.863041 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.862736 21643 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:39.868574 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:39.854844 26921 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:39.857472 27054 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:08:39.878182 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:39.855683 26722 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.875360 27002 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:39.891922 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.892431 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:39.895365 21637 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:39.894933 26636 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:39.883926 26921 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:39.905833 27075 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:39.885705 26826 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:39.941524 22247 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:39.952149 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:39.953610 22247 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:39.965703 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:39.971958 22243 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:39.975682 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:39.976657 22241 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:40.025182 22247 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:08:40.026741 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 120329us
I20260709 13:08:39.966228 26921 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:40.028812 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:40.031556 27077 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:08:40.035218 21568 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:40.036345 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.037015 21560 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:40.038070 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:39.963860 27030 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:39.941557 27075 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.052758 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:40.053154 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 869) took 1045 ms. Trace:
I20260709 13:08:40.053579 21488 rpcz_store.cc:276] 0709 13:08:39.007644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.007819 (+   175us) service_pool.cc:224] Handling call
0709 13:08:39.008227 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.127199 (+118972us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:08:39.140524 (+ 13325us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.445456 (+304932us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.445906 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.446038 (+   132us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:39.504399 (+ 58361us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.632629 (+128230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.041891 (+409262us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54002c9f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:40.041939 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.052922 (+ 10983us) raft_consensus.cc:1685] finished
0709 13:08:40.052950 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.053095 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162894,"prepare.queue_time_us":20539,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":157884,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":23811,"spinlock_wait_cycles":239559296,"thread_start_us":291786,"threads_started":1,"wal-append.queue_time_us":412744}
I20260709 13:08:40.055752 27071 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:40.056128 27080 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:08:40.051777 27030 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:40.059026 27076 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:08:40.071995 26908 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.085013 26826 ts_tablet_manager.cc:1434] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.284s	user 0.010s	sys 0.000s
I20260709 13:08:40.087141 27075 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.087738 27030 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:40.066299 26636 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:40.095279 21560 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:40.095762 27088 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.096347 27088 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:40.103031 27079 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:08:40.103026 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.103029 27083 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:40.104228 21568 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:40.104425 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.092834 26908 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:40.105187 21560 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:40.105312 26908 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:40.092592 27078 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:08:40.120746 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.124468 26997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fad88e2e67d44f7adb559c0a8eb0af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:40.099031 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-d46f34ab738d4d38b09f9d1228d68c7d received from {username='slave'} at 127.0.0.1:44644
I20260709 13:08:40.094401 27030 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.127739 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:40.136360 27064 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.432s	user 0.000s	sys 0.003s
I20260709 13:08:40.128142 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-d46f34ab738d4d38b09f9d1228d68c7d on tablet d46f34ab738d4d38b09f9d1228d68c7d with peer 549b31ac31b6428994b45938abc223a7
W20260709 13:08:40.139003 27053 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.496s	user 0.001s	sys 0.001s
I20260709 13:08:40.141621 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.098754 27088 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.144249 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.130156 27030 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.148430 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3394) took 1160 ms. Trace:
I20260709 13:08:40.148913 21567 rpcz_store.cc:276] 0709 13:08:38.988356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.988483 (+   127us) service_pool.cc:224] Handling call
0709 13:08:39.001245 (+ 12762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.063271 (+ 62026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.063335 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.063989 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.386975 (+322986us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:39.387020 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.387086 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.138064 (+750978us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:40.148049 (+  9985us) raft_consensus.cc:1685] finished
0709 13:08:40.148074 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.148342 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5008,"raft.queue_time_us":113464,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":12607,"spinlock_wait_cycles":17740160,"thread_start_us":378992,"threads_started":2,"wal-append.queue_time_us":453065}
I20260709 13:08:40.156862 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:40.157858 27063 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.294s	user 0.005s	sys 0.000s
I20260709 13:08:40.157964 27041 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:40.158619 27041 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:40.159641 27041 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:40.161693 27041 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.162210 26659 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.162433 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:40.145339 27017 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.162760 26659 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.101204 26636 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.150547 27030 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.174611 26659 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.180358 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:40.199501 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.217646 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:40.218008 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:40.232295 21639 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:40.218753 21635 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:40.219873 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:40.234128 21636 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:40.226540 22245 raft_consensus.cc:1217] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
W20260709 13:08:40.167802 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.196894 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.226987 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.183768 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.236934 21563 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:40.238173 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:40.238933 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:08:40.170068 27081 log.cc:927] Time spent T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.224s	user 0.003s	sys 0.000s
I20260709 13:08:40.188282 27076 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.163893 26984 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.248912 26984 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.248576 27076 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:40.249344 26984 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.249012 22243 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:40.249950 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:40.250555 21638 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:40.207363 27055 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.559s	user 0.003s	sys 0.000s
I20260709 13:08:40.172351 26722 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.169124 27017 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.255338 27019 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.255759 22245 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:40.256067 27012 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:40.255875 27019 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.256701 27012 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.257982 26889 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:40.258853 26889 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:40.259183 26889 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:40.174691 26944 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:40.254660 26995 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:08:40.264015 27019 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:40.268989 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.270148 21561 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:40.275161 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:40.276037 21636 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:40.277390 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:40.278496 21568 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:08:40.278589 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.279590 21566 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:40.255702 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:40.281705 21563 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:40.280943 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.283561 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:40.284605 21560 raft_consensus.cc:2368] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:08:40.282567 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:40.287632 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:40.292155 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.295928 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.296415 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.297283 21561 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:40.303043 21638 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:40.305315 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:40.307487 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1051) took 1043 ms. Trace:
I20260709 13:08:40.298439 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:40.323060 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.326704 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.308036 21643 rpcz_store.cc:276] 0709 13:08:39.263601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.263764 (+   163us) service_pool.cc:224] Handling call
0709 13:08:40.307265 (+1043501us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54002648d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:40.307409 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329805696}
I20260709 13:08:40.318248 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:40.317623 21639 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:40.328711 21569 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.331360 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.332237 21563 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:08:40.332871 26067 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:40.333253 26067 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:40.338547 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.339798 21564 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:40.322410 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.295257 26991 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:40.345865 22212 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.300426 26856 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:40.265321 27076 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.304633 26971 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.362362 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.331667 27002 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:40.342517 26907 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:40.259943 26889 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.363471 27032 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.343075 27034 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.376245 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:40.384486 26067 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.361385 26856 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.358317 27075 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:40.368242 26941 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.370821 26971 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.364045 27073 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.394834 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:40.329849 26636 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:08:40.399278 21492 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:40.367666 26830 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.364403 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.375998 27002 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.378201 26907 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.381345 26659 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:40.389541 27012 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:40.428421 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64110.6us
I20260709 13:08:40.385571 26749 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:40.408695 26067 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.409281 26941 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:40.402724 26856 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:40.434996 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.430841 21492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:40.457654 21492 raft_consensus.cc:606] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.458078 21492 raft_consensus.cc:614] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:40.458235 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:40.427601 26830 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:40.409098 27075 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:40.397764 26466 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:08:40.407065 26722 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.406752 26971 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.435460 27034 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:40.429414 26907 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:40.461956 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:40.466400 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 128984us
I20260709 13:08:40.402417 27007 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:40.428159 27002 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.473928 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:40.430440 26887 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.504983 21643 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 9.
W20260709 13:08:40.505749 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 43904.3us
I20260709 13:08:40.428591 26908 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.509188 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.499223 27017 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:40.514333 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 138160us
I20260709 13:08:40.515220 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:40.516388 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:40.517062 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.517874 22212 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:40.519131 22245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:40.519999 22245 raft_consensus.cc:606] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.520448 22245 raft_consensus.cc:614] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:40.470247 27041 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.467777 26978 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:40.523694 27034 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:40.511301 26887 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:40.475087 26342 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:08:40.511713 27030 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.509701 26991 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:40.517756 26958 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:40.504155 27005 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.249s
I20260709 13:08:40.534700 26956 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:40.526916 27076 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:40.565420 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48419us
W20260709 13:08:40.571319 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 53536.8us
I20260709 13:08:40.545262 26887 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.571269 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:40.575227 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 68263.9us
I20260709 13:08:40.543511 27017 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:40.552006 26800 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.575644 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.547008 27084 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:40.577248 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.581634 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:40.583082 22245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:40.525874 26978 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.560618 26722 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:40.570062 27071 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.599174 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:40.604250 26800 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.608263 26780 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.614429 22245 raft_consensus.cc:606] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:40.617848 22245 raft_consensus.cc:614] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:40.620286 27075 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:40.623015 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.577682 27030 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.627113 21569 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:08:40.584143 26956 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:40.631994 26941 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:40.633044 27096 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:08:40.633404 27101 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:40.633270 26856 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:40.633916 27029 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:40.634298 27099 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.634541 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:40.643364 21638 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:40.636121 22245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:40.645217 27073 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.645423 22245 raft_consensus.cc:606] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:40.647449 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:40.595319 27041 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:40.648921 27041 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:40.572567 26958 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.650184 27041 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.653151 26958 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.576081 27076 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:40.665395 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 66325.6us
I20260709 13:08:40.582350 27098 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:08:40.630455 26976 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:40.715189 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:40.730165 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.598593 27084 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:40.789506 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.641835 27019 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:40.802778 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 155448us
W20260709 13:08:40.803182 27094 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:08:40.804616 27097 log.cc:927] Time spent T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:08:40.805986 27109 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:40.806669 27109 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.807155 27109 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:40.809154 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.813702 22245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:40.814597 22245 raft_consensus.cc:606] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:40.815083 22245 raft_consensus.cc:614] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:40.816040 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 148919us
I20260709 13:08:40.819149 26956 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.828085 26969 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.828873 26969 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.829139 26971 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:40.678396 26830 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.831084 26993 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.833585 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:40.837311 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.838186 21569 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:40.852568 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.655660 27030 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.195s
I20260709 13:08:40.654449 26991 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:40.864269 27100 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:40.667469 27101 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:40.639416 27034 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:40.800771 26976 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.676924 27017 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.854475 27019 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.883641 26908 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:40.891880 26984 consensus_meta.cc:287] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.642s	user 0.013s	sys 0.000s
I20260709 13:08:40.909281 26636 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.676388 27099 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:40.865914 26993 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.920017 21567 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:08:40.908479 26997 consensus_meta.cc:287] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 13:08:40.926096 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:40.926913 27101 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:40.927671 27076 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.928157 26659 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.928762 27084 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.929615 26978 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:40.929777 27019 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:40.930821 27005 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.921132 26636 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.931457 26971 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:40.931548 27099 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:40.932379 21638 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 7.
I20260709 13:08:40.931337 27005 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.897151 27100 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:40.934679 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:40.912966 27029 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:41.046916 26993 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.949841 27084 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:41.051317 27084 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.053542 27084 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:41.054461 26997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60052 (request call id 572) took 2971 ms. Trace:
W20260709 13:08:41.054962 26907 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.005s
I20260709 13:08:41.055670 26907 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:40.951582 26856 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:41.058936 27002 consensus_meta.cc:287] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.001s
I20260709 13:08:40.917591 26984 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.024685 26887 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.109764 26887 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:41.113870 27092 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.748s	user 0.010s	sys 0.005s
I20260709 13:08:41.116396 27005 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.117048 27099 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.117561 27099 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.119699 27099 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:41.060818 26976 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:41.121539 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:41.122925 27109 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.125319 26749 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.126021 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:41.059430 27002 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.126873 21564 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:41.128424 27002 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:41.125876 26749 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.130743 26984 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.133199 21493 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:41.137948 21493 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:41.138438 21564 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:41.139660 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:41.140405 21492 raft_consensus.cc:2368] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
I20260709 13:08:41.142135 21492 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:41.058531 26907 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:40.952155 26636 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.142949 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:41.145670 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:41.146075 21488 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:08:41.142949 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:41.147302 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:41.148453 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.148553 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:41.143392 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:41.149225 22241 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:41.149312 21492 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:08:41.152185 21491 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:41.152436 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.157927 21636 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:41.159029 21493 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:41.054936 26997 rpcz_store.cc:276] 0709 13:08:38.082932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.085324 (+  2392us) service_pool.cc:224] Handling call
0709 13:08:38.284266 (+198942us) ts_tablet_manager.cc:934] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
0709 13:08:40.123238 (+1838972us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:40.348449 (+225211us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:40.369551 (+ 21102us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:40.925462 (+555911us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:40.955072 (+ 29610us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:41.054308 (+ 99236us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:41.054391 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":78630,"tablet-copy.queue_time_us":54213,"thread_start_us":74499,"threads_started":2}
I20260709 13:08:41.160310 26997 tablet_copy_client.cc:806] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:41.161008 26997 tablet_copy_client.cc:670] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:41.164831 27109 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.165602 27100 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:41.173180 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:41.174010 21564 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:41.161705 27029 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.174914 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:41.175920 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:41.176682 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:41.177066 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:41.177301 21560 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:41.176656 21564 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:08:41.181938 26822 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:41.181938 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:41.183710 21563 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:41.183898 26749 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:41.189245 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:41.190081 26907 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:41.190507 26907 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.190862 26907 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:41.192826 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:41.195495 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:41.205080 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 307984us
I20260709 13:08:41.206154 22243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6859210b204263aedc975d7586330c"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:41.206872 22243 raft_consensus.cc:606] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:41.207301 22243 raft_consensus.cc:614] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:41.210747 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:41.211108 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:41.211376 22244 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:41.211710 21636 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:41.214725 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.215492 21643 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 16: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:41.219549 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.220180 21643 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:08:41.221570 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:41.224793 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:41.233453 27109 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:41.234036 27109 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.236282 27109 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.236405 26889 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.233208 26749 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:41.238008 26749 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:41.238374 26749 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:41.240562 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:41.241139 22242 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 8.
I20260709 13:08:41.241611 21636 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:41.239307 26749 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.204425 26907 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.252010 21606 leader_election.cc:400] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
I20260709 13:08:41.252521 21606 leader_election.cc:403] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.252576 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.225909 27012 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:41.247381 22244 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:08:41.256790 22238 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:08:41.257756 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.259112 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:41.259940 22242 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 7.
I20260709 13:08:41.260257 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:41.261014 22240 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.261397 26067 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:41.261931 26067 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:41.262362 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.263206 21636 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:41.270725 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:41.273370 21457 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:41.274431 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.274556 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:41.275911 22244 raft_consensus.cc:2410] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:08:41.279356 26984 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:41.279460 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:41.279973 26984 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.280110 26067 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.280248 22246 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:41.280436 26984 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.229322 27100 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:41.286520 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:41.289161 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:41.292515 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.299643 26067 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.302488 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:41.302865 22240 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:41.301831 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:41.259001 27002 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
I20260709 13:08:41.270707 26749 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.309070 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:41.305480 21636 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:41.303372 26942 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:41.317750 26942 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.318158 26942 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:41.318650 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:41.319311 21491 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:41.266746 26991 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:08:41.321838 26969 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.326148 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:41.326860 26887 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.331192 21569 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:41.331617 21569 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:41.332396 21569 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.333350 21569 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.335520 21490 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:08:41.336803 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.331444 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:41.339190 27061 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:41.339334 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:41.339663 27061 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:41.340116 27061 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:41.341213 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:41.341534 22212 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:41.342427 26907 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.342638 26976 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:41.342913 27073 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:41.343176 26976 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.343575 27073 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:41.344772 27012 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:41.344709 27073 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.345412 27012 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:41.343649 26976 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:41.352533 21532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.072s	sys 0.128s
W20260709 13:08:41.352906 21532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.072s	sys 0.128s
W20260709 13:08:41.353173 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 756322us
I20260709 13:08:41.355581 26956 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:41.356750 27034 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:41.357059 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:41.357376 26997 tablet_copy_client.cc:538] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:41.357734 21560 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:41.363054 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.364301 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:41.364919 21639 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:41.365638 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.366922 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.368490 21634 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:41.370033 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:41.370853 21494 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
W20260709 13:08:41.371565 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.357180 27034 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:41.370115 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:41.377014 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.342446 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:41.385293 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:41.386353 22246 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:41.387375 21560 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:41.388747 21569 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:08:41.389122 21569 pending_rounds.cc:85] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 9
I20260709 13:08:41.389369 21569 pending_rounds.cc:107] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:08:41.389599 21569 raft_consensus.cc:2889] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.386678 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:41.391139 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:41.392800 26971 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:41.393263 26971 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:41.393666 26971 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.394013 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:41.395916 27085 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:41.396440 27085 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:41.397279 27085 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.400012 21635 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:41.401331 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:41.401978 21489 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:41.402088 21532 leader_election.cc:400] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17.
I20260709 13:08:41.407141 21532 leader_election.cc:403] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.409085 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:41.410043 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:41.358330 26991 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:41.414561 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:41.419914 21636 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:08:41.424021 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:41.425625 26067 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.346300 27012 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.426496 21639 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:41.422384 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:41.427731 21643 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:41.428658 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:41.428655 21490 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:41.400447 27067 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:41.423022 26889 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.420212 26991 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:41.426345 27114 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:08:41.469301 27034 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:41.473088 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.484259 22245 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:41.412341 27030 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:41.519312 27030 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:41.519703 27030 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:41.520589 27030 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.521818 27030 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.429327 27116 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17.
I20260709 13:08:41.525956 26997 tablet_bootstrap.cc:492] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
W20260709 13:08:41.549116 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.498998 27100 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:41.498996 26889 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.511984 26941 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.512893 26969 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.517827 26942 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.421391 27098 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:08:41.452700 26921 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:41.426445 27005 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:41.571540 27005 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:41.571957 27005 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.572741 26889 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:41.427156 27099 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:41.535192 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.564136 27019 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.566509 26969 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.570698 27098 consensus_queue.cc:1243] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:41.571090 26921 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:41.534080 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3059) took 1259 ms. Trace:
I20260709 13:08:41.461242 27076 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:41.498549 27029 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.594362 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:41.596817 21635 rpcz_store.cc:276] 0709 13:08:40.275023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.323661 (+ 48638us) service_pool.cc:224] Handling call
0709 13:08:40.339898 (+ 16237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.400437 (+1060539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.533810 (+133373us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400144e54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:41.533990 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437247872}
I20260709 13:08:41.636672 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:41.637890 21643 raft_consensus.cc:2410] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:41.566442 26941 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.597275 27034 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.565043 27002 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:08:41.526721 26984 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:41.600018 26921 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:41.636166 27032 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.678052 26976 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.681401 26976 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:41.681788 27008 raft_consensus.cc:1064] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:08:41.641578 27076 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:41.599516 27061 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.596971 27019 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:41.696671 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 272707us
I20260709 13:08:41.699503 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:41.645031 26971 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.713176 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:41.685945 27002 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:08:41.461531 27041 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:41.692550 27032 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.707849 27030 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.725317 21636 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:41.735162 27076 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.740834 26942 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.756302 21636 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:41.757771 27032 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:41.758490 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:41.760212 26971 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:41.763502 26969 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.765414 27019 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:41.779294 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 66221.2us
I20260709 13:08:41.791363 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:41.777688 27099 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:41.785423 27030 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:41.802677 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 209239us
I20260709 13:08:41.804298 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:41.808171 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:41.811280 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.793915 27061 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.825843 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:41.816361 27127 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:08:41.857393 27140 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:08:41.858165 26997 tablet_bootstrap.cc:700] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Time spent opening tablet: real 0.109s	user 0.000s	sys 0.002s
I20260709 13:08:41.814893 26984 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:41.801566 26956 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:08:41.815138 26971 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:41.818665 27029 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:41.800087 27032 raft_consensus.cc:2764] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 13:08:41.867256 21608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.184s (SENT) [suppressed 33 similar messages]
I20260709 13:08:41.870627 21639 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:41.881310 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:41.858875 27012 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.868011 27132 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:08:41.873662 27133 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:08:41.874292 27129 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:08:41.874475 27128 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:08:41.885012 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:41.888005 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:08:41.886562 27131 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:08:41.899117 22241 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 8: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:41.908553 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:41.883343 26971 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:41.917764 22245 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:41.920204 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:41.883551 27029 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:41.923046 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:41.924921 27111 raft_consensus.cc:993] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:08:41.921433 26971 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.925698 27111 raft_consensus.cc:1081] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:08:41.930420 21637 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:41.931293 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:41.932121 21640 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 8: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:41.932942 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:41.939558 27100 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:41.940057 27100 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.940390 27100 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:41.940526 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.946200 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.882103 27005 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.892066 26856 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.962081 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:41.963439 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:41.964141 27073 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:41.967099 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:41.968115 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:41.964391 21642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:36050
I20260709 13:08:41.946504 27029 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.922145 26969 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:41.969712 21642 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:41.949141 27071 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.953416 26958 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:41.984772 21642 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.983487 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:41.989427 21492 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:08:41.889482 27012 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:41.990201 27071 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.961222 26921 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:42.004211 26921 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:42.004733 27012 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:42.008816 26907 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.001386 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:41.894086 27099 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:41.982410 26984 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:41.984539 26969 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.017817 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:42.022185 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:42.023042 27148 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.023418 27104 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:42.022527 21642 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:42.023600 27148 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:42.045296 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.052950 21642 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:42.054801 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:42.027738 27151 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:08:42.028374 27144 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:08:41.960652 26991 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:42.086273 21638 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:42.086755 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.020965 26993 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:42.026222 26636 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:42.025278 26969 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:42.091282 27005 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:42.095499 27146 log.cc:927] Time spent T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:08:42.098097 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.024369 27145 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:42.106983 27070 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:42.108690 27148 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:42.042865 27085 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:42.117282 21490 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:42.141402 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:42.149704 26969 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.152302 26969 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:42.154551 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:42.117268 21485 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:08:42.118424 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:42.118636 21494 pending_rounds.cc:85] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 7
I20260709 13:08:42.117702 21487 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:42.157236 21494 pending_rounds.cc:107] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:42.157541 21494 raft_consensus.cc:2889] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:42.157642 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.119201 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:42.158615 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:42.122713 26958 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:42.087561 26067 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.125239 26995 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:42.126981 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:42.128774 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:42.174247 21642 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.132344 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:42.132529 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:42.132655 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:42.153229 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.029137 26971 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.156009 27030 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.168352 27085 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:42.173156 26944 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:42.179141 27012 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.192754 21642 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:42.136471 26636 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:42.186592 21641 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:42.187878 26976 raft_consensus.cc:2955] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 4 to 9, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:42.193692 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:42.183987 26907 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.198726 22243 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:42.195538 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:42.200300 21636 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:42.200389 21490 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:08:42.138242 26993 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:42.193347 22245 raft_consensus.cc:2955] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 4 to 9, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:42.207387 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 389493us
I20260709 13:08:42.135623 26659 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:08:42.209987 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:42.213826 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:42.214892 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:42.215864 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:42.216980 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:42.220402 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:42.212893 21636 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: [15.8-16.9]
I20260709 13:08:42.222020 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:42.225374 22240 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 9 LEARNER]: Advancing to term 10
I20260709 13:08:42.226104 21486 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:42.227808 21643 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:08:42.228998 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:42.233404 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:42.198589 27012 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.189471 26944 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:42.236479 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:42.237489 22243 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:42.203142 27109 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.245335 21634 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:42.241595 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:42.242331 22246 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:42.247570 21636 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:42.242997 21487 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:42.249097 22240 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 10 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:08:42.239261 21532 connection.cc:256] RPC call timeout handler was delayed by -1.3915378309999369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:08:42.250418 21532 connection.cc:256] RPC call timeout handler was delayed by -1.2484378310000466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:08:42.250748 21532 connection.cc:256] RPC call timeout handler was delayed by -1.153037831000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
I20260709 13:08:42.251624 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.255061 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:42.156461 27145 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.256657 21493 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:08:42.257192 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.258502 22242 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [10.11-12.12]
I20260709 13:08:42.225520 27041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50140 (request call id 0) took 7240 ms. Trace:
I20260709 13:08:42.263311 27070 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:42.273921 26856 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.274933 21485 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:42.275736 22241 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:08:42.240540 27012 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.239578 27099 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:42.277132 27034 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.265767 27041 rpcz_store.cc:276] 0709 13:08:34.967907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.968104 (+   197us) service_pool.cc:224] Handling call
0709 13:08:35.045134 (+ 77030us) log.cc:844] Serialized 513 byte log entry
0709 13:08:35.201417 (+156283us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b18001d89c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9f3bb0b 00007f98a9fc0b63 00007f98a9fe8752 00007f98aefa8d29
0709 13:08:35.275654 (+ 74237us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b18001d89c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:08:42.207752 (+6932098us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46109,"raft.queue_time_us":98404,"raft.run_cpu_time_us":2426,"raft.run_wall_time_us":46060,"spinlock_wait_cycles":7875456,"thread_start_us":63056,"threads_started":1,"wal-append.queue_time_us":113836,"wal-append.run_cpu_time_us":2388,"wal-append.run_wall_time_us":1002903}
I20260709 13:08:42.300196 27034 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:42.277930 27032 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:08:42.301355 27041 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:42.301693 27032 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:42.301751 27041 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:42.302134 27032 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:42.246901 26889 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:08:42.304364 26889 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:42.304766 26889 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:42.305614 26889 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:42.306241 27135 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.396s	user 0.004s	sys 0.000s
I20260709 13:08:42.264732 27161 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.297444 26971 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:42.281167 26636 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.282871 27085 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.242535 27148 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:42.314814 27148 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:42.315217 27148 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:42.302953 27032 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.310282 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:42.302642 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.325003 21486 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:42.315991 27148 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.260430 27107 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:08:42.331024 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 75926.4us
I20260709 13:08:42.278131 26956 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:08:42.297463 27145 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:42.342933 27148 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.284076 26993 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.333992 26889 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:42.285229 27100 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:42.352197 26997 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.145s	user 0.002s	sys 0.002s
I20260709 13:08:42.308308 27041 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:42.352993 27100 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:42.353699 21642 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 14. Ops: []
I20260709 13:08:42.355468 26941 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:42.346280 27032 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:42.373696 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 111528us
W20260709 13:08:42.375043 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.375939 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.380722 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.391960 21489 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:42.339831 27029 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:42.396889 27029 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:42.402372 27167 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.405913 27071 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:42.381090 27140 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:42.380944 27107 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:08:42.411743 27107 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:42.412144 27107 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:42.405956 27012 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.413267 27107 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:42.415215 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.415431 27012 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:42.415714 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.424224 27030 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:42.424739 27030 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:42.425638 27030 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.429304 26991 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:42.434535 27070 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:42.435110 27070 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:42.437660 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.438915 21561 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:42.439363 21561 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:42.440088 21561 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.442176 21561 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.442950 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.443210 21562 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 16: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:08:42.443290 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52769.1us
I20260709 13:08:42.446341 27140 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:42.447345 27029 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:42.447722 27029 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:42.452036 21492 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:42.452250 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.455437 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.456398 21569 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:42.459249 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.459976 21568 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:42.460700 27073 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:42.462118 27167 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:42.462706 27167 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.464586 22212 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:42.465761 27071 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:42.466270 27167 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:42.466336 27071 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.414597 27107 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:42.443395 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 185010us
I20260709 13:08:42.480407 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.484725 21568 raft_consensus.cc:2368] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:42.485576 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.486634 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.481184 21567 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:42.481292 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.482138 21562 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:42.488317 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:42.483250 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.490576 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.491528 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.491976 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.492695 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.493547 21567 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.493872 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.494251 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.495666 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.498023 22240 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:42.500056 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.501127 21565 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:42.502590 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:42.468326 27030 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.506035 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:42.506814 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.506072 21561 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:08:42.507926 21561 pending_rounds.cc:85] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 8
I20260709 13:08:42.508304 21561 pending_rounds.cc:107] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:08:42.508566 21561 raft_consensus.cc:2889] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.508783 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.503446 21485 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:42.515765 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:42.518345 21634 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:42.518870 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:42.519081 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:42.518575 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:42.519747 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.521481 21635 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:42.527966 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:42.528931 22242 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.528982 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.478472 27071 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.530735 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:42.532480 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 95575.7us
I20260709 13:08:42.467336 27008 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:42.534322 21608 leader_election.cc:400] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:42.535574 21642 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:42.539151 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:42.501591 27109 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:42.565166 21567 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:42.565819 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.532742 27167 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.493315 27161 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:08:42.538934 27029 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.532496 26976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43682 (request call id 0) took 3401 ms. Trace:
W20260709 13:08:42.592489 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.596648 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 57581.9us
I20260709 13:08:42.583263 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.591657 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:42.592790 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.602587 22242 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:42.535820 26956 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:42.620122 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.603475 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.570003 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.626142 21562 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:42.628077 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:42.629556 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 64717.4us
I20260709 13:08:42.630302 21567 raft_consensus.cc:2368] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:42.536532 27019 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:08:42.633738 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.636361 21562 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:42.634326 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:42.635138 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.594223 27034 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:42.630954 27029 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:42.644608 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 78741.8us
W20260709 13:08:42.642182 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 43915.3us
I20260709 13:08:42.645744 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.642251 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.647529 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.639024 27100 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.649437 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:42.654459 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.646384 21565 raft_consensus.cc:2376] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17. Re-sending same reply.
I20260709 13:08:42.633714 27147 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:42.653451 21634 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:42.639194 27084 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.649984 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.630832 27002 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.586241 27070 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:42.707760 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.659785 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.564261 27109 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:42.667167 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:42.632206 27161 consensus_queue.cc:1243] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:42.709152 21642 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:42.710664 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 61289.6us
W20260709 13:08:42.715399 27170 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:08:42.718227 27171 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:42.660669 27034 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:42.720307 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.721055 21560 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:42.722026 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.638487 27167 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:08:42.723451 27177 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:42.724764 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:42.725528 27177 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.726073 27177 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.726121 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.725557 21489 raft_consensus.cc:2955] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 4 to 9, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:42.727054 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.727800 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:42.728215 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.729311 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.730053 21563 raft_consensus.cc:2410] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:42.650432 27168 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:08:42.722594 21560 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
W20260709 13:08:42.708221 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44905.9us
I20260709 13:08:42.727841 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.587742 26944 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:42.732249 21562 raft_consensus.cc:2410] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:08:42.633021 27012 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:08:42.733028 26944 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.604133 26976 rpcz_store.cc:276] 0709 13:08:39.104604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.104745 (+   141us) service_pool.cc:224] Handling call
0709 13:08:39.200893 (+ 96148us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b540007a920. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f5f520 00007f98a9fe8b42 00007f98a9fe7800 00007f98a9fe09fa 00007f98aefa84c9 00007f98a8524c54 00007f98a8524be2 00007f98a8524b11 00007f98a8524a8c 00007f98a8523d42
0709 13:08:39.230229 (+ 29336us) log.cc:844] Serialized 508 byte log entry
0709 13:08:39.845897 (+615668us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b540007a920. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f5b142 00007f98a9f3beaa 00007f98a9f42d53 00007f98a9f42cd9 00007f98a9f42c69 00007f98a9f42c31 00007f98a9f41dfd 000000000038f354 000000000038f199 00007f98a6ef5475
0709 13:08:40.206457 (+360560us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:42.505844 (+2299387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6734,"raft.queue_time_us":7212,"raft.run_cpu_time_us":6035,"raft.run_wall_time_us":471365,"spinlock_wait_cycles":108937600,"thread_start_us":202901,"threads_started":1,"wal-append.queue_time_us":262631,"wal-append.run_cpu_time_us":5560,"wal-append.run_wall_time_us":1738671}
I20260709 13:08:42.734874 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:42.731113 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:42.735621 21560 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:42.735970 21486 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.736116 21560 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:42.744575 21563 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:42.751858 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.750000 27165 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:42.754171 27165 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:42.754869 27083 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.707079 27084 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.756737 27165 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:42.757688 27032 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:42.758050 27084 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:42.759142 27012 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:42.759552 27012 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:42.760345 27012 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.761379 27109 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:42.761509 27012 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:42.764827 27070 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:42.742264 21560 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:42.768330 21560 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.712091 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.771379 21642 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:08:42.775254 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:42.776793 21486 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:42.783910 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:42.787104 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.790876 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.792083 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:42.793962 27041 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.808625 21560 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:08:42.809041 21560 pending_rounds.cc:85] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 11
I20260709 13:08:42.809306 21560 pending_rounds.cc:107] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:08:42.809525 21560 raft_consensus.cc:2889] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:42.821487 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 69683.6us
I20260709 13:08:42.822389 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.823537 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:42.809386 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 22b45f3e8b8e428ea4709e7e9ee43868 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 13:08:42.827512 26067 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.834287 21485 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:42.830376 27175 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 13:08:42.839515 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 65353.6us
W20260709 13:08:42.840806 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 65655.7us
I20260709 13:08:42.824608 27034 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:42.845108 26067 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:42.835279 26659 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.853937 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:42.854635 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:42.855108 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:42.858991 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:42.865106 21486 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:42.824976 27167 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:42.844165 27160 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:42.864426 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:42.873257 26067 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:42.876760 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:42.888134 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.846753 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:42.904731 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 58076.1us
I20260709 13:08:42.906490 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:42.839361 26636 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:42.851806 26958 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:08:42.921478 26971 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.929541 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.934912 21486 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:08:42.930420 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:42.935464 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:42.934249 27189 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:42.934016 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 57363.3us
W20260709 13:08:42.937358 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.933482 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 79655.6us
I20260709 13:08:42.942440 21635 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:42.924384 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:42.922246 27168 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:42.949043 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:42.951890 26067 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:42.953292 26067 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:42.954206 22238 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:42.957228 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:42.957995 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:42.960079 21642 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:08:42.960592 21642 pending_rounds.cc:85] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 12
I20260709 13:08:42.960915 21642 pending_rounds.cc:107] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:08:42.961217 21642 raft_consensus.cc:2889] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.926545 27073 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:42.996742 21457 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc9f5258ae3f4790a9bc1813d73ec987. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:42.958973 21641 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:42.998415 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:42.960176 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:43.006247 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:42.952450 27148 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:42.964170 27019 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:42.956877 27191 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:42.964071 27175 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:43.002122 27107 consensus_meta.cc:287] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
I20260709 13:08:42.958540 27168 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:43.000588 27002 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:43.028350 27145 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:43.012028 27148 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:43.002723 26984 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:08:43.047274 21569 raft_consensus.cc:2368] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:08:43.000451 27032 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:43.037298 27147 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
W20260709 13:08:43.066206 27180 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:43.073241 26956 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:43.073717 26956 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:43.079490 27029 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:43.080067 27029 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:43.089918 22247 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:43.073760 21564 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
W20260709 13:08:43.070479 27071 consensus_meta.cc:287] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.004s
I20260709 13:08:43.049283 27148 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:43.070958 27189 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:08:43.106173 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.106503 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 169364us
I20260709 13:08:43.041546 27191 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.081694 27167 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:43.104024 27030 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.003s
I20260709 13:08:43.046561 27186 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:08:43.081020 27029 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:43.067209 27168 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.125372 27189 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:43.131711 21568 raft_consensus.cc:2410] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:43.134261 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:43.131940 27167 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.137864 21561 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:43.141734 27167 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:43.137487 27177 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.126477 27189 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.143644 21565 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:43.144884 27177 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:43.139994 27030 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:08:43.146061 27002 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.151141 27148 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.154964 21566 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:43.156576 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:43.106276 27071 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.159380 22240 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 15 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:43.153306 27148 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:43.162201 27002 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:43.167243 26659 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:43.182098 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 222002us
I20260709 13:08:43.180932 26971 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.198990 21608 leader_election.cc:400] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:43.199414 21608 leader_election.cc:403] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.184505 26958 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:08:43.200034 22245 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [10.11-12.12]
I20260709 13:08:43.200713 27191 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:43.202886 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:43.203533 22246 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:08:43.203717 22245 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:43.209486 26997 tablet_bootstrap.cc:492] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:08:43.210541 26997 tablet_bootstrap.cc:492] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:08:43.212117 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:43.212785 27071 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:43.216583 26997 ts_tablet_manager.cc:1403] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 1.691s	user 0.045s	sys 0.035s
W20260709 13:08:43.217921 21608 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.765s (SENT)
I20260709 13:08:43.218410 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:43.224269 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:43.227478 27168 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:43.229475 26997 raft_consensus.cc:359] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 11 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.238055 27148 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.238627 27148 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.240605 21566 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
W20260709 13:08:43.247025 21608 leader_election.cc:336] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.800s (SENT)
I20260709 13:08:43.247713 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:43.251842 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:43.252604 21485 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.252337 27167 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:43.260674 21485 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:08:43.261040 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:43.263724 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:43.264456 21566 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.268873 27168 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:43.269497 27168 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:43.270391 27168 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.260331 27100 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.258355 26997 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:08:43.278038 21566 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:08:43.234468 27177 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:08:43.262496 27012 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.262431 27147 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.282020 21485 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:43.282260 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:43.282435 22212 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:43.283787 21489 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:42.471729 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:43.296173 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:43.297763 27177 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:43.301499 27177 consensus_queue.cc:1243] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:43.301982 27177 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:43.302285 27177 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:43.306288 27182 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.449s	user 0.002s	sys 0.000s
I20260709 13:08:43.308449 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:43.293828 27071 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:43.311401 27071 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:43.314185 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:43.319214 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:43.320008 21634 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.312382 27071 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.297993 27167 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:43.320865 26993 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:43.321277 27167 consensus_queue.cc:1243] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:43.321795 27167 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:43.322111 27167 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:43.322350 26993 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:43.322734 26993 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.323174 26993 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:43.324431 27148 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:43.322921 27167 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.325469 27167 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:43.332720 26956 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.284462 27147 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.335021 27041 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.335566 27041 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.340261 27041 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:43.340945 27140 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:43.341593 27140 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:43.342360 21390 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 248) took 16587 ms (client timeout 15000 ms). Trace:
I20260709 13:08:43.343930 27140 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:43.346513 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:43.346807 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:43.347285 21560 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:43.347478 21485 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:43.349538 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:43.355242 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:43.435235 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.465938 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.509157 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.515260 21608 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.960s (SENT)
I20260709 13:08:43.515980 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:43.536242 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.336897 27147 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:43.550305 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 189981us
I20260709 13:08:43.550626 21638 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:08:43.342813 21390 rpcz_store.cc:269] 0709 13:08:26.755346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.755534 (+   188us) service_pool.cc:224] Handling call
0709 13:08:43.342280 (+16586746us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:38.323537 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:38.541359 (+217822us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:38.541404 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:08:38.541426 (+    22us) tablet.cc:662] Decoding operations
0709 13:08:38.700529 (+159103us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:38.700604 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:38.700641 (+    37us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:08:38.701938 (+  1297us) tablet.cc:701] Row locks acquired
0709 13:08:38.701963 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:08:38.702145 (+   182us) write_op.cc:270] Start()
0709 13:08:38.702302 (+   157us) write_op.cc:276] Timestamp: P: 1783602518702089 usec, L: 0
0709 13:08:38.702328 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:08:38.783649 (+ 81321us) log.cc:844] Serialized 4816 byte log entry
0709 13:08:39.180442 (+396793us) op_driver.cc:464] REPLICATION: finished
0709 13:08:39.460841 (+280399us) write_op.cc:301] APPLY: starting
0709 13:08:39.463906 (+  3065us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:39.728781 (+264875us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:39.728925 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:39.857987 (+129062us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:39.858254 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:08:39.858299 (+    45us) write_op.cc:312] APPLY: finished
0709 13:08:39.858598 (+   299us) log.cc:844] Serialized 113 byte log entry
0709 13:08:39.858777 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:39.873669 (+ 14892us) write_op.cc:454] Released schema lock
0709 13:08:39.876034 (+  2365us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:39.896099 (+ 20065us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:39.897740 (+  1641us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1015,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":253187,"apply.run_cpu_time_us":20993,"apply.run_wall_time_us":434877,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":180410,"prepare.run_cpu_time_us":30883,"prepare.run_wall_time_us":566803,"raft.queue_time_us":153381,"raft.run_cpu_time_us":22012,"raft.run_wall_time_us":184662,"replication_time_us":477955,"thread_start_us":399173,"threads_started":4,"wal-append.queue_time_us":182462,"wal-append.run_cpu_time_us":23642,"wal-append.run_wall_time_us":1897279}]]}
I20260709 13:08:43.560496 21638 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:43.556226 27148 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:43.556986 27012 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:43.592581 21643 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:43.595043 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2578) took 1081 ms. Trace:
I20260709 13:08:43.595500 21565 rpcz_store.cc:276] 0709 13:08:42.513506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.657787 (+144281us) service_pool.cc:224] Handling call
0709 13:08:43.594834 (+937047us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400126954. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:43.594981 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855880448}
I20260709 13:08:43.608954 21643 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:43.583789 27148 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.584378 27198 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.346570 26997 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:43.633471 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:43.635629 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:43.639599 21642 raft_consensus.cc:2393] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:43.566674 27177 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.637594 27148 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.653695 21642 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:08:43.650164 27204 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.372s	user 0.000s	sys 0.002s
I20260709 13:08:43.642282 27198 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.779876 27209 ts_tablet_manager.cc:933] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
W20260709 13:08:43.790602 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 217780us
W20260709 13:08:43.824406 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 166027us
I20260709 13:08:43.824924 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2521) took 1707 ms. Trace:
I20260709 13:08:43.834805 21634 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:08:43.837138 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:43.825699 21494 rpcz_store.cc:276] 0709 13:08:42.117700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.118064 (+   364us) service_pool.cc:224] Handling call
0709 13:08:42.118451 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:42.167567 (+ 49116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.167605 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:42.368487 (+200882us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b2c000014c8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:08:43.231520 (+863033us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b2c000014c8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:08:43.232063 (+   543us) log.cc:844] Serialized 52 byte log entry
0709 13:08:43.276668 (+ 44605us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:43.565750 (+289082us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.692056 (+126306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.698878 (+  6822us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.698985 (+   107us) raft_consensus.cc:1685] finished
0709 13:08:43.699004 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.824836 (+125832us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11111,"prepare.queue_time_us":373274,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2371,"raft.queue_time_us":15961,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":8522,"spinlock_wait_cycles":14395520,"thread_start_us":445338,"threads_started":3,"wal-append.queue_time_us":81582}
I20260709 13:08:43.852371 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:43.845541 27147 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.861331 27147 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.862962 27215 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:43.867034 27222 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:43.845140 27167 consensus_meta.cc:287] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.007s
I20260709 13:08:43.867620 27222 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.826530 27100 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:43.869120 27100 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.870292 27147 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:43.871217 27222 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:43.871888 27100 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:43.824879 26780 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:43.872941 26780 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:43.875106 26780 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:43.876631 26780 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:43.877208 26780 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:43.881371 26993 consensus_meta.cc:287] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.005s
I20260709 13:08:43.881943 26993 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.824442 27067 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:43.833252 27012 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.887935 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:43.890926 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:43.883366 27161 raft_consensus.cc:3055] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:43.894215 27167 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:43.899890 21636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.017s
W20260709 13:08:43.926745 21636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.001s	sys 0.017s
I20260709 13:08:43.910264 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:43.898049 27012 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.899191 26984 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:43.894409 27197 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:43.944353 21642 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:43.944790 27197 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:43.945407 27197 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:43.945865 27012 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:43.947811 27197 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:43.894773 27067 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:43.904414 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 78556.6us
I20260709 13:08:43.927347 26889 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:08:43.943027 26984 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:43.943686 26780 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:43.943898 27100 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.902923 27161 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:43.911113 27002 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.952105 27067 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:43.955924 27211 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:08:43.902681 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.968201 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:43.971138 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.971715 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.951116 27198 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:43.979039 21606 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:43.973527 26997 ts_tablet_manager.cc:1434] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.756s	user 0.008s	sys 0.014s
I20260709 13:08:43.953126 27167 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:43.978426 26889 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:43.955940 27002 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.000833 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:43.999467 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2569) took 1510 ms. Trace:
I20260709 13:08:44.000181 21566 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:08:44.012878 21566 pending_rounds.cc:85] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 10
I20260709 13:08:44.013319 21566 pending_rounds.cc:107] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:08:44.015712 27071 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:44.013592 21566 raft_consensus.cc:2889] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.012614 21569 rpcz_store.cc:276] 0709 13:08:42.489438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.645607 (+156169us) service_pool.cc:224] Handling call
0709 13:08:43.999176 (+1353569us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54003eb054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:43.999377 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778472704}
I20260709 13:08:43.978176 27100 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:08:43.964823 27229 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:44.004643 26993 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.003890 27226 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:43.998059 26997 ts_tablet_manager.cc:1467] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Tablet startup took 780ms
W20260709 13:08:44.029300 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.043840 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 61504us
I20260709 13:08:44.051345 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:44.021320 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 127793us
I20260709 13:08:44.061728 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:44.061904 27160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.132s	user 0.011s	sys 0.044s
I20260709 13:08:44.065709 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:44.068491 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 67787.2us
I20260709 13:08:44.071475 27034 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:44.073108 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.073369 21608 leader_election.cc:400] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:08:44.038059 27029 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:44.016427 27071 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.083880 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:08:44.085144 27221 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:08:44.110272 27071 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.085448 26971 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:44.085913 27219 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:08:44.058759 26889 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:44.088672 27238 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:44.009687 26984 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.041699 27148 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.122682 21635 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:08:44.104800 27067 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:44.082306 27226 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:44.124766 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:08:44.044471 26997 ts_tablet_manager.cc:1469] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Trace:
0709 13:08:38.082932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.085324 (+  2392us) service_pool.cc:224] Handling call
0709 13:08:38.284266 (+198942us) ts_tablet_manager.cc:934] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
0709 13:08:40.123238 (+1838972us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:40.348449 (+225211us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:40.369551 (+ 21102us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:40.925462 (+555911us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:40.955072 (+ 29610us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:41.054308 (+ 99236us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:41.054391 (+    83us) inbound_call.cc:177] Queueing success response
0709 13:08:41.525599 (+471208us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:43.217186 (+1691587us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:43.227307 (+ 10121us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:43.227882 (+   575us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":78630,"raft.queue_time_us":231816,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":320,"tablet-copy.queue_time_us":54213,"tablet-download-pool.queue_time_us":18623,"tablet-download-pool.run_cpu_time_us":1142,"tablet-download-pool.run_wall_time_us":177112,"thread_start_us":249488,"threads_started":3}
I20260709 13:08:44.101347 27140 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:44.103130 21608 leader_election.cc:403] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.103245 21569 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:44.104164 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:44.104938 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.105953 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.104441 26993 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:44.130160 26993 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.107609 21563 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:44.056573 27032 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:44.132869 21563 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:08:44.133328 21563 pending_rounds.cc:85] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 7
I20260709 13:08:44.133602 21563 pending_rounds.cc:107] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:08:44.132915 27032 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.133836 21563 raft_consensus.cc:2889] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.136399 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:44.137094 26889 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:44.137506 26976 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:44.062855 27235 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.117082 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.119040 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.119428 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:44.120071 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.153558 21568 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:44.120790 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:44.155078 21643 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.116900 27238 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:44.096360 27100 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.126633 21485 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 11: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:44.126034 21640 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:44.129874 27140 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.132380 26993 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.112110 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:44.083370 27160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.011s	sys 0.044s
I20260709 13:08:44.139501 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:44.141580 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.112072 27229 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.162165 27229 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.165488 27229 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.125885 27226 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:44.166728 27226 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.169055 27226 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:44.159215 21562 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:44.123605 27067 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.118065 26971 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.146351 26636 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:08:44.189112 27140 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:44.178932 27160 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:44.182920 27071 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:44.191458 27245 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:44.182132 27100 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.111814 27034 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.179016 27243 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:44.195092 27032 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:44.195933 27246 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:08:44.140682 27209 tablet_copy_client.cc:323] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.129:46061
I20260709 13:08:44.145167 27002 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:44.211117 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.216766 21562 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
W20260709 13:08:44.214576 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 78259.4us
I20260709 13:08:44.180575 26976 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:44.196976 26889 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:44.219007 21643 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:44.179471 27214 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:44.205585 26971 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:44.224750 21561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2560) took 1738 ms (client timeout 1960 ms). Trace:
W20260709 13:08:44.233994 21561 rpcz_store.cc:269] 0709 13:08:42.486106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.791839 (+305733us) service_pool.cc:224] Handling call
0709 13:08:44.224592 (+1432753us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b5400289bd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:44.224698 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":751032576}
I20260709 13:08:44.238121 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.239934 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.242830 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.158012 27235 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.220372 27140 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.247447 27250 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.248073 21579 tablet_copy_service.cc:342] P 5727b19579474da6a12f79730b924770: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-6fad88e2e67d44f7adb559c0a8eb0af8 received from {username='slave'} at 127.0.0.1:36572
I20260709 13:08:44.247989 27250 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.248587 21579 tablet_copy_service.cc:434] P 5727b19579474da6a12f79730b924770: ending tablet copy session 549b31ac31b6428994b45938abc223a7-6fad88e2e67d44f7adb559c0a8eb0af8 on tablet 6fad88e2e67d44f7adb559c0a8eb0af8 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:08:44.250283 27250 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.246959 21562 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:44.223093 27032 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:44.224216 26993 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:08:44.245138 27253 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.221726 27236 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.220486 27148 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:44.246367 27160 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:08:44.281016 21564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2557) took 1795 ms (client timeout 1765 ms). Trace:
I20260709 13:08:44.257318 27237 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:44.257354 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3109) took 1592 ms. Trace:
W20260709 13:08:44.300082 21564 rpcz_store.cc:269] 0709 13:08:42.485247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.493658 (+  8411us) service_pool.cc:224] Handling call
0709 13:08:44.280786 (+1787128us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540028a0d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:44.280926 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267712768}
I20260709 13:08:44.280464 27254 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:44.304345 27034 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.233685 26976 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.277765 27250 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:44.305341 27250 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.307490 27250 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.300741 21636 rpcz_store.cc:276] 0709 13:08:42.664541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.664656 (+   115us) service_pool.cc:224] Handling call
0709 13:08:42.665004 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:42.709022 (+ 44018us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:43.280118 (+571096us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.931401 (+651283us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:43.950405 (+ 19004us) log.cc:844] Serialized 52 byte log entry
0709 13:08:43.950676 (+   271us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:43.951035 (+   359us) log.cc:844] Serialized 14 byte log entry
0709 13:08:44.133517 (+182482us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b180027c160. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a9b98d70 00007f98a9b8c293 00007f98a9b81cea 00007f98a9b8223a 00007f98a9feca2a 00007f98a9ffc0bf 00007f98a9ffc038
0709 13:08:44.245069 (+111552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.245184 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.256890 (+ 11706us) raft_consensus.cc:1685] finished
0709 13:08:44.257089 (+   199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.257283 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":637747,"prepare.queue_time_us":529321,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":83,"raft.queue_time_us":106786,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":43822,"spinlock_wait_cycles":19946752,"thread_start_us":735098,"threads_started":3,"wal-append.queue_time_us":650864}
I20260709 13:08:44.301002 26889 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.315049 27161 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.258250 27140 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:44.316406 27161 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.317606 27140 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.304286 27254 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.319700 27238 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.321480 27254 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:44.322651 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 791) took 2130 ms (client timeout 1708 ms). Trace:
W20260709 13:08:44.323112 22247 rpcz_store.cc:269] 0709 13:08:42.192292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.192429 (+   137us) service_pool.cc:224] Handling call
0709 13:08:44.322431 (+2130002us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b5400540e54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:44.322544 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965632768}
I20260709 13:08:44.330081 21561 raft_consensus.cc:2410] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:08:44.301343 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:44.330438 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 257431us
I20260709 13:08:44.276542 27243 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:08:44.334904 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 215544us
I20260709 13:08:44.331804 27161 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:44.337002 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.343499 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:44.344233 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 123072us
I20260709 13:08:44.330201 27032 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:44.347221 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.348085 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.348570 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.350596 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.348946 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:44.351271 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.283211 27188 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:08:44.355410 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.353839 22247 raft_consensus.cc:1813] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:08:44.356246 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.356541 22247 raft_consensus.cc:2410] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:44.357550 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.358366 21486 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:44.359021 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.359457 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.360129 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.360479 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.360754 21634 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:44.360545 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:44.362969 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.359630 21635 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:44.365628 22240 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:08:44.366816 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:44.367075 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.367416 21563 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:44.367244 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.369755 21636 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:44.373298 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.374167 21490 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:44.375356 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.356735 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.339253 27235 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.377617 21485 raft_consensus.cc:1813] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:08:44.383239 21485 raft_consensus.cc:2410] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:44.352937 27238 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:44.386550 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:44.380031 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:44.396281 27252 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:44.396973 27252 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.397281 27262 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:44.398128 27262 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.398948 27256 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:08:44.401149 27262 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.402220 27262 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.407421 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61813.9us
I20260709 13:08:44.391757 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:44.409222 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:44.371498 27197 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:44.284838 27253 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.302343 27236 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.350739 27161 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.351294 27140 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:44.425637 27243 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.446182 27253 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.446264 27140 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.329890 27237 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.402894 27262 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.448975 27140 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.450345 27262 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:44.410185 27246 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:44.451256 27246 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:44.451647 27246 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:44.426962 27244 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.428536 26907 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:08:44.428445 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 129214us
I20260709 13:08:44.428054 26969 raft_consensus.cc:2955] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:44.425650 27100 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:44.398999 27034 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:44.429903 27017 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.390499 27238 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:44.365195 27032 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.431604 27257 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:44.432642 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:44.416509 21563 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:44.439579 27252 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:44.442898 26956 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.443130 27261 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:44.417696 27167 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:44.445617 27161 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.389204 27250 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:44.476120 26907 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.418219 27067 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:44.486714 27236 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.487313 21565 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:44.492477 27240 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.493209 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.494809 27197 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.505888 27213 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.660s	user 0.000s	sys 0.004s
I20260709 13:08:44.506361 22246 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:44.511873 22243 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:44.547621 21568 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:44.596709 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.552815 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.555874 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.567399 21494 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:44.569273 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 179258us
I20260709 13:08:44.545315 27238 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:44.532612 27034 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:44.567567 27083 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:44.590648 26907 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:44.567931 27167 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.511227 27244 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.592424 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.545095 27017 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.579514 27261 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:44.551448 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 118906us
W20260709 13:08:44.587433 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 178278us
I20260709 13:08:44.611671 22247 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:44.610430 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.614822 27261 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.617120 27083 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:44.623109 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.606748 27034 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.625600 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3124) took 1048 ms. Trace:
I20260709 13:08:44.625828 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.653697 21635 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:08:44.653949 22243 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:44.654295 21636 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:08:44.654771 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.631212 21641 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:44.659137 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46849.7us
I20260709 13:08:44.634621 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:44.635191 27203 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.057s	user 0.000s	sys 0.004s
I20260709 13:08:44.635272 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.636053 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.635746 27083 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.637084 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3526) took 1368 ms. Trace:
I20260709 13:08:44.637729 27244 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:44.639405 27017 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.637105 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.625090 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.640362 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.693857 21492 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:08:44.686403 21636 raft_consensus.cc:2955] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:44.641399 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:44.695094 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 53789us
I20260709 13:08:44.643415 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:44.595065 27250 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:44.696223 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 52899.6us
I20260709 13:08:44.697898 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:44.643577 27032 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:44.599769 27240 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.644307 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.647150 27268 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.647444 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.648655 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.649710 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:44.650748 27263 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:44.613775 27167 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.681692 27186 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.633473 27246 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.653394 21640 rpcz_store.cc:276] 0709 13:08:43.577284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.577420 (+   136us) service_pool.cc:224] Handling call
0709 13:08:43.586539 (+  9119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.156731 (+570192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.625356 (+468625us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400264dd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:44.625537 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235710720}
I20260709 13:08:44.663476 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.681649 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:44.684149 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:44.689055 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.682127 21566 rpcz_store.cc:276] 0709 13:08:43.268453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.571127 (+302674us) service_pool.cc:224] Handling call
0709 13:08:43.999828 (+428701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.017677 (+ 17849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.636904 (+619227us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54003eb050. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:44.637027 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985119616}
I20260709 13:08:44.703377 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:44.704487 22246 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:44.606014 27197 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:44.719712 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.725878 21641 raft_consensus.cc:2410] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:08:44.703621 27265 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.108s	user 0.003s	sys 0.000s
I20260709 13:08:44.728919 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:44.729395 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 47858.3us
I20260709 13:08:44.730965 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:44.707486 27168 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:44.651393 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.688102 27257 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:44.710032 27236 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:44.744195 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.736729 21637 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:08:44.746258 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.711758 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:44.747576 21568 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:08:44.748044 21485 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:08:44.748762 21636 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:44.734371 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:44.692631 27002 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:08:44.731668 27161 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:44.741541 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.741771 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.743116 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.746872 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.749713 21485 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:44.744853 21490 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:44.753019 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.834255 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:44.750938 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.750864 21636 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:44.834126 21642 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:44.732220 27252 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:44.833606 21489 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:44.845973 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:44.859504 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 113296us
I20260709 13:08:44.860342 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:44.860421 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.860049 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.865393 21486 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
W20260709 13:08:44.860857 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 94405.6us
I20260709 13:08:44.867035 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:44.739215 27262 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.717288 27268 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.741219 27256 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:44.863263 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:44.869024 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2584) took 1672 ms. Trace:
I20260709 13:08:44.875314 21560 rpcz_store.cc:276] 0709 13:08:43.196816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.347921 (+151105us) service_pool.cc:224] Handling call
0709 13:08:43.348229 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.348939 (+   710us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:43.348966 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:44.328501 (+979535us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b1800361180. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a
0709 13:08:44.328916 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.474451 (+145535us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:44.474509 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.474618 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.652660 (+178042us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:44.868800 (+216140us) raft_consensus.cc:1685] finished
0709 13:08:44.868826 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.868962 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2415,"raft.queue_time_us":80,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":178799,"spinlock_wait_cycles":24553472,"thread_start_us":145162,"threads_started":1,"wal-append.queue_time_us":250859}
I20260709 13:08:44.738911 27254 raft_consensus.cc:476] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:44.859916 27259 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.879298 27259 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.882627 27259 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:44.884059 21643 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 8.
I20260709 13:08:44.839843 27253 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.841728 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3524) took 1669 ms. Trace:
I20260709 13:08:44.765870 27168 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:44.743995 27236 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.734043 26991 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.157s
W20260709 13:08:44.904845 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.872864 27221 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:08:44.869947 26976 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.912179 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 49549.5us
I20260709 13:08:44.887326 21567 rpcz_store.cc:276] 0709 13:08:43.172192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.174950 (+  2758us) service_pool.cc:224] Handling call
0709 13:08:43.175352 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.175832 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:43.182033 (+  6201us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.260796 (+ 78763us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.261257 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:08:43.261395 (+   138us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:43.261438 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.261524 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.344678 (+ 83154us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b1800336460. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef5522 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:08:44.634621 (+1289943us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:44.841465 (+206844us) raft_consensus.cc:1685] finished
0709 13:08:44.841494 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.841657 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7250,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":173,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":15865,"spinlock_wait_cycles":112553984,"thread_start_us":78391,"threads_started":1,"wal-append.queue_time_us":163899}
I20260709 13:08:44.731273 27186 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.891250 27161 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.891857 27256 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.920205 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:44.902405 27236 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.899173 27243 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.896605 27252 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:44.946871 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 204108us
I20260709 13:08:44.948666 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:44.905388 27259 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:44.973461 27245 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:44.983490 27240 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:44.888093 27253 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:44.990417 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.012454 21636 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:44.971836 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:44.932163 27256 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:44.973999 27247 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:44.984416 27216 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:44.989500 27243 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:44.949590 27267 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
W20260709 13:08:45.027635 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 293337us
I20260709 13:08:44.950348 26991 consensus_queue.cc:1243] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 549b31ac31b6428994b45938abc223a7 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:44.841924 27140 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.746678 27257 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:44.946161 27229 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:44.961365 27017 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.904709 27254 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:44.922814 27148 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:44.975224 27246 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:44.998497 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:44.970839 27262 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.949923 27161 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.013625 27250 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:44.947110 26976 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:45.076432 27261 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.077708 27161 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:45.052518 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 80744.4us
I20260709 13:08:45.050832 27243 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.050567 27177 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:45.091507 21634 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:08:45.030476 27270 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.307s	user 0.001s	sys 0.001s
I20260709 13:08:45.093806 27261 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:45.094861 27243 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.095539 27191 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.096117 27191 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.096684 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:45.097903 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:45.098310 27191 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.099080 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:45.099838 21486 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:45.101081 21503 tablet_copy_service.cc:140] P 5a34fd3290de493eb6bbe828dd742772: Received BeginTabletCopySession request for tablet cc9f5258ae3f4790a9bc1813d73ec987 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:44644)
I20260709 13:08:45.101686 21503 tablet_copy_service.cc:161] P 5a34fd3290de493eb6bbe828dd742772: Beginning new tablet copy session on tablet cc9f5258ae3f4790a9bc1813d73ec987 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:44644: session id = 549b31ac31b6428994b45938abc223a7-cc9f5258ae3f4790a9bc1813d73ec987
I20260709 13:08:45.103036 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:45.104472 21485 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:45.105000 27029 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.105568 27029 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.008219 27223 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:08:45.107326 27223 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:45.107672 27223 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:45.108480 27223 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.109699 27223 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:45.110931 27262 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:45.110862 27229 consensus_queue.cc:1175] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a87bd86b86e74aa8bb61189215b73439" responder_term: 14 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:45.113077 27034 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:45.113741 27262 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.114480 26636 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:45.116180 27034 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.124989 27186 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.127249 27253 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.129980 27257 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.149917 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:45.156467 26984 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.161022 21639 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:45.161459 21639 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:44.998533 27168 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.164531 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 1949) took 1095 ms. Trace:
I20260709 13:08:45.164942 21494 rpcz_store.cc:276] 0709 13:08:44.069388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.069538 (+   150us) service_pool.cc:224] Handling call
0709 13:08:44.069815 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.600898 (+531083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.164270 (+563372us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b540008a054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:45.164467 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143655296}
I20260709 13:08:45.165736 21561 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:45.068631 27205 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 1.340s	user 0.012s	sys 0.009s
W20260709 13:08:45.069293 26956 consensus_meta.cc:287] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.001s
I20260709 13:08:45.069471 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:45.169566 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 100198us
I20260709 13:08:45.069939 26971 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:45.071087 27268 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.077886 26976 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:45.003700 27259 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.048130 27140 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.108772 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:45.010645 27252 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.172112 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:45.175690 21485 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
W20260709 13:08:45.067971 21378 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet eae01b9fdd5340dc9416e5834263a4d6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5727b19579474da6a12f79730b924770 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:45.177716 21378 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 269817us
I20260709 13:08:45.175864 27100 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:45.175534 27271 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.422s	user 0.001s	sys 0.000s
I20260709 13:08:45.184374 27100 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.184671 27199 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.170487 27253 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:45.184823 27100 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.185642 27253 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.188053 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:45.189512 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:45.062050 27254 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.192958 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:45.059046 27017 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.175212 27259 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:45.175710 27032 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.195508 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:45.059826 27216 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.067167 27148 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.192291 26971 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.190182 26956 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.193435 27268 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:45.197460 26969 consensus_meta.cc:287] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.002s
I20260709 13:08:45.186424 27246 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:08:45.198585 27177 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:45.219416 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 911) took 2038 ms. Trace:
I20260709 13:08:45.219874 22238 rpcz_store.cc:276] 0709 13:08:43.175838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.176069 (+   231us) service_pool.cc:224] Handling call
0709 13:08:43.176469 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.176891 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.176930 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.177536 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:08:43.274171 (+ 96635us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:43.274288 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.274386 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.732006 (+1457620us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:45.209487 (+477481us) raft_consensus.cc:1685] finished
0709 13:08:45.209510 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.214014 (+  4504us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":2482,"spinlock_wait_cycles":5168512,"thread_start_us":80308,"threads_started":1,"wal-append.queue_time_us":396117}
I20260709 13:08:45.233273 27140 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.201689 27032 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:45.227332 26907 consensus_meta.cc:287] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.003s
I20260709 13:08:45.252027 26907 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.256052 26907 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.259596 27253 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.274844 27236 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.278651 27254 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.288321 27252 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:45.289155 27238 consensus_meta.cc:287] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.679s	user 0.006s	sys 0.006s
I20260709 13:08:45.289605 27238 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:45.295110 27280 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:08:45.300282 27274 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.329s	user 0.000s	sys 0.002s
I20260709 13:08:45.304375 27259 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.343417 21392 catalog_manager.cc:5697] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:45.346750 21392 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:45.349951 21392 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:45.355173 21493 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:45.355407 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 1345) took 1082 ms. Trace:
I20260709 13:08:45.368147 21562 rpcz_store.cc:276] 0709 13:08:44.272773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.273010 (+   237us) service_pool.cc:224] Handling call
0709 13:08:44.273420 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.274533 (+  1113us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:44.298593 (+ 24060us) log.cc:844] Serialized 14 byte log entry
0709 13:08:45.138316 (+839723us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b180037d7a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b8223a 00007f98a9feca2a
0709 13:08:45.354180 (+215864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:45.354344 (+   164us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:45.354517 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.354663 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.355074 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23834,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"spinlock_wait_cycles":5369216,"thread_start_us":215101,"threads_started":1,"wal-append.queue_time_us":991611}
W20260709 13:08:45.375175 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 225245us
I20260709 13:08:45.377228 27002 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:45.378458 27002 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.382037 27002 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.382835 27002 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:45.385551 27030 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:45.233326 27017 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.266546 27100 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.387720 27140 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:45.388360 27140 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:45.388911 27140 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:45.389497 21569 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:08:45.390065 21569 pending_rounds.cc:85] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 11
I20260709 13:08:45.390427 21569 pending_rounds.cc:107] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:08:45.390657 27100 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:45.362500 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 166938us
I20260709 13:08:45.403688 21569 raft_consensus.cc:2889] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:45.422874 21533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.010s	sys 0.007s
W20260709 13:08:45.435846 21533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.010s	sys 0.008s
I20260709 13:08:45.400477 27002 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.448354 27148 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.439986 21392 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 13, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:45.455035 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:45.455843 27259 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:45.456389 21565 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:45.455175 21392 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 8, term changed from 9 to 10, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to <none>, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:45.458086 27260 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:45.460701 27272 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:45.461309 27272 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:45.301267 27256 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.463837 21637 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:45.464272 27216 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.465121 27256 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.467746 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:45.468012 27238 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.466476 27272 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:45.468186 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 388056us
I20260709 13:08:45.473271 27272 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:45.474066 27167 consensus_meta.cc:287] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.005s
I20260709 13:08:45.475005 27167 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:45.478588 27167 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.482935 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:45.458521 21392 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 12, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 12 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:45.493371 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.495198 27236 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.499979 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:45.501700 27076 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.507108 27002 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.502406 27076 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.527150 27076 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.537884 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:45.539247 27236 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:45.539077 21392 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 10, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 10 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.540182 27236 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.541723 21392 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 14, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 14 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:45.543051 27236 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.550060 27029 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.550982 27238 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:45.551740 27177 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:45.587704 27197 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.587800 27177 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.552513 27278 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:45.553066 27167 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:45.556208 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2590) took 1437 ms. Trace:
I20260709 13:08:45.559511 27030 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:45.561973 27247 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:45.562398 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.562922 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.563474 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:45.564977 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:45.566649 27199 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.566730 21639 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.570686 27289 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.571709 27237 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:45.604151 27289 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.574108 27253 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:45.605439 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:45.605388 27253 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.586704 27238 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.592106 21569 rpcz_store.cc:276] 0709 13:08:44.118832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.132112 (+ 13280us) service_pool.cc:224] Handling call
0709 13:08:44.132414 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.439209 (+1306795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.555814 (+116605us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003237d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:45.556134 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2888681216}
W20260709 13:08:45.598755 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 50499.4us
I20260709 13:08:45.598598 27167 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.599006 27199 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.599192 27247 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.599490 21643 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.599538 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.600523 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.600543 21487 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:45.571830 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:45.605887 27296 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:08:45.554325 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:45.595541 27030 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:45.612257 21562 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:45.626148 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.628728 21642 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:45.629976 21638 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:45.629868 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.636468 21641 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:45.621891 21392 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:45.631968 27177 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.646085 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:45.658082 27191 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.658427 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:45.659197 27191 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:45.659508 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 105381us
I20260709 13:08:45.658614 21569 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:08:45.663059 21569 pending_rounds.cc:85] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 9
I20260709 13:08:45.667038 22212 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:08:45.667896 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 82844.6us
I20260709 13:08:45.653071 27164 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.639995 27197 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:45.678088 21569 pending_rounds.cc:107] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:08:45.678529 21569 raft_consensus.cc:2889] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.645176 27029 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:45.642997 27140 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.681595 27262 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:45.681703 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 118465us
I20260709 13:08:45.682044 21639 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:45.690368 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:45.691797 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 65263.7us
I20260709 13:08:45.694010 27294 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.694504 27294 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.694909 27294 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.696053 27140 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.697575 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:45.698882 21490 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.698665 27197 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.704484 27238 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.705255 27289 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.706035 27247 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.707154 27253 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.709710 27197 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.712239 27168 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:45.713011 27168 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.715493 21639 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:45.713007 21560 raft_consensus.cc:2955] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:45.704120 27164 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.722561 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:45.722892 21490 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:45.684708 27262 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:45.729797 21493 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:45.730152 21488 raft_consensus.cc:2410] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:08:45.731915 21637 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:45.681463 27191 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.733265 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.721184 27167 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.737391 21487 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:45.688408 21392 catalog_manager.cc:5697] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:45.730775 27262 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.757148 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:45.756999 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 88443.9us
W20260709 13:08:45.766012 27295 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:08:45.766006 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:45.739455 27029 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.755121 26969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43144 (request call id 5) took 3302 ms. Trace:
W20260709 13:08:45.773188 27255 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:08:45.773654 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:45.774514 27168 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:45.779295 27164 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.781951 27076 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:45.782388 27299 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.077s	user 0.000s	sys 0.003s
I20260709 13:08:45.771799 21569 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:45.788625 21562 raft_consensus.cc:2410] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:08:45.764710 27237 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:45.802927 21563 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:45.783241 27199 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.805531 21563 pending_rounds.cc:85] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 8
I20260709 13:08:45.811239 21563 pending_rounds.cc:107] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:45.811630 21563 raft_consensus.cc:2889] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.813163 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:45.812485 21564 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:45.818295 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:45.795861 21392 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 15, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 15 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.822693 21643 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:45.825271 21569 raft_consensus.cc:2410] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:08:45.829521 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.830322 27032 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.844368 21567 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:45.846979 27307 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:08:45.847762 27191 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:45.819113 27237 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.861702 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:45.856598 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:45.870584 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.863627 21565 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:45.871922 21643 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:08:45.822187 27029 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.871387 21640 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:45.875907 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:45.877434 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.879717 27294 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.880194 27076 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.884989 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:45.886173 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:45.887284 26984 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.018s
I20260709 13:08:45.895080 21562 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.897647 21569 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:08:45.899501 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.903522 27008 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.903704 21486 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:45.904214 27008 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.904850 27294 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.864368 27237 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:45.908597 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:45.909962 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 161969us
I20260709 13:08:45.906365 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:45.911767 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:45.912362 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 85188.7us
I20260709 13:08:45.909767 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:45.917105 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:45.915766 21566 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:45.920475 27076 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.920385 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:45.921165 27076 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.921641 27076 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.921694 27294 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:45.922343 27294 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.922773 27294 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:45.917173 27167 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.926499 21639 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 20: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:45.927729 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:45.929445 27029 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.920332 21392 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 15 to 16, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 16 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.934024 21392 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 15, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 15 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.935325 27294 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.936210 21392 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 10, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 15 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:45.937661 27294 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:45.943215 21642 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:45.943917 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:45.952174 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:45.947525 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:45.783545 26969 rpcz_store.cc:276] 0709 13:08:42.341944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.346263 (+  4319us) service_pool.cc:224] Handling call
0709 13:08:42.396517 (+ 50254us) log.cc:844] Serialized 513 byte log entry
0709 13:08:43.857221 (+1460704us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b540002a420. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f5b142 00007f98a9f3beaa 00007f98a9f42d53 00007f98a9f42cd9 00007f98a9f42c69 00007f98a9f42c31 00007f98a9f41dfd 000000000038f354 000000000038f199 00007f98a6ef5475
0709 13:08:45.638468 (+1781247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194761,"raft.queue_time_us":166023,"raft.run_cpu_time_us":20704,"raft.run_wall_time_us":1413643,"spinlock_wait_cycles":14079104,"thread_start_us":135641,"threads_started":1,"wal-append.queue_time_us":236467,"wal-append.run_cpu_time_us":12675,"wal-append.run_wall_time_us":1191813}
I20260709 13:08:45.950502 21392 catalog_manager.cc:5697] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:45.930689 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:45.957058 21638 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:45.958058 21392 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:45.961490 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:45.970084 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:45.979696 27197 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:45.979730 27140 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:45.980544 27197 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:45.980587 27140 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.981330 27140 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.981868 27197 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.966375 27008 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:45.991678 27140 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:45.992515 21503 tablet_copy_source_session.cc:215] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:45.963219 26984 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:08:46.012260 21392 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 10 to 12, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 12 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:46.024574 21562 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:45.962567 27030 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:45.960132 27262 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:46.032574 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 53454.1us
I20260709 13:08:46.033522 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:46.027459 21566 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:08:46.043710 21566 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.038479 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:46.048026 27164 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:46.048480 27164 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.048710 27008 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:46.049137 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:46.050076 27272 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:46.048898 27164 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.051827 27076 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.050493 27272 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.051108 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:46.053205 21567 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:46.054198 21562 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:46.054940 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.057823 21392 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:46.061175 27262 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:46.070756 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:46.069087 21392 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:46.071838 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 305018us
I20260709 13:08:46.080570 27140 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:46.056613 27253 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:46.083082 27253 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.083503 27253 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.056268 27272 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.098721 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:46.101428 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 167391us
I20260709 13:08:46.102830 21566 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:46.103880 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 46483.7us
I20260709 13:08:46.107677 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.109704 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:46.109845 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:46.110452 21487 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.111232 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.113574 21486 raft_consensus.cc:2368] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:08:46.114427 22240 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 10: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:46.109580 27291 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.119525 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:46.124352 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.127143 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:46.121344 27236 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:46.126518 27294 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:46.130725 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:46.130359 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 80655.6us
I20260709 13:08:46.115410 27278 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:46.114095 27311 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:46.137367 27311 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.139310 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.127349 21392 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 11, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 11 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.135416 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:46.116197 27030 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:46.130183 27236 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.140210 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:46.140614 21566 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.141903 21638 raft_consensus.cc:2368] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:08:46.142448 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.142627 21642 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.144949 27311 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:46.130205 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.146036 21392 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 13, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 13 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.148084 21640 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:46.152535 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.148932 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.150879 21392 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 15, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 15 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.148378 27236 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.163389 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.163666 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.142014 27278 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:46.168913 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.164909 22238 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:46.168977 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.173825 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:46.174772 21392 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:46.179418 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.181188 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.185797 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.186028 22241 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:46.187501 27278 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.188048 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.189273 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:46.192991 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.194887 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.195531 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.173454 27307 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:46.198712 21561 raft_consensus.cc:2410] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 14 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:08:46.164016 27255 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:08:46.199900 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.204900 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.206177 21563 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.206359 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.207216 22238 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:46.207532 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.205013 26991 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:46.206508 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:46.212414 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 85659.6us
I20260709 13:08:46.198099 27076 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:46.215728 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.203665 21392 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.218935 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.218703 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:46.213241 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.224325 21392 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 16, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 16 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.226095 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.227005 22238 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.227707 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:46.228402 21567 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:46.230823 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:46.231734 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.233997 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:46.235219 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.226590 27029 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:46.236486 27029 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.239949 21392 catalog_manager.cc:5697] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 13, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:46.245882 21563 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:08:46.229635 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.249110 22246 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:46.250001 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:46.250314 21567 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:46.252671 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:46.253007 27168 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:46.253497 27168 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.238938 26991 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:46.253413 27100 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:08:46.250635 27237 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:46.274816 27237 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.275707 26991 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:46.276311 26991 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:46.276844 26991 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.277904 27237 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:46.271871 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:46.280007 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 84438.5us
I20260709 13:08:46.258922 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:46.263777 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:46.282164 21643 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.238651 27029 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:46.287756 21487 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:46.295569 21639 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:46.299666 21566 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:46.264711 27256 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:46.295923 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:46.258551 27168 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.302745 22212 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:46.319051 27256 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:46.320406 21561 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:46.320212 27256 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.270684 27255 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:08:46.294230 27199 consensus_queue.cc:1059] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:46.327040 27314 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:46.327251 27199 raft_consensus.cc:3055] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:46.327775 27199 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:46.327638 27314 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.328791 27199 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.329874 27314 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:46.330143 27199 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:46.331655 27306 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:46.332456 27306 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:46.285157 27191 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:08:46.336284 27191 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:46.336673 27191 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:46.338866 26991 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:46.337576 27191 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.340538 22238 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:46.341698 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:46.341761 21643 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:46.354971 21639 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
W20260709 13:08:46.363620 27316 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:08:46.368145 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.380499 27164 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:46.383679 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 87928.8us
I20260709 13:08:46.387266 27291 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:46.388025 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 98522.9us
I20260709 13:08:46.395918 27237 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:46.333750 27306 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.399185 27314 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:46.403805 27191 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:46.408504 27315 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.202s	user 0.003s	sys 0.000s
I20260709 13:08:46.420154 21642 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:46.314127 27253 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:46.427636 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 180566us
W20260709 13:08:46.431810 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 178285us
I20260709 13:08:46.435087 27291 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:46.473524 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:46.442905 27314 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:46.489149 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.491554 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:46.492396 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:46.498723 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:46.498975 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 56100.4us
I20260709 13:08:46.499975 21634 raft_consensus.cc:2410] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
W20260709 13:08:46.493412 21606 leader_election.cc:336] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Timed out: RequestConsensusVote RPC to 127.19.231.132:40323 timed out after 1.708s (SENT)
I20260709 13:08:46.473862 27311 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:46.482082 27291 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.504640 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:46.505098 21640 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.489210 27314 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.508991 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.517460 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.511694 22238 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 10 LEARNER]: Advancing to term 11
I20260709 13:08:46.525416 26636 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:46.529479 26636 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:46.529896 26636 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:46.530922 26636 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.532291 26636 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:46.498646 27029 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.473345 27237 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.542086 27237 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:46.523892 27311 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.547807 27311 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:46.548535 27311 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:46.549183 27311 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:46.551425 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 58083.3us
I20260709 13:08:46.555265 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:08:46.556432 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51442.3us
I20260709 13:08:46.497872 27272 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.560782 27272 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:46.564374 27294 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:46.564963 27294 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.565366 27294 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:46.569839 27255 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:46.570704 27255 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.570241 21493 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:08:46.579334 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 74794.8us
I20260709 13:08:46.584131 27255 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:46.591734 21488 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:46.519847 27167 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:46.596266 27236 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.599922 27164 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:46.601687 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:46.603183 21568 raft_consensus.cc:2368] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12.
I20260709 13:08:46.604092 27164 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:46.496670 27100 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:08:46.604638 27164 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.607867 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:46.608829 27167 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.610754 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:46.611698 27167 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:46.612149 27253 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:46.612226 27167 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:46.613600 27167 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:46.617103 21532 leader_election.cc:400] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:08:46.618669 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:46.644909 21563 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 17: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:46.632243 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.633101 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:46.634231 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.634474 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.636382 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.623430 21487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:46.648489 21487 raft_consensus.cc:606] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:46.648948 21487 raft_consensus.cc:614] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:46.649899 21532 leader_election.cc:403] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.651101 21486 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:46.646858 21485 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:46.680321 21640 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
W20260709 13:08:46.689680 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 72819.9us
I20260709 13:08:46.689855 22238 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 11 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:46.689872 21488 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:46.690632 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:46.695946 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:46.690410 22238 pending_rounds.cc:85] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 8
I20260709 13:08:46.697647 22238 pending_rounds.cc:107] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:46.697332 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:46.697953 22238 raft_consensus.cc:2889] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 11 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.698261 21563 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.708220 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:46.709008 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:46.709652 21489 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:46.711740 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.713470 27278 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.721952 27272 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.722532 27272 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.724773 27272 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:46.726728 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.710994 27164 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:46.740015 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.740295 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:46.693251 27253 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:08:46.728680 21488 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:46.701038 27029 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:46.752595 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.755122 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.749058 21494 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.714227 27278 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.727524 27236 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:46.761327 21562 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:46.763115 21487 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:08:46.766232 21487 pending_rounds.cc:85] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 7
I20260709 13:08:46.766481 21487 pending_rounds.cc:107] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:46.766690 21487 raft_consensus.cc:2889] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.719362 27199 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:08:46.773943 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.759209 27029 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:46.778719 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.782517 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.783267 21491 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:46.784909 21563 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:46.787653 21485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:46.788352 21485 raft_consensus.cc:606] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:46.767761 27197 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:46.790768 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 232923us
I20260709 13:08:46.790692 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.781788 27029 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.792493 22212 leader_election.cc:400] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12.
I20260709 13:08:46.793535 22212 leader_election.cc:403] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:46.796072 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 100200us
I20260709 13:08:46.796849 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:46.800745 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.791006 27311 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:46.807596 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:46.798009 27197 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:46.810597 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.813230 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:46.813999 22238 raft_consensus.cc:2368] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16.
I20260709 13:08:46.803056 27326 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.803246 27253 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:46.816536 21489 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:46.809705 27314 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.822476 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.819700 21567 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:46.852349 21566 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:46.852067 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.854529 27255 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.857152 27255 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.859591 27255 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:46.859969 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.861112 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.862218 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.822007 27236 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:46.863575 22241 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.864284 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.863054 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:46.864295 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:46.854718 27333 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:46.873134 21562 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:46.872789 27333 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.877353 21567 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:46.853861 27253 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:46.819523 27291 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.893362 21560 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:08:46.895314 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.897428 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:46.898994 27236 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:46.900959 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:46.901703 21489 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:46.890686 27314 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:46.886451 27272 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:46.907879 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:46.920495 26636 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:46.920609 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:46.921069 26636 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:46.921736 21486 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:46.921985 26636 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.928184 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:46.928555 27278 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:46.916973 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:46.924510 21459 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:46.925771 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:46.916301 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.930677 27291 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:46.926450 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:46.931506 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 68736.7us
I20260709 13:08:46.932667 27253 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:46.933671 26991 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:46.934239 26991 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:46.934707 27319 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:46.934967 27237 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:46.928838 21485 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.913010 27100 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:46.950521 21494 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
W20260709 13:08:46.900665 27168 consensus_meta.cc:287] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.003s
I20260709 13:08:46.959182 22246 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:46.931407 27291 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:46.935550 27319 consensus_queue.cc:1243] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:46.978087 27326 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12.
I20260709 13:08:46.978523 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:46.957615 26969 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:46.986974 22247 raft_consensus.cc:1217] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Deduplicated request from leader. Original: 17.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 13:08:46.988163 22247 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:08:46.993641 21485 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:47.001016 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:47.007292 21569 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:47.010038 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.015242 27272 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:47.016664 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:47.018115 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:46.900913 27197 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.021268 27167 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:46.902923 27236 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:47.021931 27167 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.022420 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.023437 27334 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.970985 27291 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.024616 27291 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.024669 27335 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:47.025132 27335 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:47.025514 27335 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.023916 27334 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.027966 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.030189 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:47.031551 22241 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:47.040825 22246 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:08:47.046479 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.051354 21637 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:47.051824 21637 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:47.054188 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.010107 26991 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:46.976536 27168 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:47.073072 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.059737 27278 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:47.084235 27278 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:47.084681 27278 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.085687 27333 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:47.070361 27294 consensus_meta.cc:287] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.504s	user 0.014s	sys 0.000s
I20260709 13:08:47.056723 27336 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:47.087102 27336 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:47.087514 27336 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.078585 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:47.081655 27256 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:47.078078 21637 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.085824 27319 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:47.091248 22241 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:47.076504 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:47.105937 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.052188 27307 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:08:47.058954 27237 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:47.098387 22244 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
I20260709 13:08:47.107793 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.107880 27237 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:47.097057 27340 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.002s
I20260709 13:08:47.116065 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.076448 27197 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:47.117867 21637 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.122316 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:47.117133 27260 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.097715 27256 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:47.129606 22244 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:47.073364 27100 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:08:47.126606 21532 leader_election.cc:400] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:08:47.098140 27333 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.111256 27237 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:47.104887 27319 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:47.134119 27348 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.159497 27348 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.160089 27319 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.136823 27029 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:47.141098 27100 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:47.134630 27167 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:47.098802 27294 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.144138 27168 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:47.148608 27333 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.133284 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.123394 27253 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:47.179138 27333 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:47.179795 27197 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:47.183856 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 50674.1us
I20260709 13:08:47.184566 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:47.182085 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.596s (SENT) [suppressed 8 similar messages]
I20260709 13:08:47.187438 21564 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:47.188529 22238 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:47.189622 21637 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:08:47.190140 21637 pending_rounds.cc:85] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 8
I20260709 13:08:47.190449 21637 pending_rounds.cc:107] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:47.171710 27100 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:47.190755 21637 raft_consensus.cc:2889] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.195607 27334 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:47.196214 27334 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.185236 27197 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:47.198132 27348 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:47.199191 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.150002 27256 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.206207 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.174304 27253 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.187856 27333 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.214087 27256 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.219204 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.203344 22240 raft_consensus.cc:2393] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:47.194180 27319 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.158450 27278 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:47.208885 27255 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:08:47.233574 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.235217 27100 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.242287 27100 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.221395 27253 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:47.243219 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 61178.1us
I20260709 13:08:47.246248 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:47.247068 21634 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:47.247534 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:47.248642 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 123737us
I20260709 13:08:47.249293 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.250134 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.252753 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:47.253284 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.254005 21489 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:47.198501 27197 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.268151 27029 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:47.268885 27029 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.269125 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:47.269938 21492 raft_consensus.cc:2368] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12.
I20260709 13:08:47.273142 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:47.273839 21492 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:47.273983 21486 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:47.275049 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:47.276250 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:47.277077 21493 raft_consensus.cc:2368] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15.
I20260709 13:08:47.278249 27278 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:47.263926 27335 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.269428 27029 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:47.257745 27272 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:47.257174 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:47.290479 22238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:47.291415 22238 raft_consensus.cc:606] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:47.291899 22238 raft_consensus.cc:614] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:47.293318 27209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9f5258ae3f4790a9bc1813d73ec987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:47.293756 27076 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:47.294348 27076 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:47.295246 27076 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.296955 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:47.297932 21643 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 17: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:47.301501 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:47.304737 21641 raft_consensus.cc:2368] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15.
I20260709 13:08:47.305173 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:47.305717 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:47.305418 22210 leader_election.cc:400] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12.
I20260709 13:08:47.309980 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.310581 27190 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:08:47.311058 27357 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.091s	user 0.000s	sys 0.003s
I20260709 13:08:47.311535 27190 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:47.311920 27190 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:47.310078 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:47.313462 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 124566us
I20260709 13:08:47.314182 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.315723 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:47.319590 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.322002 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.324352 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.325659 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.339203 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.340051 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:47.340150 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.340482 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.340691 21565 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.342554 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.343880 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:47.345662 22210 leader_election.cc:400] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15.
I20260709 13:08:47.346267 22210 leader_election.cc:403] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:47.350476 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:47.304553 27352 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:47.356628 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.358546 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.341581 27333 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:47.359154 21634 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:08:47.360705 21634 pending_rounds.cc:85] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 10
I20260709 13:08:47.360957 21634 pending_rounds.cc:107] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:08:47.361205 21634 raft_consensus.cc:2889] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.365195 27253 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.366158 27363 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:47.367048 27355 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.343695 27260 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.339856 27294 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:47.354635 27334 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.351596 27328 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:47.371716 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.352602 27236 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:47.374996 27255 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.375281 21636 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:47.337275 27306 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:08:47.299154 27336 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.393409 27362 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.394170 27362 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.354405 27167 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:47.354465 27311 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15.
I20260709 13:08:47.399811 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:47.402602 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.371598 27352 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:47.407087 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:47.379138 27260 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.414510 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:47.416685 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:47.416721 21569 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:47.418579 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:47.423307 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:47.544646 21489 raft_consensus.cc:1813] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:08:47.545156 21489 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:47.424683 27333 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:47.411002 27167 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.429075 26991 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.429709 21560 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:47.431299 27311 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:47.551774 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.431849 27256 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:47.551959 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.433768 27029 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:47.433593 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.369103 27190 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:47.401105 27255 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.472394 21565 raft_consensus.cc:2410] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:08:47.380666 27291 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:47.543704 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 164250us
I20260709 13:08:47.543911 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:47.432907 21642 raft_consensus.cc:2410] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:08:47.550832 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 114596us
I20260709 13:08:47.564386 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.545033 27363 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.594527 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.549011 27333 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:47.600934 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.602463 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.603444 22238 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:47.552235 27311 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:47.606232 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:47.613034 22244 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 9: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:47.577184 27029 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.581585 27253 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:47.595436 27362 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:47.596014 27294 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.606674 27333 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.591636 27167 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:08:47.618007 27190 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.601105 27348 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.623052 27336 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:47.638468 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 204940us
W20260709 13:08:47.658973 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 94716.6us
I20260709 13:08:47.672230 22210 leader_election.cc:400] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15.
I20260709 13:08:47.695199 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.638582 26991 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.645509 27310 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:47.697788 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.608491 27363 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.706470 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:47.710440 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 102985us
I20260709 13:08:47.715217 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.716141 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:47.716511 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.717005 21641 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:47.718218 21641 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:47.718931 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.719535 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.720276 21643 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 10: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:08:47.720505 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.719271 21637 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:47.721024 21637 pending_rounds.cc:85] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 10
I20260709 13:08:47.721272 21637 pending_rounds.cc:107] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:47.721513 21637 raft_consensus.cc:2889] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.721719 27255 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:47.722726 27291 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:47.723860 27369 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:47.726495 27347 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.727288 27347 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:47.732982 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 159393us
I20260709 13:08:47.733963 21639 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.737735 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:47.738643 22238 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.709491 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.743695 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.745007 22244 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:47.645201 27375 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:08:47.745276 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:47.746097 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:47.749238 21638 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:47.753124 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 52414.5us
I20260709 13:08:47.749037 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.755872 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:08:47.756747 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47380.4us
I20260709 13:08:47.757112 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.757472 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.758258 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.710421 27157 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:47.767179 22244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:47.696007 27348 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.757669 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:47.758335 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:47.762329 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.756296 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:47.755966 27253 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:47.769814 22247 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 11 LEARNER]: Advancing to term 13
I20260709 13:08:47.770442 27253 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:47.756225 27255 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:47.775260 27236 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:47.777014 27307 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:47.633462 27352 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.780059 21636 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:47.768525 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:47.789678 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:47.791226 27100 consensus_meta.cc:287] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.007s
I20260709 13:08:47.792027 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:47.792438 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:47.793227 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:47.794354 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:47.792387 27199 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:47.806069 27363 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:47.807677 27253 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:47.811074 27347 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:47.814530 27348 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:47.767776 27314 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:47.767424 27029 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:47.779976 27336 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.810532 27377 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.816540 22238 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:47.830135 21639 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:08:47.832885 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:47.833634 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44063.2us
I20260709 13:08:47.847661 22247 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 13 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:47.824383 27307 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:47.848834 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 86634.3us
W20260709 13:08:47.851859 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 308016us
I20260709 13:08:47.875262 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:47.831112 27236 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.901261 21562 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:47.879081 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:47.880772 27382 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.881335 27100 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:47.881513 27333 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.885859 27347 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:47.847898 27336 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:47.889449 21563 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:47.874066 27237 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.873791 27253 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:08:47.893761 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:47.894111 21564 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:08:47.897008 27319 consensus_meta.cc:287] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.667s	user 0.004s	sys 0.006s
I20260709 13:08:47.879830 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:47.881412 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:47.899281 21485 raft_consensus.cc:2410] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:47.905146 21562 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:47.908368 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:47.909650 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:47.915643 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.874759 27314 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:08:47.916209 21569 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:47.922098 21568 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.923605 21561 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:08:47.920367 27378 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:47.925683 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.912740 27029 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.933262 27388 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:47.933868 27384 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:47.942976 27390 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:47.928968 27100 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:47.920814 27336 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:47.932039 27319 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:08:47.909698 27382 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.952885 27333 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:47.958547 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:47.955747 27362 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:47.908990 27236 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:47.971885 27255 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:47.973246 27236 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:47.975122 27216 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:47.971179 27351 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:47.978024 27353 raft_consensus.cc:993] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:47.978693 26984 raft_consensus.cc:1081] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:08:47.978539 27353 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:47.982079 27336 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.964036 27348 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:08:47.987692 27351 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:47.988478 27351 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:47.989156 27348 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:47.989574 27348 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:47.990193 27348 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.989522 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.991462 21606 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:47.992758 27377 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.996116 27380 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.997535 27382 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:47.989907 27351 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.004037 27351 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:48.004611 27335 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:47.963364 27390 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:47.997117 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:48.007311 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:48.008513 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.008615 27390 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.015056 27100 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:48.015821 27100 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:48.016659 21568 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:48.016983 27100 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.018406 21562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:40994
I20260709 13:08:48.019156 21562 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.019147 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:48.019827 21562 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:48.020012 27237 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:48.020974 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:48.004084 27260 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:48.011873 21493 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:08:48.023453 21493 pending_rounds.cc:85] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 10
I20260709 13:08:48.023793 21493 pending_rounds.cc:107] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 15.11
I20260709 13:08:48.024117 21493 raft_consensus.cc:2917] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Aborting config change with OpId 15.11: Aborted: Op aborted by new leader
I20260709 13:08:48.024339 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:48.024693 21493 raft_consensus.cc:2889] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:48.025583 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:48.027222 27237 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:48.028357 27237 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:48.028721 27237 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:48.029597 27237 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.022454 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:48.032799 22246 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:48.033486 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:48.030705 21489 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:48.031803 21487 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:48.040238 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:48.040599 27314 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:48.040903 22240 raft_consensus.cc:2376] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10. Re-sending same reply.
I20260709 13:08:48.041182 27314 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:47.963542 27388 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.043949 27388 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:48.035275 27237 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.969990 27362 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:48.061667 27362 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.063370 27362 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.044714 27390 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.069348 27390 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:48.047904 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:48.047596 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.071864 27307 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.072095 27334 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:48.072489 27307 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.072916 27334 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:48.046425 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.071930 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.075155 27307 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:48.076004 21490 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:48.075971 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.076782 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:08:48.080878 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.092331 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.047686 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.050942 21562 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.115703 21459 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:48.119465 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 71640.4us
I20260709 13:08:48.121910 27333 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:48.122402 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:48.122691 27333 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:48.123502 27029 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:48.124420 27236 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:48.135138 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.139700 21639 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:48.147142 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 100797us
I20260709 13:08:48.148341 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.151089 21494 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:48.153153 21562 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:48.154371 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:48.155226 21643 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:48.091754 27355 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:48.134536 27334 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:48.135449 27380 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.169566 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 92857.4us
I20260709 13:08:48.165769 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.141695 27390 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:48.177753 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:48.177896 21606 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:48.159209 27353 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:48.196473 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.196020 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:48.197001 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.198129 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:48.199366 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:48.191764 27368 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:48.186245 27377 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:48.202911 21642 raft_consensus.cc:2410] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:48.203814 27314 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:48.204432 27253 raft_consensus.cc:2764] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:08:48.204771 27358 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.201411 27326 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:08:48.206540 27326 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:48.206924 27326 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:48.207738 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.207877 27326 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.209561 27314 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:48.191745 27331 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:48.215349 27331 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:48.216333 27331 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.192011 27390 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.221330 27390 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:48.223476 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.182399 27255 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:48.224629 27255 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.209565 27326 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.228219 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.237275 27311 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.261972 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.265247 22212 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:48.235033 27370 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:48.235332 27314 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:48.235837 27255 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:48.268388 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 75947.3us
I20260709 13:08:48.183964 26984 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.266659 27306 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:48.283777 21492 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:48.289963 21563 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:48.262282 27355 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:08:48.276070 27167 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:08:48.187484 27380 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:48.323299 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:48.287786 26984 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:48.341221 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:48.343865 21640 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:48.345918 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:48.346552 21639 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:48.353024 26984 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:48.354938 27380 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:48.356472 22240 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:48.355872 22241 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 13 LEARNER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:48.295673 27314 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.369299 27319 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:48.375504 27319 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.379837 22247 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.382656 27209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60044 (request call id 915) took 5110 ms. Trace:
I20260709 13:08:48.383175 27209 rpcz_store.cc:276] 0709 13:08:43.272346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.272588 (+   242us) service_pool.cc:224] Handling call
0709 13:08:43.780449 (+507861us) ts_tablet_manager.cc:934] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
0709 13:08:47.291216 (+3510767us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:47.831456 (+540240us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:47.846974 (+ 15518us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:48.324821 (+477847us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:48.379328 (+ 54507us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:48.382431 (+  3103us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:48.382548 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":63340,"tablet-copy.queue_time_us":384606,"thread_start_us":409501,"threads_started":2}
I20260709 13:08:48.384894 27209 tablet_copy_client.cc:806] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:48.385608 27209 tablet_copy_client.cc:670] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:48.387440 21639 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:08:48.399067 27314 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:48.400154 27376 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:08:48.410166 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 132809us
I20260709 13:08:48.406688 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.426349 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:48.402416 27291 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.408392 22247 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:08:48.427613 21491 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:48.429009 21491 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:48.431172 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:48.430073 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:48.410923 27370 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:48.429401 22247 pending_rounds.cc:85] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 10
I20260709 13:08:48.435694 22247 pending_rounds.cc:107] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 15.11
I20260709 13:08:48.436059 22247 raft_consensus.cc:2917] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Aborting config change with OpId 15.11: Aborted: Op aborted by new leader
I20260709 13:08:48.425084 27388 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.430862 27291 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.436906 22247 raft_consensus.cc:2889] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:48.512670 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:48.491827 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:48.437186 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 266597us
I20260709 13:08:48.521350 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:48.435600 27348 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.522364 27256 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:48.522965 27311 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:48.524591 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:48.524504 26991 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:48.527133 27291 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:48.527786 27388 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.529656 27370 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.490533 21491 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.531031 21491 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:48.530149 27348 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:48.536149 27406 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:08:48.537389 27379 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 13:08:48.538383 27319 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:48.495183 27237 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:08:48.546517 27388 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:48.503504 27407 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:48.553560 26991 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:48.554178 26991 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:48.555112 26991 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.556762 27255 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:48.557145 27255 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:48.557271 27294 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.557794 27294 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.558255 27237 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:48.558049 27255 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.558691 27237 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:08:48.511272 27403 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:08:48.568277 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.576164 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:48.608590 21491 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
W20260709 13:08:48.613392 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 121698us
W20260709 13:08:48.622097 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.633284 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:48.643740 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.646142 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:48.621246 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:48.655485 21392 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 239) took 9510 ms. Trace:
I20260709 13:08:48.655711 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.656349 21563 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:08:48.596833 27294 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:48.687724 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:48.691358 21639 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:48.691732 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.697101 27355 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:48.697767 27355 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:48.655948 21392 rpcz_store.cc:276] 0709 13:08:39.145295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.154653 (+  9358us) service_pool.cc:224] Handling call
0709 13:08:48.655400 (+9500747us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:46.994266 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:46.994991 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:46.995045 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:08:46.995088 (+    43us) tablet.cc:662] Decoding operations
0709 13:08:47.063716 (+ 68628us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:47.063854 (+   138us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:47.063883 (+    29us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:08:47.088575 (+ 24692us) tablet.cc:701] Row locks acquired
0709 13:08:47.088627 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:08:47.088805 (+   178us) write_op.cc:270] Start()
0709 13:08:47.089030 (+   225us) write_op.cc:276] Timestamp: P: 1783602527088730 usec, L: 0
0709 13:08:47.089077 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:08:47.089909 (+   832us) log.cc:844] Serialized 10410 byte log entry
0709 13:08:47.656700 (+566791us) op_driver.cc:464] REPLICATION: finished
0709 13:08:47.953927 (+297227us) write_op.cc:301] APPLY: starting
0709 13:08:47.954032 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:48.042933 (+ 88901us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:48.043050 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:48.252222 (+209172us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:48.252658 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 13:08:48.252722 (+    64us) write_op.cc:312] APPLY: finished
0709 13:08:48.253268 (+   546us) log.cc:844] Serialized 228 byte log entry
0709 13:08:48.253491 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.253709 (+   218us) write_op.cc:454] Released schema lock
0709 13:08:48.253798 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:48.254271 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.254312 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47608,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":259046,"apply.run_cpu_time_us":34802,"apply.run_wall_time_us":300317,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112703,"num_ops":26,"prepare.queue_time_us":66881,"prepare.run_cpu_time_us":34117,"prepare.run_wall_time_us":241393,"raft.queue_time_us":282973,"raft.run_cpu_time_us":56475,"raft.run_wall_time_us":278456,"replication_time_us":543677,"thread_start_us":517478,"threads_started":4,"wal-append.queue_time_us":129031}]]}
I20260709 13:08:48.698060 27237 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.698761 27355 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.699456 27237 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.641184 27388 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.703073 27388 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.705961 21494 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:48.712167 27291 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:48.644294 27336 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:08:48.712634 27291 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:48.713528 27291 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.641484 26636 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.657488 27100 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:48.651355 27335 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:48.731940 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 110782us
I20260709 13:08:48.694931 27307 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.695034 27319 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.725689 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.714552 27388 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:48.765027 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 45996.5us
I20260709 13:08:48.766142 22238 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:48.763811 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:48.759702 27326 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 LEARNER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.755498 27319 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.750517 27307 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.747727 27335 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:48.780407 21388 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:48.782255 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.782891 22238 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:48.725904 26636 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:48.745669 27167 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:08:48.813056 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.817510 22247 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:48.764415 27381 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:08:48.819823 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:48.818809 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 393331us
I20260709 13:08:48.800366 27370 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:48.821777 21637 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:48.830528 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.836642 27353 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:48.822125 27334 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:48.826910 27370 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.847568 21388 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 10 to 13, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 13 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.864076 27370 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:48.853997 27253 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:08:48.888479 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 76506us
I20260709 13:08:48.910995 27335 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:48.912083 27414 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:08:48.913076 27415 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.913686 27415 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:48.913830 21388 catalog_manager.cc:5697] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 2 to 13, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:48.916131 27415 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:48.915606 21388 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 16 to 17, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 17 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:48.917594 27420 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:48.917410 21388 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:48.919112 27417 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:08:48.920881 27421 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:48.919169 21388 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 8 to 17. New cstate: current_term: 17 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:48.922686 27418 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:48.922612 21388 catalog_manager.cc:5697] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:48.923754 27416 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:08:48.924194 27307 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:48.927070 27319 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:48.936949 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.965404 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 59341.4us
I20260709 13:08:48.965559 22244 raft_consensus.cc:606] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:48.966568 22244 raft_consensus.cc:614] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:48.965698 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 59324.4us
W20260709 13:08:48.974483 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 248865us
I20260709 13:08:48.979797 26636 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:48.975931 27426 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:08:48.983916 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:48.964763 27291 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.984700 21560 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:49.001140 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:49.001910 21564 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
W20260709 13:08:49.010108 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 190366us
I20260709 13:08:49.008306 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:49.006405 27311 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:08:49.014681 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:49.017520 21606 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.596s (SENT)
I20260709 13:08:49.020766 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:49.023221 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:49.023377 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:49.014025 21638 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:49.034410 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:49.035058 21566 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:49.034858 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:49.039714 21634 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:49.042538 21639 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:08:49.042994 21639 pending_rounds.cc:85] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 8
I20260709 13:08:49.043215 21639 pending_rounds.cc:107] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:49.043453 21639 raft_consensus.cc:2889] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:49.046363 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.048997 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:49.050016 27423 log.cc:927] Time spent T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:08:49.051149 27435 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.051800 27435 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.054227 27435 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:49.056133 27351 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:49.057679 27351 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:49.015007 27348 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:49.059077 27348 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:49.059676 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:49.056264 27375 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:49.060057 27348 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.060818 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.062042 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.065062 21560 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:49.062824 21636 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:49.066758 27351 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:49.067250 27351 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.067625 27351 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.070083 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.070839 21636 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:49.073670 27167 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:49.063664 21606 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:49.080483 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:49.087929 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.088680 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.054776 27435 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.075485 27167 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:08:49.094564 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:49.079610 27237 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:49.095512 22238 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:49.076045 27358 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.102806 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:49.105767 22247 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:49.115195 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:49.145022 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:49.101460 27435 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:49.151633 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 87459.4us
I20260709 13:08:49.111579 27358 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.163846 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.161562 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:49.169096 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.169574 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.123641 27442 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:49.151533 27375 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:49.171674 27209 tablet_copy_client.cc:538] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:49.170980 27237 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:49.205801 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 53148.7us
I20260709 13:08:49.188859 27375 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.225081 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:49.221786 27237 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.247503 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:49.231325 27375 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.256886 27334 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:49.257507 27334 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:49.257843 27434 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:49.257941 27334 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:49.225804 27380 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:08:49.260874 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.262349 21638 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:49.246462 27237 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:49.289340 21638 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:49.231516 27351 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.263406 27370 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.310858 27307 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.317057 27451 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:08:49.324440 27307 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.341289 21563 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:49.361925 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.364387 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.367122 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.389465 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.326320 27435 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:49.335157 27358 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:49.396955 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.401621 21489 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:49.340600 27380 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.403097 21485 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:49.396878 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.397095 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.404347 21487 raft_consensus.cc:2368] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20.
I20260709 13:08:49.397193 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:49.399197 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.411003 21486 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:08:49.397572 27417 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:08:49.413909 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.415040 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:49.415700 21489 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:49.406025 27358 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.396905 27347 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:49.429685 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.434391 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.435863 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.443114 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.443346 21489 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:49.443852 21485 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:49.411286 27380 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.445248 27255 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.447042 27380 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:49.447937 27455 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:08:49.449167 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:49.451233 27351 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:49.452504 27307 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:49.412786 27355 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.456490 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:49.513021 21560 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:49.513338 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.436231 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.514293 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.420339 27450 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:49.514930 21491 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:49.516460 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:49.517472 21563 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:49.520984 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:49.429914 27454 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:49.512053 27291 consensus_meta.cc:287] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.001s
W20260709 13:08:49.525161 27463 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:49.533006 22244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58620 (request call id 29) took 1786 ms. Trace:
I20260709 13:08:49.522596 27336 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.535147 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.421146 27335 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 13:08:49.548040 22244 rpcz_store.cc:276] 0709 13:08:47.747595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.767025 (+ 19430us) service_pool.cc:224] Handling call
0709 13:08:49.532684 (+1765659us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54005fdcd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fdc853 00007f98aefaa60a 00007f98a85307d4 00007f98a8530762 00007f98a8530691 00007f98a853060c 00007f98a852f8c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:49.532875 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2754475776}
I20260709 13:08:49.552372 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.553704 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:49.556571 27456 log.cc:927] Time spent T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:08:49.578014 21560 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:49.534689 27334 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.584184 27334 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:49.585228 27347 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:49.585703 27347 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.586050 27347 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:49.587169 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:49.587813 21485 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.589057 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:49.512593 27355 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.521776 27450 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.620203 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:49.454064 27358 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.627202 27386 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:49.627615 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:49.627897 27386 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.628984 27446 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:49.631970 27460 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:08:49.633538 27462 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:08:49.634737 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 55089.8us
I20260709 13:08:49.630119 27375 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.641237 21485 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
W20260709 13:08:49.621984 27407 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:49.638909 27464 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.563787 27336 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.547561 27454 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.638847 27209 tablet_bootstrap.cc:492] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
W20260709 13:08:49.688001 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 98729.9us
W20260709 13:08:49.693701 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 57012.7us
I20260709 13:08:49.720602 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:49.667372 27451 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:49.749394 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:49.739702 27386 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:49.755868 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:49.743928 27481 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:49.762040 21606 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.614s (SENT)
I20260709 13:08:49.762974 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:49.681604 27464 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.756712 27008 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:08:49.762749 26636 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:49.772969 26636 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.773468 26636 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.775650 27477 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:49.778910 27474 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:49.779588 27474 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.771061 27481 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.749507 27451 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.802239 27255 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.802698 27472 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:49.803119 27454 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:49.783707 27452 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:49.803643 27479 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.765270 27335 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.804436 27355 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:49.804880 27100 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:49.806226 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.806337 27450 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:49.806814 27437 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:49.807377 27419 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.973s	user 0.003s	sys 0.007s
I20260709 13:08:49.860273 22241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 615) took 1520 ms. Trace:
I20260709 13:08:49.860678 22241 rpcz_store.cc:276] 0709 13:08:48.339602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.339727 (+   125us) service_pool.cc:224] Handling call
0709 13:08:48.341094 (+  1367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.355697 (+ 14603us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:48.504333 (+148636us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.726375 (+222042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:48.763283 (+ 36908us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.763461 (+   178us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:48.763493 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.763562 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.786492 (+1022930us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:49.859940 (+ 73448us) raft_consensus.cc:1685] finished
0709 13:08:49.860042 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.860191 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2130,"raft.queue_time_us":20360,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":10043,"spinlock_wait_cycles":17799424,"thread_start_us":219384,"threads_started":1,"wal-append.queue_time_us":283041}
I20260709 13:08:49.808195 27447 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.850798 27472 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.808779 27464 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:49.809067 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:49.867691 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.811652 21640 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:49.812306 27375 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:49.815438 27478 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.815238 27347 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.816689 27336 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:49.757267 26969 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 13:08:49.872363 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 110357us
I20260709 13:08:49.817631 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.803715 27474 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:49.823771 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:49.823475 27237 consensus_meta.cc:287] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.006s
I20260709 13:08:49.808343 27446 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:49.872865 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 319233us
I20260709 13:08:49.863098 27482 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.875522 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.867690 27358 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:49.873539 21606 leader_election.cc:336] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.615s (SENT)
I20260709 13:08:49.879844 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.882695 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:49.848896 27255 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:49.884532 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:49.884709 21635 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:49.858091 27335 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.863152 27447 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.893658 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.894344 21634 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:49.876071 27478 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.897068 27478 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:49.866811 27437 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.903738 27437 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:49.904448 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:49.907899 27427 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.010s	user 0.001s	sys 0.002s
I20260709 13:08:49.909409 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:49.911010 21636 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:08:49.911957 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.912576 21638 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:08:49.856690 27479 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.913493 27319 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:49.915966 27479 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:49.918687 27255 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:49.916854 22241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:08:49.877568 27237 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.920253 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.920274 22241 raft_consensus.cc:606] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:49.922214 22241 raft_consensus.cc:614] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:49.922341 21638 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:08:49.922919 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:49.899492 27451 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:49.925426 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.925590 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.926930 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:49.936323 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:49.938167 21642 raft_consensus.cc:2368] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15.
I20260709 13:08:49.911116 27437 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.938657 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:49.885771 27482 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.887984 27446 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.942303 27483 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.962807 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:49.942759 22210 leader_election.cc:400] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15.
I20260709 13:08:50.025029 22210 leader_election.cc:403] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:49.939076 27355 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:08:49.939764 27319 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.943624 27447 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:49.944509 27485 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:49.940923 27449 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:49.924026 27100 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:50.089126 27100 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:50.090728 27482 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:50.090998 27485 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:49.997862 27437 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:49.939137 26636 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:50.093936 27485 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:49.927460 27255 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.094638 27441 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:49.935477 27336 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:50.095501 27336 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.096040 27336 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.096745 27446 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:50.076097 21606 leader_election.cc:336] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.773s (SENT)
I20260709 13:08:49.935995 27347 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.099138 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.100236 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.066011 27472 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.102434 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:49.939999 27481 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.088436 27449 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.103520 27449 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:50.094595 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.086580 27253 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:50.104954 27446 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:50.105036 27253 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:50.106216 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.090059 27100 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.107327 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.108564 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.109580 27481 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:50.094949 27255 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.110288 27481 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:50.110999 21634 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
W20260709 13:08:50.087414 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 145012us
I20260709 13:08:50.114616 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.114751 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:50.116662 22241 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:50.119299 21606 leader_election.cc:400] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20.
I20260709 13:08:50.119685 21606 leader_election.cc:403] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:50.120819 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:50.121001 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:50.121392 27481 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:50.067056 27431 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:50.121991 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.122200 27431 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.122610 27431 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.123237 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.125643 21606 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.124092 22240 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:08:50.127677 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.094503 26636 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.129458 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:50.126609 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 367168us
W20260709 13:08:50.130319 27354 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.286s	user 0.014s	sys 0.036s
I20260709 13:08:50.112269 27256 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:08:50.138180 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.094755 27437 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.141628 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.142009 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.133081 27482 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:50.086090 27319 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.130523 27479 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:50.134197 27485 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:50.135483 27354 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.014s	sys 0.037s
I20260709 13:08:50.131021 27481 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:08:50.159021 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.159250 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:50.125079 27472 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:08:50.136994 27256 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:50.083771 27483 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.170642 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.167297 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.167352 21642 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:50.170344 21492 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:50.173767 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.174417 21489 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:50.161538 27237 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.175714 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.162410 26969 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:50.162487 27446 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.184036 27480 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.183794 26969 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.184608 27480 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.186167 26969 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.186947 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.187297 21563 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:08:50.187701 21563 pending_rounds.cc:85] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 6
I20260709 13:08:50.187911 21563 pending_rounds.cc:107] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:08:50.188112 21563 raft_consensus.cc:2889] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:50.182932 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.170164 27478 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:50.191746 21569 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:50.178313 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.177047 21567 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:08:50.195326 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:50.195178 21491 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:50.197989 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.198194 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.179446 27485 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:50.214674 27474 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:50.216943 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:50.200282 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.200980 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.199409 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.201318 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.201967 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.203784 21642 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:08:50.206069 27449 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.210973 27256 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.225521 27256 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:50.211961 27253 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.213649 27480 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:50.198732 22242 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:50.232625 27474 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:50.221161 27442 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:50.236371 27442 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.236763 27442 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:50.238489 27449 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.196516 27237 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:50.241484 27319 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:50.191366 27446 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.182538 27255 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.244279 27446 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.193112 27478 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.245090 27478 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:50.242352 27431 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.236389 27481 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20.
I20260709 13:08:50.247056 21638 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:50.220579 21642 pending_rounds.cc:85] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 7
I20260709 13:08:50.248376 21642 pending_rounds.cc:107] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:50.248687 21642 raft_consensus.cc:2889] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:50.250402 21642 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:50.224083 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:50.182823 27484 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:50.228432 27483 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.251022 21636 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:50.251556 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.252804 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:50.257854 22241 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:50.259512 27431 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:50.276976 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 96574.2us
I20260709 13:08:50.278191 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.279284 27278 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:50.280000 21490 raft_consensus.cc:1217] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Deduplicated request from leader. Original: 13.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:08:50.280520 21490 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:50.284168 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.284437 27444 raft_consensus.cc:1064] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:08:50.287739 21642 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:08:50.288834 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:50.291433 27437 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.292073 27437 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.292342 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.292732 27370 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.294308 27437 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.295904 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:50.296934 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.298063 27437 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:50.298704 27437 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.299342 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.300767 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:50.305589 21641 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.309613 21562 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:50.310688 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.313410 21636 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:50.318949 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.319659 22241 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
W20260709 13:08:50.320168 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 43719us
I20260709 13:08:50.321501 21560 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:50.316987 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:50.330778 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.333606 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:50.334648 21567 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:50.362411 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.372447 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:50.375736 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58815.1us
I20260709 13:08:50.325793 27306 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:50.407898 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.414130 21563 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:50.417794 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.331915 27310 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:08:50.406888 27076 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:50.421267 27076 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.423808 27076 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.408506 27358 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.424919 27358 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.425550 27480 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.426041 27480 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.400602 27451 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:50.434727 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.348996 27370 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:08:50.437409 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:50.432839 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:50.438094 22242 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:50.446241 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.446389 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:50.447409 27351 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:50.449261 27441 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15.
I20260709 13:08:50.451064 27450 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:50.451200 27484 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:50.451521 27450 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:50.435336 27451 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:50.452114 27451 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.452395 27450 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.453652 27450 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:50.456660 27358 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.457088 27480 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.458976 27484 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:50.459420 27484 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.459859 27484 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:50.405916 27336 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.461768 21560 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:50.462360 27336 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.463279 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.463967 22243 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:50.465086 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.458972 22239 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:50.471473 21641 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:50.464646 27415 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:50.471060 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.430567 27442 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.478616 21560 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:50.482380 21563 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:50.470489 27481 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:50.504778 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.500348 27167 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:50.501403 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 621) took 1340 ms. Trace:
I20260709 13:08:50.501534 22243 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:50.506415 21565 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:50.502893 27442 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.506618 22238 rpcz_store.cc:276] 0709 13:08:49.161117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.161951 (+   834us) service_pool.cc:224] Handling call
0709 13:08:49.162306 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.189715 (+ 27409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.189763 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.219160 (+ 29397us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.292412 (+ 73252us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:49.292481 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.500977 (+1208496us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b54005ffd54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:50.501025 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.501073 (+    48us) raft_consensus.cc:1685] finished
0709 13:08:50.501087 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.501340 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8954,"raft.queue_time_us":68983,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":53,"spinlock_wait_cycles":41132416,"thread_start_us":37649,"threads_started":1,"wal-append.queue_time_us":74171}
I20260709 13:08:50.523988 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.475260 27256 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:08:50.475732 27478 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.476213 27351 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:08:50.527987 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:50.530015 21565 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:50.506421 27167 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:50.546972 21567 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:08:50.585311 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:50.587883 21641 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.585654 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.590022 21634 raft_consensus.cc:1813] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:08:50.590607 21634 raft_consensus.cc:2410] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:50.595273 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.531422 27190 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:50.591001 27451 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.601344 27190 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.603314 27190 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.603943 22244 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:50.600809 27478 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:50.606420 21641 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:50.607416 21565 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:50.604601 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.603271 27451 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:50.610307 27495 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:08:50.611436 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2055) took 1813 ms. Trace:
I20260709 13:08:50.611858 21640 rpcz_store.cc:276] 0709 13:08:48.798198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.798942 (+   744us) service_pool.cc:224] Handling call
0709 13:08:48.799186 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.869091 (+1069905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.611167 (+742076us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b540021af54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:50.611352 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257466240}
I20260709 13:08:50.588227 27336 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:50.622699 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.626976 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 242081us
I20260709 13:08:50.630486 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.631448 21565 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:08:50.631637 21641 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:50.633097 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.637732 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.638652 21490 raft_consensus.cc:1813] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:08:50.639335 21490 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:50.616146 27437 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.616644 27336 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.631376 26991 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.626273 27481 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:50.626806 27478 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.646538 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:50.650527 27449 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:50.651189 27449 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.653424 27449 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.653937 27449 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.654901 26991 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.635257 27167 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.656677 27167 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.657187 26991 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:50.659722 27253 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.660290 27253 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.661969 27484 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.667686 27481 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.669970 27481 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.671068 27478 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.673358 27478 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:50.674888 27474 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.675410 27474 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:50.678442 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.686091 22242 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:50.688719 21490 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:50.688774 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.692534 22242 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:50.695101 26636 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:50.654397 27449 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:50.699546 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 369895us
I20260709 13:08:50.692189 27488 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:50.716881 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:50.718618 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:50.720894 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:50.729097 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.742805 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:50.748745 27253 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.752496 27336 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.755816 21641 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:08:50.763268 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.765833 27326 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:50.766494 27326 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:50.767845 27326 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.769354 27256 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.769632 27326 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.770011 27256 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.772512 27335 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:50.773677 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52890.6us
I20260709 13:08:50.732283 27475 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:50.736091 27451 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.802091 27336 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.780589 27278 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:50.808041 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.719622 27488 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.787492 27452 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.802484 27256 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:50.815912 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.817617 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:50.826249 21489 raft_consensus.cc:2410] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:08:50.826483 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.820109 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.789186 27475 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.793112 27008 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:50.830837 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.830930 27008 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.832139 27489 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:50.832979 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:50.833379 27008 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.834007 27008 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:50.835142 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:50.835492 27370 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:50.835920 27450 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:50.830958 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.837285 21494 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:50.837659 27278 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:50.838085 27278 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:50.838955 27278 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.802770 27336 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.836155 27370 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:50.841671 27370 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.840260 27278 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:50.843608 27506 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:50.835722 21488 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:50.834278 27489 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:50.844135 27370 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:50.835573 27354 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:50.804364 27451 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.873011 27355 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.873790 27355 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.874672 27451 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:50.826287 27358 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:50.875937 27355 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.851462 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.862689 27449 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.863404 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.865147 27488 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:50.867224 27484 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.868185 27489 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:50.875543 27358 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.834545 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:50.842587 27336 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:50.883172 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48681.4us
I20260709 13:08:50.879958 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.830324 27475 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.884898 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.877261 27354 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:50.886415 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.887359 21486 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:50.889657 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:50.881263 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.876940 27503 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.827641 27452 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.896390 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:50.823501 27507 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.906647 21639 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:50.907661 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:50.912405 21635 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:50.891301 21459 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:50.883332 27355 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:50.916090 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.917863 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.918567 21493 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:08:50.886369 27354 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.881326 27489 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:50.920054 21488 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:08:50.924762 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.925724 21567 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 17: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:50.930212 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.932044 21492 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:50.934464 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.904075 27368 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:50.903656 27336 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:50.936179 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.937047 21488 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:50.937896 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:50.939682 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.942657 21635 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:50.942193 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:50.946141 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.953215 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:50.928304 27507 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:50.966270 27507 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:50.927637 27508 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:50.970124 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:50.975034 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:50.941881 27336 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:50.910434 27503 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:50.981967 27385 raft_consensus.cc:670] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:50.956562 27368 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:50.975575 27453 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:51.034531 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:50.977396 27306 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:50.984833 27358 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:50.977988 27508 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:50.993532 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:51.042021 22244 raft_consensus.cc:1813] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:08:51.042603 22244 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:50.994410 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:50.995105 27355 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:50.996147 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:51.048372 27474 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:50.995107 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:51.050151 22242 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:51.006492 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:51.032377 27505 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.051954 27368 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.052536 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.018002 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.053927 27513 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:50.982250 27489 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.054711 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.021013 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.055455 27489 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:51.056332 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.057395 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:51.058419 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.026377 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:51.059098 21488 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:51.028308 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:51.028628 27484 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:51.029688 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 54775.2us
I20260709 13:08:51.031124 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.031421 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.031627 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.034507 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.966945 27502 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:51.036757 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:50.979194 27511 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.039119 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:51.041249 21569 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:51.046307 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.065914 21563 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:51.047384 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.050311 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:51.051015 22239 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:51.008136 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:51.017176 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.055259 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.027490 27336 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.055359 21560 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:08:51.065181 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.067320 21566 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:51.071187 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.072010 21568 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:51.083783 27508 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:51.035482 27453 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.087087 27453 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.060915 27008 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:51.092118 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:51.093183 27513 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:51.092909 27475 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.093909 27513 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:51.094220 21532 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.094422 27513 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:51.073928 27449 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:51.095515 27449 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.096509 27513 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.097731 27449 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:51.099215 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49019.1us
W20260709 13:08:51.099998 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.100636 27256 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:51.060094 27503 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:51.075481 27502 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.060096 27484 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.119453 21638 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:51.120887 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:51.121606 22241 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:51.121646 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.123193 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.124253 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.124676 21492 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:08:51.060465 27388 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:51.125231 21640 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:08:51.124576 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.129078 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:51.128603 21639 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:08:51.130270 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:51.134267 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.129562 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.114223 27502 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:51.117973 27452 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:51.117141 27484 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:51.112643 27475 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:51.139386 27503 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:51.130311 27355 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.159894 21563 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:51.132622 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:51.137908 27494 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:51.137660 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:51.127611 27388 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:51.128101 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 151243us
I20260709 13:08:51.132407 27499 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:08:51.140314 21640 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:51.138191 27474 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:51.125566 27449 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:51.183326 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.184983 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:51.186808 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:51.180738 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:51.171358 27452 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:51.195655 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.196288 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:51.201061 21640 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:08:51.194425 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:51.205809 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:51.210960 26636 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:51.211438 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:51.213550 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.214673 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:51.215516 22241 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:51.215662 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:51.216467 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.216894 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.220366 27190 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:51.220989 27190 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.221685 27190 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:51.173053 27512 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:51.203838 27452 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:51.227135 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.181632 27494 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:51.228120 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.209075 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:51.207727 27513 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:51.199048 27167 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:51.207043 27353 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.239897 26636 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.206637 27484 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.227630 27347 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:51.236346 27452 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.238557 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:51.240921 27482 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:51.252390 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.260617 21637 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:51.244995 27513 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.244452 27167 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:51.269356 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:51.254765 27347 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:51.249212 27380 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:08:51.258819 27482 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:51.289721 27524 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:51.266836 27513 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:51.290385 27524 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:51.265946 27484 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:51.292405 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.281363 27167 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.297595 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.281579 27474 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:51.298723 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:51.288939 27347 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.312453 22247 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:51.220965 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:51.291676 27482 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:51.317513 27518 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:08:51.296593 27524 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.326540 27513 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.314169 27508 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:51.328150 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 89682us
W20260709 13:08:51.328781 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 107904us
I20260709 13:08:51.330356 27502 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:51.301663 27164 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:51.333469 27388 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:51.302680 27484 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:51.348380 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.326123 27444 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:51.350620 27516 log.cc:927] Time spent T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:08:51.360939 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.347496 27502 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.350157 27164 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:51.366130 27164 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:51.355372 27499 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:51.364652 27354 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.378007 27354 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:51.380008 21489 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:51.382905 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:51.386391 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:51.378549 27431 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.389067 27450 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:51.389497 27450 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:51.311277 27494 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.404083 27501 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:51.404554 27501 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:51.384377 27502 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.405422 27501 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.413872 27484 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.387269 27511 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:51.423020 27532 log.cc:927] Time spent T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:51.429423 27336 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.433822 27008 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:51.433637 27453 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.434458 27008 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.285720 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:51.442746 27513 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:51.442842 27515 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.396s	user 0.000s	sys 0.004s
I20260709 13:08:51.390383 27450 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.446167 27450 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:51.450300 27190 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.451620 27167 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.458750 21635 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:51.452739 27190 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:51.461977 27167 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:51.456765 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:51.462353 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:51.467254 21491 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:08:51.463493 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:51.468231 21485 raft_consensus.cc:2368] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15.
I20260709 13:08:51.464486 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:51.468585 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:51.468724 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:51.465193 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:51.469431 21638 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:51.469666 21493 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:08:51.465417 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:51.465758 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:51.471586 21459 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.455479 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:51.473649 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:51.474517 27449 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.477233 27453 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:51.480014 27531 log.cc:927] Time spent T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:08:51.481030 27008 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.483072 27164 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.483469 27482 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.502059 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:51.502682 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:51.504056 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:51.485584 27164 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:51.510296 27326 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:51.486557 27278 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.486850 26969 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:51.514047 26969 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.514407 26969 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.515393 27008 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:51.516541 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.487798 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.488889 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:51.520282 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:08:51.522351 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.522446 22210 leader_election.cc:400] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15.
I20260709 13:08:51.529630 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:51.529853 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:51.530264 21494 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.530511 21635 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:51.523851 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:51.534402 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 150225us
I20260709 13:08:51.535072 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:51.535419 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:51.536173 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:51.539101 21636 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:51.557298 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:51.556944 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:51.562552 21641 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.561483 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:51.538580 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:51.570202 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:51.571020 21569 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.487491 27076 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:08:51.524013 27483 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.486341 27347 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.572517 27483 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:51.573015 27483 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:51.573918 27483 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.522850 27278 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:51.512349 27326 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:51.575639 27326 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:51.576604 27326 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.577502 26969 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.578361 27326 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.526001 27388 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.579093 21634 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:51.586853 21494 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:08:51.533427 27306 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:51.492240 27336 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:51.512301 27482 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:51.597461 27209 tablet_bootstrap.cc:492] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:51.489033 27380 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:51.485841 27452 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.488191 27502 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.524160 27256 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:08:51.600416 27076 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:51.601466 27368 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:51.602749 27464 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:51.602978 27190 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:51.604382 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:51.648620 22243 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.604820 27306 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:51.552030 27440 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.555209 27431 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:08:51.622337 21638 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:51.574452 27347 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:51.612115 26969 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:51.616986 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 81628.8us
I20260709 13:08:51.670095 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:51.671304 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:51.671947 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.672797 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:51.617338 21641 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:08:51.617920 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.619643 21569 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
W20260709 13:08:51.624122 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.589485 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 50970.5us
I20260709 13:08:51.676193 21565 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:51.625590 21490 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
W20260709 13:08:51.676558 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.647665 21564 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:51.624588 27499 raft_consensus.cc:1064] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:08:51.650713 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:51.609076 27480 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:51.678027 27480 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:51.678460 27480 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.645630 27076 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:51.680387 27076 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.651435 22242 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:51.672719 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:51.684053 21634 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:51.677139 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:51.686103 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.653383 27306 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.652274 27452 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:51.700960 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:51.702984 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:51.707381 21643 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:51.623333 27380 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.708936 21642 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:08:51.708976 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 185182us
I20260709 13:08:51.710433 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:51.714231 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:51.711525 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:51.720784 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:51.695930 27167 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:51.725857 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:51.727083 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:51.715106 21568 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:51.727873 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:51.729664 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:51.730304 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.706035 27431 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.680402 27499 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:51.732934 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.732326 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:51.734833 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:51.734988 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:51.735644 21564 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:51.712339 27440 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:51.726214 27209 tablet_bootstrap.cc:492] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:08:51.740789 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:51.725471 27164 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:51.715423 27535 raft_consensus.cc:2764] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:08:51.731243 27484 raft_consensus.cc:2764] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:51.752080 21560 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:51.749187 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:51.735164 27494 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:51.742892 27335 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:51.750679 27452 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:51.737798 27347 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.753527 27256 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.756098 27440 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:51.733342 27388 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:51.769200 27494 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.763257 27164 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:51.770569 27335 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:51.832736 27335 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:51.823668 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:51.834383 27512 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.835619 27501 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.819093 27388 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:51.836228 27388 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:51.837492 27388 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.839457 27388 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.828645 27440 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.785425 27535 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.830717 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2613) took 1008 ms. Trace:
I20260709 13:08:51.844707 27504 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:51.843677 21487 rpcz_store.cc:276] 0709 13:08:50.822639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.822949 (+   310us) service_pool.cc:224] Handling call
0709 13:08:51.491556 (+668607us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b5800011198. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:08:51.491791 (+   235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.492167 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.492201 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.492697 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.709684 (+216987us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:51.709711 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.709756 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:51.830368 (+120612us) raft_consensus.cc:1685] finished
0709 13:08:51.830397 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.830651 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1491,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":10894592,"thread_start_us":216636,"threads_started":1,"wal-append.queue_time_us":335916}
I20260709 13:08:51.845217 27504 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:08:51.846930 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.850488 27278 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:51.851107 27278 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:51.852248 27278 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.853930 27278 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:51.795101 27452 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:51.859925 27452 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.846225 27504 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.866773 27480 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.821828 27209 ts_tablet_manager.cc:1403] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 2.268s	user 0.053s	sys 0.024s
W20260709 13:08:51.830984 27536 log.cc:927] Time spent T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:08:51.835142 27512 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:51.827523 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:51.871946 27076 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:51.831763 27538 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:08:51.903923 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 169008us
I20260709 13:08:51.917817 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:51.909206 21569 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:51.893623 22243 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:08:51.874571 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.914729 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:51.919229 22246 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:51.921451 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:51.923501 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49002.4us
W20260709 13:08:51.918906 21388 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 146) took 17588 ms (client timeout 15000 ms). Trace:
I20260709 13:08:51.936558 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:51.938297 21569 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:51.941416 21640 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:51.946666 21640 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:51.947798 21567 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:51.898583 27380 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:51.935078 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45634.9us
I20260709 13:08:51.890573 27504 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.943709 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:51.874713 27511 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.964758 21642 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:51.971197 27535 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:51.974084 21486 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:51.975522 21490 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:51.976845 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:51.977614 21487 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:51.895805 27433 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:51.980315 27433 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:51.981253 27433 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:51.982260 27347 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:51.779426 27543 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:51.875119 27502 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:51.928886 27546 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:51.982754 27433 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.986435 21642 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:51.984097 27512 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:51.983942 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 72662.3us
I20260709 13:08:51.923059 27494 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.988150 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:51.967410 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.996583 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:51.997421 21642 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:51.996539 21643 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:51.950548 27482 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:52.002897 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:51.948421 27167 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:52.008572 21487 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:08:51.928637 21388 rpcz_store.cc:269] 0709 13:08:34.306856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.307731 (+   875us) service_pool.cc:224] Handling call
0709 13:08:51.894693 (+17586962us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:49.128372 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:49.131342 (+  2970us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:49.131383 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:08:49.131399 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:49.132238 (+   839us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:49.132290 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:49.132331 (+    41us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:08:49.132902 (+   571us) tablet.cc:701] Row locks acquired
0709 13:08:49.132921 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:49.133058 (+   137us) write_op.cc:270] Start()
0709 13:08:49.133170 (+   112us) write_op.cc:276] Timestamp: P: 1783602529133010 usec, L: 0
0709 13:08:49.133190 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:49.225977 (+ 92787us) log.cc:844] Serialized 2856 byte log entry
0709 13:08:49.526504 (+300527us) op_driver.cc:464] REPLICATION: finished
0709 13:08:49.667067 (+140563us) write_op.cc:301] APPLY: starting
0709 13:08:49.675697 (+  8630us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:49.811033 (+135336us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:49.811115 (+    82us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:49.887539 (+ 76424us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:49.919562 (+ 32023us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:08:49.923888 (+  4326us) write_op.cc:312] APPLY: finished
0709 13:08:50.082618 (+158730us) log.cc:844] Serialized 73 byte log entry
0709 13:08:50.088544 (+  5926us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:50.088682 (+   138us) write_op.cc:454] Released schema lock
0709 13:08:50.088735 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:50.249550 (+160815us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fdde28 00007f98ada18581 00007f98ada17d58 00007f98ada1c9f1 00007f98ada1c9a9 00007f98ada1c939 00007f98ada1c901 00007f98ada1bb2d 000000000038f354 000000000038f199
0709 13:08:50.249771 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:50.249808 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55371,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":96107,"apply.run_cpu_time_us":13347,"apply.run_wall_time_us":446725,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33359,"num_ops":7,"prepare.queue_time_us":133241,"prepare.run_cpu_time_us":11883,"prepare.run_wall_time_us":1135371,"replication_time_us":378641,"spinlock_wait_cycles":19622784,"thread_start_us":131138,"threads_started":2}]]}
I20260709 13:08:51.994047 27535 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:51.875946 27164 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.009408 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:52.000685 27480 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:52.034487 21634 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:08:51.990310 27256 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:52.049606 21640 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:52.007665 26984 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:52.065394 26636 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:52.069669 21487 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:52.075124 27447 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:51.991546 27511 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:52.096413 21569 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:52.074060 27209 raft_consensus.cc:359] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:52.070225 27535 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:52.006038 27512 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:08:52.005744 27502 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:08:52.123641 21643 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:52.136083 27354 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:08:52.148931 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 205274us
I20260709 13:08:52.063838 27336 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:52.133222 26984 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:52.100849 27431 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:52.132723 27386 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.174592 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:52.158273 27326 consensus_meta.cc:287] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.003s
W20260709 13:08:52.170521 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 198378us
W20260709 13:08:52.176400 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 182304us
I20260709 13:08:52.199674 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:52.101795 27209 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:08:52.094612 27008 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:08:52.196718 21486 raft_consensus.cc:2368] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
I20260709 13:08:52.201889 21568 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:52.117535 27335 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.124661 27511 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:52.165531 27336 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.099507 27442 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
W20260709 13:08:52.200661 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52440.9us
I20260709 13:08:52.185418 26636 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.241767 22244 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:52.241894 26636 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:52.208127 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:52.197106 27450 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.122315 27306 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.166697 27499 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:52.131641 27508 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:08:52.240700 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:52.247854 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 260440us
I20260709 13:08:52.248754 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:52.249545 21562 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:52.215714 27541 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:52.201439 27503 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:52.203549 27354 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:08:52.245240 27336 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:52.255354 26636 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:52.257652 22247 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:52.202358 27386 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:52.239408 27431 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:08:52.267520 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:52.239449 27167 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 13:08:52.288863 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.304793 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 98824.3us
I20260709 13:08:52.310527 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:52.320782 27480 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:52.321534 27550 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:08:52.321408 27480 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.297861 27548 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:52.323621 27480 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:52.316452 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 93490.9us
I20260709 13:08:52.262817 27440 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:52.326064 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:52.326947 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 84963.6us
W20260709 13:08:52.328255 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 60839.3us
I20260709 13:08:52.333508 22242 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:52.250943 27450 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.341013 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:52.338147 21568 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:52.338804 21486 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:52.341179 22210 leader_election.cc:400] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
I20260709 13:08:52.344102 22210 leader_election.cc:403] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:08:52.328770 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 80105.8us
I20260709 13:08:52.344782 21642 raft_consensus.cc:2393] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:52.344981 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:52.343060 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:52.339960 27451 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:52.337513 27440 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:52.252709 27209 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:52.366366 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:52.357092 27447 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:52.339843 27554 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:52.265226 26984 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.374369 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:52.388351 21562 raft_consensus.cc:2368] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
I20260709 13:08:52.378355 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:52.380895 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:52.382164 22239 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:52.382881 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:52.390234 22245 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:52.369946 22238 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 11 LEARNER]: Advancing to term 13
W20260709 13:08:52.366145 27551 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:08:52.387339 22241 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 13 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:52.393031 27386 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:52.357542 27553 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:08:52.393687 27450 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:52.363891 27559 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:52.393590 27440 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.359155 27444 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:08:52.395920 27335 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:52.366462 27480 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:52.416481 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.400424 27447 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:52.423426 27447 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:52.425264 27440 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:52.428110 27480 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:52.429149 27480 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.432126 27347 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:52.432592 27347 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:52.433478 27347 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.438741 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:52.445287 22238 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:52.444212 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:52.455492 21561 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:52.433720 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:52.434775 27347 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:52.463732 27431 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:52.481992 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:52.414814 27451 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:08:52.457916 27256 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:08:52.503237 27555 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:08:52.506484 27562 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:52.503382 21390 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 15 to 16, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:52.520169 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.519958 21390 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.491161 27452 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:52.525982 21569 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:08:52.522065 21390 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 14, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 14 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.528282 21390 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 16 to 17, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 17 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.512164 27524 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:52.529554 21390 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:52.542446 21390 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.524791 27559 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
W20260709 13:08:52.550320 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 173580us
I20260709 13:08:52.525341 27452 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.548565 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:52.530435 27535 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.540534 27524 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:52.509205 27562 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:52.561295 22212 leader_election.cc:400] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
I20260709 13:08:52.569705 27524 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.572602 27336 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.575168 27499 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:52.575366 27157 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:52.582135 27157 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:52.583050 27157 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:52.584120 27157 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:52.586589 27562 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:52.579624 27499 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.591259 27499 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:52.584182 27494 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.002s
I20260709 13:08:52.595505 27306 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:52.586408 27431 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:08:52.595213 27494 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:52.597839 21560 raft_consensus.cc:2368] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:08:52.597999 27494 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:52.558808 27452 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:52.547763 27546 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:52.599359 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:52.599787 21566 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:52.604525 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:52.546590 21390 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.610271 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:52.612106 22244 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:52.612571 21390 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 12 to 16, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.618379 21390 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:52.620568 21390 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 17 to 19, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.631260 21565 raft_consensus.cc:2368] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
I20260709 13:08:52.631335 21459 leader_election.cc:400] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:08:52.575923 27535 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.637595 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:52.639103 27535 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:52.625929 27546 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:52.645762 27546 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:52.652539 21390 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 16 to 17, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 17 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.664355 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:52.668030 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:52.670105 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:52.670508 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:52.671347 21493 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:52.673396 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:52.654023 27306 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.650909 27503 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:52.684794 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:52.685576 22246 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:52.684813 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:52.687330 21488 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:52.689123 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:52.655035 21390 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 10 to 11, leader changed from <none> to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.677093 22241 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:08:52.691121 22241 pending_rounds.cc:85] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 9
I20260709 13:08:52.691396 22241 pending_rounds.cc:107] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:08:52.691624 22241 raft_consensus.cc:2889] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:52.823743 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:52.825064 21488 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:52.839249 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:52.837841 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 147636us
I20260709 13:08:52.836936 21390 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index -1 to 9, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.841949 21390 catalog_manager.cc:5697] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 14, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 14 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.849184 21390 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 11 to 13, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.853195 21390 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:52.681067 27524 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:52.866611 21390 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 14, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 14 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.868623 21390 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 10 to 11, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 11 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.872164 21390 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:52.874392 21390 catalog_manager.cc:5697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 4 to 9, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New cstate: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:52.876784 21390 catalog_manager.cc:5697] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.878393 21390 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:08:52.885996 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45302.7us
I20260709 13:08:52.685196 27368 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:52.895329 21490 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:08:52.677280 27431 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.189s
W20260709 13:08:52.904423 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 65271.2us
I20260709 13:08:52.902678 22242 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:52.903386 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:52.906070 21641 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:52.825619 27548 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:52.904281 26636 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:52.834872 27546 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:52.971657 21640 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:52.919319 27384 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:52.950030 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:52.978658 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:52.682626 27380 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.203s
I20260709 13:08:52.974217 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:52.976611 26636 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:52.871838 27535 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:52.991098 27535 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.993978 27535 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:52.822744 27306 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:52.971431 27209 ts_tablet_manager.cc:1434] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 1.072s	user 0.017s	sys 0.003s
I20260709 13:08:52.991487 27336 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:52.999008 21643 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:08:52.988529 26636 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.005359 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:53.007110 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:53.012877 22242 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:08:53.014509 21641 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:08:53.016382 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:53.017051 21635 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:08:52.910060 27548 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.977989 27384 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:52.982167 27464 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.980854 27541 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:53.050122 22238 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:52.910144 27368 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:53.019263 27540 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:08:53.019747 27575 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:08:53.016114 27535 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:53.054940 21635 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:52.983080 27546 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.095223 27541 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:53.017489 27209 ts_tablet_manager.cc:1467] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Tablet startup took 1108ms
I20260709 13:08:53.023757 27548 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:53.038904 27278 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:53.020833 27547 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:08:53.148470 27368 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:53.152716 27157 consensus_meta.cc:287] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
I20260709 13:08:53.133508 22212 leader_election.cc:400] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
I20260709 13:08:53.156395 22212 leader_election.cc:403] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:53.019122 27519 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.126s
I20260709 13:08:53.158951 27519 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.164594 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:53.168285 27306 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:53.169232 27384 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:53.142086 27347 consensus_meta.cc:287] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.661s	user 0.008s	sys 0.002s
I20260709 13:08:53.143759 27278 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:53.172073 27499 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.002s
I20260709 13:08:53.172613 27499 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.173225 27278 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:53.176823 27579 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:08:53.178179 27587 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:08:53.179857 27453 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:53.182266 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:53.139158 27209 ts_tablet_manager.cc:1469] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Trace:
0709 13:08:43.272346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.272588 (+   242us) service_pool.cc:224] Handling call
0709 13:08:43.780449 (+507861us) ts_tablet_manager.cc:934] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061)
0709 13:08:47.291216 (+3510767us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:47.831456 (+540240us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:47.846974 (+ 15518us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:48.324821 (+477847us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:48.379328 (+ 54507us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:48.382431 (+  3103us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:48.382548 (+   117us) inbound_call.cc:177] Queueing success response
0709 13:08:49.530683 (+1148135us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:51.899649 (+2368966us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:52.071638 (+171989us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:52.072242 (+   604us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":63340,"mutex_wait_us":11862,"raft.queue_time_us":20945,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":14254,"tablet-copy.queue_time_us":384606,"tablet-download-pool.queue_time_us":6473,"tablet-download-pool.run_cpu_time_us":1424,"tablet-download-pool.run_wall_time_us":771945,"thread_start_us":509301,"threads_started":3}
I20260709 13:08:53.183835 27440 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.186307 21641 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:53.063889 27554 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:53.188050 27554 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.062954 27464 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.192992 27464 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:53.195133 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.196231 27541 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:53.196787 27541 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:53.197281 27541 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.197976 27499 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:53.130954 27535 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:53.199780 27535 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.201004 27535 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.199626 27554 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:53.207476 27546 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:53.212077 27452 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 13:08:53.213349 27452 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.215551 27452 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:53.212744 22247 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
W20260709 13:08:53.217144 21486 consensus_meta.cc:287] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.001s
I20260709 13:08:53.217545 21486 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
W20260709 13:08:53.226403 27583 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
W20260709 13:08:53.140349 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.253551 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 280941us
W20260709 13:08:53.265743 21561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.033s	sys 0.031s
W20260709 13:08:53.266410 21561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.033s	sys 0.031s
I20260709 13:08:53.271802 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:53.273521 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:53.274456 21490 raft_consensus.cc:2410] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:53.278183 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:53.252777 27446 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:53.264225 27554 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.286207 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:53.286962 21635 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:53.296471 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:53.297442 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:53.298084 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:53.300624 27278 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:53.306121 27512 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:53.306905 27512 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.308339 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:53.310321 27553 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:53.310803 27553 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:53.311232 27553 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:53.286541 27446 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.312170 27597 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:08:53.313318 27446 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:53.310353 27541 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:53.314883 21569 raft_consensus.cc:2410] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:08:53.315279 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:53.315577 27167 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.318409 21606 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:53.298712 21564 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:08:53.322373 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:53.322994 21641 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.323647 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:53.342187 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:53.326889 21493 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:53.278990 27595 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:53.383514 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:53.370524 21491 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:53.384742 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:53.275355 21503 tablet_copy_service.cc:342] P 5a34fd3290de493eb6bbe828dd742772: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-cc9f5258ae3f4790a9bc1813d73ec987 received from {username='slave'} at 127.0.0.1:44644
I20260709 13:08:53.279866 27548 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.366093 27593 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.389580 27593 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.316139 27554 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.394414 27554 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:53.396144 27519 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
I20260709 13:08:53.372151 21485 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:08:53.321681 27535 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:53.292323 27336 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:53.290330 27566 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:53.345384 27483 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:53.378835 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:53.324878 27503 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:53.374711 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 85155.1us
I20260709 13:08:53.385046 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:53.398957 27380 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:53.453819 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:53.372612 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:53.432324 21635 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:53.419049 21641 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:08:53.415175 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:53.461838 22244 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:53.415729 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:53.412729 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:53.463102 22247 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:53.409709 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:53.464442 21562 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:53.448273 21485 pending_rounds.cc:85] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 11
I20260709 13:08:53.431766 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:53.451081 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:53.465255 21485 pending_rounds.cc:107] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:08:53.455976 21491 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:08:53.400012 27548 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:53.465602 21485 raft_consensus.cc:2889] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:53.385921 27306 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.469099 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:53.472741 21637 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:08:53.469255 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:53.478756 21640 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:53.323936 27446 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.482271 21492 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:53.443477 21503 tablet_copy_service.cc:434] P 5a34fd3290de493eb6bbe828dd742772: ending tablet copy session 549b31ac31b6428994b45938abc223a7-cc9f5258ae3f4790a9bc1813d73ec987 on tablet cc9f5258ae3f4790a9bc1813d73ec987 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:08:53.455044 27505 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.374716 26969 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:08:53.497373 22247 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:53.321681 27167 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.479578 27519 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:53.477072 27546 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.477562 27535 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:53.482002 27335 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:53.457058 27336 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.485467 27278 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.484282 27483 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:53.476666 27380 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.501683 27565 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:53.388586 27595 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.501114 27566 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:53.544116 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:53.492421 27446 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.526551 27519 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.479349 27503 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:53.534914 27335 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:53.503245 27505 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.528841 27546 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.533684 27278 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.583491 27450 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:53.584080 27450 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.584450 27450 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:53.588266 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44245.8us
W20260709 13:08:53.663939 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 182076us
I20260709 13:08:53.596297 27566 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.707553 27450 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:53.709932 27590 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.186s	user 0.011s	sys 0.000s
I20260709 13:08:53.710170 27450 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:53.706171 27553 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:53.597710 27483 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.711604 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2691) took 1148 ms. Trace:
I20260709 13:08:53.711947 27384 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.568980 27535 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.711989 21561 rpcz_store.cc:276] 0709 13:08:52.563531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.563679 (+   148us) service_pool.cc:224] Handling call
0709 13:08:52.563999 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.576658 (+ 12659us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:52.685917 (+109259us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.287912 (+601995us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.288402 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:08:53.288528 (+   126us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:53.288563 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.288629 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.711362 (+422733us) raft_consensus.cc:1685] finished
0709 13:08:53.711385 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.711543 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66940,"prepare.queue_time_us":66435,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":36083,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":30348,"thread_start_us":671179,"threads_started":2,"wal-append.queue_time_us":790512}
I20260709 13:08:53.702598 27484 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:53.704006 27519 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:53.704485 27595 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:53.706362 27503 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:53.701419 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:53.838671 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 137376us
W20260709 13:08:53.680290 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 142658us
I20260709 13:08:53.715562 27484 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:53.839622 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:53.709604 27336 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:53.837406 27599 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.286s	user 0.003s	sys 0.006s
W20260709 13:08:53.913848 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 74358.6us
I20260709 13:08:53.917133 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:53.917727 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:53.918623 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:53.919330 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:53.930027 21565 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:08:53.931102 21565 pending_rounds.cc:85] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 9
I20260709 13:08:53.931591 21565 pending_rounds.cc:107] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:08:53.932027 21565 raft_consensus.cc:2889] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:53.917816 21561 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:53.704488 27546 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:53.969237 21487 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:08:53.970146 21487 pending_rounds.cc:85] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 10
I20260709 13:08:53.970446 21487 pending_rounds.cc:107] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:08:53.925545 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:53.958755 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:53.959273 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:53.970745 21487 raft_consensus.cc:2889] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:53.971557 21562 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:08:53.967482 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 126988us
I20260709 13:08:53.975498 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:53.972187 21569 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:53.888903 27505 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:53.911392 27564 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:54.000650 21491 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:54.013697 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:53.912170 27519 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:53.913997 27256 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:53.838162 26984 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.244s
I20260709 13:08:53.913798 27548 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.021356 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.012152 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:54.015131 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 298033us
I20260709 13:08:53.913744 27567 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:53.955199 27336 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:08:54.033867 21490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.017s	sys 0.062s
I20260709 13:08:54.034742 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:54.099010 21490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.018s	sys 0.062s
I20260709 13:08:54.036772 21487 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:53.981432 27546 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:54.111207 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:54.112142 21642 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:54.024677 27494 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.060444 27256 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:54.145409 27256 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:54.146176 27256 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:54.102732 26636 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:54.113976 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:54.102072 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 85453.6us
I20260709 13:08:54.124344 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:54.131632 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:54.050280 27564 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:54.095971 27076 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:54.175201 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:54.187722 27607 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:54.188429 27607 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.191063 27607 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.191221 27076 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:54.191951 27076 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.194435 27076 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:54.199958 27601 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:53.955540 27335 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:54.202176 27256 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.205235 27256 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.207656 27484 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:54.212554 27524 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:54.213336 27524 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.218644 27553 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.104174 27567 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.221421 27567 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.164979 27380 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:54.045147 27519 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.224725 27519 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:54.096505 27548 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:54.224399 27511 raft_consensus.cc:2955] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 10 to 12, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:54.226995 27548 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:54.227792 21643 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:54.134374 27546 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.231173 21637 raft_consensus.cc:2955] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 10 to 12, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:54.232839 27546 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.237859 27564 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:54.238487 27167 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:54.240186 27167 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.240759 27167 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:54.162449 27494 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.243002 27167 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:54.244146 27494 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.251698 27512 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:54.253809 27384 consensus_meta.cc:287] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.000s
I20260709 13:08:54.257395 27524 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:54.263223 21486 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:54.273394 27353 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:54.273859 27353 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:54.274137 27278 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.277716 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.280233 22247 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:54.299049 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 212237us
I20260709 13:08:54.291270 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:54.293498 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 981) took 1021 ms. Trace:
W20260709 13:08:54.297463 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 279839us
I20260709 13:08:54.302383 21488 rpcz_store.cc:276] 0709 13:08:53.272090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.272213 (+   123us) service_pool.cc:224] Handling call
0709 13:08:54.292885 (+1020672us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b5800011198. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebdeee 0000000000375939 00007f98aef311e0 00007f98aeffa0c4 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:08:54.293024 (+   139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.293175 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.293203 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:54.293242 (+    39us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:54.293270 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.293328 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.293426 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6279040}
I20260709 13:08:54.328727 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:54.329893 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 177081us
I20260709 13:08:54.331310 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:54.296670 27615 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.296531 27617 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.343107 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:54.277598 27519 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:54.277491 27576 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.328325 27431 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.369428 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.372735 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:54.337172 27501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.002s	sys 0.009s
I20260709 13:08:54.350805 27615 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.352124 22241 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:08:54.353176 27511 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:54.353926 27167 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 8 to 10, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:54.359583 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.392725 21488 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:08:54.360299 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.360438 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.361372 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.333281 27548 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.365492 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:54.373519 21566 raft_consensus.cc:2393] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:54.363606 21493 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:54.342456 27614 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:54.332988 27336 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:54.378804 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.397107 21568 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 9.
I20260709 13:08:54.398037 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.375247 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.398882 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:54.399542 22247 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:54.380532 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.382764 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:54.401265 21560 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:54.401139 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:54.384063 21567 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:54.363575 21487 raft_consensus.cc:2955] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 10 to 12, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:54.386209 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.403458 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:54.401979 22243 raft_consensus.cc:2955] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 10 to 12, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:54.376504 27501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.003s	sys 0.009s
I20260709 13:08:54.407922 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:54.408308 21567 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.375458 27553 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:54.365151 27535 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:54.274740 27353 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:54.414065 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.414686 21566 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:54.415156 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:54.381181 27616 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:54.441970 21560 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:08:54.405184 27422 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:54.409397 27564 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:54.449719 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.413319 27368 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:54.401762 27614 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.412416 27541 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:54.372296 27519 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.457747 21561 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:08:54.420789 27512 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:54.375852 27431 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:54.449898 27353 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:54.422561 27553 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:54.478493 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:54.500530 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.426700 27546 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:08:54.483157 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 116202us
W20260709 13:08:54.485951 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 154713us
I20260709 13:08:54.487416 27637 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.487558 21567 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:54.372093 27576 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.364656 27617 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.409227 27278 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:54.493064 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3326) took 1080 ms. Trace:
I20260709 13:08:54.495414 27621 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.406541 27548 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.421378 27483 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:54.501247 27336 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.513896 21638 rpcz_store.cc:276] 0709 13:08:53.412547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.418390 (+  5843us) service_pool.cc:224] Handling call
0709 13:08:53.458851 (+ 40461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.542723 (+ 83872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.542779 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.542857 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:53.542909 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.492668 (+949759us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b5400144e54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:54.492772 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.492980 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192307968}
I20260709 13:08:54.515246 27483 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.481925 27614 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.489972 27501 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.529207 21567 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:54.478727 27564 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.480022 27627 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.543569 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.550585 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.545178 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:54.492345 27541 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:54.503492 27512 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:54.502727 27553 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:54.564365 21569 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:54.556914 22243 raft_consensus.cc:2393] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:54.518591 27483 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.450136 27616 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:54.567564 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 63136.3us
I20260709 13:08:54.565234 27484 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:54.519268 27624 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.544394 27568 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:54.576450 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:54.580767 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.574959 27452 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:54.587239 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.587972 21606 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:54.588555 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:54.539444 27546 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.556645 27501 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.595680 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.598100 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.544231 27621 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.598176 27483 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:54.598356 21457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.132:40323 timed out after 1.734s (SENT) [suppressed 8 similar messages]
I20260709 13:08:54.600147 27617 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.602661 27564 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.603014 27541 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.603770 27431 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:54.558399 27627 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.604743 27615 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.605137 27616 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.605793 27519 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:54.576622 27635 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.539110 27637 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.611927 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:54.613821 27603 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.909s	user 0.004s	sys 0.008s
I20260709 13:08:54.583287 27568 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.617089 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.611675 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.588832 27535 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:54.651454 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:54.620407 27576 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:54.660840 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.673758 22245 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:54.649233 27524 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.659116 27615 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:54.627485 27636 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.663008 22240 raft_consensus.cc:1217] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:08:54.683306 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:54.583612 27484 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:54.664201 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 76303.8us
I20260709 13:08:54.670454 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.670735 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.591634 27452 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.617308 27634 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:54.690903 27634 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:54.691522 27643 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:54.692762 27553 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.693276 27634 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:54.659564 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.694358 21487 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:54.618867 27554 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:54.695708 27546 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.696165 27554 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.699152 27647 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:54.699659 27484 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.676703 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.700953 22239 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 17: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:54.669858 27568 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:54.677866 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:54.607297 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 102321us
I20260709 13:08:54.653257 27501 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.682384 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.686623 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:54.627250 27483 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:54.686973 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.676332 27502 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:54.698530 27554 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.708752 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:54.712436 21493 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:54.685762 27631 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:08:54.716812 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:54.719199 27546 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:54.721199 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:54.722416 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.724249 22240 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:54.725157 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.725785 21494 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:08:54.726481 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.727530 22245 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:54.720034 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:54.665711 27635 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:54.676066 27535 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:54.733529 27623 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:08:54.728775 27632 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.707409 27548 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.657696 27512 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.715971 27502 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:54.686038 27524 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.723973 27484 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:54.753258 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.719048 27640 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:54.757755 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:54.719637 27553 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.705538 27636 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:54.761294 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 163037us
I20260709 13:08:54.762552 27388 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:54.755488 27548 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:08:54.749576 27647 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:54.767795 27617 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:54.752736 27484 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.768963 27452 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.763259 27586 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:54.769855 27615 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:54.750058 27502 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:54.772929 27637 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:54.745321 27554 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:54.774760 27640 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:54.798704 27554 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.799100 27640 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:54.799347 27554 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:54.802610 22241 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:54.804803 27554 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:54.788236 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:54.790639 22238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 981) took 2117 ms (client timeout 1734 ms). Trace:
W20260709 13:08:54.809906 22238 rpcz_store.cc:269] 0709 13:08:52.672995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.673152 (+   157us) service_pool.cc:224] Handling call
0709 13:08:54.790358 (+2117206us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54003b3b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:54.790506 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864732032}
I20260709 13:08:54.791224 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.806237 27452 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:54.811741 22240 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:54.792562 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.792870 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.814635 21560 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:08:54.817754 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.819538 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:54.791235 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.792011 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 982) took 1519 ms. Trace:
I20260709 13:08:54.824047 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:54.821818 21486 rpcz_store.cc:276] 0709 13:08:53.272523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.272685 (+   162us) service_pool.cc:224] Handling call
0709 13:08:53.273061 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.263822 (+990761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.791667 (+527845us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54002cb854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:54.791901 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275951488}
W20260709 13:08:54.827912 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 103750us
I20260709 13:08:54.797464 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:54.830708 22212 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:08:54.857704 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.829180 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:54.876737 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46131.1us
I20260709 13:08:54.827170 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:54.879770 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 50669.8us
I20260709 13:08:54.884159 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:08:54.794510 27630 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 13:08:54.781363 27639 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.164s	user 0.003s	sys 0.000s
I20260709 13:08:54.886086 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:54.886997 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 59953.3us
I20260709 13:08:54.888818 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:54.889464 21635 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:54.782562 27484 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:54.811820 27452 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.783550 27593 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.787542 27368 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:54.812554 27634 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:54.905500 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.905604 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.879973 27609 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.779215 27647 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.896153 27505 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:54.797753 27627 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:54.899482 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:54.900202 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:54.886130 27562 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.885936 27554 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.885926 27637 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:54.997216 27637 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.997710 27637 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:54.796746 27564 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:54.999130 27564 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:08:55.005609 27353 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.002s
I20260709 13:08:55.008163 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.008882 21636 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:55.009841 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.010385 21636 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:08:54.793766 27621 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:54.897485 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 100104us
I20260709 13:08:54.928316 27634 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.011785 27503 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.012331 27503 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.012535 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:55.012992 27634 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.897186 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:55.014647 27452 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.877905 27501 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.015275 27503 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.015928 27503 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:55.015679 27501 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.016376 27503 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.016791 27503 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.781688 27278 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
W20260709 13:08:54.913882 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 152219us
I20260709 13:08:54.918540 27368 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.019285 27278 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:55.019670 27278 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.020023 27278 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:55.020857 27368 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.021430 27368 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:55.021752 27368 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:55.022204 27524 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:54.939899 21638 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:08:55.022653 27546 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:55.018543 27501 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.014393 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:55.023829 27614 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.024554 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:55.025307 27567 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:54.920853 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:55.026010 27614 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:54.895949 27632 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:55.026229 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 105481us
I20260709 13:08:54.944875 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.026909 27632 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:54.783030 27586 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:54.899536 27447 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:54.957046 27505 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.988498 27618 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:55.015290 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 118174us
I20260709 13:08:54.936156 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.025942 27567 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:54.942915 27566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.233s	user 0.014s	sys 0.035s
I20260709 13:08:54.782038 27617 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.031739 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:54.959667 27647 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:55.076148 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 318461us
I20260709 13:08:54.990557 27511 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.083335 27568 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:55.070936 27566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.362s	user 0.015s	sys 0.036s
I20260709 13:08:55.063024 27505 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:55.058715 27634 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:55.028915 27655 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:55.037408 27564 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:54.991652 27562 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.100977 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:54.946261 27609 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.028024 27554 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.162999 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:55.163897 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 242668us
I20260709 13:08:55.192070 21637 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:08:55.173629 27535 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:55.066038 27502 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.095911 27655 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.105132 27596 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:55.087126 27354 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:08:55.070696 27618 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.106138 27483 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:55.180225 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:55.090075 27511 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.080634 27368 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.061911 27501 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:08:55.074425 27642 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:08:55.099454 27634 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.202696 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.202163 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:55.200347 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 172795us
W20260709 13:08:55.351114 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.247273 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 50685.8us
I20260709 13:08:55.365437 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.376886 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.370925 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:08:55.368108 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 188028us
I20260709 13:08:55.216163 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.223249 27586 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:55.228734 27502 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:55.407021 21637 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 9.
I20260709 13:08:55.212772 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.374491 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.373257 27256 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:55.195645 27636 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:55.371836 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.382951 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:08:55.206132 27660 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:08:55.368495 27157 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:55.217037 27617 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:55.379444 27663 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.408607 21638 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:08:55.408428 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:55.379652 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:55.206174 27568 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.223297 27446 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.374015 27615 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.373839 27593 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:55.201602 27655 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:55.211064 27596 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.449285 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.452090 27618 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.384181 27368 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:55.453238 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:55.455917 27554 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:55.457571 27634 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:55.458030 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:55.458977 27562 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.504544 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36572 (request call id 1422) took 1232 ms. Trace:
I20260709 13:08:55.381757 27614 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.465075 27635 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:55.465452 27637 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.466710 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 3783) took 1088 ms. Trace:
I20260709 13:08:55.534910 21569 rpcz_store.cc:276] 0709 13:08:54.378355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.380224 (+  1869us) service_pool.cc:224] Handling call
0709 13:08:55.466501 (+1086277us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54000a2b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:55.466615 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374886656}
I20260709 13:08:55.467875 27503 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.468859 27505 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.405259 27519 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.380419 27566 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:55.473275 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.565842 22244 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:55.475960 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.567164 21640 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:08:55.533074 27627 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.568300 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.568421 27627 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.569075 21640 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:08:55.471979 27661 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.479861 27511 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.462361 27647 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:55.486974 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 80197.7us
I20260709 13:08:55.571677 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:55.491297 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 111717us
I20260709 13:08:55.411350 27632 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:55.476347 27484 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.001s
I20260709 13:08:55.492189 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.494941 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.495210 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.488546 27157 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.496845 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.498371 21490 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
W20260709 13:08:55.499544 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.579319 21490 pending_rounds.cc:85] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 9
I20260709 13:08:55.579690 21490 pending_rounds.cc:107] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:08:55.580216 21490 raft_consensus.cc:2889] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:55.503472 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.492085 27347 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:55.459250 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:55.523593 27596 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.502044 27593 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.499985 27615 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.488343 27278 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.497328 27671 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:55.515877 21564 rpcz_store.cc:276] 0709 13:08:54.272226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.277356 (+  5130us) service_pool.cc:224] Handling call
0709 13:08:55.457846 (+1180490us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefa80a0 00007f98aefa7984 00007f98a85226d4 00007f98a8522662
0709 13:08:55.504472 (+ 46626us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5597952}
I20260709 13:08:55.571749 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:55.597244 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:55.607888 21606 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:55.490053 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:55.572472 21640 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:55.573395 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:55.499495 27608 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.496183 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.491869 27663 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:55.565263 27541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.015s	sys 0.034s
I20260709 13:08:55.575616 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:55.658322 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 205176us
I20260709 13:08:55.577291 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:55.578344 22239 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 15: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:55.582507 21569 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:55.570446 27627 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.591989 21639 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:55.594170 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:55.544188 27464 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:55.667104 22244 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:08:55.601596 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:55.668907 22247 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:55.669307 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.596333 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.565371 27566 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:55.594947 27617 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.574915 27668 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.628217 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:55.804440 27380 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:55.805794 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 177592us
I20260709 13:08:55.577525 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:55.745673 21488 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:55.748806 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:08:55.807904 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 230313us
I20260709 13:08:55.750607 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:55.809012 21486 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:55.753539 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 94261.3us
I20260709 13:08:55.607225 21568 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:08:55.759244 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:55.680038 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.759267 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:55.818374 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:55.821712 22246 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:55.823094 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.761663 27157 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:55.827138 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.762728 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:55.699719 22247 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:55.836303 22241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 862) took 1332 ms. Trace:
I20260709 13:08:55.769991 27278 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:55.678610 27464 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.587613 27484 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.864094 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.865482 22245 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:55.866143 27484 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:55.611912 27447 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:55.840757 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.867620 21643 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:08:55.867951 21641 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:55.867548 27447 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.869916 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.606913 27501 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:55.835209 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 663) took 1047 ms. Trace:
W20260709 13:08:55.609743 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 119789us
I20260709 13:08:55.871443 27501 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.871488 22239 rpcz_store.cc:276] 0709 13:08:54.787942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.825834 (+ 37892us) service_pool.cc:224] Handling call
0709 13:08:55.834692 (+1008858us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b540045fbd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:55.835022 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584271744}
I20260709 13:08:55.874065 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.773746 27503 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:55.875694 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.614852 27519 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.672102 27511 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:55.878257 27464 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:55.658951 27541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.015s	sys 0.034s
I20260709 13:08:55.709964 27593 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.880105 27519 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.673976 27566 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:55.880735 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:55.861508 22241 rpcz_store.cc:276] 0709 13:08:54.503831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.503947 (+   116us) service_pool.cc:224] Handling call
0709 13:08:54.802075 (+298128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.803214 (+  1139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.835763 (+1032549us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54003b3b50. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:55.836033 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684814592}
I20260709 13:08:55.684644 27505 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:55.585711 27446 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.884708 21562 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:55.594280 27568 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.854733 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:55.701278 27609 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:55.566295 27614 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.885819 27568 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.889178 27568 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.616528 27347 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:55.681461 27617 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.682153 22244 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:08:55.578490 27632 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.715031 27637 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:55.684561 27645 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 1.055s	user 0.000s	sys 0.006s
I20260709 13:08:55.892904 27617 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:55.686399 27653 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.794s	user 0.000s	sys 0.001s
I20260709 13:08:55.894325 22242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 985) took 1613 ms. Trace:
I20260709 13:08:55.616144 27621 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:55.570519 27661 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:55.895380 27621 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:55.895987 27621 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:55.897617 27661 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.686085 27663 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.714475 27655 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:55.686074 27667 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:55.612749 27670 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:55.902408 27670 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.903031 27655 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.903533 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2079) took 1362 ms. Trace:
I20260709 13:08:55.904039 21491 rpcz_store.cc:276] 0709 13:08:54.541359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.541613 (+   254us) service_pool.cc:224] Handling call
0709 13:08:54.542107 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.555285 (+ 13178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.555316 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.555829 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.730365 (+174536us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:54.730645 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.730715 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.685675 (+954960us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:55.902866 (+217191us) raft_consensus.cc:1685] finished
0709 13:08:55.902925 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.903300 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2273,"raft.queue_time_us":15793,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":4565,"spinlock_wait_cycles":5945600,"thread_start_us":174220,"threads_started":1,"wal-append.queue_time_us":250283}
I20260709 13:08:55.905856 27670 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.606455 27671 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.907276 27671 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:55.657661 27608 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.913287 27608 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.800231 27565 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:55.808125 21492 raft_consensus.cc:2368] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18.
I20260709 13:08:55.810343 27422 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:55.660826 21638 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:55.810563 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:55.915328 27422 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:55.830853 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.767952 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.852955 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:55.833734 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:55.617374 27482 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:55.926431 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:55.927932 21636 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 20: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:08:55.928094 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 75366.8us
I20260709 13:08:55.930260 22239 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:55.894873 22242 rpcz_store.cc:276] 0709 13:08:54.280598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.281057 (+   459us) service_pool.cc:224] Handling call
0709 13:08:54.281360 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.377729 (+ 96369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.377759 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.378309 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.630065 (+251756us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:54.630128 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.630233 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.615900 (+985667us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:55.893618 (+277718us) raft_consensus.cc:1685] finished
0709 13:08:55.893660 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.894090 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":205481,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":15504768,"thread_start_us":347335,"threads_started":2,"wal-append.queue_time_us":251026}
I20260709 13:08:55.931305 27541 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:55.923570 22240 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:08:55.925168 27422 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:55.884369 27446 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.889489 27614 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:55.711046 27615 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:55.711606 27647 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:55.686902 27668 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.870497 27447 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.939587 27446 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.940352 27668 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.874465 27501 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.917438 21486 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:08:55.942121 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3335) took 1056 ms. Trace:
I20260709 13:08:55.894409 27632 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:55.923235 27677 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:55.944173 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 63815.9us
I20260709 13:08:55.932723 27617 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:55.914410 27565 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:55.942543 21639 rpcz_store.cc:276] 0709 13:08:54.886492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.886626 (+   134us) service_pool.cc:224] Handling call
0709 13:08:55.020145 (+133519us) spinlock_profiling.cc:243] Waited 965 us on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:08:55.020348 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.671059 (+650711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.941541 (+270482us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540009b854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:55.941912 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307333760}
W20260709 13:08:55.937443 27644 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.220s	user 0.000s	sys 0.005s
I20260709 13:08:55.885613 21643 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:55.947427 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:55.958093 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 147824us
W20260709 13:08:55.960372 27666 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.596s	user 0.000s	sys 0.005s
I20260709 13:08:55.960664 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.961561 22240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 995) took 1150 ms. Trace:
I20260709 13:08:55.963550 21566 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:55.963392 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.965272 21486 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:08:55.961997 22240 rpcz_store.cc:276] 0709 13:08:54.811102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.896853 (+ 85751us) service_pool.cc:224] Handling call
0709 13:08:55.961302 (+1064449us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b540016f154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:55.961465 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960934784}
I20260709 13:08:55.965714 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.966760 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.967100 27353 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:55.967646 27353 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:55.968989 27353 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:55.969338 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3337) took 1082 ms. Trace:
I20260709 13:08:55.970894 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.967608 21486 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:55.971997 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:55.970213 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:55.973304 21636 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:55.974435 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 1421) took 1702 ms. Trace:
I20260709 13:08:55.969760 21642 rpcz_store.cc:276] 0709 13:08:54.887254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.887365 (+   111us) service_pool.cc:224] Handling call
0709 13:08:54.887717 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.891916 (+  4199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.891946 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.902117 (+ 10171us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.180668 (+278551us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:55.180708 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.180782 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.959635 (+778853us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b24003d4828. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6d7b9c4 00007f98a6d79acb 00007f98a6f34dc9 00007f98a6f34a55 00007f98a6f3409d 00007f98a9b6610e 00007f98a9b7d88c 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221
0709 13:08:55.968816 (+  9181us) raft_consensus.cc:1685] finished
0709 13:08:55.968839 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.969146 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3789,"raft.queue_time_us":4067,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8669,"spinlock_wait_cycles":57883904,"thread_start_us":278173,"threads_started":1,"wal-append.queue_time_us":426910}
I20260709 13:08:55.977576 22243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 986) took 1234 ms. Trace:
I20260709 13:08:55.979640 21641 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:08:55.980386 21494 raft_consensus.cc:2368] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:55.980654 21562 rpcz_store.cc:276] 0709 13:08:54.271887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.277054 (+  5167us) service_pool.cc:224] Handling call
0709 13:08:55.812167 (+1535113us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b58001b0998. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:08:55.812608 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.885258 (+ 72650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.974141 (+ 88883us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b54000a1c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:08:55.974328 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170330752}
I20260709 13:08:55.983083 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:56.004137 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:56.004444 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 103966us
I20260709 13:08:56.010893 21532 leader_election.cc:400] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18.
I20260709 13:08:56.011336 21532 leader_election.cc:403] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:56.012404 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:56.013018 27501 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.013340 27670 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:56.014022 27670 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:56.015085 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.016378 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:55.982967 27167 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:56.015205 27670 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.018579 27677 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:56.019411 27677 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.020681 27656 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:56.010986 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:56.026067 27347 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:56.028119 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.028532 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.029335 21561 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:56.036008 21634 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:56.036859 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3332) took 1156 ms. Trace:
I20260709 13:08:56.037106 27501 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18.
W20260709 13:08:56.037878 27368 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.012s
I20260709 13:08:56.038038 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 994) took 1133 ms. Trace:
I20260709 13:08:56.038502 21488 rpcz_store.cc:276] 0709 13:08:54.904760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.906900 (+  2140us) service_pool.cc:224] Handling call
0709 13:08:56.037718 (+1130818us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b540029a4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:56.037929 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649676032}
I20260709 13:08:56.040848 27422 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.043678 27422 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.049569 21634 rpcz_store.cc:276] 0709 13:08:54.879956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.884746 (+  4790us) service_pool.cc:224] Handling call
0709 13:08:56.035301 (+1150555us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:08:56.035593 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.036528 (+   935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.036781 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3472128}
I20260709 13:08:56.052238 21638 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:55.981029 22243 rpcz_store.cc:276] 0709 13:08:54.625409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.625584 (+   175us) service_pool.cc:224] Handling call
0709 13:08:54.660665 (+ 35081us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:54.678559 (+ 17894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.678582 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:54.679118 (+   536us) log.cc:844] Serialized 52 byte log entry
0709 13:08:55.225205 (+546087us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b18003b1400. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:08:55.372041 (+146836us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:55.594360 (+222319us) log.cc:844] Serialized 14 byte log entry
0709 13:08:55.839674 (+245314us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b18003b1400. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98ad9da3c7 00007f98a9fec9a7 00007f98a9ffc0bf 00007f98a9ffc038
0709 13:08:55.847384 (+  7710us) log.cc:844] Serialized 14 byte log entry
0709 13:08:55.850651 (+  3267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.850854 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.850941 (+    87us) raft_consensus.cc:1685] finished
0709 13:08:55.850959 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.859868 (+  8909us) inbound_call.cc:177] Queueing success response
0709 13:08:55.914063 (+ 54195us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b18003b1400. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef5522 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
Metrics: {"mutex_wait_us":198326,"prepare.queue_time_us":486591,"prepare.run_cpu_time_us":157,"prepare.run_wall_time_us":3872,"raft.queue_time_us":5969,"raft.run_cpu_time_us":517,"raft.run_wall_time_us":16533,"spinlock_wait_cycles":18832128,"thread_start_us":287847,"threads_started":2,"wal-append.queue_time_us":783404}
I20260709 13:08:56.059580 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.060999 21643 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:56.062690 21636 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:56.064965 21635 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:56.067821 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:56.072469 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:56.000270 27565 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:56.082487 21642 raft_consensus.cc:2410] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:08:56.087441 27632 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:56.092880 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.095356 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3336) took 1208 ms. Trace:
I20260709 13:08:56.095772 21641 rpcz_store.cc:276] 0709 13:08:54.886833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.886940 (+   107us) service_pool.cc:224] Handling call
0709 13:08:56.095140 (+1208200us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b5400143f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:56.095279 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136479616}
I20260709 13:08:56.099287 21636 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:56.090848 27677 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:56.108843 22212 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:56.110545 27632 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:56.111013 27632 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:56.111431 27632 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:56.115257 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.115554 27499 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.116036 27627 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:56.116245 27499 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.119639 27499 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.125139 27671 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.126708 21492 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:56.127775 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:56.131381 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44777.5us
I20260709 13:08:56.137238 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.142495 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:56.148727 27621 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.151145 27621 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:56.088798 27353 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.155697 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.157815 27353 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.158337 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:56.161545 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.193013 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:56.194089 21560 raft_consensus.cc:2368] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:08:56.195235 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.163902 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:56.169296 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.170107 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.199668 21561 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.172626 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.172928 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.173636 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:56.173832 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.178721 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:56.179878 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:56.180099 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:56.181294 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:56.201318 22244 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:56.182474 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 189872us
I20260709 13:08:56.183782 27671 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.190827 27566 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.214560 21563 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:08:56.219897 21636 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.226536 22243 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.232918 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.239472 27642 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:56.240127 27642 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.240568 27642 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:56.218000 22241 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
W20260709 13:08:56.249421 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 107073us
I20260709 13:08:56.254530 21638 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:08:56.262946 27347 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.265362 22244 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:56.271450 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.271095 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:56.225230 27632 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.282965 21561 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:08:56.287689 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:56.287712 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.289108 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:56.272334 27565 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.292368 27386 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:56.293126 27386 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.293872 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:56.295091 27622 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:56.295492 27622 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:56.295653 27646 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.295929 27622 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.296151 27646 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.301430 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:56.301496 27190 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:56.301606 21639 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:08:56.303658 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:56.302515 27368 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:56.305748 27368 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.306182 27368 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.307021 27646 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:56.309676 21642 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 20: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:56.269865 27347 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.319788 27566 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.320863 27565 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.321846 27368 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.323233 27565 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:56.324298 27368 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:56.325343 27347 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:56.335605 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.336210 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.336525 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.337085 21568 raft_consensus.cc:2368] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
I20260709 13:08:56.338814 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.339546 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.344055 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:56.346308 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:56.348775 27008 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:56.432044 27347 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:56.431924 27008 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.432644 27347 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.433243 27347 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.435367 27008 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:56.352934 27646 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:56.354925 27380 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:56.436669 27646 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:56.437732 27646 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:56.359058 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 65318.3us
I20260709 13:08:56.440702 26969 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:56.366532 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.368636 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.441927 26969 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:56.442333 26969 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:56.373242 27386 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:56.381352 22243 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:56.385125 27632 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:56.385474 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.387590 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:56.464089 21638 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:56.388376 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:56.389065 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:56.371110 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.424028 27384 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.424782 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.428632 22241 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:56.431018 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:56.442572 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.371014 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:56.444314 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 98120.9us
I20260709 13:08:56.458606 26969 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.476853 21636 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:56.479152 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.479329 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:56.411136 27622 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:56.488749 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 47668.7us
I20260709 13:08:56.456749 27642 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.515518 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:56.486124 27446 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:56.489760 27621 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:56.535717 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.541338 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.527474 27621 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.524281 27446 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:56.544203 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:56.547221 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:56.543658 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:56.546208 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:56.530267 27671 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:56.530049 27380 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:56.558671 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 169793us
I20260709 13:08:56.519225 27384 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.545274 27621 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.546813 27446 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:56.571503 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:56.567274 27508 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:56.573031 27508 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.574940 27647 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:56.569262 27380 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:56.580356 27384 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:56.581243 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 55485.1us
I20260709 13:08:56.583285 22210 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:56.584203 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:56.570575 27677 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:56.585804 27677 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:56.587076 27671 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.587872 27622 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.590265 27671 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.593091 27647 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:56.593740 27647 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.607528 21492 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20. Ops: []
W20260709 13:08:56.607801 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64296.5us
W20260709 13:08:56.607254 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 67241.8us
I20260709 13:08:56.608843 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:56.562219 27565 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:56.612650 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:56.605147 27647 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:56.617692 27620 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:56.622373 21492 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:56.621084 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:56.615904 27368 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:56.625468 27368 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:56.625910 27368 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.627170 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:56.628042 21494 raft_consensus.cc:2410] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:56.628924 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:56.628829 21493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:56.629637 21493 raft_consensus.cc:606] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:56.630278 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:56.630954 21488 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:56.629734 21487 raft_consensus.cc:2368] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 20. Current term is 21.
I20260709 13:08:56.640547 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.643138 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.648648 21568 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:08:56.650121 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:56.650102 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:56.632687 27632 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:56.655036 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:56.657194 21486 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:08:56.656352 27647 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:56.668303 27508 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.670698 27347 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.666465 27677 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:56.679920 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:08:56.680490 27386 raft_consensus.cc:1064] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:08:56.681542 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:56.682415 27499 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:56.682933 27499 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:56.683032 27670 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:56.683384 27499 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:56.688580 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:56.690297 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:56.691651 27380 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:56.693220 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44919.6us
I20260709 13:08:56.653486 27620 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:56.656247 27565 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:56.738231 27347 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.739324 27499 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.740654 27368 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.746264 27368 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.750263 27620 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.701867 27670 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:56.751587 27670 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:56.752036 27670 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.749153 27499 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:56.742208 27565 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:56.758566 27499 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:56.763761 27565 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:56.768383 27499 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:56.801630 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:56.802549 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 181556us
I20260709 13:08:56.765024 27446 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.818655 21492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:56.797859 27499 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.821622 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.842598 27446 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:56.838307 21492 raft_consensus.cc:606] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:56.767730 27386 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:56.871469 27689 log.cc:927] Time spent T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:08:56.874729 21492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:56.875500 21492 raft_consensus.cc:606] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:56.889052 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 291814us
W20260709 13:08:56.891639 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 236245us
W20260709 13:08:56.904194 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 320042us
I20260709 13:08:56.917068 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:56.900085 27642 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:56.918339 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 228135us
I20260709 13:08:56.889020 27622 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:08:56.924844 21563 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:56.950994 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:56.957574 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 249756us
I20260709 13:08:56.906656 27646 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:08:56.956053 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:56.962778 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 73285.2us
I20260709 13:08:56.966401 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:56.968838 21492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:56.949131 27562 consensus_queue.cc:1059] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:08:56.990198 27705 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:56.990649 27705 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:56.991591 27705 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:56.991694 27499 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:56.993003 27705 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:56.993165 27690 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:08:57.003625 27702 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:08:56.984790 27646 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.004621 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:56.986850 27190 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:56.983382 27446 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:57.008940 21492 raft_consensus.cc:606] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:08:57.017371 27499 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:57.017571 27621 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.018162 27646 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.018105 27502 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:56.995184 27627 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:57.030488 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 60615us
I20260709 13:08:56.987622 27566 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:08:57.031831 27190 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:57.050560 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.051371 21642 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:57.031190 27702 raft_consensus.cc:3055] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:57.054349 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 66971.8us
W20260709 13:08:57.083882 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 77284.8us
I20260709 13:08:57.047540 27446 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:57.088146 21457 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:57.056586 27655 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.057811 27702 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:57.091711 27671 raft_consensus.cc:993] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
W20260709 13:08:57.107489 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 111049us
I20260709 13:08:57.118595 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:57.121609 27700 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.122354 27700 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.124825 27700 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:57.104236 27655 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.126289 27347 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:57.126750 27347 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:57.127625 27347 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.128199 27655 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:57.128649 27347 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:57.139047 27702 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.124734 27353 raft_consensus.cc:3055] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:57.134186 27565 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.140637 27353 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:57.141201 27702 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:57.141402 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:57.141606 27353 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.143188 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:57.148576 27499 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:57.149255 27565 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:57.155134 27670 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.163283 27190 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:57.166759 27707 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:08:57.181280 27368 raft_consensus.cc:993] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:08:57.184181 27632 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:57.188707 27508 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:57.188902 27671 raft_consensus.cc:1081] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:08:57.189569 27353 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:57.191092 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.193591 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 50485.9us
W20260709 13:08:57.194844 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 76978us
W20260709 13:08:57.121871 27699 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:57.211721 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:57.211913 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:57.214056 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:57.219792 21642 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:08:57.223311 22210 leader_election.cc:400] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 20. Current term is 21.
I20260709 13:08:57.223834 22210 leader_election.cc:403] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:08:57.225432 27499 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:57.226830 27706 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:08:57.228297 27706 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:57.228682 27706 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:57.230695 27502 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:57.222577 27696 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:08:57.235880 27696 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:57.236248 27446 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:57.240334 27696 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:57.206777 26969 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:57.222048 27702 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:57.240211 27621 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:57.251502 27706 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.245167 27671 raft_consensus.cc:1081] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:08:57.270174 21486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:08:57.218312 27642 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:08:57.256884 27347 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.206332 27670 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:57.269901 22247 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:57.207398 27716 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.270961 21486 raft_consensus.cc:606] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:57.291303 21486 raft_consensus.cc:614] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:57.283267 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:57.270098 27706 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:57.286499 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.261574 27655 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:57.295048 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:57.295701 21487 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.297482 21642 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:08:57.297616 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.298197 21641 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.324141 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.330276 21562 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:57.296689 27347 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.327154 27646 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:57.340713 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.343478 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 255384us
W20260709 13:08:57.344173 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 133056us
I20260709 13:08:57.344349 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:57.349726 22210 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:57.305529 27716 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.353273 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:57.355144 21565 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:57.323884 27696 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.356741 27627 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:57.357338 27347 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:57.361199 21641 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:08:57.363688 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:57.347338 27700 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.365993 27700 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.368654 27700 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:57.365994 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:57.381381 21485 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:57.383529 21487 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:08:57.384869 22241 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:57.389252 21565 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:57.383293 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:57.384119 22247 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:57.400864 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:57.376211 27632 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:57.368695 27719 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.410722 21563 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:57.419380 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.390803 27717 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:57.411581 27627 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:08:57.414587 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49676.5us
I20260709 13:08:57.414819 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.420014 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:57.472172 27723 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.419701 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.487217 27723 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:57.489637 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.490049 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.491528 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.468596 27719 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.472368 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.492643 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.472978 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.493382 21640 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:57.474401 21486 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:57.494076 27723 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:57.475962 21488 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:57.470657 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:57.417982 27386 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:08:57.495110 27719 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:57.477025 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:57.495761 27386 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:57.477360 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.496719 21494 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:08:57.478619 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.418215 27671 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:08:57.497771 21490 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:57.498420 27422 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:57.498970 27422 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:57.420011 27716 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:57.499882 27422 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.501297 27422 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:57.479940 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.505295 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.507620 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.508261 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.481853 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.422804 27703 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:57.411630 27725 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 13:08:57.423413 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:57.496197 27386 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:57.509438 27703 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.509934 27703 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:57.510337 27386 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.510820 27717 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:57.511709 27386 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:57.512756 27717 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:57.513343 27717 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:57.513736 27717 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.508811 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.519173 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.519351 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.518481 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.520445 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:57.523308 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 99981.1us
I20260709 13:08:57.526664 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.529098 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.536782 27621 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:57.537401 27621 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:57.538553 27621 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.542483 27621 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:57.546891 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:57.547809 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.549401 27713 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:57.551980 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.562979 27347 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.563581 27347 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.566128 27347 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:57.534094 27703 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.579999 27655 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 20. Current term is 21.
I20260709 13:08:57.580168 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.586143 27703 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:08:57.590133 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.591205 27627 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:57.597124 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 188872us
W20260709 13:08:57.612854 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 192912us
I20260709 13:08:57.613852 21642 raft_consensus.cc:2368] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18.
I20260709 13:08:57.635484 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.636432 21642 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:57.637579 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.638368 21642 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:57.627405 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.632809 27723 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:57.639063 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.643342 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.641049 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:57.639693 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.645650 21494 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:08:57.626994 27700 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:57.648651 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:57.651518 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:57.645006 21562 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:57.656122 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.656777 21638 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
W20260709 13:08:57.658603 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.659677 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.660393 21637 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:08:57.661460 27696 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:57.662858 27642 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:57.663765 27642 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.669661 21636 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:57.671417 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:57.653352 27347 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.672958 21634 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:57.672955 21642 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:57.674866 21635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58372
I20260709 13:08:57.681630 21635 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.682060 21635 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:57.677482 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:57.613592 27717 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.686352 21636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58372
I20260709 13:08:57.691171 27723 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:57.691365 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.691982 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:57.666046 27703 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.697644 21636 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.713748 21489 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:08:57.702986 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.727919 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.725358 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:57.675279 27706 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:57.740700 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 69392us
I20260709 13:08:57.667362 27647 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.730759 21637 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:57.738385 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.739097 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.738628 27723 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.729645 21636 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:57.742945 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 1002) took 1179 ms. Trace:
I20260709 13:08:57.750073 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.750964 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.752434 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:08:57.746151 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 61770.7us
I20260709 13:08:57.753399 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.763048 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.763652 22244 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:57.758776 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.764125 21485 rpcz_store.cc:276] 0709 13:08:56.563817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.563979 (+   162us) service_pool.cc:224] Handling call
0709 13:08:57.742700 (+1178721us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400276fd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:08:57.742871 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832958848}
I20260709 13:08:57.766180 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:57.765127 21643 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:08:57.749240 21490 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:57.765659 27737 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:57.696612 27719 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:57.768128 21486 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:57.740999 27725 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.770597 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.774662 21489 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:57.681768 27347 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.781185 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.782083 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.784034 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:08:57.787046 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.741811 27703 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.768281 27737 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.802260 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.770385 27670 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:08:57.808678 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.796094 27347 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:08:57.798041 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.809755 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:57.802292 27642 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:57.811832 21388 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 10 to 13, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:57.814988 27731 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:57.816273 27670 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.817030 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.806622 21636 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.818856 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.820415 21636 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:57.807099 27737 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:57.762176 27706 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.820505 21641 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:08:57.753340 27647 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.831315 21641 pending_rounds.cc:85] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 9
I20260709 13:08:57.836300 22244 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:57.854710 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:57.834029 21388 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 14, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 14 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.838243 21635 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:57.858074 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 74129.2us
I20260709 13:08:57.858485 21565 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:57.865303 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:57.866003 21637 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:08:57.838965 21641 pending_rounds.cc:107] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 19.10
W20260709 13:08:57.868654 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.868687 21641 raft_consensus.cc:2889] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:57.870008 21635 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:57.772373 27725 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:57.873224 21643 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:57.831425 27670 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:57.874154 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:57.869951 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 62093.7us
I20260709 13:08:57.880352 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:57.837862 27731 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:57.892077 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.788626 27719 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.889974 21388 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:57.894603 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:57.899171 21494 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:57.895624 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:57.889254 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:57.876122 27705 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:57.901765 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:57.923915 22246 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:57.929347 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.902328 27380 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:57.944113 27380 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:57.945142 27380 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.950971 27727 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.951478 21494 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:08:57.951635 27727 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:57.952574 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:57.953857 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:57.954387 27727 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:57.902877 27706 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:57.904927 27566 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:08:57.904068 21388 catalog_manager.cc:5697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 8, term changed from 11 to 13, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added, now has a pending config: VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129), VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130), VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131), VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 13 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:57.905718 27627 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:58.021803 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:58.007145 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:58.001606 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:58.012501 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.981207 22245 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:08:57.999044 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.001550 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:57.982275 22240 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:08:58.051071 22246 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:08:58.039850 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:58.063589 22239 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:08:58.068724 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.022912 27647 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:58.070458 27725 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:58.026213 27703 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:58.004189 27717 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.075270 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:57.955845 27718 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:58.029413 27738 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:57.925283 27670 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:58.105786 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.049157 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:58.092159 21492 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
W20260709 13:08:58.094324 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.099139 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:58.110738 22246 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:57.954643 27499 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:58.091738 22245 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:58.099968 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:58.102238 22242 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:57.920472 27705 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.056706 27627 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:58.099624 27736 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.367s	user 0.002s	sys 0.000s
I20260709 13:08:58.124083 22245 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:58.132671 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.125838 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:57.973357 27446 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.133s
W20260709 13:08:58.137673 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 159697us
I20260709 13:08:58.100431 27706 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:58.148236 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:58.149675 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 100614us
I20260709 13:08:58.131021 27627 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:58.131390 27703 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:58.013123 27731 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.171301 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:58.173538 21491 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:58.144624 27718 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:58.114223 27737 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.120746 27670 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.178056 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:58.182582 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:58.190752 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.185674 21608 leader_election.cc:400] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
I20260709 13:08:58.191807 21388 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:08:58.196923 21608 leader_election.cc:403] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:08:58.201553 22239 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:58.156337 27706 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:58.204977 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.209887 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:58.213152 27750 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:58.214689 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:58.215440 21488 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:58.215780 21488 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:08:58.223435 27747 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:58.223749 27727 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:58.224181 27727 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:58.225142 27727 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.230746 27737 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:08:58.233896 27713 consensus_meta.cc:287] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.004s
I20260709 13:08:58.234498 27713 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:58.189810 27718 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.244158 27655 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:58.244666 27655 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:58.244784 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:58.245600 27655 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.253266 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:58.253969 21642 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:58.255736 27715 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:58.256387 27715 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.258282 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.259850 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:58.260337 27422 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.260468 21490 raft_consensus.cc:2376] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10. Re-sending same reply.
I20260709 13:08:58.261116 27422 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.270646 21388 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 17, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 17 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:58.272097 27705 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:58.273638 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:58.274459 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:58.278184 27422 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.276232 27655 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:58.277220 27696 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.006s
I20260709 13:08:58.284291 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.284543 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.275072 27719 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.285797 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.282860 27718 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.287177 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.288041 21493 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:58.288985 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.289762 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.290243 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.291074 21490 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:58.277406 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:08:58.292608 27706 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.292886 27499 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:58.272112 21488 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.294516 21488 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.300344 27647 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
W20260709 13:08:58.303692 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 128440us
I20260709 13:08:58.303866 22243 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
W20260709 13:08:58.304817 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.307525 22245 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 10.
W20260709 13:08:58.315354 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.316608 21643 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
W20260709 13:08:58.345134 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.272385 21388 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 16 to 20, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 20 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:58.377828 21642 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:08:58.388635 21492 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:58.389340 21492 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:08:58.380287 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 127956us
I20260709 13:08:58.393694 22246 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
W20260709 13:08:58.390233 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 85001.1us
I20260709 13:08:58.394712 21640 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:08:58.398990 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:58.399734 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:58.399679 21637 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:08:58.408430 22238 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:58.409713 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:58.400803 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 156112us
I20260709 13:08:58.411098 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:58.348273 27723 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.418587 27723 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.421890 27723 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:58.274003 27715 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:58.438041 27670 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.443578 21643 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:08:58.445775 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.447000 21492 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.448076 21492 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:58.454695 27696 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.455295 27696 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.456835 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:58.457471 21639 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
W20260709 13:08:58.457942 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46939.3us
I20260709 13:08:58.458518 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.458721 22212 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:58.457482 27696 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.463452 27696 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:58.463822 27696 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:58.464188 27696 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.469828 21388 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.476106 21488 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:58.480535 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.488965 21492 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:58.499174 21565 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:58.494913 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:58.504323 21491 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:58.467549 27700 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:58.506660 22238 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:58.493969 27646 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:58.538272 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:58.517840 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:58.539994 21638 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:08:58.543413 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:58.549448 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:58.550182 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:58.557969 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.558168 21388 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.568250 21563 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:58.568713 21563 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:58.569391 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:58.569075 21388 catalog_manager.cc:5697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 7 to 10, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 10 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.569487 21563 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.570032 21635 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:08:58.570523 21563 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:58.572127 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:58.581073 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 374994us
W20260709 13:08:58.592279 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.599361 21388 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 15 to 16, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130), now has a pending config: VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129), VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130), VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131), VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 16 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:58.618057 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.596577 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:58.619551 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.610095 21388 catalog_manager.cc:5697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:08:58.553922 27723 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:58.628330 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:58.631528 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:58.639540 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.587103 27742 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:58.647038 21388 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 10 to 12, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 12 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.579761 27705 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.653677 22241 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
W20260709 13:08:58.714540 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 314869us
I20260709 13:08:58.698676 21388 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 16, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:58.722738 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:58.638242 27753 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 13:08:58.719058 21608 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.618s (SENT)
I20260709 13:08:58.732499 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.655799 27670 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:58.729941 22212 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:58.656471 27742 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.655956 27706 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:58.735049 21388 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 14, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 14 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.713917 27621 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:58.648612 27723 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:58.654856 27499 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
W20260709 13:08:58.773180 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 262363us
I20260709 13:08:58.772231 21388 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 15, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 15 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:08:58.781272 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.786710 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:58.748348 27670 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:58.756011 27742 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:58.723687 27705 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.761171 27713 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:58.727789 27347 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:08:58.757659 27642 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:58.791141 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64944.3us
I20260709 13:08:58.757539 27712 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:58.755362 27706 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:58.793663 21388 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 15, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 15 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.804265 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:58.805032 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.811877 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.789022 27446 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.810913 21388 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:08:58.790843 27670 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:58.777153 27621 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:58.829195 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.797094 27750 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:58.816380 27706 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:58.829674 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 157197us
I20260709 13:08:58.817662 27655 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.853305 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:58.859156 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:08:58.861672 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.862751 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:58.865515 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.830543 27713 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:58.870522 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:58.870764 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.879359 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.880075 21562 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:58.881091 21567 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:58.863472 27627 consensus_meta.cc:287] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.006s
W20260709 13:08:58.883464 21608 leader_election.cc:336] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.783s (SENT)
I20260709 13:08:58.885782 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:58.883718 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.886314 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.886897 21568 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:58.884195 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.886489 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.888187 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.888499 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.889065 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:58.889349 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:58.889932 21566 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:58.889117 21565 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:08:58.891677 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.889751 21564 raft_consensus.cc:2376] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12. Re-sending same reply.
I20260709 13:08:58.828256 27446 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.867777 27499 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:58.894035 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.894572 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:58.882290 27753 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:58.906706 27753 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:58.907070 27647 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:58.907505 27647 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:58.889914 27627 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.907902 27621 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.907810 27753 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.908385 27647 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.909390 27647 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.891185 27770 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:58.911260 27754 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:08:58.912521 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.913846 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.914390 21561 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:58.862154 27655 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.919456 27705 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:58.920285 21634 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:58.920768 27655 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.921365 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:58.922009 21564 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:58.923563 21390 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 249) took 11744 ms (client timeout 15000 ms). Trace:
I20260709 13:08:58.921418 27499 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:58.923934 21552 tablet_service.cc:1558] Processing DeleteTablet for tablet 22b45f3e8b8e428ea4709e7e9ee43868 with delete_type TABLET_DATA_TOMBSTONED (TS 5727b19579474da6a12f79730b924770 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:36498
I20260709 13:08:58.925141 27499 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.926961 27621 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:58.927074 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.927815 21562 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:08:58.927592 27621 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.928779 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:58.901968 27759 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:58.929616 21562 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 12: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:58.929801 27621 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.863754 27750 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:58.931742 27627 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.932415 27750 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:58.896524 21568 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:58.903189 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:58.935490 21569 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.937222 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:58.938921 27712 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:58.939333 27767 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
I20260709 13:08:58.851598 27723 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.930531 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.919497 21637 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:58.943331 21562 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:08:58.903110 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.923858 27446 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:58.919342 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:58.944753 21638 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:08:58.946051 21563 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:08:58.946542 21563 pending_rounds.cc:85] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 12
I20260709 13:08:58.924140 21560 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:58.947568 27696 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:58.928697 21390 rpcz_store.cc:269] 0709 13:08:47.179478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.179790 (+   312us) service_pool.cc:224] Handling call
0709 13:08:58.896026 (+11716236us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:53.380237 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:53.380910 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:53.380945 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:53.380965 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:53.403116 (+ 22151us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:53.403194 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:53.403227 (+    33us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:08:53.405003 (+  1776us) tablet.cc:701] Row locks acquired
0709 13:08:53.405025 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:53.405177 (+   152us) write_op.cc:270] Start()
0709 13:08:53.405312 (+   135us) write_op.cc:276] Timestamp: P: 1783602533405126 usec, L: 0
0709 13:08:53.405341 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:08:53.406063 (+   722us) log.cc:844] Serialized 8820 byte log entry
0709 13:08:54.609433 (+1203370us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:08:54.744227 (+134794us) op_driver.cc:464] REPLICATION: finished
0709 13:08:55.367405 (+623178us) write_op.cc:301] APPLY: starting
0709 13:08:55.373833 (+  6428us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:55.841847 (+468014us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:55.841933 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:56.596506 (+754573us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:56.596914 (+   408us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:08:56.596977 (+    63us) write_op.cc:312] APPLY: finished
0709 13:08:56.597634 (+   657us) log.cc:844] Serialized 196 byte log entry
0709 13:08:56.951891 (+354257us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.018514 (+ 66623us) write_op.cc:454] Released schema lock
0709 13:08:57.018612 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:57.083562 (+ 64950us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.089600 (+  6038us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":80906,"reported_tablets":51,"spinlock_wait_cycles":7296,"child_traces":[["op",{"apply.queue_time_us":517148,"apply.run_cpu_time_us":59706,"apply.run_wall_time_us":1677067,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95999,"num_ops":22,"prepare.queue_time_us":247157,"prepare.run_cpu_time_us":13614,"prepare.run_wall_time_us":180103,"raft.queue_time_us":30097,"raft.run_cpu_time_us":42036,"raft.run_wall_time_us":369619,"replication_time_us":1315032,"spinlock_wait_cycles":26377600,"thread_start_us":944781,"threads_started":5,"wal-append.queue_time_us":526771,"wal-append.run_cpu_time_us":26672,"wal-append.run_wall_time_us":3220326}]]}
I20260709 13:08:58.952287 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:58.952312 21563 pending_rounds.cc:107] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:08:58.953173 21563 raft_consensus.cc:2889] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:58.954842 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:58.956976 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.957685 21568 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:58.957724 21564 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:08:58.959764 22212 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:58.959861 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:58.962339 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.967855 21569 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:08:58.938374 27670 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:58.970314 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 75806.6us
W20260709 13:08:58.988379 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.989046 21569 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:08:58.989209 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.989692 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.946269 27742 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:58.972188 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:58.968519 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:58.961928 27762 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:58.992419 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:59.012897 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.001202 21457 leader_election.cc:400] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18.
I20260709 13:08:59.014436 21457 leader_election.cc:403] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:58.966596 27712 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:59.009819 21638 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:08:58.961848 27677 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 13:08:59.022102 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 138663us
I20260709 13:08:59.023826 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:58.968407 27774 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.025125 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.026759 21490 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:58.990693 27725 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:59.023962 21608 leader_election.cc:336] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.788s (SENT)
I20260709 13:08:59.037467 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:58.962087 27731 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:08:59.036099 21569 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:59.040256 21566 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:08:59.041108 27741 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:08:58.992025 27772 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.020201 27712 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.071878 27712 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.042205 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:59.072553 22241 raft_consensus.cc:1813] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
W20260709 13:08:59.072875 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49126us
I20260709 13:08:59.041458 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.073948 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.067765 27627 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:08:59.047281 22244 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 19. Ops: []
I20260709 13:08:59.081166 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:08:59.075019 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47342.7us
I20260709 13:08:59.051822 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:59.065641 27775 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18.
I20260709 13:08:59.057910 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:59.070498 27670 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:59.071072 27762 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:59.073217 22241 raft_consensus.cc:2368] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
I20260709 13:08:59.067521 27741 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:59.049636 22243 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:59.066759 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.082885 21569 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.083683 22246 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:59.084692 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:59.085673 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.094194 21637 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: [16.14-18.15]
I20260709 13:08:59.095295 21642 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:59.097203 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.102025 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:59.104619 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.105877 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:59.107774 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:59.109275 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:59.102809 21637 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:08:59.112002 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:59.047854 27696 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:59.078890 27566 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.124984 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:08:59.115597 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 91648.4us
I20260709 13:08:59.117080 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:08:59.115347 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48657.7us
I20260709 13:08:59.122067 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:59.122921 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:59.128095 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:59.128309 21635 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:59.107410 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.079507 27742 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:59.121759 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.127430 21637 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:59.101351 27715 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.130287 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.138484 21487 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:59.130594 21636 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:59.131068 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:08:59.131848 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.140136 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.131124 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:59.113687 27655 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:59.121572 27765 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:59.142901 27717 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:59.143538 27717 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:59.143664 27765 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:59.144662 27717 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.149191 21569 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:08:59.151244 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:59.101333 27741 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:59.041419 27706 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.066263 27725 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.084437 27621 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:08:59.155054 27776 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:08:59.135191 27446 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:59.160712 27774 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:59.164641 27741 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.179939 27725 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:59.180339 27741 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.124801 27772 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:59.157925 27766 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:59.114964 27775 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.166316 27696 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:59.184178 27696 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:59.185173 27696 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:59.174311 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47263.1us
I20260709 13:08:59.177467 27776 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:59.199510 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.199671 21640 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
W20260709 13:08:59.178241 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 70901.1us
I20260709 13:08:59.179065 27762 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.183027 27772 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:59.183513 27766 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:59.132202 27380 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:59.190126 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.190310 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:59.201963 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.198499 21635 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:08:59.207579 21643 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 19. Ops: []
W20260709 13:08:59.211167 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.213663 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 140189us
I20260709 13:08:59.195936 27706 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:59.220115 22238 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:08:59.195717 27776 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:59.226310 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.205878 27772 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:59.230222 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 94800.6us
I20260709 13:08:59.231259 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:59.234210 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.230898 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.198158 27725 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:08:59.222831 27380 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:59.244937 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:59.248203 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 46312.4us
I20260709 13:08:59.226589 27647 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:59.222934 27446 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.268733 22246 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:59.261916 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:08:59.266117 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.261996 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.222429 27422 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:08:59.231907 27646 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:59.273332 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:59.274127 27706 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.275565 27762 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:59.276363 27770 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:59.277194 27347 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:59.277400 27713 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:59.276886 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.254952 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:59.256345 27670 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:59.268604 27753 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:59.256412 27723 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:59.261602 27774 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:59.288750 27778 tablet_replica.cc:333] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:08:59.271736 27766 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.303812 27766 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.303501 27723 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.292323 27670 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:59.297933 27789 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:59.291872 27770 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.300212 27756 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:59.310318 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.309906 27670 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.294697 27713 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:08:59.313364 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.314469 27723 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:59.315001 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:59.294365 27347 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.316009 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:08:59.317096 27727 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:59.332347 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.288954 27776 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.291100 27647 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:08:59.312389 27741 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:59.343634 27791 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:59.289932 27762 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.346184 27762 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:59.330721 27646 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.337496 27774 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:59.347288 27774 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:59.347817 27774 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.349215 27566 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.339104 27380 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.351538 27741 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:59.352290 27741 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:59.330485 27703 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:59.355581 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:59.333956 27756 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:59.363401 27703 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:59.371172 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 100183us
I20260709 13:08:59.335335 27739 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:59.371410 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:08:59.371587 21488 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:08:59.377676 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:59.363422 27776 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:59.387939 22238 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:59.372884 27703 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.413407 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:08:59.443403 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 111135us
I20260709 13:08:59.414606 27750 consensus_queue.cc:1059] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:08:59.420768 27731 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:08:59.443840 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48779.2us
W20260709 13:08:59.435714 27785 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:08:59.436878 27713 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:59.441110 27646 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:59.373437 27621 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:08:59.421200 27782 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.150s	user 0.000s	sys 0.004s
I20260709 13:08:59.444173 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:59.446234 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:59.449556 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:59.450402 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:08:59.453374 22238 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:59.453343 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:59.455787 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:59.467993 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.430616 27347 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:08:59.368867 27712 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:59.491587 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45436.4us
I20260709 13:08:59.374698 27753 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
W20260709 13:08:59.494611 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 233303us
I20260709 13:08:59.448777 27499 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:59.506592 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:59.507767 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52024.5us
I20260709 13:08:59.509850 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:08:59.536273 21606 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.607s (SENT)
I20260709 13:08:59.537022 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.537308 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:59.543251 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:59.488332 27739 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:59.544847 22246 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:08:59.549510 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:08:59.550408 21608 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.561s (SENT)
I20260709 13:08:59.558470 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.558658 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.561828 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.562508 21493 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:59.506067 27647 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:59.504148 27422 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:59.510046 27768 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:59.566319 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.505421 27621 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:08:59.540035 27499 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:59.545894 27762 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:59.450670 27731 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.569980 21488 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:08:59.573050 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.577621 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.560263 27739 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:59.581851 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.565853 27380 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.560328 27446 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:59.577088 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.563715 27347 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:59.567494 27793 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:59.538847 27670 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.562882 27787 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:59.567260 27776 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:59.567101 27566 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:59.568480 27768 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:08:59.576846 27499 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:59.590476 21493 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:08:59.573271 27646 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.594511 27764 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:59.577299 27762 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:59.588449 27739 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:59.564285 27769 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:08:59.575907 27804 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:08:59.629490 27772 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.622408 27446 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:59.626036 27787 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:59.653002 27796 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:08:59.655429 27795 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:59.631533 27776 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:59.656651 27794 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:08:59.657040 27764 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:08:59.657985 27807 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:59.634310 27768 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.693383 27756 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:08:59.699990 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 118173us
I20260709 13:08:59.645581 27762 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.642513 27647 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:08:59.705960 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 139687us
I20260709 13:08:59.712209 21487 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:59.712769 21567 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:08:59.634075 27566 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.723960 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.702585 27787 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:59.715610 27796 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:59.738648 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:59.742121 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.747474 27715 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:59.747972 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.747995 27715 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:08:59.666889 27621 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.723129 27756 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:59.730774 27706 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.752370 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.748740 27715 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.731431 27712 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:59.733963 27789 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:59.755590 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:59.755623 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.765034 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:08:59.756356 27706 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.757257 27769 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:59.721400 27347 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:08:59.758843 21490 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:08:59.758972 27816 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:59.759250 27772 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:59.760547 27446 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:59.760043 27796 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.756593 27812 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.765437 21561 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:08:59.769766 27810 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:08:59.781522 27731 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:59.781417 27774 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.782248 27815 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:59.783209 27769 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:59.784308 27813 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:59.786516 27804 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:59.787971 27792 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:08:59.819008 27764 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.833549 27776 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:59.832360 27769 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:08:59.790585 21608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.416s (SENT) [suppressed 29 similar messages]
I20260709 13:08:59.790486 27750 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:59.791687 27756 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.792104 27566 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:59.793825 21532 leader_election.cc:400] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
I20260709 13:08:59.795318 27770 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:59.800832 27727 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:59.801661 27422 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:08:59.818554 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.806054 27809 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:08:59.800890 27386 raft_consensus.cc:1064] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:08:59.822387 27765 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:59.788527 27499 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.827575 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:59.818606 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 53643.6us
I20260709 13:08:59.844220 21561 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:08:59.875192 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:08:59.846930 21567 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:59.848805 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:08:59.875859 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.859819 21532 leader_election.cc:403] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:59.876221 21643 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.868616 27770 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:08:59.877379 27770 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.880074 27770 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:59.838522 27715 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:08:59.882251 27741 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.529s	user 0.005s	sys 0.014s
I20260709 13:08:59.848768 27778 raft_consensus.cc:2243] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.885109 27756 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:59.824286 27347 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.835294 27792 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.891969 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:08:59.898392 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 104724us
W20260709 13:08:59.899142 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 71635us
I20260709 13:08:59.882730 27741 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:08:59.862990 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 72407us
I20260709 13:08:59.865243 21565 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:59.866246 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:08:59.867197 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:59.900739 21643 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:08:59.867470 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:08:59.830482 27801 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:08:59.831432 27774 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:08:59.837888 27670 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:08:59.824384 27446 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:59.831795 27815 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:59.846005 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:08:59.919754 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:08:59.924546 21566 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:08:59.825701 27647 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:08:59.996376 21492 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:00.003556 21491 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:59.961563 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.841869 27769 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:08:59.995445 21485 pending_rounds.cc:85] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 11
I20260709 13:09:00.007957 21485 pending_rounds.cc:107] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:09:00.008354 21485 raft_consensus.cc:2889] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:00.008433 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 88772us
W20260709 13:08:59.960515 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47317us
I20260709 13:08:59.860958 27727 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:08:59.928021 21634 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:59.962805 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.009686 21489 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:08:59.967314 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:59.923192 21635 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:59.928464 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.013314 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.010263 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:08:59.928046 22212 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:08:59.928556 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.892442 27775 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:59.996850 27677 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.868422 27422 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:59.966827 27776 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:00.022502 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:59.977509 27804 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.023828 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.027101 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.037111 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:08:59.895591 27789 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.145s
I20260709 13:08:59.886571 27386 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:00.023320 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 95346.3us
I20260709 13:09:00.053829 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:00.024523 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:08:59.918174 27750 raft_consensus.cc:2706] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Received pre-election callback for term 15 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:09:00.060070 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:00.038457 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.014533 27670 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:00.041569 27815 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.065588 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.041810 27727 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.048314 21486 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:59.887514 27765 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:08:59.918370 27719 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:00.018348 21494 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:08:59.918664 27715 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:00.037181 27712 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:00.039500 27713 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:00.067368 21489 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:09:00.088634 27765 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.090345 21490 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:00.017764 27819 consensus_queue.cc:1059] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:09:00.071137 27792 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:00.055451 27804 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.072254 27646 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:00.075650 27739 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.059588 27753 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:00.087225 21638 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:00.087615 27778 raft_consensus.cc:2272] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.088234 27712 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:00.062808 27706 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.062677 27670 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.121152 27670 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.112035 27762 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.050562 27677 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.127584 27762 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:00.128748 27677 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:00.130155 27712 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.131362 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.050261 27774 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:09:00.068707 27621 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:09:00.083072 27723 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.111311 21638 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:00.119360 27696 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.137714 21489 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:09:00.118597 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:00.148823 27741 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:00.150139 27804 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.108484 27380 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:00.157810 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 100985us
I20260709 13:09:00.133600 27796 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.160290 21638 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.166765 21638 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:00.161139 27824 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.005s
I20260709 13:09:00.122488 27768 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:00.163046 27825 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.194s	user 0.000s	sys 0.005s
I20260709 13:09:00.175282 27797 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:00.200466 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 141896us
I20260709 13:09:00.198550 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:00.201916 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:00.204550 27819 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:00.208638 27719 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:00.108987 27446 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.208078 27834 raft_consensus.cc:2955] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 8 to 11, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:00.214937 21494 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:00.214964 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:00.215232 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:00.219988 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 53838.6us
W20260709 13:09:00.181782 27703 consensus_meta.cc:287] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.731s	user 0.012s	sys 0.000s
I20260709 13:09:00.224632 27762 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.225425 27762 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.231030 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:00.226928 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:00.233793 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.236794 21606 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.240478 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:00.244977 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:00.201251 27739 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:00.258668 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:00.259948 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.166288 27696 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.219347 27793 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.219178 27804 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.228852 27719 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.169153 27723 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:00.274536 27829 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:09:00.275787 27832 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:00.276623 27832 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:00.277216 27762 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:00.277500 27836 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:09:00.280262 27768 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:00.274566 27830 log.cc:927] Time spent T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:09:00.285355 21565 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:00.173132 27796 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.290493 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:00.296537 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.298113 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.262764 27713 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:00.256130 27725 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:00.227350 27380 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:09:00.268440 27765 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.234048 27703 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.245428 27772 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:09:00.246946 27815 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:09:00.310932 27818 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:00.287497 27793 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.373050 27775 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:00.377221 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 121623us
W20260709 13:09:00.392650 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.393769 21638 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:00.272460 27422 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.292867 27804 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.399080 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:00.399226 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 158876us
I20260709 13:09:00.293018 27719 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.377621 27818 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:09:00.410434 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.361905 27670 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.368377 27765 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:00.423333 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.414819 27787 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.005s
I20260709 13:09:00.411590 27818 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:00.403198 27762 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:00.397830 27713 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:09:00.448648 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.451886 27793 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.453372 27775 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.454649 27719 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:00.453402 27844 log.cc:927] Time spent T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:00.456698 27832 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:00.446938 27787 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.487905 27804 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:00.488163 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 484635us
I20260709 13:09:00.489001 27796 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.489240 27787 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.489965 27696 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.460284 27765 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:00.495159 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.496445 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.496882 27703 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:00.497702 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.499153 27670 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:00.499373 22241 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:00.460465 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.502383 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.461604 21563 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:00.502532 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.461787 27422 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.448843 27768 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:09:00.469363 27646 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:00.476313 21562 raft_consensus.cc:2393] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:09:00.486086 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.513597 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:00.517470 21560 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:00.517899 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:00.489974 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:00.527030 22245 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 LEARNER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:00.527860 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.529528 27696 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:00.474485 27762 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.533046 27762 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:00.533595 22241 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:00.534101 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:00.535265 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:00.536455 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.538007 21560 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:00.534627 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:00.525314 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:00.514662 27646 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:00.544450 27646 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.541018 27741 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:00.547248 27723 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.547497 27741 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:00.500734 27841 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:00.551656 21563 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:09:00.552811 27832 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:00.553251 27832 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:09:00.549860 27756 consensus_meta.cc:287] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.005s
I20260709 13:09:00.556283 21564 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:09:00.556746 21564 pending_rounds.cc:85] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 14
I20260709 13:09:00.557040 21564 pending_rounds.cc:107] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:09:00.557338 21564 raft_consensus.cc:2889] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:00.563385 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.444762 27819 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:09:00.569152 21487 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:00.561545 22238 raft_consensus.cc:2955] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 8 to 11, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:00.567288 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:00.550601 27499 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.534610 27719 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:00.566907 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:00.583364 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.529587 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:00.579660 21486 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:00.546432 27646 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:00.564769 27762 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:00.590581 21493 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:00.584267 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:00.576602 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:00.554091 27832 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.594483 21490 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.572743 27723 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:00.602399 21494 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:00.599112 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.581305 27725 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:00.610216 27774 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:00.610965 27712 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.607685 27499 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:09:00.607767 27739 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:00.611491 27712 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.612252 27739 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.614524 27712 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.621507 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.622440 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.629873 22244 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:00.630625 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.616693 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.632205 21494 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:00.593425 27713 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:00.565361 27796 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:09:00.572357 27812 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:09:00.603727 27621 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:00.572515 27422 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:09:00.609391 27723 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:00.630178 27670 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:09:00.617435 27741 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:00.637106 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.648162 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:00.658149 22243 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 10: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:00.587666 27719 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.638631 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.665148 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.663045 21490 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:00.671762 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.679673 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.648239 27850 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.654839 27723 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:00.642585 27621 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:00.671593 27741 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:00.647997 27703 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:00.634207 27380 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:09:00.637226 27847 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:00.689100 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.688902 27647 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:00.638834 27815 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:09:00.672866 27725 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.634595 27845 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:09:00.730751 27741 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:00.730953 27703 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.734095 27703 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.736369 27703 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:00.694214 27621 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:00.750556 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 70957.1us
I20260709 13:09:00.755563 27819 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:00.780835 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:00.754654 27725 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:00.778810 27862 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:00.697687 27739 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:00.755739 27818 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.691497 27850 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.792078 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.798547 27739 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:00.788444 27819 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:00.801905 27719 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:00.801009 27819 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.806087 27819 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:00.791985 27834 consensus_meta.cc:287] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:09:00.808099 27752 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:00.808543 27752 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:00.809423 27752 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.811101 21634 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:00.812016 27717 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:00.812469 27717 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:00.813366 27717 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.814059 27696 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:00.814452 27717 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.815656 27696 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:00.816450 27723 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.817726 27446 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:00.819121 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:00.878345 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.879554 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.791299 27703 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:00.878902 21639 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:00.824530 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:00.883811 22241 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.825513 22246 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:00.827803 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3403) took 1266 ms. Trace:
I20260709 13:09:00.829972 27850 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.830905 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:00.888211 21640 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:00.833284 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:00.833856 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 197470us
I20260709 13:09:00.889901 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:00.834563 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:00.818660 27778 ts_tablet_manager.cc:1916] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:00.835382 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:00.892145 21643 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 9.
I20260709 13:09:00.892259 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.802021 27727 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.840961 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:00.841892 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51004.5us
I20260709 13:09:00.893925 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.894760 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:00.859143 21568 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:09:00.859771 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.861620 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.885115 21635 rpcz_store.cc:276] 0709 13:08:59.562012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.562191 (+   179us) service_pool.cc:224] Handling call
0709 13:08:59.562580 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.013496 (+450916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.827565 (+814069us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540005d2d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:00.827742 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828860672}
I20260709 13:09:00.900074 21561 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:09:00.900909 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:00.905673 21561 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:00.907447 21487 raft_consensus.cc:2410] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:09:00.912294 27723 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:00.913468 27762 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:00.914872 27845 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:00.916530 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:00.917416 27621 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.917802 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:00.919064 21488 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:00.920351 21638 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:00.920271 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:00.810699 27752 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:00.921618 22244 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:00.913609 21643 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:09:00.908315 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.921618 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.925102 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.927340 21565 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:00.925449 21635 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:00.927666 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.928299 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:00.929713 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.931496 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.934697 21642 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:00.935931 27706 raft_consensus.cc:3055] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:00.936342 27706 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:00.937139 27706 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:00.938315 27706 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:00.938678 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.940469 27859 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:09:00.943795 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:00.944180 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:00.945660 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:00.945698 27566 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:00.946684 27566 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:00.947446 27422 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:00.948014 27566 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:00.950166 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:00.950766 21639 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:09:00.875890 27719 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.958891 27642 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:00.959811 27655 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:00.965449 27762 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:00.966464 21566 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:00.968986 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.881774 27446 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:00.972482 27446 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:00.974010 27446 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:00.976405 27621 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:00.978272 27853 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:09:00.979650 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.955116 22241 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:00.980774 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:00.956537 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:00.958446 21637 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:00.982615 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:00.983415 21643 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:00.979576 21568 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:09:00.982611 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:00.985875 21637 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 22: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:00.986927 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:00.951772 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:00.995769 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:00.996821 21643 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:00.996601 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:00.997291 21639 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:00.998952 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:01.000125 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:01.001941 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:01.002871 21635 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:01.004088 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:00.994765 21567 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:00.948983 27725 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:00.952500 27797 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:01.008495 21643 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 19. Ops: []
I20260709 13:09:00.948506 27566 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:01.007061 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:01.025420 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:01.010242 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:01.035290 21643 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:01.020211 27646 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.068728 21636 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:01.050977 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:01.090965 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56086.1us
I20260709 13:09:01.066741 21637 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:01.030866 27753 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:00.989537 27719 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.097105 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:01.041185 27422 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:01.043335 27750 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.092821 27725 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:01.093107 27768 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:01.057888 27863 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:01.097468 21639 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:01.112665 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:01.114729 27750 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.117309 27725 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.121345 27719 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:01.123467 27818 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:01.123508 22238 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:01.095645 27718 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:01.041456 27796 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:09:01.126219 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:01.097065 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:01.124899 27756 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:01.105027 27715 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:01.131323 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.135851 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:01.137061 27768 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.138185 27846 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:09:01.138656 21567 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:01.139569 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:01.108165 27422 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:01.145392 21641 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:01.147567 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:01.111718 27753 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:09:01.127818 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.136876 27770 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:01.136476 27772 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:01.190965 27772 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.191439 27772 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:01.196135 27725 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:01.094720 27646 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.161027 21634 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:01.170563 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.177095 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:01.168387 27834 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:01.163569 27715 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.187927 27753 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.199400 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.199518 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.201146 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:01.201359 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:01.201771 21486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
W20260709 13:09:01.202380 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 54936.6us
I20260709 13:09:01.156651 27756 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:01.219187 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.212517 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:01.125226 27566 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.174335 27422 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:01.229879 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:01.231508 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51810.7us
I20260709 13:09:01.231719 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:01.156327 27718 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.137225 27863 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.225847 27723 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.192s
I20260709 13:09:01.229688 27621 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.418069 21641 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
W20260709 13:09:01.348737 27878 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:01.400024 27380 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.328953 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.420684 27380 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.372291 27768 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:01.422086 27756 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.423147 27756 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:01.419571 21641 raft_consensus.cc:2955] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 8 to 11, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:01.259423 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:01.421270 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:01.400825 27762 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:01.377928 27778 ts_tablet_manager.cc:1929] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.8
I20260709 13:09:01.281025 27834 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:01.425417 27778 log.cc:1199] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5727b19579474da6a12f79730b924770: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/wals/22b45f3e8b8e428ea4709e7e9ee43868
I20260709 13:09:01.426304 27834 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.258225 21643 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:01.428820 21643 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:01.257730 27741 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.203380 27719 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.430122 21643 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:09:01.431051 27872 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:09:01.424997 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 165699us
I20260709 13:09:01.432156 27718 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:01.235348 27725 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:01.432463 27811 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:09:01.433058 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 201401us
I20260709 13:09:01.433718 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:01.403367 27833 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.434689 27833 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.435422 27797 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:01.436707 27833 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:01.437100 27752 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.005s
W20260709 13:09:01.378682 27874 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:01.233047 27715 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:01.318473 27792 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:01.430316 27848 consensus_queue.cc:1175] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a87bd86b86e74aa8bb61189215b73439" responder_term: 18 status { last_received { term: 17 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:01.430503 27719 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.330925 27646 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:01.422272 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.449518 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.449263 27719 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:01.427029 27778 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36498 (request call id 2) took 2509 ms. Trace:
I20260709 13:09:01.432544 21635 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:01.366020 27750 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:01.451018 27778 rpcz_store.cc:276] 0709 13:08:58.917662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.923622 (+  5960us) service_pool.cc:224] Handling call
0709 13:08:59.237706 (+314084us) ts_tablet_manager.cc:1151] Deleting tablet 22b45f3e8b8e428ea4709e7e9ee43868
0709 13:08:59.261619 (+ 23913us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:00.755197 (+1493578us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54002224d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fea4cd 00007f98ad9d534c 00007f98aeff860a 00007f98af0292d0 00007f98af00f83d 00007f98af00f7e9 00007f98af00f779 00007f98af00f741 00007f98af00e96d 000000000038f354
0709 13:09:01.326198 (+571001us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:01.377760 (+ 51562us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:01.426926 (+ 49166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":566717,"spinlock_wait_cycles":378846080,"tablet-delete.queue_time_us":298262,"thread_start_us":204418,"threads_started":1}
I20260709 13:09:01.387363 27770 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:01.443740 27811 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:01.327037 27769 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:01.328316 27875 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:09:01.453778 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:01.423413 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:01.456426 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.456652 21560 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:01.458961 27696 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:01.461925 27766 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:01.462226 27646 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:01.462409 27766 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:01.462903 27766 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:01.462806 27646 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.463150 27772 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.465131 27646 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:01.465363 27772 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:01.465767 27642 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:01.466180 27642 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.466092 27864 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:01.453058 27811 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.461809 27696 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.469465 27696 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:01.470633 27752 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:01.471220 27752 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.473300 27752 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:01.475493 21636 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:01.475726 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:01.477088 27797 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:01.478576 27797 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:01.479339 27647 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:01.479779 27647 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:01.466673 27642 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:01.462163 27723 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:01.484102 27723 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:01.484910 27723 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:01.251765 21564 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:01.460685 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:01.424023 27380 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:01.420965 21642 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 12: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:01.498636 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:01.393888 21494 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
W20260709 13:09:01.487874 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.490445 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 67088.5us
I20260709 13:09:01.502666 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:01.503710 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.503947 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:01.232694 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:01.498163 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:01.505254 21560 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:01.499548 22242 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:01.508090 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.508716 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:01.418278 27621 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.512444 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:01.511020 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:01.514465 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:01.510679 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:01.524116 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.468930 27811 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:01.524924 27380 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:09:01.532801 27380 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:01.533178 27621 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:01.525681 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:01.429059 27863 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:01.531172 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:01.507699 27719 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:01.520062 27833 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:01.557809 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.527309 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.513568 27772 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:01.568758 27719 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.576166 27719 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:01.566183 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:01.511298 27718 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:09:01.579427 27819 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:01.533200 27380 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:01.581248 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.581132 27380 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.480661 27647 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.506953 27715 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.583956 27715 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:01.584631 27715 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:01.587076 27719 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.588429 27876 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:01.589107 27696 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.589643 27876 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:01.590107 27876 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:01.590332 22241 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:01.591212 27816 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:01.573199 27717 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:09:01.595520 27725 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:01.596066 27717 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:01.596519 27717 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:01.596635 21640 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:09:01.597460 27717 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.573655 27797 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:01.599407 27797 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.600170 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:01.601387 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:01.602337 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:01.602996 27797 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:01.513362 27868 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:01.564992 27846 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:01.497463 27750 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.604009 27750 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:01.566851 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.605950 27851 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.916s	user 0.005s	sys 0.000s
W20260709 13:09:01.606354 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.534538 27776 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:01.607059 27776 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:01.607476 27776 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:01.607704 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2724) took 1198 ms. Trace:
I20260709 13:09:01.499693 27861 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:09:01.529475 27670 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:01.608791 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:01.568919 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:01.609709 21494 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:01.614841 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:01.617952 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49128.5us
I20260709 13:09:01.429704 27741 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.608100 21485 rpcz_store.cc:276] 0709 13:09:00.409562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.409710 (+   148us) service_pool.cc:224] Handling call
0709 13:09:00.410016 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.412729 (+  2713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.412777 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.413368 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.573601 (+160233us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:00.574261 (+   660us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.616597 (+ 42336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.616671 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.605349 (+988678us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:01.607408 (+  2059us) raft_consensus.cc:1685] finished
0709 13:09:01.607509 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.607649 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83656,"prepare.queue_time_us":5861,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5572,"raft.queue_time_us":76057,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":17813,"spinlock_wait_cycles":12853248,"thread_start_us":159929,"threads_started":1,"wal-append.queue_time_us":235206}
I20260709 13:09:01.616941 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:01.618804 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:01.589499 27719 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:01.623678 21638 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:01.626859 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:01.569649 27727 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:01.637540 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:01.645910 21641 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:01.648733 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.598773 27717 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:01.625617 27873 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.277s	user 0.000s	sys 0.003s
I20260709 13:09:01.665374 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:01.661135 21643 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:01.627568 27832 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:01.628086 27845 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:01.704702 27845 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:01.672849 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:01.673820 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:01.709618 21562 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:01.685163 27741 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:01.649825 27846 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.718961 21562 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:01.722440 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:01.689563 27723 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.690884 27727 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:01.692651 27642 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.697335 27696 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:01.656061 27380 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:01.619149 27766 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.658429 27446 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:01.714437 27566 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:01.706065 27845 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:01.736629 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 224990us
I20260709 13:09:01.748281 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:01.731959 21562 raft_consensus.cc:2955] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 8 to 11, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:01.751271 21486 raft_consensus.cc:606] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:01.664710 27706 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:09:01.715525 27846 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.753451 22244 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:09:01.752357 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:01.726987 27715 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:01.724795 27815 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:09:01.764829 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:01.775321 22242 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:01.745690 27727 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:01.772249 21568 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
W20260709 13:09:01.791560 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 225434us
I20260709 13:09:01.793129 21566 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:01.796068 22242 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:09:01.792486 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:01.757755 27718 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:01.804975 22212 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:01.727813 27866 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:09:01.808064 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:01.770231 27670 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:01.813937 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 299519us
I20260709 13:09:01.818169 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:01.802848 27752 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.796501 27741 raft_consensus.cc:476] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:01.668660 27876 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:01.770061 27861 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
W20260709 13:09:01.881446 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.933233 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.942699 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.939775 27816 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:01.940299 27815 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:01.919508 27752 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:01.924674 27850 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:09:02.039901 27715 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:02.055570 27846 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:02.041384 27422 consensus_meta.cc:287] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.004s
I20260709 13:09:02.034472 27899 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:09:02.056453 27723 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:01.988205 27876 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:02.006565 27772 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:02.004657 27727 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:02.099046 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.152571 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 392579us
I20260709 13:09:02.073658 27756 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:02.158648 21493 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:02.172124 21486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:02.173280 21486 raft_consensus.cc:606] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:02.173843 21486 raft_consensus.cc:614] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:02.061647 27816 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.065001 27815 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.202055 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:02.074266 27422 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:02.211735 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 289904us
I20260709 13:09:02.163060 27766 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:02.215797 27885 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.444s	user 0.001s	sys 0.001s
W20260709 13:09:02.241418 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 436539us
I20260709 13:09:02.272107 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:02.282684 27906 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:02.282961 21486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:02.283574 21486 raft_consensus.cc:606] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:02.283946 21486 raft_consensus.cc:614] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:02.285087 27898 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:09:02.287317 27895 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:09:02.289801 27903 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:02.291126 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1259) took 1105 ms. Trace:
I20260709 13:09:02.291695 21636 rpcz_store.cc:276] 0709 13:09:01.185515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.479794 (+294279us) service_pool.cc:224] Handling call
0709 13:09:01.483030 (+  3236us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:01.483714 (+   684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.483769 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:01.525336 (+ 41567us) log.cc:844] Serialized 52 byte log entry
0709 13:09:01.827796 (+302460us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:02.158170 (+330374us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.194308 (+ 36138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.194509 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.290854 (+ 96345us) raft_consensus.cc:1685] finished
0709 13:09:02.290880 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.291046 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36311,"raft.queue_time_us":36191,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":4242,"thread_start_us":528403,"threads_started":2,"wal-append.queue_time_us":697845}
I20260709 13:09:02.304185 27816 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:02.306283 27717 consensus_meta.cc:287] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
W20260709 13:09:02.240492 27890 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
I20260709 13:09:02.250406 27766 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 13:09:02.214839 27715 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:02.311825 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.242231 27899 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:09:02.316344 27832 consensus_meta.cc:287] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.000s
I20260709 13:09:02.317195 21565 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:02.320341 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36572 (request call id 1492) took 1124 ms. Trace:
I20260709 13:09:02.320801 21566 rpcz_store.cc:276] 0709 13:09:01.195461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.198162 (+  2701us) service_pool.cc:224] Handling call
0709 13:09:02.320075 (+1121913us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54001e0354. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:02.320233 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284742656}
I20260709 13:09:02.314612 27899 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:02.323311 27899 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:02.325443 21567 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:02.341159 27866 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:02.341038 27762 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:02.342130 27642 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.341811 27866 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.325922 27753 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.324371 27899 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.330623 27868 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:09:02.380811 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.344830 27717 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:02.342149 27762 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.379791 27753 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.348114 27750 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:02.416095 21568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.002s	sys 0.023s
W20260709 13:09:02.416731 21568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.002s	sys 0.023s
I20260709 13:09:02.373543 27347 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:09:02.418198 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 194635us
W20260709 13:09:02.423002 22210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.000s	sys 0.027s
W20260709 13:09:02.425624 22210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.000s	sys 0.028s
W20260709 13:09:02.426456 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 608331us
W20260709 13:09:02.432286 22213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.024s	sys 0.046s
W20260709 13:09:02.432711 22213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.025s	sys 0.046s
I20260709 13:09:02.406929 27868 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:02.433238 27380 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.688s	user 0.014s	sys 0.000s
I20260709 13:09:02.406158 27717 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.427544 27899 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:02.439795 27762 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:02.457275 27770 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.464816 27812 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.465374 27792 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:02.465830 27752 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:02.451176 27914 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:09:02.467262 27765 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:09:02.467772 27566 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.715s	user 0.012s	sys 0.000s
I20260709 13:09:02.422960 27347 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.495272 27792 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.504951 27792 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.502720 27347 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:02.441457 27772 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:09:02.487335 27762 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:02.511847 27772 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:02.511670 27762 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.512508 27772 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:02.485989 27380 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:02.498588 27776 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.891s	user 0.017s	sys 0.000s
W20260709 13:09:02.499490 27910 log.cc:927] Time spent T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:02.495661 27765 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:02.526341 27765 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.527699 27765 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:02.518927 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1263) took 1332 ms. Trace:
I20260709 13:09:02.531088 21634 rpcz_store.cc:276] 0709 13:09:01.186777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.506107 (+319330us) service_pool.cc:224] Handling call
0709 13:09:01.506355 (+   248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.566913 (+ 60558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.566966 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.567456 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.837023 (+269567us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:01.837082 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.837180 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.518570 (+681390us) raft_consensus.cc:1685] finished
0709 13:09:02.518602 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.518835 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60220,"raft.queue_time_us":62011,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2113,"thread_start_us":269279,"threads_started":1,"wal-append.queue_time_us":778981}
I20260709 13:09:02.513777 27772 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.522560 27776 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.533632 27756 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:02.534185 27756 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:02.534579 27776 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.492182 27812 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.535905 27772 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:02.536162 21490 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:02.537719 27812 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.489624 27770 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.540984 27770 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:02.541791 27888 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:09:02.543361 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3428) took 1404 ms. Trace:
I20260709 13:09:02.543774 21643 rpcz_store.cc:276] 0709 13:09:01.141704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.431270 (+289566us) service_pool.cc:224] Handling call
0709 13:09:01.431518 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.666504 (+234986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.543114 (+876610us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54000bcf54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:02.543295 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527391104}
I20260709 13:09:02.547042 27718 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:02.547906 27718 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.552258 27718 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.517376 27762 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:02.547107 27422 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.564015 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1038) took 1088 ms. Trace:
I20260709 13:09:02.571889 27861 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:02.572598 27861 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.573087 27861 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:02.580389 22245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1043) took 1097 ms. Trace:
W20260709 13:09:02.582415 27892 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.531s	user 0.000s	sys 0.005s
I20260709 13:09:02.581035 22245 rpcz_store.cc:276] 0709 13:09:01.482903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.484243 (+  1340us) service_pool.cc:224] Handling call
0709 13:09:01.484545 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.484751 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:01.749877 (+265126us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.579831 (+829954us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.579917 (+    86us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:02.580001 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.580101 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.580286 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":507774,"prepare.queue_time_us":657883,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2001,"thread_start_us":586466,"threads_started":2,"wal-append.queue_time_us":688799}
I20260709 13:09:02.583017 27723 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:02.587325 27677 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:02.531311 22241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1041) took 1050 ms. Trace:
I20260709 13:09:02.621693 22241 rpcz_store.cc:276] 0709 13:09:01.480967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.481159 (+   192us) service_pool.cc:224] Handling call
0709 13:09:01.481463 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.590849 (+109386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.531055 (+940206us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54000d0554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:02.531255 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249873280}
I20260709 13:09:02.622649 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.623654 21643 raft_consensus.cc:2410] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:02.624316 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:02.564636 22246 rpcz_store.cc:276] 0709 13:09:01.475408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.475656 (+   248us) service_pool.cc:224] Handling call
0709 13:09:01.476115 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.476624 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:01.772493 (+295869us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.563275 (+790782us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b180039bf20. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:09:02.563493 (+   218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.563570 (+    77us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:02.563638 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.563745 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.563920 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6237,"prepare.queue_time_us":557605,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":4669696,"thread_start_us":556579,"threads_started":2,"wal-append.queue_time_us":695744}
I20260709 13:09:02.627032 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.627705 21641 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:02.629142 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:02.629762 21634 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:02.603881 27762 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.626590 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:02.632213 27862 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:02.637094 27862 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.639551 27862 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:02.640429 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.641047 21636 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
W20260709 13:09:02.646853 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 217027us
W20260709 13:09:02.647892 27916 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:09:02.648290 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:02.649048 27642 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:02.649525 27642 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:02.649822 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:02.628643 27770 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.652150 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3408) took 1741 ms. Trace:
I20260709 13:09:02.652375 27770 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.653451 27923 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:02.654016 27923 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.621876 27815 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.621249 27347 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:02.626909 27713 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.652451 27719 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:02.591634 27380 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.646317 27753 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:02.654743 27770 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:02.655776 27868 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:02.655886 22244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1039) took 1178 ms. Trace:
I20260709 13:09:02.656162 27815 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.652902 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1040) took 1174 ms. Trace:
I20260709 13:09:02.668527 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:02.656257 27923 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.650404 27642 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.669436 21642 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:02.657642 27908 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:09:02.659507 27347 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.658929 27835 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.659797 27717 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:02.672204 27835 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.662104 27762 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.659652 27866 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:02.663087 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.662591 27713 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.675432 21636 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 10.
I20260709 13:09:02.676945 27813 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:02.677657 27813 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.663762 27719 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.678596 27719 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:02.652595 21639 rpcz_store.cc:276] 0709 13:09:00.911130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.137372 (+226242us) service_pool.cc:224] Handling call
0709 13:09:01.151971 (+ 14599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.279046 (+127075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.279085 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.318510 (+ 39425us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.618462 (+299952us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:01.618502 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.651757 (+1033255us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b54001149d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:02.651805 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.651855 (+    50us) raft_consensus.cc:1685] finished
0709 13:09:02.651870 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.652090 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4171,"raft.queue_time_us":148,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":31055,"spinlock_wait_cycles":197622656,"thread_start_us":288829,"threads_started":1,"wal-append.queue_time_us":401855}
W20260709 13:09:02.663371 27833 consensus_meta.cc:287] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.054s	user 0.013s	sys 0.002s
I20260709 13:09:02.683787 27833 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:02.684231 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.685068 22245 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:02.659543 21634 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:02.689684 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:02.691080 21640 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:09:02.693552 27725 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.694619 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:02.694293 27725 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.695299 21639 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:02.668853 22238 rpcz_store.cc:276] 0709 13:09:01.478255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.478416 (+   161us) service_pool.cc:224] Handling call
0709 13:09:01.478700 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.479060 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.479093 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.479585 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.755256 (+275671us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:01.755313 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.755403 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.582032 (+826629us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b24003367b8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6d7b9c4 00007f98a6d79acb 00007f98a6f34dc9 00007f98a6f34a55 00007f98a6f3409d 00007f98a9b6610e 00007f98a9b7d88c 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221
0709 13:09:02.652612 (+ 70580us) raft_consensus.cc:1685] finished
0709 13:09:02.652635 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.652833 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1040,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":160,"spinlock_wait_cycles":29437312,"thread_start_us":275275,"threads_started":1,"wal-append.queue_time_us":571162}
I20260709 13:09:02.697347 27725 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:02.695314 27866 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:02.668682 27815 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.698740 27866 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:09:02.699807 27762 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:02.700793 27815 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.668457 22244 rpcz_store.cc:276] 0709 13:09:01.477673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.499769 (+ 22096us) service_pool.cc:224] Handling call
0709 13:09:01.500225 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.765735 (+265510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.655630 (+889895us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54005fdcd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:02.655823 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581565184}
I20260709 13:09:02.703513 27813 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.703866 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:02.704537 21634 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:02.704831 27647 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:02.710098 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:02.710768 21635 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:02.719556 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:02.722252 21634 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:09:02.723430 21635 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:09:02.724529 27833 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.725250 27923 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:02.727692 27813 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:02.728865 27815 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:02.728981 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:02.729907 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:02.730572 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.782212 21564 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:02.731279 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.732123 27864 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:02.732260 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:02.735283 27861 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.728075 27719 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.737797 27789 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:02.739667 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:02.749879 21565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 2788) took 1820 ms (client timeout 1964 ms). Trace:
I20260709 13:09:02.665982 27380 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:02.710992 27713 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:02.790022 21565 rpcz_store.cc:269] 0709 13:09:00.929283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.933709 (+  4426us) service_pool.cc:224] Handling call
0709 13:09:02.749485 (+1815776us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003ea654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:02.749653 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3071834496}
I20260709 13:09:02.768369 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:02.795408 27835 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.795987 27861 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.791175 27815 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.796908 27864 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:02.798272 27815 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:02.789489 27923 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.800292 27719 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:02.800999 22246 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:02.739909 21642 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:02.801723 27923 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.791329 27813 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.804395 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:02.804764 27813 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:02.805145 21563 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:02.781255 27846 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:02.805718 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.806136 27846 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.806629 21564 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:09:02.808343 27846 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:02.791661 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52060.6us
I20260709 13:09:02.740562 27850 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:02.815400 21566 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:09:02.815761 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.816645 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.819375 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.820500 21564 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:02.822074 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.822106 21639 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:09:02.822513 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.823000 21569 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:02.823300 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:02.823853 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 55597.8us
I20260709 13:09:02.823889 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.824870 21569 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:02.827023 27850 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.788384 27833 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.828306 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.828787 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:02.829280 27850 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:02.829389 27833 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.829878 21560 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:02.829715 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:02.826567 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.833501 21642 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:09:02.800139 27756 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.831247 21569 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:09:02.839174 21634 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:09:02.849653 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.850179 22244 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:02.823407 21564 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:02.838583 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.851666 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:02.850724 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.852161 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:02.853047 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.870070 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:02.871971 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.822520 27380 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:02.853739 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.854099 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.872701 22241 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:02.849740 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:02.873694 21565 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:02.857290 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.858724 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.859458 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:02.860162 21486 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:02.858716 21493 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: []
W20260709 13:09:02.827080 27876 consensus_meta.cc:287] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.730s	user 0.003s	sys 0.011s
I20260709 13:09:02.872027 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.857720 21563 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:02.876220 22245 raft_consensus.cc:2393] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:02.853791 27725 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.878738 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.880822 21485 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:02.882869 21489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:02.883224 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.883493 21489 raft_consensus.cc:606] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:02.883527 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:02.883935 21489 raft_consensus.cc:614] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:02.885257 21640 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:02.887286 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.888092 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.888862 22245 raft_consensus.cc:2368] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:09:02.868554 27923 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:02.892992 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.890424 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.893365 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.893723 21490 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:02.893965 21639 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:02.894764 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.868985 27696 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:02.860934 27896 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:02.893051 21567 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:09:02.895448 21490 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
W20260709 13:09:02.899195 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.887156 27813 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.895251 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.903160 21639 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:02.904275 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:02.904407 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.904877 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.898761 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:02.906032 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:02.906808 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.907150 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.907768 21490 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:02.878074 27930 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:02.880628 27931 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:02.913091 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.890147 27621 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:02.909086 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:02.888180 27770 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:02.888671 27833 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:02.913347 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.916393 21487 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:09:02.911307 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.914659 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.917586 21492 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:02.918423 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.918983 21492 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:09:02.919742 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.920717 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.921665 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.922175 21492 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:02.888614 27347 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:02.925866 27928 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:09:02.910422 27899 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:09:02.929239 21493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:02.929916 21493 raft_consensus.cc:606] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:02.915230 27896 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:02.931559 27896 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.931955 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.935500 27833 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.936044 27833 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.937798 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:02.909647 27696 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:02.941138 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:02.912388 27930 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.942390 27772 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:02.943332 27772 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:02.943276 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.910113 27769 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.943804 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.944242 27769 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.944628 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.944715 21494 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:02.945712 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.946002 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.890132 27868 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:09:02.946403 27769 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:02.912143 27813 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.946933 27931 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.886755 27725 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:02.961181 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.961802 21489 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:09:02.934459 27909 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:09:02.971771 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.941045 27696 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:02.949167 27868 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:02.935555 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:02.910948 27923 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:02.950312 27770 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:02.942438 27930 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:02.915162 27765 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:02.953581 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.994923 27765 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.995147 21487 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:02.995388 27765 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:02.996193 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:02.997347 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.997911 21487 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:09:02.963164 27713 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:02.999010 27713 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.999331 27713 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.999688 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:03.003515 27917 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:03.004036 27917 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:03.004220 27725 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:02.954612 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46697.1us
I20260709 13:09:02.946434 21488 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:02.956072 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47065.5us
I20260709 13:09:02.988446 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.938706 21564 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:03.006899 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:02.957161 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.007769 21490 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:02.958134 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.958292 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.958820 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.962620 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.963917 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:02.998660 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:02.957484 21606 leader_election.cc:400] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:09:02.915324 27927 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:02.943809 27772 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:02.986997 21639 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:02.988507 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:03.011420 21487 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:03.023315 27718 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:03.028769 27718 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:03.024145 27386 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:03.029624 27386 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:03.029516 27446 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:03.030462 27446 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:03.021075 27621 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:03.031808 27446 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:03.031687 27621 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.032611 27815 raft_consensus.cc:3055] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:03.032979 27815 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:03.033776 27815 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.035175 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 1504) took 1267 ms. Trace:
I20260709 13:09:03.035552 21568 rpcz_store.cc:276] 0709 13:09:01.767497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.803031 (+ 35534us) service_pool.cc:224] Handling call
0709 13:09:01.803460 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.418817 (+615357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.418883 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.548259 (+129376us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b2c00010da8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:09:02.548788 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.860653 (+311865us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:02.860699 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.860766 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.034870 (+174104us) raft_consensus.cc:1685] finished
0709 13:09:03.034890 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.035113 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8618,"raft.queue_time_us":9368,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":10544384,"thread_start_us":917226,"threads_started":2,"wal-append.queue_time_us":479805}
W20260709 13:09:03.038371 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.019511 21606 leader_election.cc:403] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:03.032194 27446 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:03.011323 21489 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:03.028463 27769 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:02.967456 27766 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:03.041559 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:03.042655 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:03.040903 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:03.044400 21492 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:03.045868 21488 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:03.047967 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 90570.7us
I20260709 13:09:02.985347 27868 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:03.049158 21565 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:09:03.057492 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:02.987273 27862 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:03.069316 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:03.029218 27718 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:03.021615 27927 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:03.030568 27386 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.061549 27762 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:03.103134 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.063202 27815 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:03.093334 27876 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:03.095800 27753 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:03.062618 27832 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:03.135349 27386 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:03.068042 27380 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.098284 27769 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:03.025053 27770 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.099627 27813 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:03.091652 27717 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
W20260709 13:09:03.146726 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 105927us
I20260709 13:09:03.156474 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.157202 21569 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:03.122740 27927 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:03.152730 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.156860 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:03.101584 27866 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:03.158839 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.162252 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:03.161296 21569 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:03.133426 27876 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:03.140811 27753 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.067274 27766 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.140692 27756 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:03.119563 27862 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.169090 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.099980 27772 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:03.199658 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 134524us
I20260709 13:09:03.181201 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:03.165002 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.060611 27917 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:03.170917 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 108849us
I20260709 13:09:03.099225 27446 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.222736 21636 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:03.183564 27725 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.184819 27866 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.224380 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:09:03.229233 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 107656us
I20260709 13:09:03.153440 27832 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.158479 27380 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.233826 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:03.225507 27926 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.481s	user 0.003s	sys 0.000s
I20260709 13:09:03.198158 27753 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:03.232904 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:03.167186 27776 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:09:03.098402 27923 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:03.262250 27934 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.142s	user 0.001s	sys 0.001s
I20260709 13:09:03.235370 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:03.225734 27938 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
W20260709 13:09:03.265098 27904 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.825s	user 0.003s	sys 0.003s
I20260709 13:09:03.239696 21636 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 21: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:03.148120 27868 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.265830 27846 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.266594 27868 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:03.268000 27347 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.268476 27347 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:03.268874 27347 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.271030 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:03.271346 27939 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:09:03.272099 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3938) took 1639 ms. Trace:
I20260709 13:09:03.273103 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.273788 21643 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:03.275000 27868 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:03.275741 27868 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:03.276211 27868 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.277518 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.278452 27868 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:03.280468 27770 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:03.281448 21638 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:09:03.284582 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.285720 21640 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:03.225975 27942 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:03.272507 21561 rpcz_store.cc:276] 0709 13:09:01.632989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.635965 (+  2976us) service_pool.cc:224] Handling call
0709 13:09:01.636298 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.652360 (+ 16062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.652389 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.664498 (+ 12109us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.067724 (+403226us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:02.067761 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.067827 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.161806 (+1093979us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:03.271757 (+109951us) raft_consensus.cc:1685] finished
0709 13:09:03.271798 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.272037 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15688,"raft.queue_time_us":16260,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":10429,"spinlock_wait_cycles":35021696,"thread_start_us":335860,"threads_started":1,"wal-append.queue_time_us":700264}
I20260709 13:09:03.225847 27929 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:03.234520 27940 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:03.329110 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 148078us
I20260709 13:09:03.197872 27930 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.232596 27756 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:03.294057 27753 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:03.336624 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 176245us
I20260709 13:09:03.335767 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:03.234642 27769 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:09:03.232321 27924 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.289s
I20260709 13:09:03.303066 27929 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.236052 27725 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.238379 27866 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.302300 27931 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:03.335685 27940 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:03.329222 27835 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:03.348551 27723 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:03.346837 27948 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:03.366689 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:03.251281 27876 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.373504 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:03.362542 27940 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:03.359525 27929 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:03.365103 27931 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:03.389724 21457 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:03.390272 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 154981us
I20260709 13:09:03.347045 27756 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.391050 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:03.328981 27942 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.391754 22212 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:03.433907 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:03.398231 27566 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:03.401242 27446 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:03.439831 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 50182.5us
I20260709 13:09:03.455022 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:03.405184 27769 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:03.407044 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.408725 27922 raft_consensus.cc:2955] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:03.431675 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.437223 27347 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.437844 27953 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.470914 27962 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:03.472043 27753 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:03.534127 27962 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.472616 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:03.536137 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 63586.3us
I20260709 13:09:03.536872 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:03.473268 27955 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:03.449071 27566 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:03.463838 27846 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:03.491629 27380 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:03.394078 27945 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:03.545774 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 89587.1us
I20260709 13:09:03.504987 27756 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:03.507087 27739 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.508244 27930 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:03.389017 27951 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:03.557173 27951 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.559782 27725 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:03.559979 27951 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:03.511132 27832 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:03.374878 27948 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.541234 27766 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:03.562244 27772 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:03.562687 27948 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:03.511986 27924 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:03.563678 27924 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.564139 27924 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:03.565975 27718 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.375499 27723 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.567981 27866 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:03.391556 27899 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:09:03.516093 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 140317us
I20260709 13:09:03.367720 27835 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:03.521479 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 130493us
I20260709 13:09:03.575834 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:03.432114 27862 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:03.528581 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 93187.3us
I20260709 13:09:03.530810 27946 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:03.530920 27959 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:03.532950 27347 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:03.533581 21643 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:03.438889 27876 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:03.476936 27942 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:03.540133 27647 consensus_meta.cc:287] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.835s	user 0.008s	sys 0.001s
W20260709 13:09:03.487673 27952 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:09:03.537220 27833 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.003s
I20260709 13:09:03.528620 27621 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:03.554085 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.551136 27945 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.638515 27945 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:03.580407 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.582175 21634 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:03.547402 27715 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:03.640511 27715 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.640924 27715 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:03.586334 27948 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:03.643242 27948 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:03.643631 27948 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:09:03.644838 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 115699us
I20260709 13:09:03.644528 27948 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.645851 27948 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:03.646420 27946 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:03.588740 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.589540 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:03.673708 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 84265.2us
I20260709 13:09:03.675475 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:03.593456 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.676450 21642 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:03.595883 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.603487 21560 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:03.606879 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:03.607826 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:03.609315 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:03.680291 22238 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:03.609835 27741 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.606513 21561 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:03.609781 27833 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.682410 21494 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:03.683456 27833 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:03.609858 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:03.614029 27762 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12.
I20260709 13:09:03.615569 27962 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:03.584839 27967 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:03.576591 27846 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:03.714986 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:03.620234 27713 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.620s	user 0.002s	sys 0.008s
I20260709 13:09:03.621695 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.569356 27739 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.624019 27723 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:03.624794 27835 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:03.626961 27765 consensus_meta.cc:287] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.000s
I20260709 13:09:03.586656 27899 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:03.651141 27929 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.653954 27715 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.657374 27772 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:03.658970 27621 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:03.662169 21562 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:03.662071 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:03.662885 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.751874 22243 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:03.664237 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:03.665658 27940 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.670666 21641 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:03.683550 21642 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:03.720382 27945 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:03.690739 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:03.690775 21568 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 16: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:09:03.715716 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 169485us
I20260709 13:09:03.733778 21635 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
W20260709 13:09:03.711964 27815 consensus_meta.cc:287] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.569s	user 0.000s	sys 0.012s
I20260709 13:09:03.730659 21561 raft_consensus.cc:2955] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:03.763981 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 73368.4us
I20260709 13:09:03.713131 27923 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:09:03.713143 27832 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:03.686102 27969 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.594332 27566 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.758399 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:03.784935 21562 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:03.777076 21569 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:03.783259 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:03.760629 21494 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:09:03.786247 21494 pending_rounds.cc:85] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 15
I20260709 13:09:03.786525 21494 pending_rounds.cc:107] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:09:03.786757 21494 raft_consensus.cc:2889] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:03.787025 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:03.761058 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.789624 27762 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:03.790215 27762 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:03.790678 27762 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:03.766155 27846 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.791850 27940 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:03.791563 27846 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.792579 22245 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:03.794312 27927 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 13:09:03.765573 27723 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:09:03.771704 27832 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:03.795687 27832 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:03.771485 27876 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:09:03.746407 27765 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.764024 21568 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:03.799606 27765 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:03.791589 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.711122 27959 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:09:03.799609 27718 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:03.769769 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.770008 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.725847 27713 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.765570 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:03.805440 27713 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:03.806334 21637 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:03.807772 21642 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:03.746300 27835 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.759985 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.790606 27769 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:03.748054 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:03.800489 21491 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:03.710404 27741 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.808254 21485 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:03.773255 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.810546 21636 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:09:03.813480 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:03.814879 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:03.810683 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.761726 27945 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.818925 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.876684 27715 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:03.846092 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:03.807178 22246 raft_consensus.cc:2955] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:03.852982 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 79294.1us
I20260709 13:09:03.933653 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:03.934290 21492 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:03.935412 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 120684us
I20260709 13:09:03.936717 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:03.937670 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.885996 21642 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:03.940405 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:03.875624 27850 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.843168 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.850111 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:03.941598 21486 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:03.942126 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:03.942906 21493 raft_consensus.cc:2368] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16.
I20260709 13:09:03.887118 27446 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.942982 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.943302 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:03.942487 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.944000 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:03.864640 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:03.831568 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.874667 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.769701 27967 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.848264 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.844136 22243 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:03.845908 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:03.958039 22244 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:03.909873 21562 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:03.879009 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:03.958204 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.925833 21636 pending_rounds.cc:85] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 8
I20260709 13:09:03.959317 21636 pending_rounds.cc:107] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:09:03.959339 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.959681 21636 raft_consensus.cc:2889] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:03.959973 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:03.926440 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 113044us
I20260709 13:09:03.819548 27959 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:03.960749 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:03.794308 27846 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:03.955693 21492 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:03.841614 27713 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.927438 27718 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.931486 27945 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:03.949553 27832 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.951573 22238 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 16: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:03.980204 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.901738 27566 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.955724 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.849058 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.981199 21490 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:03.981630 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.814230 27927 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.961596 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:03.964082 22240 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:09:03.966145 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.887423 27769 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.967779 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.932416 27647 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:03.968818 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:04.003684 21562 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:03.969041 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:03.946365 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 81864.6us
I20260709 13:09:04.004495 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:03.844164 27835 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.966845 21640 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:03.974043 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:03.962747 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:04.010473 21489 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:03.976199 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:03.946389 21638 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:03.772436 27621 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:03.975090 27947 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:03.961424 21487 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:09:03.952751 27347 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:03.952085 27955 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.023214 27835 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.022987 27955 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.025533 27955 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.025826 27832 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.026871 27725 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:04.027016 21488 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:04.027426 27725 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.027935 27725 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:04.028174 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:04.028870 21638 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:04.012202 27815 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:04.029800 27815 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:04.029868 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:04.030915 27815 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.010656 27713 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.032125 27713 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.032533 27713 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.033830 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.952394 27850 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:03.911473 27899 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.038368 21494 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:03.971818 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:03.993079 21493 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:09:03.999344 27971 log.cc:927] Time spent T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:09:03.999778 27739 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:04.001142 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.961302 27772 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:04.042739 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 70986.7us
I20260709 13:09:04.043571 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:04.044263 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:04.004990 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:04.005944 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:04.005813 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:04.044996 21638 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:04.046099 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:04.046424 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:04.048071 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3444) took 1124 ms. Trace:
I20260709 13:09:04.040730 22243 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:03.963240 27446 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.015154 27967 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.962025 27862 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:04.013967 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:04.014601 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:03.967502 27959 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:04.014919 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:04.016444 21642 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:03.977900 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:04.001230 27929 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.034523 21567 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:04.040529 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:03.973067 27969 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:09:04.007090 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:04.055984 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 50073.3us
I20260709 13:09:04.048489 21637 rpcz_store.cc:276] 0709 13:09:02.923832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.270674 (+346842us) service_pool.cc:224] Handling call
0709 13:09:04.047884 (+777210us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b540024ead4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:04.048016 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229040896}
I20260709 13:09:04.071545 21562 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:04.063999 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:03.979859 27718 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:04.068572 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 53787.9us
I20260709 13:09:04.072700 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:04.073537 21608 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:04.074774 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:04.053627 27947 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:04.080590 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:04.078606 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:04.135604 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55127.9us
I20260709 13:09:04.132443 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:04.132344 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 59341.2us
I20260709 13:09:04.137507 21569 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:04.062577 27862 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.008860 27924 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:04.058578 27968 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:04.058688 27876 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.065100 27739 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:04.140971 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:04.067828 27959 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.165205 21642 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:04.079133 27930 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.179667 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:04.134553 27347 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.182020 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:04.182825 21565 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:04.079367 27927 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:04.191391 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 112872us
I20260709 13:09:04.131019 27866 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:04.191859 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:04.145840 27862 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:04.144531 27647 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:04.118741 27948 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:04.210053 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:04.213486 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:04.138852 27756 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:09:04.140923 27929 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:09:04.138530 27835 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:09:04.065335 27967 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:04.194341 27980 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:09:04.293180 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 288250us
I20260709 13:09:04.331082 21565 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.331676 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:04.332624 21562 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:04.218708 21489 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:04.338356 21569 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:04.203732 27833 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:04.196252 27866 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:04.284438 27982 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:09:04.354116 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:04.359913 21494 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:09:04.360322 21494 pending_rounds.cc:85] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 11
I20260709 13:09:04.360561 21494 pending_rounds.cc:107] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:09:04.360836 21494 raft_consensus.cc:2889] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:04.212448 27927 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:04.316216 27850 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.308813 27769 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.333504 27948 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.331938 27647 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.355329 27846 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:04.214922 27347 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.144s
I20260709 13:09:04.220781 27723 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.148s
I20260709 13:09:04.356926 27446 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.255630 27762 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:04.358837 27866 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:04.384753 21565 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:04.410360 21564 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:04.366472 27967 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.367136 27718 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.382999 27647 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:04.405943 27985 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:09:04.387192 27974 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:04.382751 27948 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:04.434909 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 293999us
I20260709 13:09:04.377246 27833 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:04.443590 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 305803us
I20260709 13:09:04.411249 27930 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.373903 27927 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.440527 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:04.450688 21606 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:04.466219 21606 leader_election.cc:400] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16.
I20260709 13:09:04.468091 21606 leader_election.cc:403] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:04.473455 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1281) took 1029 ms. Trace:
I20260709 13:09:04.474195 21641 rpcz_store.cc:276] 0709 13:09:03.444020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.445205 (+  1185us) service_pool.cc:224] Handling call
0709 13:09:03.447930 (+  2725us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800187b98. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6ebdb71 00007f98a6ebda22 00007f98afdd6c09 00007f98aef30ee0 00007f98aeffa0ab 00007f98aeffa131 00007f98aefbbfc0 00007f98aefa6929 00007f98aefa63d2 00007f98a851dbd4
0709 13:09:03.670475 (+222545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.757071 (+ 86596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.473150 (+716079us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54002648d0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:04.473373 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514067712}
I20260709 13:09:04.456943 27718 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:04.500051 27945 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:04.501442 21639 raft_consensus.cc:2368] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17.
I20260709 13:09:04.506332 27947 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:04.506758 27947 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:04.507576 27947 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.508556 27947 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.516207 27927 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:04.517526 27927 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:04.518004 27927 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.518374 27927 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.451263 27739 consensus_queue.cc:1059] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:09:04.466709 27955 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:04.455101 27930 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:04.523025 21491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 2740) took 1610 ms (client timeout 1809 ms). Trace:
W20260709 13:09:04.558836 21491 rpcz_store.cc:269] 0709 13:09:02.912727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.912855 (+   128us) service_pool.cc:224] Handling call
0709 13:09:04.522702 (+1609847us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b54002765d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:04.522936 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2038628224}
W20260709 13:09:04.559753 22246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.020s	sys 0.010s
W20260709 13:09:04.557864 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 94650.2us
W20260709 13:09:04.523483 21635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1277) took 1568 ms (client timeout 2015 ms). Trace:
W20260709 13:09:04.562685 21635 rpcz_store.cc:269] 0709 13:09:02.955297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.162001 (+206704us) service_pool.cc:224] Handling call
0709 13:09:04.523272 (+1361271us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b540009b354. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:04.523412 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261483776}
W20260709 13:09:04.540184 27725 consensus_meta.cc:287] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
W20260709 13:09:04.560247 22246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.020s	sys 0.010s
W20260709 13:09:04.528389 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.524343 27987 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:04.547791 27741 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:04.538036 27739 raft_consensus.cc:3055] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:04.559571 27876 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.574030 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:04.535187 27924 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:04.544071 27955 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:04.567112 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 285442us
I20260709 13:09:04.579645 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:04.575807 21642 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:09:04.567830 27953 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:04.521363 27983 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260709 13:09:04.577589 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:04.599352 27953 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:04.600330 21640 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:04.544970 27762 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:04.566169 27725 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.602025 21638 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:04.602250 27953 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:04.602766 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:04.538518 27833 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.595647 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:04.597494 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:04.604120 27988 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
I20260709 13:09:04.604489 21634 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:04.605130 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:04.576962 27713 consensus_meta.cc:287] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.001s
I20260709 13:09:04.606165 27713 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.606639 21634 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:04.572635 21635 raft_consensus.cc:2955] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:04.559792 27846 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:09:04.547528 27930 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:04.571667 27739 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:04.610097 27739 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.591562 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:04.603096 27725 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:04.611649 27968 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.612143 27924 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.613125 27862 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.604157 21641 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:04.523556 27947 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.631168 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:04.632525 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:04.634776 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:04.635615 21491 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
W20260709 13:09:04.623656 27984 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:09:04.649525 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:04.649643 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:04.650259 21560 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:04.650982 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:04.621925 27966 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:09:04.652247 21635 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:04.616557 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:04.642586 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:04.646916 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:04.648804 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:04.653293 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:04.669924 21491 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:04.657088 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:04.657660 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:04.669965 21567 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:04.671017 21485 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:04.661608 27955 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.623469 27948 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.672286 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:04.672781 27955 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:04.672914 21634 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:04.673944 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:04.674024 27948 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.659246 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:04.675244 21490 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:04.676110 27647 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.658443 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:04.651410 27725 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:04.679337 21640 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:04.679437 27725 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.674597 21634 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:04.652956 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:04.661026 21639 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:09:04.682211 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 65779.9us
I20260709 13:09:04.682921 21560 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:04.649480 27739 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:04.646934 27718 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:04.624907 27946 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:09:04.647516 27930 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:04.706353 27981 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.637s	user 0.000s	sys 0.003s
I20260709 13:09:04.680712 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:04.708081 27992 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.708204 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:04.708612 27992 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.709540 27756 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:04.710064 27756 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:04.711309 27815 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:04.710995 27756 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.691884 27862 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:04.693027 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:04.737710 21634 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:04.694490 27923 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.698360 27832 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:04.640993 27924 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:04.698583 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:04.742357 21640 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:04.688525 27647 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:04.618016 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 54558.5us
I20260709 13:09:04.748857 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:04.683091 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:04.713591 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:04.717554 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:04.720438 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:04.721385 21638 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 13:09:04.751253 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 68249.3us
I20260709 13:09:04.751456 21564 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:04.752120 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:04.728331 27969 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.679956 27725 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:04.740087 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:04.686043 21490 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:04.723115 27713 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:04.753815 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:04.711711 27815 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:04.719931 27966 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.753835 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:04.721990 27992 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.759112 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:04.759328 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:09:04.759841 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 293713us
I20260709 13:09:04.793026 22245 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:04.763355 21392 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 12 to 13, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 13 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:04.793886 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:04.741811 27832 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:04.764668 27696 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:09:01.461772 21378 catalog_manager.cc:5028] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): tablet 22b45f3e8b8e428ea4709e7e9ee43868 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
W20260709 13:09:04.803328 21378 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 3.34386e+06us
I20260709 13:09:04.704061 27959 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:04.787775 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47790.9us
I20260709 13:09:04.792378 21457 leader_election.cc:400] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17.
I20260709 13:09:04.764926 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:04.809641 21457 leader_election.cc:403] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:04.718261 27866 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.754573 27909 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:04.720482 27718 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:04.754431 27956 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:04.823772 21392 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 14 to 16, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 16 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:04.809757 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:04.775008 21388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 240) took 8829 ms. Trace:
I20260709 13:09:04.815672 21639 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:04.779101 27923 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.819581 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:04.811457 21634 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:04.830677 27866 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:04.830919 21564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d"
dest_uuid: "5727b19579474da6a12f79730b924770"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36498
I20260709 13:09:04.831224 27864 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:04.831826 27914 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:09:04.831956 21637 raft_consensus.cc:2368] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22.
I20260709 13:09:04.832705 27864 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:04.833655 21561 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:04.833827 27864 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:04.834251 27864 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:04.823649 21638 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:04.834829 27959 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.834935 27566 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:04.836796 27718 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:04.838364 27876 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:04.831504 21564 raft_consensus.cc:606] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Received request to transfer leadership
I20260709 13:09:04.839202 21564 raft_consensus.cc:614] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:04.788857 27815 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:04.790799 27945 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:04.830451 27917 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:04.805812 27832 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:04.805145 27948 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:04.782014 27996 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:04.788632 27715 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:04.848953 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:04.841355 21568 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:09:04.822297 21606 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:09:04.871320 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53086.2us
I20260709 13:09:04.816498 27713 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:04.853564 21392 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 14 to 16, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 16 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.874222 21568 pending_rounds.cc:85] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 10
I20260709 13:09:04.891925 21568 pending_rounds.cc:107] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:09:04.892253 21568 raft_consensus.cc:2889] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:04.827598 21388 rpcz_store.cc:276] 0709 13:08:55.946144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.946498 (+   354us) service_pool.cc:224] Handling call
0709 13:09:04.774911 (+8828413us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:59.295030 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:59.317984 (+ 22954us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:59.318046 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:08:59.318068 (+    22us) tablet.cc:662] Decoding operations
0709 13:08:59.319674 (+  1606us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:59.319785 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:59.319824 (+    39us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:08:59.356741 (+ 36917us) tablet.cc:701] Row locks acquired
0709 13:08:59.373525 (+ 16784us) write_op.cc:260] PREPARE: finished
0709 13:08:59.418852 (+ 45327us) write_op.cc:270] Start()
0709 13:08:59.419040 (+   188us) write_op.cc:276] Timestamp: P: 1783602539394033 usec, L: 0
0709 13:08:59.419057 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:08:59.419849 (+   792us) log.cc:844] Serialized 7854 byte log entry
0709 13:08:59.757580 (+337731us) op_driver.cc:464] REPLICATION: finished
0709 13:09:00.043417 (+285837us) write_op.cc:301] APPLY: starting
0709 13:09:00.043522 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:00.543069 (+499547us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:00.543193 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:00.780683 (+237490us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:00.781066 (+   383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:09:00.781122 (+    56us) write_op.cc:312] APPLY: finished
0709 13:09:00.781576 (+   454us) log.cc:844] Serialized 164 byte log entry
0709 13:09:01.057867 (+276291us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:01.137426 (+ 79559us) write_op.cc:454] Released schema lock
0709 13:09:01.146912 (+  9486us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:01.201730 (+ 54818us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:01.226160 (+ 24430us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":428707,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":253841,"apply.run_cpu_time_us":50267,"apply.run_wall_time_us":1125265,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79295,"num_ops":18,"prepare.queue_time_us":216899,"prepare.run_cpu_time_us":12694,"prepare.run_wall_time_us":217350,"raft.queue_time_us":161457,"raft.run_cpu_time_us":8225,"raft.run_wall_time_us":111972,"replication_time_us":335071,"spinlock_wait_cycles":1251968,"thread_start_us":658242,"threads_started":5,"wal-append.queue_time_us":433290,"wal-append.run_cpu_time_us":20611,"wal-append.run_wall_time_us":2221530}]]}
I20260709 13:09:04.818678 27909 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:04.820958 27723 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:05.008631 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 186734us
I20260709 13:09:04.875731 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:05.011098 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 137373us
W20260709 13:09:05.011848 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 192317us
I20260709 13:09:04.874161 22245 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:05.020890 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 149587us
I20260709 13:09:05.022167 21459 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:04.782552 27969 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:04.801924 27966 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:04.873842 27996 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.873279 27948 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:05.034343 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 158652us
I20260709 13:09:04.888988 27715 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.887423 27566 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:05.041805 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.051719 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:05.022938 27909 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.078409 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.033193 27776 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:04.887844 27962 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.153s
I20260709 13:09:05.038349 27715 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:05.046058 27940 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:05.084493 22245 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:05.043947 27850 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:05.038987 27948 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:05.040630 27996 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:05.079276 27899 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.084081 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:05.036340 27927 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.083884 28001 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:05.108685 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:05.084833 27776 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:05.092777 27647 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:05.038036 27864 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:05.120599 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 97451.7us
I20260709 13:09:05.108685 27765 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:09:05.129093 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 375321us
I20260709 13:09:05.113570 27776 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.134886 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.135061 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.135455 21490 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:09:05.086927 27953 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:05.110517 27945 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:05.113318 27930 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:05.144030 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.144935 21638 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:05.147167 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:05.149806 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.150110 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.154148 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:05.155126 21485 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:05.159453 21638 raft_consensus.cc:2368] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
I20260709 13:09:05.158625 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.161499 21639 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
W20260709 13:09:05.163034 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 126008us
I20260709 13:09:05.132244 27765 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.189136 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:05.191183 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:09:05.191354 28000 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:09:05.191895 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.111481 27899 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.159919 21392 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 17 to 20, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 20 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.202415 21637 raft_consensus.cc:2368] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
W20260709 13:09:05.193913 27955 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.521s	user 0.003s	sys 0.007s
W20260709 13:09:05.195565 28005 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:09:05.200570 22243 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:05.200333 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 119510us
W20260709 13:09:05.223318 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53296us
I20260709 13:09:05.225534 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:05.142186 27924 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:05.181452 27953 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.170185 27930 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:05.120399 27566 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:05.258391 27999 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:09:05.254165 27953 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:05.263381 27924 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:05.263926 27924 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:05.264302 27924 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:05.268134 28015 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.268812 28015 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.271489 27769 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:05.272428 27769 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:05.272774 27769 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:05.273572 27769 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.145287 27866 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:09:05.219267 27765 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:05.255525 21490 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:05.205919 27850 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:05.285418 22243 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
W20260709 13:09:05.263455 28011 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:09:05.236425 27621 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:09:05.295473 21532 leader_election.cc:400] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22.
I20260709 13:09:05.308261 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.309312 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.311234 21532 leader_election.cc:400] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
I20260709 13:09:05.311547 21532 leader_election.cc:403] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:09:05.303911 27725 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:09:05.334812 27725 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.336556 21634 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 21: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:05.302335 27718 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:09:05.300972 27850 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.345379 21490 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:09:05.345880 21490 pending_rounds.cc:85] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 14
I20260709 13:09:05.346174 21490 pending_rounds.cc:107] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:09:05.346472 21490 raft_consensus.cc:2889] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:05.349670 27725 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:05.360584 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49843.3us
I20260709 13:09:05.361399 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.366732 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:05.357537 28007 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:09:05.295532 27769 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:05.291841 28010 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:05.290745 28015 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:05.311969 27966 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:05.310844 27969 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:05.361471 27756 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:05.372798 27718 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:05.365141 27967 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:05.363758 27446 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.310578 28017 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:09:05.404561 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.404891 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.391927 27876 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:05.412932 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.413705 21488 raft_consensus.cc:2368] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:05.406569 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:05.405037 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:05.392578 21565 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:05.416939 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.418103 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:05.418527 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:05.419283 21486 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:05.409159 28004 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:09:05.403139 27718 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.425130 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:05.427749 21565 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:05.425587 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:05.407682 27967 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:05.411597 27927 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:05.435169 28009 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:09:05.436396 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2222) took 1569 ms. Trace:
W20260709 13:09:05.437247 28016 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:09:05.439296 28006 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:09:05.411087 27756 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:09:05.436534 28013 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:09:05.391472 27832 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.436808 21636 rpcz_store.cc:276] 0709 13:09:03.874456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.342413 (+467957us) service_pool.cc:224] Handling call
0709 13:09:04.342873 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.343356 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.343395 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.356640 (+ 13245us) log.cc:844] Serialized 26 byte log entry
0709 13:09:04.779522 (+422882us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18002026c0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:09:05.088515 (+308993us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:05.088577 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.088677 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.436070 (+347393us) raft_consensus.cc:1685] finished
0709 13:09:05.436090 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.436336 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8097,"spinlock_wait_cycles":31025408,"thread_start_us":308731,"threads_started":1,"wal-append.queue_time_us":810899}
W20260709 13:09:05.488032 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 121362us
W20260709 13:09:05.442685 28008 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:09:05.490504 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:05.418972 27725 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:05.444868 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.395498 28010 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.495194 21489 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:05.496703 28010 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:05.497754 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 44446.7us
I20260709 13:09:05.447449 27723 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.447937 27776 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.499197 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:05.500197 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:05.500367 21486 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:05.451381 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.440685 27967 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:05.501178 21560 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:05.501631 27832 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.455227 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.455834 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.463750 27927 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:05.509367 27927 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.509860 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.510500 21492 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.465212 27946 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:05.423795 27962 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
W20260709 13:09:05.473369 21378 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet eae01b9fdd5340dc9416e5834263a4d6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5727b19579474da6a12f79730b924770 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:05.525982 21378 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52706.8us
I20260709 13:09:05.475493 27647 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:05.478910 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:05.429026 27947 consensus_meta.cc:287] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.000s
I20260709 13:09:05.384413 27930 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.490005 21639 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:09:05.491555 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:05.500450 27776 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.430716 27718 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.454736 27862 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:09:05.478688 27914 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.646s	user 0.005s	sys 0.005s
I20260709 13:09:05.501226 21493 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:05.498554 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:05.504958 21566 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:05.514200 21641 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:05.514411 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.465131 27715 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.523422 21489 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:05.527916 21640 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:05.478230 27446 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
I20260709 13:09:05.572400 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.573875 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.522509 21492 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:05.431854 28021 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:09:05.539098 21569 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:05.505728 27899 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.550385 27929 raft_consensus.cc:993] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
W20260709 13:09:05.551290 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 52832.9us
I20260709 13:09:05.588621 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.589260 21492 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:05.589730 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:05.551853 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.552049 27917 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:05.554221 27739 consensus_meta.cc:287] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.855s	user 0.006s	sys 0.003s
I20260709 13:09:05.555809 27955 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:05.535003 27647 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.545258 27862 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:05.560066 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:05.560945 21566 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:05.565616 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:05.629894 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 69910.7us
I20260709 13:09:05.630578 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.632105 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.544775 27947 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16.
I20260709 13:09:05.492723 27924 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.498711 27723 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.634588 21532 leader_election.cc:400] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:05.613273 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.636075 21638 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:05.559808 27832 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:05.640743 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:05.642771 21634 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:05.539196 27909 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.643443 21638 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:05.610972 27917 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:05.652240 27723 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.652945 27723 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:05.627632 27756 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.538455 27725 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:05.628311 21487 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:05.568611 27914 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17.
I20260709 13:09:05.630170 27927 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:05.575428 27776 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:05.639142 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:05.622309 21640 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:09:05.626032 27846 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:05.635089 27929 raft_consensus.cc:1081] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:09:05.668586 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.720381 21637 raft_consensus.cc:2368] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18.
I20260709 13:09:05.691804 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.666014 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 3990) took 1585 ms. Trace:
I20260709 13:09:05.654734 27723 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
W20260709 13:09:05.697409 28003 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.670s	user 0.000s	sys 0.004s
I20260709 13:09:05.697175 27967 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.655225 28025 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:09:05.667677 27815 consensus_meta.cc:287] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.779s	user 0.010s	sys 0.000s
I20260709 13:09:05.632956 21642 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:05.703109 28010 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:05.633746 28026 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:05.633939 27769 raft_consensus.cc:2764] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:09:05.708401 27947 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:05.708461 27776 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.720750 27927 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:05.714193 21491 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
W20260709 13:09:05.672081 27948 consensus_meta.cc:287] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.005s
I20260709 13:09:05.723795 21492 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:05.661001 27715 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.721146 21563 rpcz_store.cc:276] 0709 13:09:04.080706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.380727 (+300021us) service_pool.cc:224] Handling call
0709 13:09:04.381092 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.381470 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.381499 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.381931 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:09:04.742066 (+360135us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:04.742126 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.742221 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.664924 (+922703us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b24000f87c8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6d7b9c4 00007f98a6d79acb 00007f98a6f34dc9 00007f98a6f34a55 00007f98a6f33fb0 00007f98a9baa488 00007f98a9baabe8 00007f98a9b82398 00007f98a9b7d76a 00007f98a9b7cbb6
0709 13:09:05.665697 (+   773us) raft_consensus.cc:1685] finished
0709 13:09:05.665722 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.665951 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1159,"raft.queue_time_us":981,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":17281,"spinlock_wait_cycles":50798848,"thread_start_us":314065,"threads_started":1,"wal-append.queue_time_us":626600}
I20260709 13:09:05.749310 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:05.722040 21643 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:05.664589 27924 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.750610 27948 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.755270 27948 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.647382 27765 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.757504 21494 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:05.733961 28021 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.762284 21485 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:05.663125 27909 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:05.731285 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.735158 21635 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:05.739372 21562 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:09:05.709944 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.741381 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:05.779296 28039 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:05.746316 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.746318 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.779911 28039 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:05.780369 28039 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:05.780776 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.782123 21492 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:05.746903 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:05.764206 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 128646us
I20260709 13:09:05.766454 21532 leader_election.cc:400] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18.
I20260709 13:09:05.784298 21567 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:05.784476 21532 leader_election.cc:403] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:09:05.767740 21563 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:05.718655 27953 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.769397 21493 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:05.723018 27846 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.787693 27846 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.788550 27953 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:05.789239 21490 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:09:05.790303 27846 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:05.779209 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 69446.7us
I20260709 13:09:05.792228 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.793509 27866 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:05.793694 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.794164 27866 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.794579 27866 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:05.794898 27945 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:05.795396 27945 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.793463 28039 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.797837 28039 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:05.786620 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45509.6us
I20260709 13:09:05.795925 27945 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:05.801946 27776 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:05.802809 28037 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:09:05.804736 27967 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.786716 27929 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:05.806921 27832 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:05.759159 27765 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.738301 28026 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.810523 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:05.810774 28026 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.759173 28021 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.798225 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.813557 28021 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.819156 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.821147 27866 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.751951 27769 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:09:05.825809 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:05.826696 21493 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
W20260709 13:09:05.799966 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 163729us
I20260709 13:09:05.732481 27815 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.830228 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.833943 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:05.763932 27725 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.842981 27866 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:05.844399 27718 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.845386 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:05.846155 22243 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:05.827647 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:05.734674 28010 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.744163 27947 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:05.831457 27996 consensus_meta.cc:287] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.000s
I20260709 13:09:05.832419 28039 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:05.846215 27945 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.858008 21564 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:05.858636 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.860836 21639 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:05.859719 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:05.863963 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.867982 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.872354 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.762310 27927 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.852100 27948 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:05.848095 28049 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:05.848668 27718 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:05.880034 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:05.880609 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 66297.8us
I20260709 13:09:05.885766 21639 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:05.889272 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:05.883896 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.841123 27446 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:09:05.898082 21637 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:05.888348 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:05.896984 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.899659 21640 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 23: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:05.901541 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.902860 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:05.903594 21640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58372
I20260709 13:09:05.904219 21640 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:05.904249 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:05.904772 21640 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:05.906371 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.906633 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:05.907177 21638 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 21: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:05.860036 27996 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.908154 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.909384 27996 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:05.909605 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.857271 27914 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:09:05.879649 28039 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:05.889334 27832 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18.
I20260709 13:09:05.913271 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:05.916853 21638 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:09:05.902769 27718 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:05.889705 27909 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:05.863812 27715 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:09:05.897341 27846 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:05.931538 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:05.933413 22245 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.928805 27967 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:09:05.907089 27948 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:05.939303 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:05.942306 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:05.945060 22245 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:05.946113 22241 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:05.918437 27866 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:05.917815 27446 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:05.935408 27846 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.955487 21640 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.974267 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:05.956959 27927 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:05.953274 27948 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.900583 28049 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:05.975833 21640 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:05.940224 27718 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:05.939656 27909 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:05.977028 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 50411.2us
I20260709 13:09:05.977228 27846 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:05.963587 27446 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:06.000500 27718 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:06.003090 27446 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:06.004179 27948 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:06.004977 27815 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:06.005465 28039 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:06.007639 27909 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:05.988279 27647 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:06.013242 28049 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:06.014153 27647 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:06.019428 27995 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:06.026934 27945 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:06.027980 27947 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:06.024336 28010 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:06.021517 27995 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:06.029372 27864 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:06.030470 27995 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:06.031980 27995 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:06.095369 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 173271us
I20260709 13:09:06.119964 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:06.267195 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.283470 27647 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.285485 27647 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:06.005031 27446 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:06.293869 27647 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:06.317576 27715 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.323396 27776 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.332484 27866 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:06.425448 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 293663us
I20260709 13:09:06.336766 27899 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:06.427955 21491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.003s	sys 0.006s
I20260709 13:09:06.334703 27862 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:06.446264 21491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.003s	sys 0.006s
I20260709 13:09:06.444710 27967 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:06.449002 27959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.013s
W20260709 13:09:06.456624 27959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.002s	sys 0.013s
I20260709 13:09:06.458624 28010 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:06.459739 28010 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:06.461221 27862 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:06.466974 27715 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:06.456667 27967 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:06.517940 27967 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:06.551323 27967 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:06.552253 27967 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:06.529791 21532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.013s	sys 0.021s
I20260709 13:09:06.531234 27765 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:06.531531 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 79375.3us
I20260709 13:09:06.535518 21640 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:06.536206 27866 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:06.601989 21532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.014s	sys 0.021s
I20260709 13:09:06.545651 28034 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:06.617797 27765 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:06.504370 27776 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:06.622051 21459 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.908s (SENT) [suppressed 3 similar messages]
I20260709 13:09:06.546082 27446 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:06.546419 21560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 3998) took 1833 ms (client timeout 1908 ms). Trace:
I20260709 13:09:06.544173 27922 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:09:06.826128 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.739221 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.920511 27718 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.953857 27718 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:06.955087 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 330861us
I20260709 13:09:06.956771 27718 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:06.624169 27776 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:06.958040 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1074) took 1137 ms. Trace:
W20260709 13:09:06.938349 21560 rpcz_store.cc:269] 0709 13:09:04.713191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.713339 (+   148us) service_pool.cc:224] Handling call
0709 13:09:06.545933 (+1832594us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54000181d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:06.546148 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1725182720}
I20260709 13:09:06.925096 27765 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:06.958577 21491 rpcz_store.cc:276] 0709 13:09:05.820222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.828371 (+  8149us) service_pool.cc:224] Handling call
0709 13:09:05.828666 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.851228 (+ 22562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.851288 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.852308 (+  1020us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.543443 (+691135us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:06.543514 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.543644 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:06.957679 (+414035us) raft_consensus.cc:1685] finished
0709 13:09:06.957704 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.957919 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34383,"raft.queue_time_us":14471,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":2303,"thread_start_us":588891,"threads_started":1,"wal-append.queue_time_us":1102804}
W20260709 13:09:06.965658 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 343752us
I20260709 13:09:06.880040 27959 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:06.981355 27862 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.007s
I20260709 13:09:06.859076 28034 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:06.981822 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1317) took 1072 ms. Trace:
I20260709 13:09:06.983042 21641 rpcz_store.cc:276] 0709 13:09:05.871543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.871677 (+   134us) service_pool.cc:224] Handling call
0709 13:09:05.871979 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.872182 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.872220 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.879878 (+  7658us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.206421 (+326543us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:06.206568 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.206764 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:06.938009 (+731245us) raft_consensus.cc:1685] finished
0709 13:09:06.938030 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.943836 (+  5806us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":295571,"threads_started":1,"wal-append.queue_time_us":711611}
I20260709 13:09:06.990275 28023 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:09:06.989712 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 1.1006e+06us
I20260709 13:09:06.992744 28023 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:06.989737 27446 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:06.986191 28010 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:06.986505 27967 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:06.989158 27715 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:06.996204 27969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.382s	user 0.005s	sys 0.017s
I20260709 13:09:06.994300 27959 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.003528 28023 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.000145 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1314) took 1079 ms. Trace:
I20260709 13:09:06.992697 28034 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:07.004181 27969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.505s	user 0.005s	sys 0.017s
I20260709 13:09:07.005664 21642 rpcz_store.cc:276] 0709 13:09:05.867815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.869609 (+  1794us) service_pool.cc:224] Handling call
0709 13:09:05.870031 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.870463 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.870504 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.871139 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.503158 (+632019us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:06.503281 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.503409 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:06.520591 (+ 17182us) raft_consensus.cc:1685] finished
0709 13:09:06.520616 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.946677 (+426061us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5424,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2452,"thread_start_us":496205,"threads_started":1,"wal-append.queue_time_us":600983}
I20260709 13:09:07.013233 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.011830 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:07.014087 21641 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
W20260709 13:09:07.021991 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.027186 27929 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:07.028421 27929 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.016832 27715 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.039996 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.036164 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.052717 21638 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: [21.11-22.12]
I20260709 13:09:07.047122 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:07.071583 21642 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:09:07.065083 28074 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.076085 21563 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:07.057765 27914 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:07.076893 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:07.072926 27929 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.081173 28059 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.082438 28074 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.083336 21568 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:07.081804 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.086349 27713 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.091451 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:07.091949 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.089515 27713 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.087745 28059 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.092577 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.092753 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.093457 21563 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 10.
I20260709 13:09:07.079558 27715 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.093514 21568 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:07.097875 21567 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:07.098050 21642 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:07.091004 27446 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.111505 21638 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:07.096644 27959 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.113426 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:07.117079 21491 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:07.118171 28079 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:09:07.092121 27914 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.120112 27713 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:07.121019 27846 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.083s	user 0.011s	sys 0.014s
W20260709 13:09:07.127089 28077 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:09:07.114929 27446 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.136197 27446 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.137470 28074 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.143373 27959 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.144244 27959 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.144685 27715 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:07.145328 21485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 2785) took 1693 ms (client timeout 1620 ms). Trace:
W20260709 13:09:07.145819 21485 rpcz_store.cc:269] 0709 13:09:05.451332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.454990 (+  3658us) service_pool.cc:224] Handling call
0709 13:09:07.144920 (+1689930us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540008aa54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:07.145110 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448698112}
I20260709 13:09:07.146770 27959 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.150264 27959 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.151111 27959 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.152130 27922 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.152688 27922 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:07.154498 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:07.157447 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.158030 27446 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.158664 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.164644 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.134831 27846 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:07.170938 28082 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:09:07.175558 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:07.178567 21642 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 23: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:09:07.179402 27864 consensus_meta.cc:287] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 1.146s	user 0.010s	sys 0.016s
I20260709 13:09:07.180166 28049 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.180377 21635 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:07.180763 28049 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:07.182056 21494 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 2186) took 2047 ms (client timeout 2044 ms). Trace:
W20260709 13:09:07.182509 21494 rpcz_store.cc:269] 0709 13:09:05.134609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.134733 (+   124us) service_pool.cc:224] Handling call
0709 13:09:07.181631 (+2046898us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54000b7054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:07.181844 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422966528}
I20260709 13:09:07.184675 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:07.190306 22238 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:07.195230 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50140 (request call id 1) took 1531 ms. Trace:
I20260709 13:09:07.195749 21566 rpcz_store.cc:276] 0709 13:09:05.669519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.677563 (+  8044us) service_pool.cc:224] Handling call
0709 13:09:07.194712 (+1517149us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54003ea654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe8735 00007f98aefa8d29 00007f98a85271d4 00007f98a8527162 00007f98a8527091 00007f98a852700c 00007f98a85262c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:07.194997 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021274880}
I20260709 13:09:07.201193 27959 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:07.201788 21440 auto_rebalancer.cc:893] Removing replace marker failed: Leader has not yet committed an operation in its own term
W20260709 13:09:07.202435 21440 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:09:07.207849 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.208166 21560 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
W20260709 13:09:07.202844 21440 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:09:07.209096 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2197) took 1497 ms. Trace:
I20260709 13:09:07.211674 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4010) took 1819 ms. Trace:
I20260709 13:09:07.212128 21562 rpcz_store.cc:276] 0709 13:09:05.392125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.392759 (+   634us) service_pool.cc:224] Handling call
0709 13:09:05.393077 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.778902 (+385825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.211005 (+1432103us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400017cd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:07.211428 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795589376}
I20260709 13:09:07.213999 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.215212 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.216320 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2842) took 1487 ms. Trace:
I20260709 13:09:07.216389 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:07.217219 22238 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:07.216883 21564 rpcz_store.cc:276] 0709 13:09:05.728923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.730151 (+  1228us) service_pool.cc:224] Handling call
0709 13:09:05.730488 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.860520 (+130032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.215872 (+1355352us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001f9fd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:07.216156 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292820352}
I20260709 13:09:07.219559 27846 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.219677 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.209564 21492 rpcz_store.cc:276] 0709 13:09:05.711864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.782888 (+ 71024us) service_pool.cc:224] Handling call
0709 13:09:05.783180 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.789908 (+  6728us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:05.790192 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.794005 (+  3813us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.794455 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.794613 (+   158us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:05.794651 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.208502 (+1413851us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b540005c3d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:07.208566 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.208627 (+    61us) raft_consensus.cc:1685] finished
0709 13:09:07.208712 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.208912 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":689,"prepare.queue_time_us":155,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1750,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":174,"spinlock_wait_cycles":12822912,"thread_start_us":3527,"threads_started":1,"wal-append.queue_time_us":928,"wal-append.run_cpu_time_us":2216,"wal-append.run_wall_time_us":1008677}
I20260709 13:09:07.202600 27914 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.231091 28049 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.232084 28001 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:07.232844 27969 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:07.233351 27969 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:07.237061 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.237767 22240 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:07.238801 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1069) took 1885 ms. Trace:
I20260709 13:09:07.239261 21490 rpcz_store.cc:276] 0709 13:09:05.353737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.354508 (+   771us) service_pool.cc:224] Handling call
0709 13:09:05.355008 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.789514 (+434506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.238285 (+1448771us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b540002e4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:07.238603 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998148352}
I20260709 13:09:07.241344 22244 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:07.232864 28001 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.247926 27922 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.250378 27922 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.250761 28001 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:07.254704 21643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3470) took 2668 ms (client timeout 2072 ms). Trace:
W20260709 13:09:07.256302 21643 rpcz_store.cc:269] 0709 13:09:04.585879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.591227 (+  5348us) service_pool.cc:224] Handling call
0709 13:09:07.254251 (+2663024us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400296654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:07.254456 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2370320256}
I20260709 13:09:07.257701 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.258618 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.259141 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.257778 27446 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.259835 21490 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:07.255858 21640 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:09:07.234583 27969 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.260048 27446 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.258644 21634 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:07.262037 28034 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:07.262234 28010 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.265388 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.266006 28074 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:07.266541 28071 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:07.268756 27713 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.261809 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.271744 28034 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.268952 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.272897 27917 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.274437 27969 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:07.276108 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:07.274891 28001 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:07.315940 28001 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.318112 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.319074 21640 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:09:07.320174 28034 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.320923 21566 raft_consensus.cc:2368] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17.
I20260709 13:09:07.320539 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.309103 28074 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.277657 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:07.322300 21634 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:07.322927 21567 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 23: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:07.279917 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:07.281795 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1072) took 1831 ms. Trace:
I20260709 13:09:07.283464 27833 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:07.324119 28074 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:07.324697 28001 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:07.324991 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.284026 28059 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.284340 27866 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.323851 21489 rpcz_store.cc:276] 0709 13:09:05.450000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.582464 (+132464us) service_pool.cc:224] Handling call
0709 13:09:05.582972 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.629130 (+ 46158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.629192 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:05.629313 (+   121us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:05.629377 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.281398 (+1652021us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b5400276fd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:07.281462 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.281622 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105165568}
I20260709 13:09:07.285254 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.326568 27866 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.327294 21565 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:09:07.327068 28010 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.328974 27866 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.329510 28010 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.287649 22238 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:07.300307 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2251) took 1533 ms. Trace:
I20260709 13:09:07.302204 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:07.303378 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.303584 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.303823 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.304411 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.304526 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.310401 21639 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:07.310674 22243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1068) took 1455 ms. Trace:
I20260709 13:09:07.311206 27917 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.338881 28071 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.308068 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.338917 27713 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.344043 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:07.324528 27833 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.345587 27713 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.345718 28049 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:07.283958 27446 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.346496 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:07.307934 27862 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.330850 21637 rpcz_store.cc:276] 0709 13:09:05.766773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.766956 (+   183us) service_pool.cc:224] Handling call
0709 13:09:07.290376 (+1523420us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b5400296154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:07.300064 (+  9688us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168407808}
I20260709 13:09:07.333563 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:07.332497 22243 rpcz_store.cc:276] 0709 13:09:05.855047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.855197 (+   150us) service_pool.cc:224] Handling call
0709 13:09:05.881813 (+ 26616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.997647 (+115834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.997686 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:05.997733 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:05.997767 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.310047 (+1312280us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54007346d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:07.310171 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.310414 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265860992}
I20260709 13:09:07.334734 22240 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 17: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:07.335810 22241 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:07.346055 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.346731 21643 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:07.349737 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:07.350536 21490 raft_consensus.cc:2368] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:09:07.347612 21562 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 21: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:07.352016 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.353545 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.354230 21562 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:07.347787 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:07.355608 21486 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:07.348258 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.356559 27621 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:07.356971 27621 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.355883 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.357306 27621 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:07.358192 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.359220 21561 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:07.344471 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.348289 21636 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:07.361065 21640 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:07.346477 28049 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.347926 27862 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.347569 21566 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:07.346532 27833 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.364463 27833 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:07.366196 22212 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:07.360154 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:07.367422 21566 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:07.368049 21606 leader_election.cc:400] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:07.359275 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.360193 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.371263 27713 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.328034 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.342147 28071 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:07.371992 27713 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.369537 27862 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.348924 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.374442 21567 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:09:07.370173 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:07.375490 21487 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:07.370486 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.375805 21560 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:09:07.375819 21487 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:07.349278 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.371167 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:07.350551 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.360335 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.368129 28049 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:07.381155 21486 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:07.377955 21565 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
W20260709 13:09:07.382572 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.379040 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:07.386170 21488 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.381613 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.368451 21606 leader_election.cc:403] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:09:07.377483 21487 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.391065 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.391283 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.391935 21640 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:07.379149 27862 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.376936 28071 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:09:07.395994 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 90294.3us
I20260709 13:09:07.392971 27866 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:07.390514 28002 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:07.395324 27995 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:07.405192 21487 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:07.407968 21489 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:07.412109 28002 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.423482 27922 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:07.424077 27922 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.424765 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.426062 21457 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.426189 27922 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.426261 21491 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:07.427237 27914 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:07.427695 27914 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:07.427498 27846 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:07.428158 27914 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:07.428782 27846 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:07.429224 27846 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.429562 27846 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.429682 28071 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.409122 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.408761 21490 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:07.431891 21487 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:07.434484 21568 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:07.435410 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:07.434439 21636 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:07.438301 21488 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:09:07.430985 27715 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:07.438907 21561 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 10.
I20260709 13:09:07.439131 27715 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:07.439786 28070 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:07.440049 27715 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.441546 27715 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:07.423476 28002 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:07.427378 27621 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.440356 28070 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.448897 27621 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.438375 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.450675 28070 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:07.461162 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 117432us
I20260709 13:09:07.464416 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:07.464831 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 77104.5us
I20260709 13:09:07.471076 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.470615 28070 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.474572 28070 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:07.475869 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.463205 27922 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:07.483631 28059 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:07.484167 28059 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.484563 28059 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:07.486379 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.476522 27917 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:07.484737 27713 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.485531 27922 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.491523 27922 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.472859 27866 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:07.453486 27914 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.460283 27862 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.487531 27969 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.479619 28070 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.495011 21457 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.495632 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:07.500906 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:07.503153 27713 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:07.496750 28023 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:09:07.493975 27866 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:07.502849 27929 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:07.504524 27866 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.505018 27929 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:07.505419 27929 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:07.503613 27850 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:07.503837 27621 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:07.506484 27929 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.507707 27850 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:07.507794 27621 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:07.508167 27850 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.508487 27929 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:07.508882 27621 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.508883 27862 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.505616 27969 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.511098 28070 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:07.512580 27969 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.514484 28071 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.510588 27621 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.517673 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:07.523133 27969 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:07.519311 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 57313.7us
I20260709 13:09:07.552201 28059 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:07.557706 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 85834.1us
I20260709 13:09:07.560657 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:07.561517 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.526329 28002 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.569011 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.569928 22238 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:07.570281 28025 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:07.571249 28025 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:07.571648 28025 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:07.571719 27914 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.572983 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:07.572718 28025 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.573697 21568 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:07.574103 28025 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:07.575132 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.575773 21564 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:07.576840 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.581823 27719 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.582008 27862 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.582439 27719 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.582589 27862 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.582597 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.584631 27719 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.585718 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:07.584631 27862 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.586488 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.586992 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.587236 21636 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:09:07.587683 21637 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:07.588313 28002 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.589092 28002 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.589557 28002 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.566445 28071 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.567243 28023 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:07.585134 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:07.586578 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.599105 21568 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:07.592002 21638 raft_consensus.cc:2376] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16. Re-sending same reply.
W20260709 13:09:07.612831 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.624555 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.626103 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.627187 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:07.631116 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 113541us
I20260709 13:09:07.635006 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.636021 21636 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:07.638413 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:07.641235 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:07.645349 21567 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:07.641040 21457 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.590878 28071 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.652616 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:07.653357 21561 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:07.655375 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:07.656103 21642 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:09:07.631348 28023 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.659909 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 91509.5us
I20260709 13:09:07.663352 28002 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.663596 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:07.666499 27846 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.666934 28023 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.668916 27846 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.658015 27833 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:07.669667 27833 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:07.670101 27833 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.670954 28093 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:09:07.671586 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.671639 28093 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:07.673331 21392 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 147) took 17024 ms (client timeout 15000 ms). Trace:
I20260709 13:09:07.672945 28093 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.674909 27713 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:07.668900 28023 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.684407 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:07.685343 22238 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 17: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:07.696516 21561 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
W20260709 13:09:07.703022 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 50749.4us
W20260709 13:09:07.683615 28086 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:09:07.713680 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:07.699185 27862 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:07.725598 28071 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:07.726496 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 63047.7us
I20260709 13:09:07.707908 27446 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.731752 27446 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.732158 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:07.734179 27446 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:07.721025 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 67500.1us
I20260709 13:09:07.740919 21637 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:07.734205 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:07.746028 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 93288.4us
I20260709 13:09:07.749910 21642 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
W20260709 13:09:07.755587 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.756101 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.760684 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:07.761225 21639 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:07.761888 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 49255.3us
W20260709 13:09:07.673753 21392 rpcz_store.cc:269] 0709 13:08:50.649113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.649314 (+   201us) service_pool.cc:224] Handling call
0709 13:09:07.673107 (+17023793us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:05.337455 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:05.338322 (+   867us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:05.338366 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:09:05.338397 (+    31us) tablet.cc:662] Decoding operations
0709 13:09:05.339304 (+   907us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:05.339385 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:05.339431 (+    46us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:09:05.340007 (+   576us) tablet.cc:701] Row locks acquired
0709 13:09:05.340040 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:09:05.340240 (+   200us) write_op.cc:270] Start()
0709 13:09:05.340399 (+   159us) write_op.cc:276] Timestamp: P: 1783602545340179 usec, L: 0
0709 13:09:05.340431 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:09:05.341393 (+   962us) log.cc:844] Serialized 1758 byte log entry
0709 13:09:05.582357 (+240964us) op_driver.cc:464] REPLICATION: finished
0709 13:09:05.586154 (+  3797us) write_op.cc:301] APPLY: starting
0709 13:09:05.586258 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:05.668868 (+ 82610us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:05.668978 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:05.801075 (+132097us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:05.821131 (+ 20056us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:09:05.821177 (+    46us) write_op.cc:312] APPLY: finished
0709 13:09:05.821417 (+   240us) log.cc:844] Serialized 49 byte log entry
0709 13:09:05.821583 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:05.821680 (+    97us) write_op.cc:454] Released schema lock
0709 13:09:05.821721 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:05.822177 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:05.822206 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1882463,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":3326,"apply.run_cpu_time_us":8422,"apply.run_wall_time_us":236002,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20831,"num_ops":4,"prepare.queue_time_us":62951,"prepare.run_cpu_time_us":36432,"prepare.run_wall_time_us":85776,"raft.queue_time_us":138041,"raft.run_cpu_time_us":3703,"raft.run_wall_time_us":3856,"replication_time_us":241755,"thread_start_us":265439,"threads_started":4,"wal-append.queue_time_us":97873,"wal-append.run_cpu_time_us":23403,"wal-append.run_wall_time_us":1403764}]]}
I20260709 13:09:07.755579 28092 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:07.772367 22210 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:07.778170 28059 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:07.759850 28071 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:07.759311 27946 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.761929 27862 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:07.734767 27833 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.764720 27914 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.789551 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.796540 27914 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.799196 28026 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:07.784040 28092 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.804034 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:07.807394 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 73279.6us
I20260709 13:09:07.809846 27922 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.811818 27833 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:07.817703 28097 log.cc:927] Time spent T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:09:07.811924 27922 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.825634 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.786578 27946 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.827040 27969 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:07.828153 27864 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:07.828596 27864 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.828531 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.828979 27946 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.829176 27864 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.829438 21641 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:07.830552 28023 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.805035 28092 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:07.843955 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.804126 27914 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:07.850310 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46352.4us
I20260709 13:09:07.847378 28026 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:07.875877 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 89694.8us
I20260709 13:09:07.875074 27946 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:07.880762 28096 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.882274 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:07.882952 27446 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:07.882819 28096 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.883800 27446 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:07.884155 27446 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:07.885017 27446 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.880908 27946 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:07.881394 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44894.4us
I20260709 13:09:07.886214 27446 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.887523 27946 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:07.885803 28096 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.892689 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.892807 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.893415 21636 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:07.897439 28026 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:07.898058 28094 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:09:07.898458 28026 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.831074 28023 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.904675 27866 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.905166 28023 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.872822 27850 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:07.911957 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.912714 27850 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:07.914330 28092 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:07.915233 27969 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:07.915784 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:07.916620 27969 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:07.916767 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:07.917037 27969 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.917465 27969 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:07.918133 28070 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:07.918535 28070 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:07.918917 28070 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:07.925011 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 87080.4us
I20260709 13:09:07.925964 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:07.928819 21639 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:09:07.936173 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.926898 28071 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:07.943939 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.943928 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.950291 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.951522 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.931030 27621 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:07.967257 27621 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.967769 27621 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:07.952960 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.971709 21488 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:07.949785 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.959972 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:07.973862 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.962232 27866 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:07.963059 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:07.965559 28070 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:07.973857 21569 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:09:07.972890 21489 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:07.983042 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.983635 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:07.988493 21491 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:07.982937 21639 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
W20260709 13:09:07.994678 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.997504 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:07.997608 21487 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:07.997637 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:07.999928 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:08.000648 21637 raft_consensus.cc:2368] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12.
I20260709 13:09:08.000698 22212 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.001765 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.002846 21488 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:08.014313 21489 raft_consensus.cc:2368] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12.
I20260709 13:09:08.023470 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.024896 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:08.026075 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 140858us
I20260709 13:09:08.026566 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.029635 21563 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:08.030728 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.028218 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.027192 21486 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
W20260709 13:09:08.032790 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.033582 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:08.037882 21638 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:08.039080 21488 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:08.040395 22238 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:08.041610 28070 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:08.041554 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:08.043696 21459 leader_election.cc:400] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17.
I20260709 13:09:08.044823 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.047169 27866 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:08.047798 27866 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:08.048967 27866 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:08.054999 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.059520 21643 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:09:08.063791 27974 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:08.065562 21459 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.067505 28101 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:08.069201 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.070423 28101 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:08.073144 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 122050us
I20260709 13:09:08.074726 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:08.080260 28071 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:08.080888 28071 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:08.081341 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.081904 28071 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:08.087041 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.996658 27864 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.024917 28002 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:08.095839 21490 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:09:08.096241 21490 pending_rounds.cc:85] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 11
I20260709 13:09:08.091832 21606 leader_election.cc:400] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:09:08.099040 21606 leader_election.cc:403] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:09:08.100034 21491 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:08.102569 28095 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.103320 28095 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.104212 27864 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.105588 28095 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.107335 27719 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:08.097579 27929 raft_consensus.cc:2764] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:09:08.097231 28002 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.111222 28002 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:08.096529 21490 pending_rounds.cc:107] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:09:08.113039 21490 raft_consensus.cc:2889] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:08.115206 27719 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:08.115690 27719 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:08.116685 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:08.116830 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:08.117435 21634 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:09:08.117442 21641 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:08.119393 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.120297 28049 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:08.120718 28049 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.121068 28049 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:08.116912 27719 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:08.129730 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 50921.3us
I20260709 13:09:08.130578 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:08.131907 21641 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:08.132880 27862 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:08.134078 27862 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:08.134436 27862 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:08.134577 27969 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.146312 27862 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.141712 27719 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:08.131830 28059 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:09:08.152096 27862 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.148726 27969 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.161791 28096 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.162475 28096 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.165845 28096 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.167258 28059 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:09:08.169560 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 405370us
I20260709 13:09:08.176026 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:08.173084 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.179000 27846 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:08.179608 27846 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:08.141754 27621 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.180604 27846 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.183827 28002 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:08.139951 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 58855.6us
I20260709 13:09:08.184167 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:08.190953 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 148231us
I20260709 13:09:08.194185 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:08.194319 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:08.194504 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.195060 21638 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:09:08.195122 21563 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:08.195869 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.196765 28107 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:08.197482 28107 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.198849 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.190896 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:08.200687 21634 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:08.209882 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.210951 27723 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:08.211531 27723 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:08.212345 27723 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.189049 21457 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.220434 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:08.221751 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.226241 27850 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:08.226898 27850 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:08.227885 27850 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.231236 28023 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:08.234491 28059 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:08.235357 27713 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:08.237246 27713 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:08.235527 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:08.244077 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 45340.4us
I20260709 13:09:08.245186 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.248268 21563 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:09:08.186777 28002 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.250655 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.254297 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:08.255195 21639 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:09:08.257130 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.258102 22238 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:08.258134 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:08.261487 22241 raft_consensus.cc:2368] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20.
I20260709 13:09:08.238251 27969 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.263067 21642 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:09:08.264827 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.267071 28106 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.274112 27974 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:08.274422 28106 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.276803 28106 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.279678 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:08.280783 27446 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:08.281566 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:08.283008 28070 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:08.265105 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:08.259172 21634 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:08.266351 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:08.273736 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.286912 21388 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:08.271708 28107 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:08.306953 21638 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:09:08.307696 21388 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.317152 21388 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.321336 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:08.320626 21388 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 12 to 14, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 14 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:08.336406 21457 leader_election.cc:400] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20.
I20260709 13:09:08.336956 21457 leader_election.cc:403] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:08.317725 28071 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.343732 21391 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 22b45f3e8b8e428ea4709e7e9ee43868 with cas_config_opid_index 4: aborting the task: latest config opid_index 9; task opid_index 4
I20260709 13:09:08.344184 27621 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.344113 21388 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.356499 21388 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:08.357080 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 141195us
I20260709 13:09:08.321159 27833 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:08.349979 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 76372us
I20260709 13:09:08.352444 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:08.345688 21643 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:08.360869 21639 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:08.363665 28049 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.357885 21388 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 15 to 16, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.370621 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.376298 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:08.376987 21641 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:08.379330 21606 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:08.379441 28059 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:08.382280 28107 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.382808 28107 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.384840 28107 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.370208 27922 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:09:08.387724 21569 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:09:08.393026 28110 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:08.396414 27719 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:08.397028 27719 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:08.398313 21391 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 244) took 32794 ms (client timeout 15000 ms). Trace:
I20260709 13:09:08.398401 27940 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:08.399276 27719 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:08.398867 21391 rpcz_store.cc:269] 0709 13:08:35.626407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.632553 (+  6146us) service_pool.cc:224] Handling call
0709 13:09:08.398222 (+32765669us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106193,"reported_tablets":51}
I20260709 13:09:08.370481 27715 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:09:08.401034 28049 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.372190 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.410349 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:08.411177 21637 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:08.414117 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 132622us
I20260709 13:09:08.415764 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:08.415802 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.417049 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.420393 22210 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.373544 21388 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 9 to 10, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.426090 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.409632 27866 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:08.428786 21388 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 16 to 18, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 18 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.434670 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:08.436997 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 56395.2us
I20260709 13:09:08.366083 28071 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:08.439998 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 73273.8us
I20260709 13:09:08.439898 21388 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.440759 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.428124 28107 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:08.441483 21388 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 17 to 22, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 22 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:08.443481 21388 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 17 to 18, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 18 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:08.431746 28106 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:08.428085 27969 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.446218 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.447598 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.449489 21637 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:08.444842 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.434032 27940 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:08.427773 28059 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:08.451839 28106 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:08.466228 27940 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:08.466724 28059 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.467344 27940 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.469237 28070 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:08.469655 28070 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.469995 28070 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:08.456069 22241 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:09:08.446671 21388 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 8 to 11, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.433183 27446 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:08.442323 28107 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:08.482422 28107 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:08.457098 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.442404 27866 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:08.457967 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.458820 28093 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:08.459036 28114 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:08.459923 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:08.444802 28092 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:08.460896 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:08.461442 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 93512.3us
I20260709 13:09:08.461927 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.462829 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.494561 21488 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:08.463338 28071 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:08.463728 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.477695 21634 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:08.478574 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.475287 21388 catalog_manager.cc:5697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 8 to 10, term changed from 13 to 16, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to <none>, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129), VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130), VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131), VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 16 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:08.479568 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:08.504597 21492 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:08.479568 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.505497 22241 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:08.506438 21490 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:08.480247 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:08.478505 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.473308 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.477619 21641 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:08.466537 28106 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:08.460696 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.494930 21459 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.515594 21494 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:08.495916 21486 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:08.515621 21491 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:08.510267 21388 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 16 to 17, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 17 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:08.527454 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.523077 21388 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 14 to 15, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 15 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:08.491493 27446 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:08.530324 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.493844 28092 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.528142 22238 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:09:08.539280 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.532696 21388 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 10 to 12, term changed from 16 to 18, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to <none>, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129), VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130), VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131), VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 18 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:08.533023 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.536374 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.541296 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.505338 28093 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:08.505568 28113 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:08.544874 21641 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:08.518887 27719 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:08.540690 28092 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:08.547888 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:08.545680 27846 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:08.579497 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:08.534452 27969 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:09:08.540433 27446 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.600549 28114 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.601171 28114 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.601990 27446 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:08.587098 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 54147.5us
I20260709 13:09:08.589877 28025 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:08.591863 28112 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 13:09:08.545611 27929 consensus_queue.cc:1059] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:09:08.598270 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 103396us
I20260709 13:09:08.568307 28113 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:08.619426 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.624361 21492 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:08.620229 21388 catalog_manager.cc:5697] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:08.626305 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 46938.7us
I20260709 13:09:08.627774 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:08.629642 27862 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:08.580603 27719 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:08.632128 27864 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:08.632218 27719 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:08.634683 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 131906us
I20260709 13:09:08.635749 21388 catalog_manager.cc:5697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 11 to 13, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 13 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:08.638537 21532 leader_election.cc:400] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12.
I20260709 13:09:08.638942 21532 leader_election.cc:403] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:08.602655 27446 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:08.642323 21388 catalog_manager.cc:5697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:08.646747 28124 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:08.657832 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:08.643090 27446 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:08.659315 27929 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:08.659853 27929 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:08.660372 27969 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:08.660833 27969 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.661319 27969 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:08.660897 27929 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:08.663241 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 43920.7us
I20260709 13:09:08.663409 27914 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:08.664000 27914 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:08.664515 27914 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:08.636441 27846 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:08.668411 27846 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.671068 28093 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.664537 21459 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:08.625097 28113 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:08.676167 28091 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.678925 27713 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:08.682124 28125 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:08.689725 28125 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:08.682677 28114 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.636595 28025 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:08.697928 28106 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.683928 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.685519 27446 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.682432 27969 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.671801 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:08.706532 21636 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:08.705209 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.706570 21634 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:09:08.716615 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 59428.9us
I20260709 13:09:08.616287 27866 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.717675 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.719283 28119 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:08.719702 28119 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:08.720077 28119 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.641337 27862 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:09:08.698558 27715 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20.
I20260709 13:09:08.707437 21388 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 17 to 19, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.724381 21635 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:08.725107 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.727078 21491 raft_consensus.cc:2410] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 24 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:09:08.727324 21388 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.728732 21488 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:08.733193 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.733594 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:08.736603 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.745206 21492 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:08.748148 21488 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:08.748049 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:08.752805 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:08.744958 21493 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:08.743626 21388 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.694761 28114 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:08.756903 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:08.716076 27929 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.755659 21388 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 18 to 19, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 19 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:08.771747 27713 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:08.772125 22243 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:08.754593 28112 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:08.773568 28025 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.777267 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.724905 28071 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:08.779139 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 119984us
I20260709 13:09:08.782652 21388 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:08.799957 21485 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:09:08.804323 21488 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:08.777966 28114 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:08.806408 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.807238 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.694756 28092 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.808763 21488 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:08.803402 21388 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.795297 27446 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:08.801378 28118 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:08.819092 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.833045 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.838732 21488 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:08.818689 21388 catalog_manager.cc:5697] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.824548 28106 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.825609 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.798854 28071 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:08.840313 21567 raft_consensus.cc:2368] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17.
I20260709 13:09:08.845450 21489 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:08.841934 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.847070 28129 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:08.847656 28129 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.849995 28129 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.850979 28071 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:08.858019 27914 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.860558 28092 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:08.866641 21565 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:08.876945 28113 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.850529 28129 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:08.898694 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.836675 28023 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.817035 28120 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:08.901501 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.845903 28118 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:08.909992 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 131415us
I20260709 13:09:08.917472 21569 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:08.917771 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.917526 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:08.919067 22243 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:08.943094 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.947132 21567 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:08.977356 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:08.979089 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:08.979699 21641 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:08.979779 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.944047 27922 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.978201 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:08.902681 28107 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.912752 28023 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.906733 28119 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.998255 21641 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:08.920698 27862 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:09:09.000877 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:08.921011 27866 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
W20260709 13:09:09.027572 28131 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:08.995895 27922 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:08.905793 28114 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.032305 28023 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:08.984894 28091 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.946630 28070 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:08.916044 28129 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.029165 28118 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.071990 21561 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:09.072623 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:09.001411 28141 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:09:09.080231 22243 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:09.003831 28124 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12.
I20260709 13:09:09.004994 27969 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:09.032297 28107 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:09.106544 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:09.115965 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 194073us
I20260709 13:09:09.119117 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.119820 21489 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.128113 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:09.133389 28136 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:09.133430 28119 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:09.135548 28141 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:09.136121 28141 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.136564 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:09.137910 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:09.138904 21637 raft_consensus.cc:2393] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:09.137280 21636 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:09.147965 21560 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:09.114764 27862 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:09:09.162976 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.163105 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:09.167068 28134 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:09:09.167104 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.169991 28070 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:09.170730 27833 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:09.174458 28129 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:09.174677 28114 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.178347 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:09.179052 21565 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:09.181116 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:09.182444 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:09.183110 21566 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:09.183157 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.184018 21493 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 19: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:09.184285 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:09.185464 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:09.175123 27864 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
W20260709 13:09:09.188783 28133 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.183s	user 0.001s	sys 0.007s
I20260709 13:09:09.189419 21566 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:09.191125 21566 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:09:09.191641 28132 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.189s	user 0.007s	sys 0.000s
I20260709 13:09:09.192654 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.193053 21566 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:09.162384 28106 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:09.194115 28125 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.195294 28125 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.197387 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:09.198119 21638 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:09.198359 21642 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:09.198119 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.200901 28125 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:09.203624 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:09.204306 21564 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:09.205078 27922 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:09.207021 21636 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:09.224598 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:09.138489 27914 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:09.224174 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 74078.7us
I20260709 13:09:09.228367 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:09.234541 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.229928 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:09.235512 21566 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:09.236801 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:09.237661 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:09.238600 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:09.241039 21560 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:09.241508 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:09.246254 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.255440 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:09.271431 21638 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:09.198913 28113 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:09.284421 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:09.286617 21562 raft_consensus.cc:2368] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:09:09.291339 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:09.294173 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.295264 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.298393 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:09.235718 28129 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.303925 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.305455 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.306429 21492 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:09.307808 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:09.311949 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:09.315136 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 77521.6us
I20260709 13:09:09.306857 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:09.325795 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.326480 21488 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:09.327489 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:09.310575 21560 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:09.321740 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:09.329653 21560 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:09:09.322489 21562 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:09.304730 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:09.316640 21493 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:09.288352 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:09.331377 21561 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:09.328109 22240 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:09.334808 21569 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:09.336618 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:09.336836 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48615.4us
I20260709 13:09:09.337604 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:09.337608 21560 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:09.233650 28101 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:09:09.341575 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:09.342407 22238 raft_consensus.cc:2410] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:09:09.344218 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:09.357709 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:09.351193 22243 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
W20260709 13:09:09.361670 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.363232 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:09.364980 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.326906 28113 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:09.366519 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.368794 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.322172 27723 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:09:09.332561 28125 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:09.365658 28107 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:09:09.320099 28129 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.316413 28155 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:09:09.373014 21569 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:09:09.370272 27969 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:09.383649 21485 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:09.387117 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.387960 21493 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:09.383945 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 47408.9us
I20260709 13:09:09.347307 27862 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:09.391036 21561 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:09.354259 28120 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:09.339076 28070 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:09.364161 28124 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:09.363772 28112 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:09.403213 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.404259 28117 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:09.404433 28141 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:09.382501 28113 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.384825 28023 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:09.405808 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:09.406183 27929 consensus_meta.cc:287] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.004s
I20260709 13:09:09.372571 27866 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:09.408772 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.340562 28071 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.375780 28135 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.355281 28025 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:09:09.423555 21560 raft_consensus.cc:2368] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20.
I20260709 13:09:09.427603 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:09.432030 21492 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
W20260709 13:09:09.439334 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 111962us
I20260709 13:09:09.440627 28155 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:09.423748 27713 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260709 13:09:09.443281 28107 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:09.427259 28023 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:09.444931 28071 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:09.447176 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.419983 28117 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.451411 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.384977 28125 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.453670 28149 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.454779 28135 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.458034 28160 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:09.458572 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.460229 28113 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:09.472234 21564 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11.
I20260709 13:09:09.490679 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:09.484963 27713 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:09.493366 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:09.416689 28070 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.502077 21485 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:09.509326 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:09.503605 21560 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:09.481235 28155 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:09.505713 21562 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:09.505468 21567 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 12.
I20260709 13:09:09.422334 28124 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.488582 28117 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:09.530507 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 127381us
I20260709 13:09:09.561995 21565 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:09.515220 27866 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:09.507023 28129 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:09.565871 27446 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.734s	user 0.005s	sys 0.005s
I20260709 13:09:09.570323 21565 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:09.619741 21563 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:09.620671 21459 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.572561 28125 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:09.574151 28070 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:09.577000 21493 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:09.577013 21485 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:09.577276 28023 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.581537 21568 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:09.583169 28155 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.589200 28119 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.590847 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:09.654982 21634 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:09.655368 21635 raft_consensus.cc:2410] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:09:09.591202 28147 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:09.568255 28163 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:09:09.594395 21567 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:09.601220 21532 leader_election.cc:400] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 11. Current term is 12.
I20260709 13:09:09.623778 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:09.659976 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58930.7us
I20260709 13:09:09.660770 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.661504 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.666296 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.668255 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:09.646150 21489 consensus_meta.cc:287] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.003s
I20260709 13:09:09.570484 28135 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:09.650187 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.651420 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:09.650265 21485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:09.653733 28157 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.654098 28155 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.669930 21489 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:09.680070 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.680488 21491 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:09.657653 28147 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:09.519515 28071 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 13:09:09.674701 21485 raft_consensus.cc:606] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:09.738749 21485 raft_consensus.cc:614] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:09.674206 21492 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:09.664388 27850 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:09.724395 28135 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.709306 21636 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:09.701175 21489 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:09.673520 28070 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.674896 28125 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:09.712353 28161 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:09.715543 28145 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:09.716902 28147 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.682962 27833 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:09.814757 27833 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:09.815312 27833 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:09.799885 28091 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:09.817570 28091 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:09.818423 28091 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.659042 28119 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.819613 28091 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:09.821303 28119 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:09.719614 27929 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:09.803754 28135 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.822649 27929 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:09.823048 27929 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:09.823886 28135 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:09.823817 27929 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.825057 27929 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:09.720413 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:09.721278 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:09.722189 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:09.829594 21640 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 11: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:09.723006 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:09.723817 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:09.732311 28124 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:09.732565 28117 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.831321 21643 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:09.832983 28117 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:09.733356 28149 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:09.833619 28149 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:09.712937 27723 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.710327 21634 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:09:09.681429 28157 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.671439 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.834632 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2817) took 1110 ms. Trace:
I20260709 13:09:09.842344 27723 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.845516 27723 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:09.746757 21485 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:09.847136 21485 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:09.699613 28101 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:09.856215 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 184908us
I20260709 13:09:09.799347 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.809031 28145 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:09.683228 28093 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
W20260709 13:09:09.859663 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 60421.7us
W20260709 13:09:09.850368 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.858392 21642 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:09.842154 21494 rpcz_store.cc:276] 0709 13:09:08.724070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.733205 (+  9135us) service_pool.cc:224] Handling call
0709 13:09:08.772870 (+ 39665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.781977 (+  9107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.782033 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.811723 (+ 29690us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.948504 (+136781us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:08.948545 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.948608 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.828429 (+879821us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b2400120bd8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6d7b9c4 00007f98a6d79acb 00007f98a6f34dc9 00007f98a6f34a55 00007f98a6f33fb0 00007f98a9baa488 00007f98a9baabe8 00007f98a9b82398 00007f98a9b7d76a 00007f98a9b7cbb6
0709 13:09:09.834327 (+  5898us) raft_consensus.cc:1685] finished
0709 13:09:09.834351 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.834572 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12192,"raft.queue_time_us":21899,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6216,"spinlock_wait_cycles":11241216,"thread_start_us":80680,"threads_started":1,"wal-append.queue_time_us":164607}
I20260709 13:09:09.881659 21639 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:09.804032 27846 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.889207 21491 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:09:09.893162 21493 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:09:09.886272 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:09.848134 21485 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.900218 21485 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:09.901176 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 510078us
I20260709 13:09:09.903630 27446 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:09.905172 27446 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:09.911207 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:09.913425 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.915912 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.860391 27974 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:09.881770 27922 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:09.917848 21562 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:09.881014 28124 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:09.919597 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:09.925750 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.927728 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.930256 27446 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.931414 21486 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:09.930943 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:09.934333 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 215154us
I20260709 13:09:09.867885 28135 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:09:09.935753 21487 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:09.916745 28164 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.940171 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.943378 21459 leader_election.cc:400] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20.
I20260709 13:09:09.936120 28120 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:09.948150 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.949036 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.952854 21459 leader_election.cc:403] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:09:09.954527 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:09.935477 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.957741 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.964252 21485 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:09:09.965582 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:09.952275 21494 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:09:09.967545 21485 pending_rounds.cc:85] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 11
I20260709 13:09:09.901635 28125 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:09:09.907195 28117 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:09:09.834578 28149 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.929901 27713 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:09.902350 27846 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:09.967901 21485 pending_rounds.cc:107] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:09:09.997782 21485 raft_consensus.cc:2889] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:09.975196 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 108219us
I20260709 13:09:09.983839 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:09.997294 28138 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:09:10.007135 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:09.966877 28120 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:09.978355 28141 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:09.926502 27974 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:10.013441 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 82586.7us
I20260709 13:09:09.999152 28070 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:10.002234 27914 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20.
I20260709 13:09:10.017628 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.016556 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.019243 21608 leader_election.cc:400] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:09:10.004972 28023 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:10.006325 28124 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:10.008666 28129 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:10.023669 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.024478 28107 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:10.024560 28189 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:10.025481 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.026196 28107 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.026357 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.026381 28189 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:10.027595 28189 consensus_queue.cc:1243] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:10.027653 28107 raft_consensus.cc:2764] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:09:10.027631 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.028501 28189 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:10.029053 28107 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:10.029455 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:09.973704 28164 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.031347 22238 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:10.012198 28120 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:10.061240 21643 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:10.082813 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:10.099686 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 70306.2us
I20260709 13:09:10.101392 21636 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:10.020560 28114 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:10.063717 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.071069 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:10.070636 22241 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:10.071511 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:10.069772 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:10.071763 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:10.034132 22243 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:10.020040 27713 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:09:10.108963 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:10.070622 28181 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:10.128888 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:10.035526 28141 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:09:10.146734 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 83141.4us
I20260709 13:09:10.074620 28166 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:10.022835 27969 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:10.079685 28157 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:10.057144 28095 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.079243 28175 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.064675 28145 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:10.170032 28164 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:10.066821 27864 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:09:10.155372 28049 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.155730 28166 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:10.155979 27969 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.175141 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:10.203624 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 271164us
I20260709 13:09:10.156342 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.178151 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.030472 28159 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:10.031522 27846 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:10.108155 28124 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:10.187701 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.200649 21636 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:10.020648 28167 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.139s
I20260709 13:09:10.202425 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.202351 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:10.202737 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 248336us
I20260709 13:09:10.021879 28070 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.206477 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:10.219170 22245 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:10.152328 28141 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:10.212718 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:10.219628 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 194727us
W20260709 13:09:10.217433 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 107753us
I20260709 13:09:10.030293 28180 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.204s
I20260709 13:09:10.220629 28141 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.221506 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:10.221846 28141 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:10.221189 28180 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:10.216143 21642 raft_consensus.cc:2410] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:09:10.223917 28180 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:10.224936 28180 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.226403 28180 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:10.231726 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:10.234313 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 46682.7us
I20260709 13:09:10.236236 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.239099 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.206573 27969 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:10.205093 28107 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:10.231352 27833 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.194940 28165 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:09:10.248929 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:10.263226 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.218472 28112 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.279313 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.186338 28175 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.251057 27864 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:10.288036 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.261315 27917 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.216605 28164 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:09:10.251343 28124 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:10.272454 28092 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:10.306536 27922 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:10.310168 22239 raft_consensus.cc:2410] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:09:10.287743 28112 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.316972 28112 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:10.321050 28175 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:10.301038 28173 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.309435 28195 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:10.327390 28195 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:10.243129 27846 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:09:10.328382 28195 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.310655 28165 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:10.355587 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 123263us
W20260709 13:09:10.357558 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 136112us
I20260709 13:09:10.373632 21560 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:10.384431 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:10.385259 21560 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:10.392299 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:10.375464 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 93044.3us
I20260709 13:09:10.395715 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:10.396782 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 108874us
I20260709 13:09:10.335667 27922 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.399516 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.401463 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.401608 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.402144 21561 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:10.402491 21565 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:10.404086 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:10.404330 21565 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:10.404768 21561 raft_consensus.cc:2376] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 11. Re-sending same reply.
I20260709 13:09:10.406374 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.407174 21561 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
W20260709 13:09:10.412948 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.414541 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.415551 21561 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:10.417554 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:10.418217 21561 raft_consensus.cc:2376] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17. Re-sending same reply.
I20260709 13:09:10.418430 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.420774 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.422730 21568 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:10.422880 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.423703 21565 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:10.423642 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.424346 22212 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:10.400791 27922 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:10.425894 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 178492us
I20260709 13:09:10.400590 28204 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.392830 28117 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:09:10.442548 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.443095 21560 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:10.445394 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:10.425343 28198 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:10.398602 28202 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:09:10.464152 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.419517 27864 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:09:10.419246 28165 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:09:10.440689 28095 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:10.472175 28208 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:10.461685 28198 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.456117 28203 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:10.406517 28107 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.492779 27833 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:10.460933 28112 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:09:10.476015 28095 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:10.531306 28171 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.791s	user 0.001s	sys 0.003s
I20260709 13:09:10.434412 28124 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:10.538962 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 103352us
I20260709 13:09:10.485312 28023 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.541095 27446 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:10.495779 28198 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.494838 28203 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.494690 28070 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:10.465196 28205 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
W20260709 13:09:10.546964 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 82891us
I20260709 13:09:10.541638 28095 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.575238 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 1605) took 1353 ms. Trace:
I20260709 13:09:10.575961 21569 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:10.579205 28207 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.581480 28180 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.595922 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.582121 28206 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:10.601812 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.603006 21635 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:10.591113 21566 rpcz_store.cc:276] 0709 13:09:09.221505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.360255 (+138750us) service_pool.cc:224] Handling call
0709 13:09:09.360777 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.367089 (+  6312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.367120 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.377339 (+ 10219us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.649750 (+272411us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:09.649971 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.650100 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.530581 (+880481us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:10.574884 (+ 44303us) raft_consensus.cc:1685] finished
0709 13:09:10.574908 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.575161 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4672,"raft.queue_time_us":8802,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":80,"spinlock_wait_cycles":120505728,"thread_start_us":271853,"threads_started":1,"wal-append.queue_time_us":297194}
I20260709 13:09:10.465569 28204 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.591431 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.526767 28166 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.628937 27974 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:10.594820 28112 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:10.591058 28203 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.629882 28112 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.632797 28112 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:10.594597 27864 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:09:10.638582 28149 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:10.609694 28207 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.554605 28023 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.644183 28207 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:10.644521 28023 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:10.646136 27969 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.648376 27969 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:10.649111 21568 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:09:10.608434 28180 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.642199 27922 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.659688 28147 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:10.666610 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 75249.3us
I20260709 13:09:10.666851 28129 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.668325 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4071) took 1081 ms. Trace:
I20260709 13:09:10.668798 21569 rpcz_store.cc:276] 0709 13:09:09.586771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.587228 (+   457us) service_pool.cc:224] Handling call
0709 13:09:10.575775 (+988547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.593495 (+ 17720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.668081 (+ 74586us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400151b50. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:10.668237 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272551296}
I20260709 13:09:10.670023 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:10.670957 27862 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:10.672389 27862 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:10.673190 28204 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:10.666652 28180 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:10.673568 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.674837 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.675148 28167 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.675952 28152 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:10.675721 28167 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.676368 28152 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:10.676622 28194 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:10.660423 28120 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.531s	user 0.002s	sys 0.008s
I20260709 13:09:10.677105 28194 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:10.671228 28224 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.677503 28194 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.660765 27922 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:10.677892 28167 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:10.676821 28152 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.678977 27862 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:10.679481 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.680545 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.677861 28224 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.682971 28221 raft_consensus.cc:476] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:10.683745 28125 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:10.684347 21643 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:10.685274 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:10.696178 28224 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:10.690069 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.701324 28091 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:10.701910 28091 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.702504 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:10.703197 28221 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:10.703743 28221 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:10.703852 28227 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.704521 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:10.704432 28227 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.704772 28221 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.692497 28159 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:10.690739 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.707337 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.707942 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.717144 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.724295 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:10.728012 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.728470 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.734613 21566 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:10.739579 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:10.740352 21491 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:10.670044 28163 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:10.706671 28227 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:10.722195 28159 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:10.741902 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:10.751112 21641 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:10.746265 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:10.744650 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 153033us
I20260709 13:09:10.690480 28203 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.726694 28164 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:10.750188 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.728615 28167 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:10.729631 27866 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:10.755249 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:10.753707 28198 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.735236 28107 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.735705 28204 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:10.758657 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.760989 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:10.764417 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.760136 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:10.745270 28163 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:10.768973 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.770694 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.771872 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:10.677433 28120 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.773398 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:10.775688 28161 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:10.765153 28204 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:10.757149 28205 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:09:10.777817 28169 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.001s	sys 0.025s
I20260709 13:09:10.777737 28195 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:10.779460 28163 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.765853 28129 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.740890 27969 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:09:10.787144 28219 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:10.855453 27446 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:10.793515 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:10.792894 21493 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:09:10.754099 28125 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:10.792810 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:10.794606 28209 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:10.860707 21491 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:10.794154 21492 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:10.760600 28180 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:10.809595 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:10.811939 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 57142.5us
I20260709 13:09:10.812337 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.865658 21487 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:10.813586 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.817198 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.819191 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:10.866643 21566 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:10.866743 21638 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
W20260709 13:09:10.820115 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.828740 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:10.748085 28095 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:10.823182 28169 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.001s	sys 0.025s
I20260709 13:09:10.841517 27866 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:10.843675 28167 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:10.844435 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:10.870002 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:10.870368 21561 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:10.796352 28070 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:10.856643 21493 pending_rounds.cc:85] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 11
I20260709 13:09:10.816735 28204 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:10.817044 28205 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.763233 28164 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:10.856186 21494 raft_consensus.cc:2376] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15. Re-sending same reply.
I20260709 13:09:10.896872 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:10.897859 21486 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:10.864157 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:10.865412 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 110562us
I20260709 13:09:10.875288 21493 pending_rounds.cc:107] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:09:10.901387 21493 raft_consensus.cc:2889] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:10.866271 28202 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:10.876731 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:10.902284 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:10.902653 21489 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:10.903147 22245 raft_consensus.cc:2368] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15.
I20260709 13:09:10.877640 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:10.903497 21491 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260709 13:09:10.878293 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49891.9us
I20260709 13:09:10.855856 28219 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.890225 28120 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:10.890833 28091 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:10.891108 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:10.892517 22242 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:09:10.806175 28161 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.909598 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:10.911207 22238 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:10.905876 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:10.895488 28205 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:10.909152 28191 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:10.927354 28145 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:09:10.931953 28226 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:10.932837 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:10.933754 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:10.935122 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.054232 21634 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:10.867981 28180 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:10.966737 22238 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:10.986013 28230 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:10.910734 28219 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:10.989657 28228 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:10.918422 28112 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:10.992762 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.072657 21485 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:10.993953 28213 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:10.994434 28223 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:10.997043 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:10.913789 28129 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:10.917454 28070 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:11.109439 21636 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:11.002143 21563 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:09:11.004678 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:11.008823 22239 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:09:11.024292 28166 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:11.032711 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:11.034950 27866 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:11.036190 28163 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:11.036962 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.022346 28093 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:11.119782 28070 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.135170 28093 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.108790 28223 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.137171 28093 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.137730 28147 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:11.138159 28147 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:11.037715 28210 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:11.142352 28210 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:11.091575 28149 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.048187 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.143165 28149 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.057358 22246 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:10.867774 28209 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:10.988657 28225 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:09:11.066208 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:10.882970 28167 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.093375 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:11.092551 21491 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
W20260709 13:09:11.104797 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46039.6us
I20260709 13:09:11.113986 21563 pending_rounds.cc:85] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 12
I20260709 13:09:11.114089 21486 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:11.056607 28191 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:11.117816 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.115437 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:11.121769 21485 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:09:11.121943 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 89332.7us
I20260709 13:09:11.119783 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:10.915942 28202 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.130560 28095 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.131954 28161 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.079874 28230 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.078222 28112 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:11.134447 28188 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:09:11.134625 22242 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:11.192597 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:11.179301 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.186162 21563 pending_rounds.cc:107] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:09:11.194566 21563 raft_consensus.cc:2889] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:11.143940 21642 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:11.188936 22246 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:11.196873 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:11.198310 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:11.198097 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82773.9us
W20260709 13:09:11.204452 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 84726.1us
I20260709 13:09:11.204545 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:11.206713 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:11.116601 28129 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.210731 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.249540 21606 leader_election.cc:400] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15.
I20260709 13:09:11.250005 21606 leader_election.cc:403] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:11.186925 27866 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:11.254246 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48828.3us
W20260709 13:09:11.255330 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 53550us
I20260709 13:09:11.193365 28112 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:11.258491 22242 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:09:11.267542 21459 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:11.243209 28095 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:11.274039 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.243063 28227 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:11.249272 28120 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.281350 28120 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.248991 27713 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:11.247900 27922 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:11.209776 28145 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:09:11.260339 27846 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:11.115501 28152 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:11.295416 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.275429 28095 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.296640 28095 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:11.283542 28164 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.286540 27922 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.299333 27922 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:11.300290 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:11.307530 28227 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:11.312899 28152 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.313508 28203 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.321931 21486 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:11.329802 28120 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.336326 27914 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:11.289064 28191 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.341308 28191 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:11.342934 28190 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:11.343577 28217 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:11.344215 28217 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.347036 28193 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:11.197350 28147 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:11.348873 28194 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.000s
I20260709 13:09:11.349725 28129 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.349470 28194 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.353700 28194 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.355108 21486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:11.355724 21486 raft_consensus.cc:606] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:11.356060 21486 raft_consensus.cc:614] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:11.359690 28180 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.270819 27866 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.354110 28204 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.369506 28180 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.346588 28217 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.277140 28210 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.394423 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.395138 21494 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:11.384938 27917 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.392684 27862 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:11.383474 28180 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.444969 21494 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:11.412870 28230 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.467408 21563 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:11.437083 28167 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.450192 28219 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.460144 28205 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.464350 28180 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:11.440868 28159 consensus_meta.cc:287] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.000s
I20260709 13:09:11.476552 21494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:11.419804 27917 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.480095 21494 raft_consensus.cc:606] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:11.481743 21494 raft_consensus.cc:614] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:11.483099 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 208035us
I20260709 13:09:11.483860 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:11.486121 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 240372us
I20260709 13:09:11.493250 21640 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 24: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:11.494447 21565 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 24: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:11.498878 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:11.499524 21564 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:11.501024 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.508519 21563 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:11.481352 28159 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.526955 28120 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.527154 28159 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.527562 28120 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.528110 21487 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:11.529502 27917 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.529838 28120 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.534207 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.535295 28198 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:11.507467 28221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.014s	sys 0.017s
W20260709 13:09:11.537011 28221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.014s	sys 0.017s
I20260709 13:09:11.537930 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:11.539404 21564 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:11.540576 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.541647 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.542186 21564 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:09:11.543066 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.543774 21564 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 16: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:11.543066 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:11.507936 28230 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.547168 21567 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 11.
I20260709 13:09:11.560998 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:11.501452 28253 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.548732 28257 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:11.572154 28257 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:11.549333 27866 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.573752 28166 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.574316 28166 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.575875 28070 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.576368 28166 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.577483 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.579308 28231 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.572485 28202 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.579916 28231 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.581190 28152 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:11.581650 28152 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:11.582280 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.583014 21561 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
W20260709 13:09:11.583818 28242 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:09:11.584378 21561 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:11.584463 28209 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.585330 28145 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:11.586081 21485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:11.585922 28145 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.586716 21485 raft_consensus.cc:606] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:11.588016 28219 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.588253 28231 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.573770 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.549842 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.552330 27922 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.592788 27922 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.523471 27914 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:09:11.563397 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:11.596839 27914 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:11.597282 27914 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:11.597676 27914 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:11.515872 28095 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.601538 28095 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.602348 21487 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:11.603602 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.604801 28223 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.604888 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.605249 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:11.606076 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.606240 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.606630 28091 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.606904 28230 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.607287 28091 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.609125 28230 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.512059 28101 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:11.557384 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:11.562354 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.547919 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:11.623155 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 75327.7us
I20260709 13:09:11.624694 21641 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:11.625088 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:11.564064 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.555362 28204 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.568451 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:11.629976 21489 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:11.630169 21568 raft_consensus.cc:2393] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:11.568540 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:11.569672 21640 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:11.630738 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.631248 21493 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:11.571060 28244 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:09:11.571247 28250 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 13:09:11.634102 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:11.634729 21569 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:11.635211 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.635852 21492 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:11.557202 28205 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.636785 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:11.637065 28145 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.637354 21492 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:11.638195 21493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
W20260709 13:09:11.639968 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.640586 28198 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:11.642197 28198 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:11.611881 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.642961 28223 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:11.645423 28149 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.565359 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.612969 28120 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:11.613685 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.613986 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.647150 28120 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.647801 22242 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:11.513230 28254 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.649909 28254 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.634181 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:11.582590 28152 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.651209 21489 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:11.651762 28152 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:11.652104 28254 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.652853 21488 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:11.631901 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:11.604907 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.633368 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.619248 28257 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:11.675464 21567 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:11.676541 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.677466 21567 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:09:11.678129 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 43521.3us
I20260709 13:09:11.680022 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:11.639823 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.649364 28120 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.659731 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:11.633404 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.688709 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:11.689003 21487 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:11.656919 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.689652 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:11.657673 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.690528 21568 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 24: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:11.690758 21562 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:11.660058 21489 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:09:11.684549 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:11.670616 21569 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:11.686823 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.692678 21641 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:11.686960 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:11.693238 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:11.693907 21564 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 17: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:11.695786 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.696708 21567 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:11.697784 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.699330 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.688959 22247 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:11.700918 28091 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:11.701943 28198 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:11.702642 28198 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:11.703141 28198 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 24 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:11.703969 28198 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.704811 21565 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
W20260709 13:09:11.706856 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 75014.1us
I20260709 13:09:11.707310 21569 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:09:11.708449 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.708976 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:11.709136 21565 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:11.713063 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:11.698509 21567 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:11.713356 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.632184 28101 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:11.673949 27866 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:11.730876 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:11.653934 28194 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:11.723168 21638 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:11.715263 28149 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:11.711328 28191 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:11.718713 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:11.719794 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:11.733686 21492 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:11.736092 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.740120 21638 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:11.712234 28155 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:11.620473 28253 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.744330 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:11.749387 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.750061 21641 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:11.753568 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:11.708268 28173 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:09:11.738837 28197 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:11.756050 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:11.715904 27723 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:09:11.780436 28254 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:11.780818 28254 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:11.781164 28254 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:11.745332 28163 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:11.742434 28194 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:11.779409 21636 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:09:11.785866 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.752667 28205 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:11.817770 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.754653 28149 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:11.783468 28227 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15.
W20260709 13:09:11.808390 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 242171us
I20260709 13:09:11.822521 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.808902 27914 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.737308 28221 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:09:11.812866 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:11.813570 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 75923.9us
I20260709 13:09:11.754041 28093 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:11.837160 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:11.837639 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.811424 28163 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.816742 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:11.817826 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:11.844437 21638 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 24: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:11.742967 28191 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:11.841780 21566 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:11.837675 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:11.848413 21637 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:09:11.828317 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.828368 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.850220 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:11.834920 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.816742 21564 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:11.839346 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.840508 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:11.852481 21487 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 24: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:11.826948 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:11.853101 21639 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:11.831905 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.854156 21642 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:11.851241 21488 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:11.870118 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:11.876056 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:11.876724 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:11.877843 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:11.754232 28101 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:11.879824 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:11.841210 28163 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:11.833377 28205 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:11.871064 22247 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:11.887250 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:11.894251 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44142.7us
I20260709 13:09:11.836251 28093 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:11.836385 28149 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:11.888904 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:11.896559 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:11.901605 28093 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:11.916474 28265 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:09:11.916682 27914 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:11.871624 27917 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:11.920023 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.920794 21486 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:11.921761 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:11.922346 21486 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
W20260709 13:09:11.911713 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.924749 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:11.923532 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 168257us
W20260709 13:09:11.934298 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45537.1us
W20260709 13:09:11.902472 28112 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.618s	user 0.003s	sys 0.008s
I20260709 13:09:11.901265 27713 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:11.893951 28195 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:11.933247 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:11.972808 21639 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:11.984858 21457 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:11.970746 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:11.969762 21643 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
W20260709 13:09:11.990021 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 56891.2us
I20260709 13:09:11.994405 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:11.986042 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:11.943524 28223 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:11.999060 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 72039.4us
I20260709 13:09:11.923224 28106 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:12.001008 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:12.007917 28167 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:11.962015 27850 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:09:12.011004 28202 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:11.997825 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:11.966497 27713 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.950112 28152 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:11.955974 27914 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:11.962669 27917 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:11.943223 28210 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:09:11.951062 28070 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:09:11.999581 28145 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:12.014204 28164 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:12.031484 28195 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:11.902141 28194 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.031317 28193 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:12.060998 28193 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.061477 28193 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:12.063265 27917 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.064596 28161 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:12.065052 28161 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.065424 28161 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:12.026898 28159 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:12.067546 28159 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:12.068521 28159 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.019907 28167 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:12.071650 28167 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:12.032976 27713 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:12.071055 27862 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:12.076654 27862 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:12.078871 28205 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.039984 28229 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:12.030759 28152 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:12.087967 28152 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:12.091624 28253 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:12.092168 28163 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.095409 28191 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:11.962520 28112 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.112121 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:12.114975 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:12.143543 28163 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:12.145505 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:12.146178 21564 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:12.156169 21564 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:09:12.162395 21640 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 22: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:09:12.164971 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 277841us
I20260709 13:09:12.163875 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:12.166131 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:12.240137 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 74106.9us
W20260709 13:09:12.240257 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 68507.2us
W20260709 13:09:12.240824 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.241794 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:12.243554 28208 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:09:12.243517 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 245724us
I20260709 13:09:12.097682 28193 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.250059 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:12.250401 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:12.256587 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:12.244095 28208 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:12.265000 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:12.269614 28167 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.258292 28204 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:12.273798 28093 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.274896 28202 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:12.275331 28202 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:12.275702 28202 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:12.276208 28093 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:12.279794 21486 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:12.264248 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:12.283875 28112 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:12.288478 28161 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.294633 21486 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:09:12.248960 28191 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:09:12.312587 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48442.8us
I20260709 13:09:12.313539 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:12.317507 21606 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:12.321260 27929 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:12.309264 28145 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:12.321385 28093 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:12.322528 28093 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:12.322381 28145 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.323124 28093 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:12.325384 28145 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:12.328310 28204 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:12.328747 28204 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:12.328600 27862 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.329171 28204 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:12.309262 28191 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.315909 28120 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:12.260573 28270 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:12.331632 28191 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:12.344825 28254 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:09:12.345263 28254 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.332036 27713 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.348225 28093 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.349248 27713 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:12.330770 27862 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:12.341207 28193 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.335011 21635 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:12.335280 28208 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.354125 28167 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.337216 28270 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:12.356196 28257 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 13:09:12.356621 28257 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.356873 28270 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.357707 21634 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:12.359709 28257 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:12.359854 28093 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.057438 28149 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.438015 21638 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:09:12.442323 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.375378 28191 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.376806 28204 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.377919 28152 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.380210 28161 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.320482 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:12.387545 28180 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.389072 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:12.395619 28254 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:12.397025 21493 raft_consensus.cc:606] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:12.405428 28282 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:12.490214 28282 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:12.436291 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 272509us
I20260709 13:09:12.492887 28282 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.498943 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:12.499826 22243 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:12.503083 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:12.503369 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:12.503599 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:12.513069 22238 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:12.514245 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:09:12.518217 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 197820us
I20260709 13:09:12.506631 28203 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:12.524135 28101 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:12.504375 28180 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.540501 28198 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:12.541167 28198 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.522003 28202 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.530964 28167 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:12.559715 28152 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:12.558420 28227 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:12.566236 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:12.567778 21493 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:09:12.544656 28191 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:12.569455 21485 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:12.567914 28227 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:12.565594 28167 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.580801 28202 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:12.582299 28180 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.570325 28070 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:12.574981 28204 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:12.592895 28254 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:12.593449 28254 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.589668 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36572 (request call id 1623) took 1439 ms. Trace:
I20260709 13:09:12.594660 21563 rpcz_store.cc:276] 0709 13:09:11.150129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.299972 (+149843us) service_pool.cc:224] Handling call
0709 13:09:12.589475 (+1289503us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400146ed4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:12.589598 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382360448}
I20260709 13:09:12.595623 28254 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:12.591117 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 59133.8us
I20260709 13:09:12.597661 21459 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:12.599079 27922 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:09:12.584015 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 54714.2us
I20260709 13:09:12.602221 28147 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:12.583094 28070 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.608387 28070 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.616526 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:12.618798 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:12.621465 28152 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:12.616852 28191 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:12.623061 28191 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.625185 28191 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:12.589947 28266 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.692s	user 0.004s	sys 0.009s
I20260709 13:09:12.627730 28152 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:12.628325 28152 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.628760 28167 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:12.630467 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 2898) took 1312 ms. Trace:
I20260709 13:09:12.630887 21561 rpcz_store.cc:276] 0709 13:09:11.318358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.591637 (+273279us) service_pool.cc:224] Handling call
0709 13:09:11.591929 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.635406 (+ 43477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.635439 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.635986 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.734682 (+ 98696us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:11.734720 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.734776 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.589186 (+854410us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:12.630166 (+ 40980us) raft_consensus.cc:1685] finished
0709 13:09:12.630188 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.630406 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43077,"raft.queue_time_us":44737,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":9869184,"thread_start_us":98360,"threads_started":1,"wal-append.queue_time_us":192460}
I20260709 13:09:12.635066 27922 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:12.642740 27850 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:12.649443 28180 raft_consensus.cc:993] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:09:12.638338 28070 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:12.654512 28152 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:12.653257 28101 raft_consensus.cc:1081] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:09:12.648579 28302 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:12.660283 28302 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.664567 28302 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.651152 27850 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.660507 27922 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.677003 27850 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:12.641482 28227 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.656088 28198 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:12.672107 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:12.672120 28167 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.673188 28117 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:12.674177 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:12.675879 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1107) took 1296 ms. Trace:
I20260709 13:09:12.679443 28198 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:12.681663 28257 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.689612 28257 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.683648 28167 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.687752 28117 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:12.681419 28147 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:12.694511 28167 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.696803 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:12.697971 28227 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:12.700214 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:12.654318 28070 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.709383 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:12.710197 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:12.691259 21491 rpcz_store.cc:276] 0709 13:09:11.379635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.379750 (+   115us) service_pool.cc:224] Handling call
0709 13:09:11.389051 (+  9301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.405044 (+ 15993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.405081 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.570202 (+1165121us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b2c000014c8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:09:12.572164 (+  1962us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.646200 (+ 74036us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:12.646235 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.646306 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.675483 (+ 29177us) raft_consensus.cc:1685] finished
0709 13:09:12.675512 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.675783 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8121,"raft.queue_time_us":3566,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":15175,"spinlock_wait_cycles":4425600,"thread_start_us":60706,"threads_started":1,"wal-append.queue_time_us":87112}
W20260709 13:09:12.705543 28298 log.cc:927] Time spent T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:12.716718 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:12.716856 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:12.717233 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:12.717656 22247 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:12.694653 28117 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.725876 21490 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:12.726163 28070 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.727782 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:12.729857 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3611) took 1013 ms. Trace:
I20260709 13:09:12.732224 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:12.732672 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:12.732928 21492 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:12.731276 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:12.730254 21640 rpcz_store.cc:276] 0709 13:09:11.716609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.716751 (+   142us) service_pool.cc:224] Handling call
0709 13:09:12.729618 (+1012867us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400219b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:12.729803 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990245632}
I20260709 13:09:12.737804 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:12.737861 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:12.738616 21493 raft_consensus.cc:2368] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
I20260709 13:09:12.738682 21487 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:12.741741 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:12.742098 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:12.742543 21493 raft_consensus.cc:2368] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:09:12.732276 28195 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:12.749684 28195 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.749735 27850 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.750656 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:12.751998 28195 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.752310 27850 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:12.759384 21490 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:12.762805 21488 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:12.764447 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:12.765448 28117 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:12.766510 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:12.767031 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:12.767810 21563 raft_consensus.cc:2368] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16.
I20260709 13:09:12.740236 28233 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:09:12.765468 28159 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:12.769552 28159 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:12.770512 28159 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:12.772298 28257 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:12.733757 28216 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:12.774209 28216 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:12.775009 28216 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:12.776207 28216 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:12.776949 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:12.777771 21640 raft_consensus.cc:2368] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21.
I20260709 13:09:12.784092 21637 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:09:12.787936 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:12.793483 21606 leader_election.cc:400] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
I20260709 13:09:12.793929 21606 leader_election.cc:403] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:09:12.795370 21491 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:12.797158 21606 leader_election.cc:400] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:09:12.797715 21606 leader_election.cc:403] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:09:12.799904 21492 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:12.801800 21606 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:12.802913 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:12.803002 22247 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:12.840267 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:12.830890 21568 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:12.829818 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:12.850257 21561 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:12.819250 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:12.851588 21560 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 16: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:12.819303 21637 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:12.825917 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:12.794710 27864 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:09:13.087805 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:12.876961 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:12.884390 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:12.892122 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:12.802413 28257 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:12.881842 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:13.078410 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.863559 21564 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:12.893083 22245 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:09:12.911790 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:12.880797 21487 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:12.889421 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:12.904323 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:12.864163 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:12.865227 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:12.936537 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:13.102741 21563 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:12.814721 28147 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:12.808593 28204 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:13.093156 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:12.814574 28164 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:13.109395 21561 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:13.055083 21640 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:13.111984 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:13.139519 21562 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:12.940366 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:12.801362 27723 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.323s
I20260709 13:09:12.901376 28191 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.808706 28149 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:09:12.938482 28303 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:09:13.107561 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 218264us
W20260709 13:09:13.134626 28271 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:09:13.163159 28285 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:13.164028 28285 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.107923 21560 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:13.155520 21459 leader_election.cc:400] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16.
I20260709 13:09:13.165431 21459 leader_election.cc:403] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:09:13.156399 21563 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:13.108264 21566 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:13.130285 28159 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:12.979547 21567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:40994
I20260709 13:09:13.139413 28194 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:13.172260 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:13.174705 21567 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:13.183543 21567 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:13.070459 28203 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:13.055090 28154 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260709 13:09:13.181000 21640 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:09:13.200843 21640 pending_rounds.cc:85] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 14
I20260709 13:09:13.201179 21640 pending_rounds.cc:107] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:09:13.201638 21640 raft_consensus.cc:2889] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:13.209728 21643 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:13.186000 28254 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16.
I20260709 13:09:13.203971 28149 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.203298 28302 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.013s	sys 0.024s
W20260709 13:09:13.252936 21532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.023s	sys 0.028s
I20260709 13:09:13.206616 28194 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:13.160666 28191 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.212661 28306 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:13.240216 27922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.017s	sys 0.037s
W20260709 13:09:13.253818 21532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.023s	sys 0.028s
W20260709 13:09:13.263856 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 586713us
I20260709 13:09:13.244793 21567 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.279695 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:13.281391 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:13.259146 28302 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.013s	sys 0.025s
I20260709 13:09:13.286718 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:13.283334 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:13.249612 28285 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:13.287679 21565 raft_consensus.cc:2368] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
I20260709 13:09:13.258751 28165 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.291173 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:13.284297 21568 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:13.287771 21564 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:13.289325 21566 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 22: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:13.274901 27922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.018s	sys 0.037s
I20260709 13:09:13.293164 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:13.212047 28203 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.300439 21568 raft_consensus.cc:2368] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:09:13.296519 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:13.308219 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 202899us
I20260709 13:09:13.309870 28203 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:13.311443 21608 leader_election.cc:400] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
I20260709 13:09:13.317345 28197 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:13.317966 21634 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:13.318104 28197 consensus_queue.cc:1243] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:09:13.319324 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 493513us
I20260709 13:09:13.260993 28149 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.322665 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:13.327394 21563 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:13.305704 21567 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:13.377794 21564 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:13.368877 27922 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:13.302768 28165 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.395750 27922 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.397810 28165 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:13.353998 28203 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:13.398833 28203 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.389683 28194 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.402839 21635 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
W20260709 13:09:13.393174 28227 consensus_meta.cc:287] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.000s
I20260709 13:09:13.397922 27922 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:13.295027 28306 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.414011 28306 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:13.410768 28164 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:09:13.427383 28152 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:13.428176 28152 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.431525 21638 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
W20260709 13:09:13.421217 28315 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:09:13.388880 28191 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:13.450712 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 286030us
W20260709 13:09:13.456560 28216 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.680s	user 0.005s	sys 0.008s
I20260709 13:09:13.458706 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.461836 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.462405 21487 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:13.463982 21487 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:13.466231 21562 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:13.482009 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.452744 28152 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:13.497073 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.500547 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.500826 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.503710 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.505260 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.505452 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.484360 28257 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.499007 28117 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.000s
I20260709 13:09:13.508558 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:13.509661 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 200699us
I20260709 13:09:13.511138 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:13.508901 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 206354us
I20260709 13:09:13.517206 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.518291 21634 raft_consensus.cc:2410] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:09:13.514762 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 340879us
I20260709 13:09:13.532361 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.536643 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:13.544580 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.546147 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:13.546399 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:13.561415 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.523574 28257 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.568018 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:13.568382 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 247914us
I20260709 13:09:13.570181 21634 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:09:13.571499 28311 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:09:13.607040 28257 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:13.562372 28320 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:09:13.607882 27922 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:13.575680 28306 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.608852 28306 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.611001 28306 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:13.611862 28149 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:13.579346 28328 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:13.613418 28328 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:13.614442 28328 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.615701 28328 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:13.579963 28308 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:13.618269 28308 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.620690 28308 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:13.587808 28224 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:13.621510 28224 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:13.622437 28224 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.623502 28224 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:13.589274 28166 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:13.626403 28166 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:13.627347 28166 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.628365 28166 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:13.629079 28203 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:13.594365 28285 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:13.603591 28204 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
I20260709 13:09:13.604316 28197 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.639292 28197 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.641541 28197 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:13.608181 28317 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.361s	user 0.004s	sys 0.000s
I20260709 13:09:13.576942 28093 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:13.644316 28254 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:13.616226 21532 leader_election.cc:400] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21.
I20260709 13:09:13.649950 21532 leader_election.cc:403] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:09:13.652177 21640 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:09:13.653909 28197 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21.
I20260709 13:09:13.661659 28197 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:13.663682 28197 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.666687 28324 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:13.667439 28324 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.669795 28227 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:13.670125 28324 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:13.670302 28197 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:13.670485 28227 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.674023 28227 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:13.674760 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.679486 21641 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
W20260709 13:09:13.676743 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 113608us
I20260709 13:09:13.689317 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:13.701097 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:13.712309 28282 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:13.700330 28161 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:13.700762 28325 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:09:13.718209 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:13.730031 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:13.731506 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:13.712659 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:13.735116 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:13.671736 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46099.5us
I20260709 13:09:13.743240 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:13.742650 28302 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:09:13.705550 28204 consensus_queue.cc:1059] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:09:13.716915 28227 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:09:13.782258 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:13.785351 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.743213 28194 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:13.776067 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:13.741967 28282 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:13.776402 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:13.747887 28324 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:13.788630 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:13.790743 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:13.797473 21487 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:13.797802 21487 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:13.797894 28195 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:13.798195 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:13.791393 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.792053 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.799250 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.793938 21636 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:13.750730 28325 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:13.799881 21639 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:13.800029 21641 pending_rounds.cc:85] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 11
I20260709 13:09:13.803313 21641 pending_rounds.cc:107] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 22.12
W20260709 13:09:13.803470 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 72069.9us
I20260709 13:09:13.803719 21641 raft_consensus.cc:2889] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:13.804436 28149 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:13.801939 28306 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:13.805015 28149 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:13.805877 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:13.807052 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.807708 21491 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:13.808012 28285 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:13.806061 28149 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.808552 28285 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:13.808612 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.809587 28285 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.803332 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:13.801067 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:13.812094 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:13.805738 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.807559 28321 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:13.822252 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:13.823732 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:13.798542 21487 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.828120 21488 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:13.749078 28180 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:09:13.839099 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:13.833480 28164 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:13.833981 21608 leader_election.cc:400] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18.
I20260709 13:09:13.839991 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.835637 28227 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:13.831348 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:13.840783 28227 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.842308 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:13.839344 21487 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:13.811355 28327 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:09:13.849424 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.847575 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:13.850128 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.851393 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.800941 28101 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:13.801754 28197 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:13.852483 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.852872 21565 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:13.853168 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.792428 28254 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:09:13.829771 28306 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:13.832263 28194 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:13.829926 28308 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:13.872707 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:13.880162 21569 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:13.869151 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.844385 28305 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:13.836690 28204 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:09:13.861462 28321 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:13.870901 28324 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:13.875100 28332 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:13.874217 28154 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:13.882572 28194 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.884773 28302 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:13.902567 28101 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:13.901081 28161 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.923276 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 380386us
I20260709 13:09:13.916314 28302 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:13.917711 28101 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.896416 28191 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:09:13.916097 28194 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:13.938328 28302 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:13.953291 28332 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:13.954005 28332 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.956300 28332 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:13.956497 28101 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:13.959898 21388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 250) took 6706 ms. Trace:
I20260709 13:09:13.896903 28282 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.916461 28154 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.907264 28321 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.921041 28161 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:13.926065 21488 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:13.975703 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:13.975872 21634 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:13.976240 22247 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:13.961169 21388 rpcz_store.cc:276] 0709 13:09:07.231933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.232268 (+   335us) service_pool.cc:224] Handling call
0709 13:09:07.311904 (+ 79636us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4c090 00007f98a9feaf3a 00007f98afda11cc 00007f98afe9f37e 00007f98ae3602a4 00007f98ae360232 00007f98ae360161 00007f98ae3600dc 00007f98ae35f392 00007f98a831d48c 00007f98a831c8c6
0709 13:09:13.938142 (+6626238us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:09.517558 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:09.518211 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:09.518250 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:09:09.518262 (+    12us) tablet.cc:662] Decoding operations
0709 13:09:09.727709 (+209447us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:09.727836 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:09.727865 (+    29us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:09:09.730161 (+  2296us) tablet.cc:701] Row locks acquired
0709 13:09:09.730232 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:09:09.730415 (+   183us) write_op.cc:270] Start()
0709 13:09:09.730576 (+   161us) write_op.cc:276] Timestamp: P: 1783602549730344 usec, L: 0
0709 13:09:09.730619 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:09:09.743998 (+ 13379us) log.cc:844] Serialized 10884 byte log entry
0709 13:09:10.529072 (+785074us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a6ed80ac 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b
0709 13:09:11.554527 (+1025455us) op_driver.cc:464] REPLICATION: finished
0709 13:09:11.913295 (+358768us) write_op.cc:301] APPLY: starting
0709 13:09:11.913441 (+   146us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:12.283112 (+369671us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:12.283173 (+    61us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:12.679098 (+395925us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b180006d5a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9d210ec 00007f98a9d23af7 00007f98a9d24fb0 00007f98ada391bb 00007f98ada805d4 00007f98ad92c8da 00007f98ad92f3cb 00007f98ad92efd3 00007f98ada2de34
0709 13:09:12.704230 (+ 25132us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:12.704766 (+   536us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:09:12.704835 (+    69us) write_op.cc:312] APPLY: finished
0709 13:09:12.705421 (+   586us) log.cc:844] Serialized 236 byte log entry
0709 13:09:12.890796 (+185375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:12.891132 (+   336us) write_op.cc:454] Released schema lock
0709 13:09:12.891251 (+   119us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:13.087135 (+195884us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:13.087189 (+    54us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85384,"reported_tablets":42,"spinlock_wait_cycles":68331776,"child_traces":[["op",{"apply.queue_time_us":292619,"apply.run_cpu_time_us":57561,"apply.run_wall_time_us":1098983,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116879,"num_ops":27,"prepare.queue_time_us":145852,"prepare.run_cpu_time_us":35873,"prepare.run_wall_time_us":1393021,"raft.queue_time_us":257364,"raft.run_cpu_time_us":50383,"raft.run_wall_time_us":196715,"replication_time_us":1823753,"spinlock_wait_cycles":115466368,"thread_start_us":1818550,"threads_started":5,"wal-append.queue_time_us":1264746,"wal-append.run_cpu_time_us":19253,"wal-append.run_wall_time_us":1763101}]]}
I20260709 13:09:13.969892 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:13.977125 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.977653 21634 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:13.977746 21635 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:13.970737 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:13.981753 21640 raft_consensus.cc:2410] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:09:13.958598 21487 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:13.971366 21636 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:13.971789 22238 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:13.972802 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.006932 22247 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:14.011456 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.012284 22245 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
W20260709 13:09:14.016925 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 215626us
I20260709 13:09:14.024081 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:14.026678 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:14.051883 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.056962 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.057622 22247 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:14.059188 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.061192 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:14.064940 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.062577 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:14.068625 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.070462 28149 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:14.071012 28149 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.071431 28149 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:14.075067 28191 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:13.978070 28166 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:09:14.120021 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 277774us
W20260709 13:09:14.146756 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.149636 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.050040 28180 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:14.047421 28325 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:14.122401 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:14.169001 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 46670.1us
I20260709 13:09:14.170547 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.171594 21569 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:14.178169 21569 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:14.180485 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.180842 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.182994 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.183858 21564 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
W20260709 13:09:14.189425 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 162843us
I20260709 13:09:14.190594 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:14.194491 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.207897 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.208658 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.201258 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.170126 28180 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:14.214092 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64992.5us
I20260709 13:09:14.215826 21562 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:14.216506 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.216697 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:14.180681 28306 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.182442 28332 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:14.224949 21389 catalog_manager.cc:5697] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:14.226851 28339 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:09:14.206426 28305 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.223423 28180 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:14.236672 28095 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.269990 28354 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:14.285061 28352 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:14.285581 28352 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.286000 28352 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:14.286823 28328 consensus_meta.cc:287] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.660s	user 0.013s	sys 0.001s
I20260709 13:09:14.250917 28332 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:14.230818 28306 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.247334 28197 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.274091 21389 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 13 to 15, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 15 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.246378 28280 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:09:14.248708 28305 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.335326 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.332281 21389 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 18 to 16, leader changed from <none> to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 16 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:14.341990 21564 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:14.310379 28321 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:14.337117 28344 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:09:14.331115 28161 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.327164 28354 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:14.339563 28346 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:09:14.327417 28328 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.333631 28323 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:14.273924 28095 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.268765 28325 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.330240 28194 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.362293 21389 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:14.368721 28343 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 13:09:14.368907 28349 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:09:14.341118 28197 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:14.382292 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 152530us
I20260709 13:09:14.357643 28319 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.352770 27922 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:14.357076 28093 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:14.398692 28365 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:14.408703 28161 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:14.409330 28161 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.412498 28095 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.413851 28305 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.417076 28227 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.420996 28149 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:14.425740 28359 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:09:14.428385 28356 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:09:14.433880 28324 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.521s	user 0.002s	sys 0.009s
I20260709 13:09:14.434363 28324 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:14.442664 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.468508 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:14.394299 28345 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.161s	user 0.002s	sys 0.000s
I20260709 13:09:14.360672 28328 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:14.446769 28355 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:09:14.448909 28203 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:14.444926 28194 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:14.529208 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.508948 28308 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:14.529608 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 328514us
I20260709 13:09:14.438735 28302 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.546077 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.386482 28332 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.521009 28257 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:14.446329 28197 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.459180 27922 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.461243 28093 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.525480 28203 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:14.554070 28321 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:09:14.557305 28149 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:14.615036 28346 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:09:14.611472 28224 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.988s	user 0.012s	sys 0.002s
I20260709 13:09:14.589571 28197 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.561024 28257 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:14.587162 28194 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:14.639591 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.640400 28197 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.641776 28093 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:14.644372 28361 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:09:14.617264 28161 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.554355 28308 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.652944 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.655138 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:14.667989 21485 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:14.668370 21488 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:14.619123 28324 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:14.646930 28352 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.661247 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:14.637946 28333 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.628640 28147 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:09:14.468572 28336 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.227s
I20260709 13:09:14.679705 21490 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:14.682024 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:14.687444 22245 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:14.400218 28348 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.273s
I20260709 13:09:14.690814 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.669040 28367 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:14.399466 28365 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.673295 28366 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.397796 28319 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.658080 28194 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.680904 28369 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.696560 28152 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:14.728462 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 198389us
I20260709 13:09:14.730520 21488 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:14.733101 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.735816 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.706696 28381 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:14.718258 28204 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:14.739068 21485 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:14.681209 28324 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:14.740054 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 194048us
I20260709 13:09:14.426539 28354 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.750015 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.746145 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.750587 21492 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:14.689086 28333 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.737340 28328 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:14.752310 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.739322 28325 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:14.758253 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.679116 28203 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.742499 28368 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:14.767445 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.727629 28366 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.769083 28386 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:14.772257 28367 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.772689 28386 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:14.772926 28367 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.740646 28152 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.775384 22247 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:09:14.775775 28204 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.776404 28204 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.776893 28352 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.777189 28152 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:14.777606 28352 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:14.778394 28352 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:14.745291 28381 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.779073 28204 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:14.773476 28386 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:14.778563 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.757670 28321 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:14.790943 21568 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:14.760702 28161 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.799235 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.802299 28367 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.803287 28367 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:14.788763 28386 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.805258 28308 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:14.806399 28377 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:09:14.785583 28352 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.807085 28352 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:14.808112 28194 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.803848 28367 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.815457 28197 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.784952 28368 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.817703 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.813824 28367 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.794243 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.821266 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.818614 28368 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.823421 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.824255 21492 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:14.738365 28369 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.770601 28366 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.818951 28386 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:14.836143 28324 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.845459 28154 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.844973 28306 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.840173 28319 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.849483 28369 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.787454 28302 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:14.850507 28323 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:14.851199 28323 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:14.852415 28333 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:14.854936 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.859297 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.860260 21561 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:14.822898 28161 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:14.869918 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:14.870993 21639 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:14.788010 28203 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:14.790439 27922 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.841622 28365 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.795912 28332 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:14.907518 28332 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.909303 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.833443 21488 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:14.781096 28325 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.911643 28352 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:14.913726 28352 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.880617 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.898310 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.913975 28325 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.899891 22247 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:09:14.834731 28374 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:09:14.915580 28154 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:14.917450 28332 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.917600 28386 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:14.919368 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:14.927697 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.907018 28180 consensus_meta.cc:287] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.006s
W20260709 13:09:14.929709 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 171535us
I20260709 13:09:14.932279 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:14.934227 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:14.935933 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.793975 28321 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:14.935817 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:14.938357 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.939791 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:14.940030 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.941460 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.944916 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.945058 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.945590 21490 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:14.946560 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:14.948381 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.948640 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:14.949424 21564 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:09:14.954128 21568 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:14.936604 21493 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:14.938802 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:14.959486 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.960387 21562 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:14.961476 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.963153 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.878674 28381 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:14.963871 21563 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:14.963902 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.964567 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:14.975512 21567 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:14.964740 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:14.965420 21635 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:14.976497 21637 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 21: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:14.966233 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.966612 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.967913 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.968259 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.968600 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:14.979112 21492 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:14.967659 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:14.972662 21564 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:14.930590 27850 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:14.981017 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:14.981832 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.959280 28321 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:14.983547 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:14.955873 28332 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.932360 28180 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.035710 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:15.011055 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 43492.1us
I20260709 13:09:15.011998 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:14.995904 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:14.985683 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.078128 21492 raft_consensus.cc:2410] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:15.078197 21486 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:14.991674 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.938306 28161 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:15.094866 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 103289us
I20260709 13:09:15.095695 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:14.955952 28152 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.977594 22246 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:14.980384 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:15.103123 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:15.101277 22242 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:15.020001 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.022542 21487 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:09:15.023240 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.023854 28371 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:09:15.020879 28227 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:15.075026 22245 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
W20260709 13:09:14.988757 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.015686 28333 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:09:14.974247 28194 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:14.982839 28306 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.106894 28381 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:15.152518 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:15.152266 28306 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.019972 28379 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:15.079242 21639 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:15.157944 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.079974 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.089521 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.090907 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.093257 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:15.096133 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.113934 28152 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.122023 28203 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:15.128536 28378 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:15.076911 28154 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:15.130956 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.166378 21492 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:09:15.017987 28164 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
I20260709 13:09:15.049124 28334 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:15.079093 28332 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.146533 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.139159 28227 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:15.154094 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.142712 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:15.184523 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.186158 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.155727 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:15.155956 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:15.156198 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.156806 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.162839 21486 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
W20260709 13:09:15.163724 21533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.013s	sys 0.045s
W20260709 13:09:15.164062 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 70930.3us
I20260709 13:09:15.188273 21634 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
W20260709 13:09:15.189779 21533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.013s	sys 0.045s
I20260709 13:09:15.188843 21640 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:15.194693 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.195483 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:15.167037 28376 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:15.190842 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:15.152577 28381 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:15.158268 28194 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:15.223647 21563 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:15.224720 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:15.206485 28180 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.207423 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:15.209164 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.209455 28322 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:15.210515 28285 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:15.211373 28332 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.182730 28155 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.194276 28282 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:15.217082 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:15.254323 21564 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:15.218942 28323 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.168772 28378 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:15.170868 28369 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:15.223779 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:15.265045 21562 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:15.206717 28152 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:15.227952 21561 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:15.230226 21636 raft_consensus.cc:2410] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:15.183179 28334 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.191745 28227 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:15.231340 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:15.229490 28384 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:15.232851 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:15.183360 28154 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.235245 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4147) took 1031 ms. Trace:
I20260709 13:09:15.190423 28149 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:15.249890 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 146851us
I20260709 13:09:15.243356 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:15.257082 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 66331.1us
I20260709 13:09:15.272589 21566 rpcz_store.cc:276] 0709 13:09:14.203396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.205014 (+  1618us) service_pool.cc:224] Handling call
0709 13:09:14.205279 (+   265us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:14.576728 (+371449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.576776 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:14.610687 (+ 33911us) log.cc:844] Serialized 52 byte log entry
0709 13:09:14.922249 (+311562us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:14.922299 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.922386 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.234951 (+312565us) raft_consensus.cc:1685] finished
0709 13:09:15.234978 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.235168 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79201,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"thread_start_us":662465,"threads_started":2,"wal-append.queue_time_us":549246}
I20260709 13:09:15.274029 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:15.258167 28332 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:15.204356 28381 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:15.243554 28216 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:15.232997 21563 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
W20260709 13:09:15.281035 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 109214us
I20260709 13:09:15.264348 28378 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:15.260248 28282 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:15.268937 28369 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:15.268673 28334 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:15.299089 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:15.302662 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:15.305608 28306 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.292264 28373 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:15.306257 28373 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.306620 28373 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:15.312358 28154 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.298027 28282 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:15.317643 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:15.281917 28384 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.263453 28155 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.322320 28400 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:15.283867 28332 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:15.326902 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:15.290632 28147 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:15.291173 28216 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:15.297127 28194 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.302101 28369 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:15.333540 28332 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:15.333884 28384 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:15.342660 28391 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:09:15.329015 28325 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:15.243698 28321 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.344132 28334 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.294517 28152 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:15.351500 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49063.7us
I20260709 13:09:15.347273 28373 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.287286 28149 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.350968 28336 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:15.359462 28216 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.385797 28202 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:15.352968 28254 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:09:15.482133 21642 raft_consensus.cc:2368] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23.
W20260709 13:09:15.486045 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48465.7us
I20260709 13:09:15.360389 28147 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:15.484377 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 121442us
I20260709 13:09:15.348721 28400 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.445817 28152 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.482273 28325 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:15.523368 21494 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 2882) took 1702 ms (client timeout 2043 ms). Trace:
W20260709 13:09:15.523806 21494 rpcz_store.cc:269] 0709 13:09:13.820794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.820941 (+   147us) service_pool.cc:224] Handling call
0709 13:09:15.516647 (+1695706us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54002765d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:15.523305 (+  6658us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995381120}
I20260709 13:09:15.500888 28386 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:15.491479 28378 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.551532 21560 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:15.522828 28282 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:15.561396 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.526417 28325 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.565420 28161 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.581588 28161 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.582058 28373 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:15.582330 28396 log.cc:927] Time spent T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:09:15.582517 28378 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:15.536579 28386 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.573894 28412 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.623989 28413 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:09:15.633852 28155 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.633430 28337 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.634055 28321 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:15.637488 28334 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:15.648452 28337 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:15.652918 28409 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:09:15.653331 28337 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:15.653488 28227 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.654140 28325 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.655612 21635 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 16: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:15.656751 28147 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:15.659155 28386 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:15.639102 28412 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.663023 28323 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.669139 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:15.669890 22239 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:15.651063 28282 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:15.658603 28149 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:15.672441 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:15.672956 28227 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:15.675879 28415 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:15.644269 28161 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:15.688715 28332 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.691587 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.692601 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.692942 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.693282 21641 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:15.693984 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.699116 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.699244 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.699645 28152 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:15.699821 21636 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:15.699985 21641 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:15.700835 28400 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:15.700977 28332 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.703236 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4144) took 1508 ms. Trace:
I20260709 13:09:15.703694 21569 rpcz_store.cc:276] 0709 13:09:14.194332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.195728 (+  1396us) service_pool.cc:224] Handling call
0709 13:09:14.195941 (+   213us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:14.199974 (+  4033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.200004 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:14.224949 (+ 24945us) log.cc:844] Serialized 52 byte log entry
0709 13:09:15.546140 (+1321191us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18000333a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:09:15.620904 (+ 74764us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:15.620958 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.621058 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.702867 (+ 81809us) raft_consensus.cc:1685] finished
0709 13:09:15.702887 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.703152 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16259,"raft.queue_time_us":4560,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":16561,"spinlock_wait_cycles":7251328,"thread_start_us":74531,"threads_started":1,"wal-append.queue_time_us":1456832}
I20260709 13:09:15.705230 28412 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:15.709820 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 435829us
W20260709 13:09:15.711231 28388 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.778s	user 0.000s	sys 0.009s
I20260709 13:09:15.711786 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:15.713454 28404 log.cc:927] Time spent T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:09:15.714263 28306 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:15.716039 22247 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:15.714381 28392 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:15.720682 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:15.725476 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:15.726083 21492 raft_consensus.cc:2368] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23.
I20260709 13:09:15.637534 28381 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.735188 28400 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.735788 28400 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.736534 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.736868 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.736558 28227 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:15.737946 28400 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:15.738092 28381 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:15.738251 28227 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.733803 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:15.739336 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.739990 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.740804 21490 raft_consensus.cc:2410] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:15.740875 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.741118 22241 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:15.746748 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.750262 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:15.751713 21643 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:15.752540 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.755604 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:15.761230 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:15.765424 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:15.763365 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:15.766990 21643 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 21: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:15.769493 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:15.747094 28195 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:15.742712 28367 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:15.778193 21643 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:15.809242 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:15.761093 28392 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.767925 28336 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:15.769855 28272 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:15.808889 28348 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:15.809736 28389 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:15.841372 28117 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.843756 28117 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.844017 28369 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.844233 28216 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.845899 28117 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.846511 21566 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:15.845960 28369 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:15.838490 28392 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.855023 21494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:15.855657 21494 raft_consensus.cc:606] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:15.838943 28272 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:15.856940 28272 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:15.857192 28392 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.864001 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:15.864897 21490 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:15.866829 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:15.873245 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 92705.9us
I20260709 13:09:15.867515 21490 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:15.818884 28367 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.818274 28195 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.882350 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:15.846632 28216 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.860536 28381 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:15.899255 28381 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.871963 28333 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.901719 28381 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:15.858681 28348 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.904224 28348 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:15.858924 28389 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.908574 28180 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:15.914332 28422 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:15.901437 28333 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.930672 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:15.914615 28195 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:15.935369 28412 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:15.874934 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:15.867355 28117 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:15.938988 28216 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:15.940224 28400 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:15.939951 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:15.941133 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 66284.6us
I20260709 13:09:15.892714 28227 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:15.935225 28285 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:15.941946 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:15.941180 27850 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:15.943025 27850 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.943140 28216 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:15.942410 28373 raft_consensus.cc:2955] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:15.918401 28367 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:15.943357 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:15.943426 27850 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:15.945129 21459 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:15.946615 28323 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:15.947925 28257 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:15.948873 28323 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:15.949728 28257 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:15.951102 28161 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:15.951316 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2895) took 1287 ms. Trace:
I20260709 13:09:15.951766 21487 rpcz_store.cc:276] 0709 13:09:14.663846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.664010 (+   164us) service_pool.cc:224] Handling call
0709 13:09:14.664396 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:15.108380 (+443984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.951092 (+842712us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400299854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:15.951266 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823054080}
I20260709 13:09:15.952342 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.953178 21642 raft_consensus.cc:2410] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:15.955626 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:15.951709 28161 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:15.959777 28161 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.962393 21491 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.965224 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:15.944196 28216 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:15.977417 21643 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:15.917586 28180 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:15.980679 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:15.987409 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:16.002375 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:15.996726 21643 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:16.093628 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:16.101470 28384 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:16.102077 28384 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:16.102943 28332 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:16.103461 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:16.104272 21492 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:16.105014 28195 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:16.103504 28332 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:16.105608 28195 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.107107 28332 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:16.107618 28195 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:16.107919 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.108104 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.108829 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:16.109047 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:16.109407 21566 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:16.109543 21565 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:16.109966 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.111125 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:16.111486 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:16.020253 21487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:16.112141 21487 raft_consensus.cc:606] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.112484 21487 raft_consensus.cc:614] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:16.113011 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:16.113466 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:16.113986 21562 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:16.114224 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:15.993897 28227 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:16.010748 21642 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:16.005285 28194 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:16.037528 28272 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:15.996399 28381 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:09:16.043187 28333 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:16.046646 21639 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:15.986954 28216 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:16.057839 27850 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:16.090023 21494 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:16.091631 21641 raft_consensus.cc:2410] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:09:16.092069 21488 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:09:16.111636 21560 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.024062 28389 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:15.986614 28306 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:16.117791 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.153542 21565 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:16.153852 21564 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:09:16.154520 21562 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:16.155275 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.155462 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.156877 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.157039 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.157501 21562 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:16.119684 21563 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:16.160393 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.125648 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.163880 21563 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:16.167793 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.158659 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:16.125800 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 123546us
I20260709 13:09:16.135236 28152 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:16.135663 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.136672 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:16.175453 21568 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:16.145918 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.149652 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:16.178264 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.180759 21637 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:09:16.155092 21392 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 17 to 19, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 19 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:16.181272 21637 pending_rounds.cc:85] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 10
I20260709 13:09:16.181959 21637 pending_rounds.cc:107] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:09:16.182250 21637 raft_consensus.cc:2889] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:16.185774 21488 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:16.187095 21489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:16.187690 21489 raft_consensus.cc:606] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:16.188021 21489 raft_consensus.cc:614] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:16.150638 28272 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:16.195447 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.196645 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:16.197521 21566 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:16.198704 28282 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:16.199389 28282 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:16.199717 28282 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.135087 28180 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:09:16.200065 28282 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.200415 28180 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:16.200773 28180 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:16.201623 28180 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:16.137434 28368 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:09:16.203049 21561 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:16.205090 27850 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:16.197484 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.207029 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:16.207598 28285 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:09:16.207115 28412 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:16.210923 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.212338 21562 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:09:16.208873 28375 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.212960 28216 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.213829 28302 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:16.213673 28375 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.235884 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.236332 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:16.237895 28375 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:16.238461 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.240393 21560 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:16.215442 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.219229 28180 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:16.230824 21392 catalog_manager.cc:5697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 10 to 12, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 12 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:16.284572 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.187287 28152 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:16.234741 28216 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:16.235325 28282 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:16.213641 21562 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:16.244697 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.301239 21560 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:16.209292 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.301483 21392 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:16.302666 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 93454us
I20260709 13:09:16.303659 28431 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:16.278064 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:16.306815 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:16.307775 22242 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
W20260709 13:09:16.309135 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.297148 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.310362 28382 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:16.276708 28365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.021s	sys 0.031s
I20260709 13:09:16.287216 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:16.288718 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.291850 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:16.292713 22210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.021s	sys 0.040s
I20260709 13:09:16.284085 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.247426 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:16.303337 21392 catalog_manager.cc:5697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:16.320133 21494 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:16.313179 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.322070 28375 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:16.323911 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.250845 21488 raft_consensus.cc:1240] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:16.286060 21561 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:09:16.326509 22210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.021s	sys 0.040s
W20260709 13:09:16.327688 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 565129us
I20260709 13:09:16.331878 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:16.332162 28384 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:16.334034 28390 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:16.334137 28282 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:16.335803 22242 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:16.336815 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:16.341665 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 53019.8us
I20260709 13:09:16.287220 28363 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:16.351568 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:16.315546 28365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.021s	sys 0.031s
I20260709 13:09:16.292773 28381 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:16.276746 27850 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:09:16.380368 22241 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:16.340634 28375 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:16.381588 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49828.6us
W20260709 13:09:16.389884 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53159.6us
I20260709 13:09:16.313136 28366 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.070s
W20260709 13:09:16.393242 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 55811.5us
I20260709 13:09:16.394908 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.404088 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.404570 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:16.392622 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:16.405484 21569 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.354080 28380 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.395275 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:16.386858 28322 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:16.363121 27922 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:16.406821 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.421934 28322 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:16.422171 27922 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:16.422398 28322 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:16.422962 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.423179 27922 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.424301 28392 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:16.424932 28392 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:16.427220 28363 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:16.428380 28438 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:16.339221 28093 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:09:16.428536 21392 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 15 to 17, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 17 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:16.430017 28365 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:16.430428 28365 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:16.430647 28093 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:16.431212 28093 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:16.428241 28363 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.432098 28093 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:16.433279 28093 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:16.435423 28371 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:16.412592 28302 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:16.414921 28373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43140 (request call id 22) took 2504 ms. Trace:
I20260709 13:09:16.444065 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:16.407986 22242 raft_consensus.cc:2955] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:16.419034 28433 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:09:16.406533 28431 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:16.340342 28306 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:16.445887 21389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 245) took 19782 ms (client timeout 15000 ms). Trace:
I20260709 13:09:16.419842 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:16.447211 22239 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:16.411340 28380 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.430048 21392 catalog_manager.cc:5697] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:16.436564 21569 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:16.380983 28149 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:09:16.388599 28257 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:09:16.437160 28272 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:16.444118 28302 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:16.462278 21392 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:16.440815 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45700.8us
I20260709 13:09:16.468744 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:16.395025 28384 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:16.380242 28227 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:09:16.388944 28381 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.428196 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.475654 21392 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 16 to 19, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 19 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:16.473412 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:16.478027 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.480332 21561 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:09:16.470727 21490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:16.459223 28161 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:09:16.446290 21389 rpcz_store.cc:269] 0709 13:08:56.663297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.663571 (+   274us) service_pool.cc:224] Handling call
0709 13:09:16.445806 (+19782235us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:14.800814 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:14.801483 (+   669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:14.801524 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:09:14.801539 (+    15us) tablet.cc:662] Decoding operations
0709 13:09:14.802273 (+   734us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:14.802340 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:14.802379 (+    39us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:09:14.802912 (+   533us) tablet.cc:701] Row locks acquired
0709 13:09:14.802934 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:09:14.803098 (+   164us) write_op.cc:270] Start()
0709 13:09:14.803221 (+   123us) write_op.cc:276] Timestamp: P: 1783602554803043 usec, L: 0
0709 13:09:14.803239 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:09:14.804028 (+   789us) log.cc:844] Serialized 1762 byte log entry
0709 13:09:15.622151 (+818123us) op_driver.cc:464] REPLICATION: finished
0709 13:09:15.831068 (+208917us) write_op.cc:301] APPLY: starting
0709 13:09:15.837990 (+  6922us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:15.847891 (+  9901us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:15.848034 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:15.850524 (+  2490us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:15.850763 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:09:15.862532 (+ 11769us) write_op.cc:312] APPLY: finished
0709 13:09:15.868753 (+  6221us) log.cc:844] Serialized 49 byte log entry
0709 13:09:15.868946 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:15.869079 (+   133us) write_op.cc:454] Released schema lock
0709 13:09:15.869138 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:15.869799 (+   661us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:15.869840 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3394,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":186453,"apply.run_cpu_time_us":7339,"apply.run_wall_time_us":48744,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20831,"num_ops":4,"prepare.queue_time_us":79400,"prepare.run_cpu_time_us":10721,"prepare.run_wall_time_us":166824,"raft.queue_time_us":110946,"raft.run_cpu_time_us":45087,"raft.run_wall_time_us":133493,"replication_time_us":818705,"thread_start_us":366760,"threads_started":4,"wal-append.queue_time_us":243192}]]}
I20260709 13:09:16.387158 28152 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:16.484902 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 56773.6us
I20260709 13:09:16.446346 28365 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.464365 28272 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:16.452036 28216 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:09:16.483907 21490 raft_consensus.cc:606] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:16.451164 28436 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:16.486521 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.493616 21532 leader_election.cc:400] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23.
I20260709 13:09:16.476840 28302 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:16.490666 21457 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.502238 21490 raft_consensus.cc:614] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:16.508620 28440 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:16.481449 28155 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:09:16.486351 27850 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:09:16.489794 28323 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:09:16.490255 28357 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:16.499842 21392 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 22 to 23, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 23 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.625602 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:16.625330 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:16.606858 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.494678 28389 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:16.627269 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:16.628033 21634 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:16.626942 21392 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 9 to 10, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 10 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:16.630688 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:16.490468 28368 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:16.636523 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:16.637068 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:16.588120 22239 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:16.638098 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:16.639195 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:16.641746 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:16.505611 28365 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:16.512809 28194 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:16.524646 28381 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:16.645397 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:16.654341 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 163739us
I20260709 13:09:16.523515 28333 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:16.529222 28348 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:16.506641 28436 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.628686 21563 raft_consensus.cc:2955] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:16.497449 28161 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.644825 28257 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:16.650851 28400 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:16.657743 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:16.664155 21491 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:16.664777 28333 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:16.656045 28117 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:09:16.703821 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.666625 28227 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:16.656286 28194 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:16.733165 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48309.7us
I20260709 13:09:16.733577 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.526674 28380 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:16.721140 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.722144 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.727551 21490 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:16.728328 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:16.728856 21641 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:16.664764 28357 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:16.734398 21640 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:16.670200 28348 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:16.679039 28368 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:16.752336 28368 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.753554 28161 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:16.734841 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.525117 28272 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:16.737402 21532 leader_election.cc:400] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23.
I20260709 13:09:16.664891 28382 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:09:16.695062 28436 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:16.732698 28101 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:16.732352 28227 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:16.743543 28400 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:16.750816 28348 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.735301 28366 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:16.732625 28204 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:16.443614 28373 rpcz_store.cc:276] 0709 13:09:13.910122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.910349 (+   227us) service_pool.cc:224] Handling call
0709 13:09:14.025792 (+115443us) log.cc:844] Serialized 508 byte log entry
0709 13:09:16.409828 (+2384036us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13523,"raft.queue_time_us":126374,"raft.run_cpu_time_us":1955,"raft.run_wall_time_us":115156,"thread_start_us":341425,"threads_started":2,"wal-append.queue_time_us":264740,"wal-append.run_cpu_time_us":4097,"wal-append.run_wall_time_us":1062662}
I20260709 13:09:16.734836 28392 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:16.795305 28392 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.755071 28257 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:16.785709 28381 consensus_queue.cc:1059] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:16.788527 28302 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.776731 28101 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.780283 28272 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:16.774024 28227 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:16.793892 28204 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.767658 28380 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:16.778546 28366 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:16.765265 28322 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:16.805517 28443 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:09:16.806342 28348 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:16.808701 28257 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 23 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:16.807788 28380 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:16.823202 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 348530us
I20260709 13:09:16.762902 21532 leader_election.cc:403] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:09:16.760377 21491 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:16.743940 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.911638 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.913475 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:16.914770 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06b5fb42c147456889a1843340b22720 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:09:16.915369 21564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.017s	sys 0.012s
W20260709 13:09:16.956404 21564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.017s	sys 0.012s
W20260709 13:09:16.924651 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 420159us
W20260709 13:09:16.953838 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 219742us
I20260709 13:09:16.962572 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.962594 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.966114 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:16.973553 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:16.825784 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:16.779628 28194 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.163872 28194 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.750818 28333 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:16.813689 28357 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:16.828356 28380 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:16.832167 28392 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:16.831573 28400 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:16.858345 28445 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:09:16.978016 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.180259 22239 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:16.978430 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.195828 28285 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:17.196486 28285 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:16.980942 28101 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:16.981652 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:16.982851 28152 raft_consensus.cc:3055] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:16.991933 27864 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:16.993815 28306 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23.
I20260709 13:09:16.999511 28389 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:16.999735 28204 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.000730 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:16.980849 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:16.986501 28163 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:17.007296 28257 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.009676 28302 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:17.011305 28322 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:16.836912 28366 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.139813 28384 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:17.140359 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 167222us
I20260709 13:09:17.141208 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4180) took 1016 ms. Trace:
W20260709 13:09:17.145583 28458 log.cc:927] Time spent T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:09:17.154385 28412 raft_consensus.cc:993] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:09:17.209429 28152 raft_consensus.cc:740] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:17.198148 28285 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.220079 28163 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:17.237670 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 277777us
I20260709 13:09:17.244623 28163 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:17.263767 28152 consensus_queue.cc:260] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.266018 28101 raft_consensus.cc:1081] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:09:17.255972 22245 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:17.275424 28384 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.278760 28384 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:17.283038 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:17.311873 28285 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:17.320453 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.331236 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 79218.8us
W20260709 13:09:17.338946 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 317751us
I20260709 13:09:17.231317 21565 rpcz_store.cc:276] 0709 13:09:16.125198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.163202 (+ 38004us) service_pool.cc:224] Handling call
0709 13:09:16.163539 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.180878 (+ 17339us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:16.449765 (+268887us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.907958 (+458193us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.909714 (+  1756us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.910103 (+   389us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:16.910143 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.910339 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.140804 (+230465us) raft_consensus.cc:1685] finished
0709 13:09:17.140827 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.141040 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22346,"prepare.queue_time_us":62067,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":103455,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":34454,"thread_start_us":696357,"threads_started":2,"wal-append.queue_time_us":407210}
I20260709 13:09:17.344817 28466 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:17.344908 28333 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:17.345677 28466 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.334409 27864 raft_consensus.cc:2764] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:09:17.348027 28466 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.348871 28456 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:17.354080 28366 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:17.340411 21634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.004s	sys 0.007s
I20260709 13:09:17.339576 28431 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:09:17.359333 21606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.004s	sys 0.008s
W20260709 13:09:17.361668 21609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.006s	sys 0.006s
W20260709 13:09:17.341377 21608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.002s	sys 0.010s
W20260709 13:09:17.366379 21606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.005s	sys 0.009s
I20260709 13:09:17.367977 28431 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:17.370523 21609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.007s	sys 0.006s
I20260709 13:09:17.375576 28456 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:17.376204 28456 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:09:17.378664 21608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.003s	sys 0.010s
W20260709 13:09:17.379629 28272 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.571s	user 0.014s	sys 0.002s
I20260709 13:09:17.379958 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:17.380720 22245 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.382344 28163 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.383795 28472 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:17.386036 28472 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.387181 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:17.396349 28464 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:17.396413 28472 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.384905 28285 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:17.397142 28464 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:17.384562 28227 consensus_meta.cc:287] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.004s
I20260709 13:09:17.397285 28466 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:17.399029 28466 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.400303 28464 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.401198 28466 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.402066 28227 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.398263 28285 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:17.367161 21634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.005s	sys 0.008s
I20260709 13:09:17.415386 28431 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.423749 22246 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:17.426506 22242 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:09:17.427475 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.427841 28431 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:17.428471 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.428673 28431 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:17.431548 28348 consensus_meta.cc:287] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.015s
W20260709 13:09:17.432003 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 469680us
W20260709 13:09:17.420290 21640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.076s	sys 0.133s
I20260709 13:09:17.436884 22242 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:17.444255 28431 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.445204 28152 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:17.446872 28466 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.447579 28466 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:17.448387 28467 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.076s	user 0.001s	sys 0.001s
I20260709 13:09:17.449993 28466 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:17.455780 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.457067 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:17.457911 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:17.459633 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:17.460579 28475 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:17.461601 28473 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:17.462965 28163 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:17.464437 21565 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:09:17.421171 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 680042us
I20260709 13:09:17.467484 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:17.491580 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 833888us
W20260709 13:09:17.473353 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 190568us
I20260709 13:09:17.479872 21564 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:09:17.482188 28476 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.109s	user 0.005s	sys 0.000s
I20260709 13:09:17.491848 28227 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.469880 28285 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.495347 22245 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:17.504822 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:17.521092 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.532224 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.535939 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:17.536494 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.538113 28470 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:09:17.539196 28473 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:17.540453 28431 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:17.540622 28285 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:17.540997 28431 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:17.541208 28285 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:17.542157 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.500790 28472 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:17.502379 28456 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.540714 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:17.550012 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.551221 22246 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:09:17.551147 28472 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.552441 28473 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:17.553036 28473 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:17.554404 28472 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.555666 28285 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.548622 28152 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:17.559240 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:17.562460 22247 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:17.554108 28473 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:17.573015 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.576512 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.579514 22241 raft_consensus.cc:2368] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
I20260709 13:09:17.578140 28472 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:17.582362 28472 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.545184 28380 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.550624 28257 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:17.581466 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:17.583276 28163 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:09:17.596647 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.610615 28436 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.806s	user 0.016s	sys 0.004s
I20260709 13:09:17.611088 28466 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.615413 28466 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.615753 28384 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:17.616539 28384 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.617914 28466 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.573326 28431 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.592061 28348 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.620409 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:17.587618 28152 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.629009 28101 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.628924 28227 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:17.630491 28101 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.634362 21640 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:17.634899 28101 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.618752 28384 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:17.637400 28348 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.639380 28472 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.639614 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:17.640189 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:17.640347 28400 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:17.640826 28348 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.640898 28400 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.640245 21492 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:17.647210 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:17.648175 21489 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 12: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:17.649319 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:17.612789 28436 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.637872 28257 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.624020 28466 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:17.657176 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:17.658718 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.644390 28285 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:17.659344 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.656070 28456 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:17.662894 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.665688 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:17.671280 21494 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:17.674777 28381 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:17.678509 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:17.679164 28381 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.659086 28333 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:17.683856 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:17.683406 28333 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.694732 21492 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:17.672179 28472 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:17.695739 28333 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:17.698364 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 130746us
W20260709 13:09:17.686260 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.132:40323 timed out after 1.569s (SENT) [suppressed 14 similar messages]
I20260709 13:09:17.686440 28475 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:09:17.702807 28306 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:17.703293 28306 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:17.704286 28306 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.705526 28257 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.705727 28306 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:17.696089 28472 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.685720 28466 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.710892 28431 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:17.719292 28381 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.687871 28400 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.722098 21638 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:09:17.701496 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:17.725456 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:17.730218 22245 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:17.732751 28384 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:17.725210 28482 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:09:17.731125 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:17.736537 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:17.740058 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:17.733839 28481 log.cc:927] Time spent T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:09:17.742575 28483 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:09:17.735886 28101 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:09:17.744403 28470 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:17.745573 28471 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:17.748024 28471 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.748369 28152 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.749151 28470 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:17.749687 28470 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:17.752552 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 51132.2us
I20260709 13:09:17.750384 28471 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:17.736167 28472 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.753989 28384 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:17.757673 28152 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:17.756529 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:17.758250 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:17.760744 28384 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:17.762818 21532 leader_election.cc:400] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
I20260709 13:09:17.763741 21532 leader_election.cc:403] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:17.764204 28466 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.767196 28348 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:17.771379 28384 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16.
I20260709 13:09:17.776773 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:17.777696 28180 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:17.779160 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:17.780328 28380 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.783015 28436 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:17.783761 28152 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:17.784063 21492 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:17.784354 21490 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:17.785236 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:17.750635 28470 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.787009 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:17.788789 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:17.790416 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:17.794094 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:17.795357 28384 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:17.796336 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:17.797582 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:17.799407 21491 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:17.802109 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:17.803154 21491 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:09:17.803686 21491 pending_rounds.cc:85] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Aborting all ops after (but not including) 13
I20260709 13:09:17.803984 21491 pending_rounds.cc:107] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:09:17.804325 21491 raft_consensus.cc:2889] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.806927 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:17.808962 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:17.809576 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:17.810524 28380 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:17.810850 21491 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:09:17.809726 28152 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:09:17.812011 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.814410 28384 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:17.813305 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:17.817972 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:17.813709 21608 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:17.821913 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:17.822443 28152 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:17.822851 21490 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:17.825599 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:17.826908 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 118623us
I20260709 13:09:17.827584 28431 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:17.828429 28152 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:17.828217 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:17.832975 21641 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:17.836860 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:17.837870 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:17.840229 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:17.819327 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:17.851639 21634 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:17.852470 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 166277us
I20260709 13:09:17.853211 21490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:17.854086 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:17.851611 28485 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.260s	user 0.002s	sys 0.000s
I20260709 13:09:17.859061 21490 raft_consensus.cc:606] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:17.863724 21565 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:17.885179 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.891865 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.892660 22245 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 20: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:17.893460 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.870241 28436 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:17.879102 28180 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.906635 28180 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.897972 21639 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:17.898109 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:17.908394 21568 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:17.899325 21643 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:17.909092 28180 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:17.899682 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:17.901088 21637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58372
I20260709 13:09:17.903177 22239 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:09:17.911336 28477 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:17.912039 28477 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:17.915071 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 95829.9us
I20260709 13:09:17.915375 22241 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:17.883211 28348 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:17.916527 28348 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.917798 28285 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.910197 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:17.925711 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:17.918394 28285 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:17.939220 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:17.943903 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:17.947611 28484 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.353s	user 0.006s	sys 0.000s
I20260709 13:09:17.944528 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:17.949524 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:17.951018 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.956769 21565 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:17.948081 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:17.918737 28348 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:17.954137 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.962270 28366 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:17.962941 28366 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:17.965161 28366 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.966145 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.967362 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.970654 21636 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:17.957834 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.940711 28456 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:17.950742 28470 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:17.984824 28470 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.985275 28470 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:17.980639 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:17.988090 21565 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 17: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:17.982957 28101 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:17.975095 28152 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.998479 28152 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.000792 28152 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.991240 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.001454 22239 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:18.001714 21567 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:17.982491 28456 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.004956 28456 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.007318 28306 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:17.971011 28384 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:18.010970 28384 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:17.992300 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.989765 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:18.012033 28384 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.015305 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:17.995759 28471 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:18.017014 28471 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:09:18.017460 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.996335 28371 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:18.020532 28285 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.021246 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:18.017413 28471 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:17.996590 28325 raft_consensus.cc:993] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:09:17.976815 28477 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:17.974814 28473 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:17.974601 28412 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:18.023352 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:18.023873 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:18.027244 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.022746 21606 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:18.023173 28472 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:18.030011 28412 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:18.049208 28412 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:18.033548 28470 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.052340 28470 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:18.029773 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:18.076916 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:18.079546 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.079416 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:18.025164 28325 raft_consensus.cc:1081] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
W20260709 13:09:18.096921 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 147456us
I20260709 13:09:18.096899 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:18.100674 21491 raft_consensus.cc:2368] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
I20260709 13:09:18.095088 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:18.101392 21486 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:18.094098 21569 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:18.110239 21459 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:18.112823 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:18.093137 28380 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:18.118422 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:18.122848 21642 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:18.124781 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:18.124926 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:18.127434 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:18.128006 21489 raft_consensus.cc:2393] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 22: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:18.128361 21636 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:18.114696 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:18.117442 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:18.025377 28471 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:18.150944 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 128264us
I20260709 13:09:18.144551 21639 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:18.157059 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:18.155341 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:18.160204 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 165534us
I20260709 13:09:18.143611 28470 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:09:18.165548 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.173624 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:18.173820 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.166338 28470 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.168814 28180 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:18.193188 21565 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:18.169591 28474 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:18.183398 28473 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:18.193492 28180 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.201555 28380 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:18.203279 28473 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:18.228524 28473 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.229449 28471 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:18.205498 28282 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.231580 28282 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.190052 28470 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:18.214877 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:18.235623 21562 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:18.200757 28497 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:18.239881 28472 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:18.239704 28497 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.240530 28472 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.243248 28152 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:18.215745 28494 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:09:18.243922 28152 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.224465 28180 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:18.225934 28380 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:18.247107 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 78924.4us
I20260709 13:09:18.247860 28472 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:18.227056 28474 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.247241 28380 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:18.283645 21642 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:18.234405 28282 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:18.249291 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:18.254577 21486 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
W20260709 13:09:18.291177 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 134190us
W20260709 13:09:18.293440 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 44221.7us
W20260709 13:09:18.325356 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 147162us
W20260709 13:09:18.330574 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 141941us
I20260709 13:09:18.333940 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:18.286235 28466 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:09:18.323935 28348 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:18.293015 28325 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:09:18.298897 28412 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:18.344100 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.344693 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 79345.1us
I20260709 13:09:18.355314 28306 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.357632 28412 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.365408 21637 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:18.365903 21637 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:18.381068 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44051.5us
I20260709 13:09:18.382465 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:18.337540 28152 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:18.361346 28507 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.430213 28348 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.431437 28514 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:18.384419 28282 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.388351 28431 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:18.346026 28466 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:18.393394 28475 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.438542 21562 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:18.399824 28152 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:18.449262 28152 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:18.449577 28474 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:18.449831 28152 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:18.448921 28380 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.442819 28431 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:18.453344 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 53923.1us
I20260709 13:09:18.399221 28306 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:09:18.464083 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:18.471575 21637 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:18.465195 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 128167us
I20260709 13:09:18.450227 28466 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.478617 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.443719 28282 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.463932 28431 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:18.492373 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:18.489764 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:18.493930 21562 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:18.494084 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:18.496337 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 108865us
I20260709 13:09:18.501580 28371 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:18.452006 28514 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.452507 28507 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.509231 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:18.477303 28464 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 13:09:18.555227 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 67875.5us
I20260709 13:09:18.479398 28475 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:18.557404 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 49486.9us
I20260709 13:09:18.572588 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:18.577454 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 291926us
I20260709 13:09:18.578678 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:18.519142 28371 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:18.574483 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.603612 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.605698 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:18.606976 28163 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:18.615998 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:18.616902 22210 leader_election.cc:400] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
I20260709 13:09:18.622942 22210 leader_election.cc:403] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:18.519354 28412 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:09:18.658954 21562 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:18.602720 28325 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:18.658023 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:18.615841 28474 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:18.663465 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.660007 28366 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:09:18.610553 28470 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.707975 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:09:18.709270 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 82187.5us
I20260709 13:09:18.682768 28497 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:18.713392 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 109084us
I20260709 13:09:18.708847 22242 raft_consensus.cc:2376] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16. Re-sending same reply.
I20260709 13:09:18.715233 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:18.720568 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.698336 28501 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:18.698130 28512 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:18.711048 28380 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:18.711309 28348 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.722959 28371 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.731413 28180 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.733556 28180 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.727981 28514 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:18.728030 28522 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.728777 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:18.735419 28522 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.737746 28522 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.739279 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.740048 21567 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:18.740442 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.741088 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.741607 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.741761 21567 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:09:18.743294 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.743608 22238 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:18.744603 22247 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:18.744673 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.715425 28405 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:18.746122 28405 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:18.746239 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.727872 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.748059 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.749293 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.750468 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:18.751891 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:18.726274 21569 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:18.757901 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:18.755492 21564 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:18.715010 28322 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:18.760350 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 45237.4us
I20260709 13:09:18.711539 28517 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:18.727734 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:18.768550 21637 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:18.755533 28412 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.776579 21459 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:18.764482 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:18.735450 28475 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.780431 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:18.781018 21561 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:18.762419 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 253288us
I20260709 13:09:18.765874 28516 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:09:18.766644 28464 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:18.728413 28473 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.786638 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.773900 28282 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.760241 28512 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:09:18.797024 21560 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:18.783243 28522 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:18.797859 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:18.784180 28501 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:18.788774 28517 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.805075 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.791446 28464 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.770666 28322 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.814851 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.816120 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:18.816746 21566 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:18.817103 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:18.818429 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:18.804963 28471 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.575s	user 0.015s	sys 0.001s
I20260709 13:09:18.823050 28515 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:18.823844 28515 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:18.825500 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.829115 28366 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18.
I20260709 13:09:18.826702 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.831805 28470 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.802774 28522 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:18.832991 28522 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.832577 21567 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:18.838815 28152 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.840924 28431 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.842024 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.804579 28501 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:18.844018 28517 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.783845 28412 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.807543 21564 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:18.795698 28180 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:09:18.865967 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:18.847359 28464 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.849797 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:18.852533 21566 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:18.859997 21561 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:18.806080 28529 raft_consensus.cc:2764] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:09:18.871579 21569 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:18.872064 21486 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:18.846362 28473 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.884663 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:18.885896 28508 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.552s	user 0.006s	sys 0.000s
I20260709 13:09:18.886548 28472 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:18.887001 28472 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.887359 28472 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.867051 28436 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.890671 28436 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.885933 28513 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:18.892946 28436 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:18.895219 28510 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.534s	user 0.006s	sys 0.000s
I20260709 13:09:18.900995 21634 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:18.861373 28501 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.908713 28517 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:18.909837 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:18.910485 21642 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:18.912392 28412 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:18.914127 28431 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.916234 28152 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:18.832607 28525 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:18.919147 28525 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:18.919938 28466 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:18.767294 28405 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.920097 28525 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.801479 28348 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:09:18.812041 28507 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:18.873961 21562 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:09:18.876293 28322 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:18.881245 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:18.917408 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:18.917709 22244 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:18.918114 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:18.849625 21560 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:18.929872 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:18.926267 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 127326us
I20260709 13:09:18.942356 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:18.943276 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:18.943684 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 76023.9us
I20260709 13:09:18.946106 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:18.951427 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:18.951674 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:18.946969 22243 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:18.955045 28466 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.955550 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:18.956586 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:18.956390 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:18.960599 22240 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:18.961053 28431 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:18.961699 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:18.962327 22240 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:18.962419 28473 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:18.963145 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:18.963033 28473 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.965257 28473 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.962344 28475 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.966365 28498 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:18.966845 28498 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.967262 28498 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:18.967470 21642 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:18.971714 28348 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:18.972242 28348 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:18.972452 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:18.973042 21565 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:18.966410 28475 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:18.975096 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.977368 21564 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:09:18.977097 28464 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.977731 21564 pending_rounds.cc:85] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 12
I20260709 13:09:18.978088 21564 pending_rounds.cc:107] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:09:18.978359 21564 raft_consensus.cc:2889] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:18.979128 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.993759 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:18.961571 28431 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:18.963043 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:18.948134 28306 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.008493 28466 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:19.008958 28306 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.009903 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:19.011196 28306 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:18.966737 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.012926 28431 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:19.013415 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 70249.9us
I20260709 13:09:18.972787 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:18.975226 28475 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:18.979061 28497 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:19.012948 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:19.015405 28497 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.015679 28501 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.020893 21486 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:18.996090 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:18.997929 22247 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:19.000058 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:19.001242 28380 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:19.002615 28523 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:19.039011 28523 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:19.039476 28523 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:19.006399 28495 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:18.973126 28348 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.043318 28521 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:19.008066 28525 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:19.014683 28466 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:19.004199 28524 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:19.022991 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.024416 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.024874 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:19.023792 28538 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:19.027982 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.051349 21565 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:19.051910 21642 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:19.028671 21636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58372
I20260709 13:09:19.022625 28522 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.024084 28152 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:09:19.035362 28504 log.cc:927] Time spent T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.648s	user 0.002s	sys 0.004s
I20260709 13:09:19.035259 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.074723 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4227) took 1016 ms. Trace:
I20260709 13:09:19.075870 28498 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.035909 28517 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:19.077145 28517 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:09:19.077533 28517 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:19.078352 28539 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260709 13:09:19.078521 28517 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.039342 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:19.079481 21642 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:09:19.079969 28517 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:19.043731 28521 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:19.021579 28497 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:19.082155 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.048517 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:19.050518 22245 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
W20260709 13:09:19.051070 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 51063.2us
I20260709 13:09:19.052814 21636 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:19.085386 21636 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:19.055634 22242 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:19.055655 21486 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:19.058547 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.071218 22240 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:19.070544 28524 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.075169 21563 rpcz_store.cc:276] 0709 13:09:18.058422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.075857 (+ 17435us) service_pool.cc:224] Handling call
0709 13:09:18.093285 (+ 17428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.093638 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.093665 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.107053 (+ 13388us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.292939 (+185886us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:18.293016 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.293113 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.034600 (+741487us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:19.074401 (+ 39801us) raft_consensus.cc:1685] finished
0709 13:09:19.074428 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.074660 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2131,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":9337,"spinlock_wait_cycles":122796288,"thread_start_us":132764,"threads_started":1,"wal-append.queue_time_us":208353}
I20260709 13:09:19.091056 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:19.082257 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:18.994189 21639 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:19.084218 21491 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.088845 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:19.084975 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:19.084134 21641 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:19.096285 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:19.098479 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.099185 21494 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:19.055457 28512 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:19.100939 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.101475 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.107931 28380 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:19.108405 28380 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:19.109386 28514 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:19.109336 28380 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.111168 28152 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:19.112170 28152 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.116896 28501 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:19.099601 28513 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:19.119000 21562 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:19.119501 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:19.121025 28524 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:19.121640 28495 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:19.102663 21494 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
W20260709 13:09:19.127197 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 55336.3us
I20260709 13:09:19.131412 21491 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:19.132870 21636 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.135150 28497 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:19.137087 28513 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:19.139503 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:19.139175 28521 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.140762 28521 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.140857 28514 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:19.142148 28512 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:19.142238 21636 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:19.030629 28472 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.144227 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:19.122628 28464 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:19.145079 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:19.149286 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.100231 28466 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:19.156410 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.158511 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.133680 28498 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:19.164631 21491 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:19.156653 21459 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:19.166594 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:19.168087 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:19.168815 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:19.169329 28431 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:19.169483 22242 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:19.171919 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:19.172748 22240 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 20: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:19.181545 21634 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:19.185417 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.188253 28529 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:19.189065 28529 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:19.190011 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:19.190941 21642 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:19.191107 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:19.191675 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.192552 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.198598 21563 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:19.190119 28529 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.203150 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.166267 28497 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:19.166749 28501 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:19.169804 28431 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:19.207783 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 67342.5us
I20260709 13:09:19.209232 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.208112 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:19.211189 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:19.212220 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:19.213517 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:19.214344 21636 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:19.215969 21642 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:19.212990 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:19.179586 28475 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:09:19.229604 21641 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 20: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:19.212945 28431 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:19.232026 28466 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:19.233456 28535 log.cc:927] Time spent T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:19.191784 28464 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:09:19.217525 28497 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:19.253185 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:19.254876 21568 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:19.256297 28435 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:19.257107 28471 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:19.265489 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.237289 28470 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:19.295888 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 43722us
I20260709 13:09:19.308946 28548 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:19.309505 28548 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:19.309868 28548 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:19.276414 28101 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:09:19.327361 28180 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:19.328011 28180 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.330149 28180 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:19.333138 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:19.340987 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 164850us
I20260709 13:09:19.343376 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:19.344194 22240 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:19.347033 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:19.336248 28546 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:19.351176 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 51326us
I20260709 13:09:19.300436 28514 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:19.370196 28547 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:19.370690 28547 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:19.372519 28547 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.373687 28547 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:19.375334 28471 raft_consensus.cc:2955] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:19.366904 28473 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:19.379662 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:19.400281 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:19.348716 28507 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:09:19.369462 28514 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:19.407757 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:19.408102 21561 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:19.431241 22240 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:19.396811 28152 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:19.402711 28472 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:19.397001 28473 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:19.447890 28473 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.435707 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:19.434724 28152 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:19.451594 28152 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.452185 28366 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:19.454587 28523 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.456748 21565 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:19.457093 28523 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:19.460433 28435 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:19.460713 28503 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:19.461077 28435 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.461311 28503 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.463492 28503 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:19.429315 28474 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:19.429250 28501 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.429829 28514 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:19.482638 21565 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:19.478744 28371 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:19.407407 28466 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.483374 28474 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.514134 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:19.405426 28497 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:19.516815 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 109137us
I20260709 13:09:19.519197 28558 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:19.507035 28348 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:19.509559 28501 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.508605 28473 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:09:19.512878 28371 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:19.517357 28474 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:19.541710 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:19.552901 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.553194 21562 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:19.549261 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.542066 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.547616 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.554140 21641 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:19.560662 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.562005 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.562839 28507 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:09:19.563611 28522 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:19.564234 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:19.565757 28556 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:19.527181 28470 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:09:19.568558 28371 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.570235 28371 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:19.542124 28435 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:19.549602 28548 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.542356 28518 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:19.576289 28501 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:19.576419 21492 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:19.554474 28348 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.581641 28348 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:19.583395 21491 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:19.182709 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:19.590000 28514 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.609575 22212 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:19.618264 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:19.631157 21486 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:19.631527 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:19.634858 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 120810us
I20260709 13:09:19.635630 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:19.636720 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:19.639168 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 89011.6us
I20260709 13:09:19.640625 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:19.641037 21486 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:09:19.548434 28431 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.647428 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.650357 21489 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:19.648593 28495 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:19.670589 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:19.681927 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.682195 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.683080 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:19.683934 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.629247 28512 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:19.690593 21567 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:19.689358 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:19.687752 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:19.693949 21459 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:19.700323 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:19.648720 28431 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:19.708005 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 479648us
I20260709 13:09:19.668651 28503 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:19.694466 21568 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:09:19.682147 28523 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:19.672849 28501 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:19.674105 28495 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:19.703894 28384 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:09:19.732069 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.727227 28497 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:19.743441 28497 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:19.743916 28497 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:19.747051 28526 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:19.747804 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:19.748643 21487 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:19.749871 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:19.751261 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:19.752385 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:19.751993 28512 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:19.753000 21487 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:19.753367 21487 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:19.754263 21487 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.754884 28514 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:19.755661 21487 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:19.756943 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:19.717900 28572 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:19.716450 28523 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:19.963090 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 253392us
W20260709 13:09:19.969132 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.731778 28384 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:19.739262 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:19.977846 21485 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:19.732957 28471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43140 (request call id 21) took 5849 ms. Trace:
I20260709 13:09:19.721033 28501 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:19.731863 28495 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:19.989106 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 305969us
I20260709 13:09:19.772588 28516 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.719049 28503 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:19.966487 28523 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:19.805742 28466 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.997812 28547 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.002s
I20260709 13:09:19.739482 28505 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.334s
I20260709 13:09:19.971866 28526 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:20.055668 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.998742 28501 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.999236 28464 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:20.085450 21487 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
W20260709 13:09:20.088389 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 60391.5us
I20260709 13:09:20.093875 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:19.990098 28412 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
W20260709 13:09:20.112658 28474 consensus_meta.cc:287] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
I20260709 13:09:20.113289 28474 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.116211 28474 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:20.128854 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:20.054096 28466 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.147351 28101 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:20.096953 28464 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:20.168805 28575 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:09:20.170753 28571 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:09:20.171051 28543 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
W20260709 13:09:20.171882 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.172660 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.135928 28537 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:09:20.187705 28576 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:09:20.111511 28384 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.233143 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:20.241485 22244 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:20.053179 28516 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.245267 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:20.245673 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:20.246868 22240 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:19.996163 28471 rpcz_store.cc:276] 0709 13:09:13.886272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.897617 (+ 11345us) service_pool.cc:224] Handling call
0709 13:09:15.347398 (+1449781us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b1800065640. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98aa01d73d 00007f98a9fe8f3f 00007f98a9fe86b3 00007f98a9fe09fa 00007f98aefa84c9 00007f98a8524c54 00007f98a8524be2 00007f98a8524b11 00007f98a8524a8c 00007f98a8523d42
0709 13:09:15.961711 (+614313us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b58006059d0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f3e0aa 00007f98a9fc0447 00007f98a9fdd70a 00007f98a9fde76a 00007f98a9fdd91b 00007f98a9fe903c 00007f98a9fe86b3 00007f98a9fe09fa 00007f98aefa84c9 00007f98a8524c54
0709 13:09:15.965956 (+  4245us) log.cc:844] Serialized 508 byte log entry
0709 13:09:19.716294 (+3750338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51071,"raft.queue_time_us":42871,"raft.run_cpu_time_us":1093,"raft.run_wall_time_us":1092,"spinlock_wait_cycles":3558594304,"thread_start_us":376775,"threads_started":1,"wal-append.queue_time_us":575837,"wal-append.run_cpu_time_us":3917,"wal-append.run_wall_time_us":1255048}
I20260709 13:09:20.252359 28503 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.253739 28464 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:20.257978 28371 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.663s	user 0.006s	sys 0.001s
I20260709 13:09:20.259071 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cc9f5258ae3f4790a9bc1813d73ec987 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:20.166638 28526 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.227313 28384 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:20.265918 21534 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.001s	sys 0.009s
W20260709 13:09:20.266393 21534 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.001s	sys 0.009s
I20260709 13:09:20.271713 22245 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:20.273367 21485 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:20.280917 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.281626 28584 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.282167 28584 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.284490 28584 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.284330 28501 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.276705 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:20.289719 22242 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:20.224017 28497 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:20.288326 28585 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:09:20.288970 28466 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.286753 28501 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.304170 21494 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:20.314442 28588 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:20.344628 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:20.301873 28503 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:20.364044 28503 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.364430 28503 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:20.365797 28495 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.372211 28497 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:20.358692 28573 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.630s	user 0.000s	sys 0.003s
W20260709 13:09:20.373404 28564 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.855s	user 0.000s	sys 0.005s
I20260709 13:09:20.376040 28495 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.376310 28548 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.379034 28152 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:20.379302 28572 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:20.353722 28523 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.342388 28588 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.384451 28588 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.359861 28589 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:20.385229 28589 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.387455 28589 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:20.362946 28516 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.387709 28523 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:20.372428 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.399085 28513 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:20.399580 28513 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:20.400436 28513 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.401859 28513 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:20.401993 28152 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:20.402645 28152 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:20.406088 21532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.000s	sys 0.033s
W20260709 13:09:20.406471 21532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.000s	sys 0.033s
W20260709 13:09:20.411332 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 709797us
I20260709 13:09:20.412192 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:20.412873 21635 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
W20260709 13:09:20.416129 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.416755 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:20.418032 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:20.418664 21634 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:09:20.419227 28557 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.419999 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:20.421139 28514 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.421649 28514 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.424202 21635 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:20.419736 28557 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.427987 28557 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.428205 21487 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:20.430017 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:20.430369 28557 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:20.430979 28557 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.434158 28557 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.430099 28514 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:20.448211 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:20.451684 28546 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:20.452314 28546 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.458855 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:20.459725 21636 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:20.461256 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:20.461970 21639 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:20.463771 21640 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:09:20.469045 28514 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:20.469739 28514 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.472260 28514 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.472791 21636 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:20.476454 28546 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.479288 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:20.480187 21487 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:20.480820 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:20.481455 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:20.481623 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:20.481933 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:20.482177 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:20.482530 21492 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:20.482844 21487 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
W20260709 13:09:20.484303 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 508262us
I20260709 13:09:20.485900 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:20.486261 28524 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:20.486932 28524 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.490300 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:20.492965 28517 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:20.493837 28503 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.494897 21491 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:20.496938 28431 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.497171 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:20.497480 28431 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.499771 21640 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:09:20.500159 21640 pending_rounds.cc:85] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 12
I20260709 13:09:20.500382 21640 pending_rounds.cc:107] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 13:09:20.500638 21640 raft_consensus.cc:2889] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.504454 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:20.505239 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:20.506013 28517 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:20.506404 28431 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.507081 28517 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:20.507602 21561 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:20.507733 28517 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:20.508104 28517 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:20.508944 28517 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.510097 28517 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:20.511787 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:20.512696 28549 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:20.514371 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:20.489789 28524 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.490906 28546 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:20.516503 28546 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.503506 28523 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.519399 28523 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.522150 28549 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:20.524327 28152 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.528097 28380 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:20.528543 28546 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:20.521989 28523 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.477123 21634 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:20.537851 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:20.539034 28546 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:20.539546 28546 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.540172 28546 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:20.540868 21391 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.543819 28357 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:20.555812 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.565243 28517 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.565976 28517 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:20.539451 21392 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 241) took 12719 ms (client timeout 15000 ms). Trace:
I20260709 13:09:20.575874 28517 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:20.576635 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.578491 21562 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:09:20.593878 21641 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:20.595852 28152 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.596601 28152 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.601329 28152 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:20.564314 21391 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.611356 28527 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:20.620613 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.626912 28503 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.628279 21636 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:20.629494 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:20.631147 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:20.631554 28546 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.631851 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:20.568691 21392 rpcz_store.cc:269] 0709 13:09:07.819793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.833950 (+ 14157us) service_pool.cc:224] Handling call
0709 13:09:20.539238 (+12705288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:17.372851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:17.373736 (+   885us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:17.373800 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:09:17.373836 (+    36us) tablet.cc:662] Decoding operations
0709 13:09:17.404626 (+ 30790us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:17.404720 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:17.404751 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:09:17.410155 (+  5404us) tablet.cc:701] Row locks acquired
0709 13:09:17.410226 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:09:17.410427 (+   201us) write_op.cc:270] Start()
0709 13:09:17.410597 (+   170us) write_op.cc:276] Timestamp: P: 1783602557410355 usec, L: 0
0709 13:09:17.410638 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:09:17.411438 (+   800us) log.cc:844] Serialized 4088 byte log entry
0709 13:09:17.471499 (+ 60061us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a6ed80ac 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b
0709 13:09:17.861089 (+389590us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:18.227174 (+366085us) op_driver.cc:464] REPLICATION: finished
0709 13:09:18.435089 (+207915us) write_op.cc:301] APPLY: starting
0709 13:09:18.435204 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:18.687377 (+252173us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:18.687444 (+    67us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:18.734194 (+ 46750us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:18.734551 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:09:18.734619 (+    68us) write_op.cc:312] APPLY: finished
0709 13:09:18.735849 (+  1230us) log.cc:844] Serialized 97 byte log entry
0709 13:09:18.736788 (+   939us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:18.736938 (+   150us) write_op.cc:454] Released schema lock
0709 13:09:18.737019 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:18.737484 (+   465us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:18.737516 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":239524,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":160818,"apply.run_cpu_time_us":17643,"apply.run_wall_time_us":315984,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45887,"num_ops":10,"prepare.queue_time_us":459662,"prepare.run_cpu_time_us":20863,"prepare.run_wall_time_us":175029,"raft.queue_time_us":205375,"raft.run_cpu_time_us":25577,"raft.run_wall_time_us":150675,"replication_time_us":792729,"spinlock_wait_cycles":22402560,"thread_start_us":647070,"threads_started":4,"wal-append.queue_time_us":182365,"wal-append.run_cpu_time_us":30100,"wal-append.run_wall_time_us":2146608}]]}
I20260709 13:09:20.664832 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.677752 21564 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:09:20.681412 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:20.660847 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 318344us
W20260709 13:09:20.703987 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.704327 21639 raft_consensus.cc:2368] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23.
W20260709 13:09:20.675493 21457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.024s	sys 0.020s
W20260709 13:09:20.742837 21457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.024s	sys 0.020s
I20260709 13:09:20.652979 28547 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:20.743093 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:20.743528 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 614698us
I20260709 13:09:20.752782 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.754159 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.754760 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:20.756274 21636 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 20: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:20.761271 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.644807 28523 consensus_queue.cc:1059] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:09:20.805054 28581 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:20.805704 28405 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.805791 28581 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.774621 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:20.811757 21561 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:20.767917 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:20.776036 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:20.777292 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.774621 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.780591 21643 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:20.773829 28547 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.802281 28471 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:20.767122 28579 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:20.806478 28405 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.808478 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.810407 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.777626 21634 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260709 13:09:20.824486 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53206.6us
I20260709 13:09:20.824697 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:20.824549 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.825392 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:20.818375 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.823228 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2955) took 1120 ms. Trace:
I20260709 13:09:20.836820 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.839411 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:20.837754 21567 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:20.846244 21566 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:20.847366 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.850625 21564 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:20.851755 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:20.852583 21562 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:20.853005 21486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.006s	sys 0.015s
W20260709 13:09:20.855844 21486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.006s	sys 0.015s
I20260709 13:09:20.829180 21490 rpcz_store.cc:276] 0709 13:09:19.703085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.368266 (+665181us) service_pool.cc:224] Handling call
0709 13:09:20.368619 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.368849 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:09:20.369176 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.822800 (+453624us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.822871 (+    71us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:20.822931 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.823026 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.823163 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17063,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1082,"thread_start_us":453220,"threads_started":1}
I20260709 13:09:20.866401 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:20.869179 21563 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:09:20.851801 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 85677us
W20260709 13:09:20.873865 22247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.036s	sys 0.057s
W20260709 13:09:20.874290 22247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.036s	sys 0.057s
W20260709 13:09:20.877079 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 52454.4us
I20260709 13:09:20.879078 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:20.881268 21640 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:09:20.881637 21640 pending_rounds.cc:85] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 9
I20260709 13:09:20.881873 21640 pending_rounds.cc:107] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:09:20.882107 21640 raft_consensus.cc:2889] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.841939 28471 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:20.840760 28152 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:20.848249 28513 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:20.890578 22210 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:20.884644 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:20.836252 28501 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:09:20.886912 28435 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.899776 28366 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:20.847163 28517 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:20.901593 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:20.926976 22245 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 20: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:20.883555 28380 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:20.870272 28594 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:20.853587 28466 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.935105 28466 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.935774 28581 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.903740 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:20.924216 28507 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:20.937407 28507 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.937959 28466 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:20.938544 21568 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:20.914556 28513 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.938004 21563 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:20.941383 28513 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:20.942088 28513 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:20.865696 28514 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:20.943275 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:20.880740 28582 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.943853 21643 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:20.943969 28582 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.944690 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:20.945257 21636 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:20.946107 28582 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.865362 28549 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.916807 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:20.946835 28549 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.947160 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:20.947448 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:20.947786 21634 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:20.841709 28579 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.951491 22242 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:20.952008 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:20.952816 22241 raft_consensus.cc:2368] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:20.931151 28272 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:20.953882 28272 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:20.954312 28272 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.954654 28506 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:20.955042 28380 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.955631 28506 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:20.956444 28506 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:20.956810 28506 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:20.933881 22246 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:20.957978 28547 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.957660 28506 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.942956 28514 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.958575 28547 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:20.960878 28514 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:20.927597 28435 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.961977 21643 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:20.963696 28435 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:20.965171 22244 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:09:20.970158 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:20.971191 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:20.972164 28549 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.972324 28546 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:20.916118 28522 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:20.942164 28589 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:20.973440 28589 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:20.973332 28522 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.974387 28589 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:20.975476 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:20.976241 21491 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:20.909227 28152 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:20.954694 28272 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:20.978597 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:20.973354 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:20.980546 21563 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:20.980913 22240 raft_consensus.cc:1240] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:20.980574 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.975582 28589 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:20.905623 28477 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:20.992431 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.964418 28435 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:21.000304 22239 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:20.980638 21494 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
W20260709 13:09:20.987155 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.904232 21561 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
W20260709 13:09:20.982467 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 80250.1us
I20260709 13:09:21.003283 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:21.005152 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:20.978469 28152 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:20.983925 21636 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:20.998412 21562 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:09:21.018846 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.018870 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:20.938705 28466 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.020509 21636 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:20.958711 28506 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:21.022894 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:21.029657 21643 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:20.959245 28547 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.027550 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:20.975593 28522 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.033707 21639 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:21.029969 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:21.037276 21643 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:09:21.037569 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:21.038285 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.016162 28475 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:21.038889 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.014755 28435 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.016955 28524 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:20.981731 28517 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.021385 28357 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:09:21.043064 21639 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:21.023916 28380 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:21.048048 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:21.076169 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:21.048907 28550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.027s	sys 0.081s
I20260709 13:09:21.051108 28524 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:21.051769 28405 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.052868 28579 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:21.047909 28435 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:21.056252 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:20.993312 28513 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.034574 28466 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.091920 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.095356 22242 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:21.103071 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.059993 28475 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:21.109644 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.113549 21643 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
W20260709 13:09:21.093986 28550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.028s	sys 0.081s
I20260709 13:09:21.116137 21640 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:21.095404 28526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.029s	sys 0.084s
I20260709 13:09:21.093079 28581 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.101167 28501 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:21.135731 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.140137 21636 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 25.
I20260709 13:09:21.107193 28366 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.132603 28526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.030s	sys 0.084s
I20260709 13:09:21.158761 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2349) took 1474 ms. Trace:
I20260709 13:09:21.210465 28366 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:21.212024 21493 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 2353) took 1525 ms (client timeout 1675 ms). Trace:
W20260709 13:09:21.212446 21493 rpcz_store.cc:269] 0709 13:09:19.686109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.716640 (+ 30531us) service_pool.cc:224] Handling call
0709 13:09:21.211801 (+1495161us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540013a1d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:21.211941 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3342875776}
I20260709 13:09:21.212821 28366 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:21.211236 21486 rpcz_store.cc:276] 0709 13:09:19.684793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.693675 (+  8882us) service_pool.cc:224] Handling call
0709 13:09:19.699089 (+  5414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:19.727365 (+ 28276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.727401 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:20.312321 (+584920us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b2c000014c8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:09:20.313159 (+   838us) log.cc:844] Serialized 52 byte log entry
0709 13:09:20.856469 (+543310us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:20.899484 (+ 43015us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.899745 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.899825 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.158307 (+258482us) raft_consensus.cc:1685] finished
0709 13:09:21.158432 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.158635 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32649,"prepare.queue_time_us":43101,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":36542,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":61607,"spinlock_wait_cycles":5932416,"thread_start_us":542733,"threads_started":1,"wal-append.queue_time_us":837849}
I20260709 13:09:21.213872 28475 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.159438 28570 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:09:21.166951 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.215440 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.170192 21569 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:21.216821 28513 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:21.174412 28517 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:21.174435 22241 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:21.176049 28466 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:21.177201 28524 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.178920 28547 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:21.179332 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:21.179710 28501 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:21.180253 28579 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:21.185599 28522 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:21.122212 28507 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.198873 28581 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:21.200351 28601 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.149s	user 0.003s	sys 0.000s
I20260709 13:09:21.222210 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:21.230046 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.230207 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:21.226594 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 47342.7us
I20260709 13:09:21.231904 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:21.218065 28570 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:21.236696 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:21.233187 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:21.244002 27864 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:21.244486 27864 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.244837 27864 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:21.221287 28558 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:21.226684 28180 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:21.237380 28523 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:21.235262 28587 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:21.253301 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.255618 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.260999 21634 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:21.229043 28384 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:21.227454 28522 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:21.258649 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.235705 28507 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:21.247398 28366 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:21.251473 28431 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:21.271833 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.235836 28579 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.272558 21494 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:21.286113 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:21.291754 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.257041 28558 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:21.298125 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.256079 28272 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.258759 28180 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.272444 28507 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.303927 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.304306 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.295814 28557 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:21.308310 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.318091 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.327280 21565 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:21.295692 28534 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:21.331832 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.341538 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.347790 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:21.351310 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.353190 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.354924 28547 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:21.355719 28180 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.356313 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.356685 22212 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:21.357331 22245 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:21.324137 28522 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.358834 28522 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:21.358978 28477 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:21.359398 28579 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.362268 28507 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.304777 28581 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:21.365495 28272 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.329748 28285 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:21.369686 28285 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:21.370581 28285 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.371619 28285 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:21.359397 28477 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.373654 28477 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:21.272768 28501 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.380921 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.381217 28558 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:21.279286 28570 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.382311 28570 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:21.385807 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:21.422693 21560 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:21.385175 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:21.432475 21458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.028s	sys 0.020s
W20260709 13:09:21.433022 21458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.028s	sys 0.020s
W20260709 13:09:21.434113 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.426513 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:21.467401 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:21.469375 22247 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.012s
W20260709 13:09:21.470031 22247 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.005s	sys 0.012s
I20260709 13:09:21.443243 28557 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:21.476951 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:21.477981 21635 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:21.447304 28519 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.445287 28547 raft_consensus.cc:2764] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:09:21.384678 28466 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:09:21.453423 28506 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.495289 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.511865 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1211) took 1205 ms. Trace:
I20260709 13:09:21.514304 21569 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:09:21.523959 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:21.517875 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:21.524931 21489 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:21.536010 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 50275.6us
I20260709 13:09:21.526530 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.527057 22247 rpcz_store.cc:276] 0709 13:09:20.274007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.274144 (+   137us) service_pool.cc:224] Handling call
0709 13:09:20.279322 (+  5178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.279689 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.279716 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.280182 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.877208 (+597026us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:21.474943 (+597735us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.478368 (+  3425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.478708 (+   340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.478804 (+    96us) raft_consensus.cc:1685] finished
0709 13:09:21.478820 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.479014 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16719,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":30351,"spinlock_wait_cycles":40576,"thread_start_us":1159545,"threads_started":2,"wal-append.queue_time_us":833198}
I20260709 13:09:21.484503 28557 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.514418 28357 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:21.468753 28594 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:09:21.472518 28525 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:09:21.563232 28435 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.564755 22246 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 19. Ops: []
I20260709 13:09:21.528705 28506 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.573421 28506 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:21.576215 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.526285 28477 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.573902 21635 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:09:21.541469 28549 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:09:21.595041 28502 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.595873 28502 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.518612 28519 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.601109 28519 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.601765 28519 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.582363 28477 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:21.615921 28609 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:21.541469 28557 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:21.626986 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.639858 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.639981 21489 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:09:21.639024 21560 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
W20260709 13:09:21.619052 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 378807us
I20260709 13:09:21.642302 28519 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.645869 21532 leader_election.cc:400] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23.
I20260709 13:09:21.646268 21532 leader_election.cc:403] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.598682 28502 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.566071 28435 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.621256 28584 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:21.661453 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 137566us
I20260709 13:09:21.621973 28609 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:21.713493 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 49681.7us
I20260709 13:09:21.661625 28285 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:21.715055 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:21.642650 27864 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.718436 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:21.722294 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:21.722618 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.723825 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.720975 28525 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:09:21.727057 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:21.727699 21493 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:21.728231 21487 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:21.677845 28613 raft_consensus.cc:2764] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:09:21.731055 22241 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 26: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:21.733307 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.739876 21492 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:21.743641 21491 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:21.733647 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.744017 21491 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:21.734041 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.715730 28550 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23.
I20260709 13:09:21.737459 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:21.746312 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.742750 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.747049 21487 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:21.747889 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.748487 21487 raft_consensus.cc:2376] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19. Re-sending same reply.
I20260709 13:09:21.749590 21487 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260709 13:09:21.736377 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.719810 28285 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:21.725436 28384 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:21.752281 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.744783 21491 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.753060 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:21.751729 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 248129us
I20260709 13:09:21.755287 28624 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:21.723373 28526 consensus_queue.cc:1059] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:09:21.763131 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.763589 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.763865 21485 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:21.764245 21492 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:21.723574 28519 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.723229 28524 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:09:21.728475 28536 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:21.730638 28589 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:21.773823 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:21.774492 21565 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:21.765774 21491 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:21.735282 27864 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:21.779546 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:21.764264 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 225008us
I20260709 13:09:21.760350 28579 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:21.780305 21492 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:21.763875 28587 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:21.788520 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:21.791421 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.759279 28384 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:21.796550 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 469831us
W20260709 13:09:21.797618 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.798560 21493 raft_consensus.cc:2410] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:09:21.800645 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.763676 28431 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:09:21.803697 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.804374 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.804728 21606 leader_election.cc:400] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:21.805022 21563 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:21.806348 22247 raft_consensus.cc:2393] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:21.807117 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:21.807893 21493 raft_consensus.cc:2376] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19. Re-sending same reply.
I20260709 13:09:21.809253 21606 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:21.810487 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.814495 21491 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:09:21.817850 21565 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:21.781781 28579 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:21.781705 28536 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:21.824923 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:21.798552 28384 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:21.733227 28609 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:21.814433 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:21.823455 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.825685 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:21.785799 28589 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:21.826361 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:21.827709 28621 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:09:21.798887 28587 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.819416 28549 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:09:21.819341 28466 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:21.831168 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.864821 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:21.832315 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.833035 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.833722 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:21.835052 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:21.867413 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.867748 21492 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:21.835744 28431 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:09:21.836916 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.837390 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.871438 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.871887 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.839910 21642 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:09:21.844020 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:21.842505 21490 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:21.847246 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:21.873052 21641 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:21.848511 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.873588 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.866806 21488 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:21.768611 28624 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.865018 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.831910 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.867436 21487 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:21.879673 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:21.858801 28587 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:21.842126 28477 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:21.874191 21636 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:21.892200 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.861423 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.892824 21560 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:21.875321 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.878062 21639 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:21.879802 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:21.894120 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.894431 21640 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:21.825368 28579 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:21.880692 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.881719 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.883469 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.885471 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.886166 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.894940 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.900374 21635 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:21.895690 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:21.893606 21642 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:21.903642 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.904031 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:21.890888 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.904943 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:21.896955 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.794803 28285 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:21.899448 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:21.909341 21636 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:21.906514 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.898598 21490 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:21.914458 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.908157 21639 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
W20260709 13:09:21.920037 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 55294.9us
I20260709 13:09:21.897601 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:21.921144 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.922122 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:21.922866 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:21.923720 21488 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:09:21.869717 28610 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:21.930773 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.939617 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:21.940236 21485 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:21.869568 28431 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:21.922305 28558 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.879590 28180 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:21.941238 21491 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:21.922411 21643 raft_consensus.cc:2955] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:21.880484 28526 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:21.890945 28524 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.988200 21459 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:21.895592 28609 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:21.952112 21490 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:21.953099 28587 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:21.960230 28647 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:21.966300 21487 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:21.964239 28405 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:21.953506 28527 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.970705 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.975502 28282 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:21.972654 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:22.018604 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46027.4us
W20260709 13:09:22.019520 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.020195 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:09:21.979657 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 176053us
W20260709 13:09:21.977478 28628 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:21.920871 28477 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:22.024250 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 119386us
I20260709 13:09:22.025075 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:22.025384 28477 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:22.027776 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.949703 28547 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:22.028430 28547 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.028960 28547 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.000574 28587 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.964708 28584 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:21.966038 28634 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:22.004297 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:21.949119 28466 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:22.007015 21491 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:21.890473 28608 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.118s
I20260709 13:09:21.939894 28610 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:22.056072 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:22.062923 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.063324 21640 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 26.
I20260709 13:09:21.998435 28285 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:22.075073 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 142534us
I20260709 13:09:21.978929 28558 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.080271 21490 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:22.056407 28612 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:22.012439 28519 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:22.055212 28587 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.082276 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:21.964545 28613 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:09:22.075138 28610 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.079414 28431 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.009809 28536 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.093024 21562 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:09:22.093500 28608 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:22.055537 28405 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.070371 28634 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.097756 28594 raft_consensus.cc:3055] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:22.098299 28616 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 13:09:22.148633 28519 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.100653 28384 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.035879 28527 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.067227 28549 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:22.183658 28522 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.001s
I20260709 13:09:22.184201 28549 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:22.184489 28384 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.104837 28466 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:22.184718 28549 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.185117 28466 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:22.185949 28466 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.187150 28466 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:22.009881 28589 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.188731 28624 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:22.087109 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:22.192052 28570 consensus_meta.cc:287] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.809s	user 0.009s	sys 0.002s
I20260709 13:09:22.108928 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 998) took 1143 ms. Trace:
I20260709 13:09:22.192675 22246 rpcz_store.cc:276] 0709 13:09:20.965089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.976035 (+ 10946us) service_pool.cc:224] Handling call
0709 13:09:21.047012 (+ 70977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.565156 (+518144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.642052 (+ 76896us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54005a2b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:22.108659 (+466607us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b54005a2b50. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:22.108828 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352723584}
I20260709 13:09:22.112931 27864 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:21.996487 28526 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.194546 27864 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.196461 28526 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.197113 27864 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:22.083539 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:22.178763 28631 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.359s	user 0.001s	sys 0.001s
I20260709 13:09:22.204816 28466 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:22.205593 28557 consensus_meta.cc:287] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 13:09:22.206110 28557 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.056931 28584 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:22.148036 21641 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:21.985631 28180 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.161953 21488 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 26.
I20260709 13:09:22.006632 28524 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.020298 28647 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.147322 28520 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:22.100941 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:22.177870 28594 raft_consensus.cc:740] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:22.124778 21492 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:22.151060 28646 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:22.230334 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.175386 28608 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.233880 28634 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:22.229398 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 128541us
I20260709 13:09:22.181376 28519 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.243211 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:22.243958 21568 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
W20260709 13:09:22.251272 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 346394us
I20260709 13:09:22.256743 21488 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:22.260617 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:22.261705 21492 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:22.262434 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:22.250069 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:22.264348 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:22.266907 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.267504 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:22.266767 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:22.268759 21560 raft_consensus.cc:2368] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20.
I20260709 13:09:22.226258 28645 raft_consensus.cc:2764] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:09:22.229059 28549 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:22.275421 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:22.276960 21639 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:09:22.277401 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:22.272974 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:22.226804 28520 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:22.273648 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:22.274735 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:22.238639 28436 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:09:22.280377 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 198170us
I20260709 13:09:22.282651 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:22.283488 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.288374 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:22.291066 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:22.272482 28616 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:22.299700 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:22.308547 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.310748 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:22.275823 28501 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:22.311564 21635 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 22: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:22.282505 28520 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:22.318811 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.281827 28624 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:22.280578 28649 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:22.323457 21641 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:22.325743 21606 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:22.312119 28466 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:22.335886 21637 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:09:22.307705 28616 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:22.336535 21637 pending_rounds.cc:85] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 11
I20260709 13:09:22.310501 28436 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:22.337843 21637 pending_rounds.cc:107] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:09:22.322986 28651 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:22.376148 21637 raft_consensus.cc:2889] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:22.331298 28646 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:22.310369 28475 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:09:22.383113 21494 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:22.382112 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:22.384388 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 58782.8us
W20260709 13:09:22.382118 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 63633.3us
I20260709 13:09:22.384753 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:22.385528 21489 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:09:22.386169 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:22.386760 21562 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:22.299870 28594 consensus_queue.cc:260] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.388921 28405 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:22.327744 28635 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:09:22.350430 28582 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:22.354873 28616 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:22.385124 21606 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:22.391983 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:22.347339 28608 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:22.337510 28659 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:22.347535 28558 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.347898 28527 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.337208 28501 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:22.373544 28644 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:22.348840 28647 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:22.390830 28609 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:22.407505 28405 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:09:22.393064 28589 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:09:22.406574 28646 raft_consensus.cc:2764] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:09:22.397106 28384 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:09:22.404052 21459 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:22.401419 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.404649 21569 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 21: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:22.328389 28650 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:09:22.422046 22210 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.428206 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
W20260709 13:09:22.452181 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48219.6us
W20260709 13:09:22.455411 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 54072.2us
I20260709 13:09:22.477216 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.461742 28664 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:22.440641 28534 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:22.437052 28609 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.437752 28436 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.439888 28557 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:22.448006 28644 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:22.423238 28524 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.437557 28180 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.464432 28507 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:22.428714 28501 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:22.451282 28579 consensus_meta.cc:287] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.002s
I20260709 13:09:22.501279 28579 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.503638 28579 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.467221 28431 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:22.506402 28527 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.506976 28527 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.508989 28527 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.510972 21563 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:22.467985 28519 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.490285 28646 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:22.513211 28519 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.469424 28477 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:22.418730 28587 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.514310 28477 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.514961 22246 raft_consensus.cc:1813] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:09:22.515431 22246 raft_consensus.cc:2368] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:22.516266 28587 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.469686 28520 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.480396 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:22.517285 21485 raft_consensus.cc:2368] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19.
W20260709 13:09:22.481355 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 59413.8us
I20260709 13:09:22.517877 28507 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.518349 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:22.518833 28520 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:22.530117 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:22.530766 21560 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.532716 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:22.534983 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:22.483600 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 463452us
I20260709 13:09:22.535693 21486 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:22.535948 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:22.484158 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:09:22.537863 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:22.487722 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 91930us
I20260709 13:09:22.489459 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:22.396638 28654 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:09:22.550562 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:22.495735 28549 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:22.494642 28644 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:22.552752 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:22.553581 28645 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:22.553722 28581 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:22.554188 28581 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:22.554524 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 70516.6us
I20260709 13:09:22.554718 28647 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:22.555200 28647 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:22.555307 21606 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:22.555382 28520 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:22.556578 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.554543 28581 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:22.516572 28477 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.429574 28547 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.489737 28534 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.560066 28645 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.560871 28534 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:22.486411 28272 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:22.562112 28645 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:22.562157 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:22.565713 28616 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.518289 28507 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:22.547056 21494 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
W20260709 13:09:22.550030 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.572016 28647 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:22.576870 28658 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.187s	user 0.004s	sys 0.000s
I20260709 13:09:22.581769 28584 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.560871 28547 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:22.562364 28609 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:22.587430 28594 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:22.590201 28651 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:22.590754 28651 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:22.596028 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:22.598519 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 53604.9us
I20260709 13:09:22.600523 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:22.600804 21492 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:22.596859 28520 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:22.602800 28664 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:09:22.604403 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47885us
I20260709 13:09:22.605827 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.609233 21560 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:22.603302 28664 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:22.611398 28650 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:22.618333 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:22.621397 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:22.624285 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.624583 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:22.622407 28659 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:22.613078 21459 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:22.621321 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:22.627843 28549 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:22.626092 28519 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:22.631392 28549 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:22.631896 28549 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:22.611220 28664 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:22.634064 21563 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:22.636575 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.620034 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:22.644827 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:09:22.646087 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.646675 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.654559 28285 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:22.655225 28285 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:22.648440 28659 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:22.619059 28610 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.656100 28285 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.656505 28642 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:22.658010 28610 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:22.659734 28584 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:22.660148 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:22.661051 28180 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:22.661880 28180 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:22.662256 28180 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.662580 28180 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.663100 21638 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:22.663363 27864 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:22.663769 27864 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:22.664132 27864 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:22.662741 28477 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:22.667138 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:22.670420 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:22.671631 21457 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:22.668183 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 43694.3us
I20260709 13:09:22.672818 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:22.667553 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 54578.9us
I20260709 13:09:22.665993 28635 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:22.669142 28654 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:22.694536 28667 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:22.680739 28536 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:22.681039 28609 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:22.678004 28272 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:09:22.692613 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.717347 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:22.700119 28635 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:22.697391 28520 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.721884 21391 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 148) took 14062 ms (client timeout 15000 ms). Trace:
I20260709 13:09:22.721767 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:22.722944 28642 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:22.723368 28639 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:22.723874 28640 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:09:22.724515 28534 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.683849 28659 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:09:22.727234 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:22.727383 21606 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.730757 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:22.734236 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:22.734769 21643 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:22.731129 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:22.735849 21636 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:22.731956 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:22.732648 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:22.732475 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:22.737021 22247 raft_consensus.cc:2368] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:09:22.737202 21639 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:22.737301 21642 raft_consensus.cc:2368] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:09:22.737221 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:22.740741 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.714762 28667 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:22.808060 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:22.806686 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 80088.3us
I20260709 13:09:22.745838 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.812181 21532 leader_election.cc:400] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:22.735770 28635 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:22.743770 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:22.813735 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 67961.5us
I20260709 13:09:22.815443 21634 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 13:09:22.815861 21634 pending_rounds.cc:85] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 14
I20260709 13:09:22.808110 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:22.816095 21634 pending_rounds.cc:107] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 13:09:22.816351 21634 raft_consensus.cc:2889] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:22.818720 22246 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:22.819887 28581 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:22.820519 28672 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:22.821892 21608 leader_election.cc:400] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20.
I20260709 13:09:22.808729 28654 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:22.823508 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:22.713693 28613 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
W20260709 13:09:22.746553 28663 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:09:22.806648 28609 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:22.740547 28502 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:22.725272 28523 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:22.749863 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:22.836606 21643 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:22.851178 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:22.837467 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:22.837714 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:22.838474 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:22.853037 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 103284us
I20260709 13:09:22.808885 28610 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:22.726456 28644 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.852149 21643 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 25 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:09:22.853226 21490 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.838676 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:22.854027 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:22.882644 21486 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:22.726732 21391 rpcz_store.cc:269] 0709 13:09:08.659802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.663208 (+  3406us) service_pool.cc:224] Handling call
0709 13:09:22.721833 (+14058625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:21.302721 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:21.367619 (+ 64898us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:21.367671 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:09:21.367699 (+    28us) tablet.cc:662] Decoding operations
0709 13:09:21.368212 (+   513us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:21.368319 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:21.368362 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:09:21.368761 (+   399us) tablet.cc:701] Row locks acquired
0709 13:09:21.368786 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:09:21.368968 (+   182us) write_op.cc:270] Start()
0709 13:09:21.369115 (+   147us) write_op.cc:276] Timestamp: P: 1783602561368911 usec, L: 0
0709 13:09:21.369145 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:09:21.369994 (+   849us) log.cc:844] Serialized 925 byte log entry
0709 13:09:22.110858 (+740864us) op_driver.cc:464] REPLICATION: finished
0709 13:09:22.388787 (+277929us) write_op.cc:301] APPLY: starting
0709 13:09:22.388879 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:22.431491 (+ 42612us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:22.431609 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:22.432917 (+  1308us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:22.433107 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:09:22.433151 (+    44us) write_op.cc:312] APPLY: finished
0709 13:09:22.433334 (+   183us) log.cc:844] Serialized 33 byte log entry
0709 13:09:22.433498 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:22.448994 (+ 15496us) write_op.cc:454] Released schema lock
0709 13:09:22.451587 (+  2593us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:22.465153 (+ 13566us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:22.465186 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23464,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":269949,"apply.run_cpu_time_us":5064,"apply.run_wall_time_us":76344,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12479,"num_ops":2,"prepare.queue_time_us":488803,"prepare.run_cpu_time_us":53496,"prepare.run_wall_time_us":385975,"raft.queue_time_us":235888,"raft.run_cpu_time_us":34842,"raft.run_wall_time_us":244624,"replication_time_us":708312,"thread_start_us":881382,"threads_started":4,"wal-append.queue_time_us":345949}]]}
I20260709 13:09:22.883919 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:22.886435 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:22.743028 28549 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.895885 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:22.744692 28534 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:22.877735 22244 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:22.850391 28616 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:22.878302 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:22.824821 28435 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:22.882009 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:22.745954 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:22.877609 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:22.926198 21638 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:22.909993 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:22.910233 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:22.740330 28520 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.876845 28547 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:22.922835 21486 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:22.924234 28667 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:22.925465 21634 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:22.893503 28645 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:22.985488 21493 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
W20260709 13:09:22.988806 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 150574us
I20260709 13:09:22.989431 21494 raft_consensus.cc:2410] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:09:22.932868 28646 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:22.991179 21638 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:22.941987 28610 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:22.975522 28645 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:23.002090 28646 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:23.009038 21457 leader_election.cc:400] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:09:23.011713 21457 leader_election.cc:403] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:09:22.939081 28614 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.304s
I20260709 13:09:22.999729 28612 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.017913 28666 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:23.021291 28666 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:23.022392 28666 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.024166 28666 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.998777 28610 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:23.033908 21563 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:09:23.010121 28645 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:23.033715 28610 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:23.033558 28612 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.095897 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:23.051962 28644 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:23.116771 28651 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 13:09:23.117367 28651 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.124128 28664 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:23.128679 28431 consensus_meta.cc:287] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.624s	user 0.005s	sys 0.004s
I20260709 13:09:23.130476 21490 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:23.148270 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:23.140829 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 120860us
I20260709 13:09:23.154136 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:23.154799 21563 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
W20260709 13:09:23.157950 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 166403us
I20260709 13:09:23.138504 28635 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.158931 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:23.140794 28675 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
W20260709 13:09:23.152745 28647 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 13:09:23.155014 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:23.151664 28534 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:23.174388 21457 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:23.175554 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:23.157912 28549 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:23.178100 22241 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:23.187081 21491 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:09:23.192154 21457 leader_election.cc:400] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:09:23.195091 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:23.196857 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:23.197695 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:23.187795 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:23.166177 28520 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:23.201025 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:23.206285 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:23.207516 28547 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:23.168289 28582 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:23.204828 21636 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:23.217211 28431 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.218029 28431 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.219072 28520 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:23.219991 28520 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:23.221731 28431 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:23.223819 28520 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:23.224597 28520 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:23.225700 28520 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.234450 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:23.139271 28646 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.242008 21491 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:23.169646 28647 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.209311 28664 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:23.210938 28557 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:23.215862 28549 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.241241 28507 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.002s
W20260709 13:09:23.295702 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 107971us
W20260709 13:09:23.297588 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 91382.5us
I20260709 13:09:23.245898 28582 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:23.280233 28681 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:23.307730 21487 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:23.296917 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:23.289891 28651 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:23.265362 28698 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:23.318115 28506 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:23.305401 28547 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:23.318642 28506 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.319109 28506 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:23.320236 28547 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.321985 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:23.323999 28635 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:23.324224 28523 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:23.332880 28594 consensus_meta.cc:287] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.003s
I20260709 13:09:23.335855 21485 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:23.294587 28507 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.336376 28654 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:23.354298 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:23.348220 28582 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.356415 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:23.357357 28697 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.338569 28698 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:23.365231 28654 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.294129 28549 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.368105 21566 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:23.376693 28507 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:23.376847 27864 consensus_meta.cc:287] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.712s	user 0.007s	sys 0.006s
I20260709 13:09:23.377746 21490 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:23.378707 28647 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:23.377743 27864 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:23.381040 28180 consensus_meta.cc:287] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.718s	user 0.007s	sys 0.003s
I20260709 13:09:23.382211 28180 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.383800 21493 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:09:23.386313 28180 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:23.387981 28698 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.390508 27864 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:23.391191 28697 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.394899 28697 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:23.396731 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:23.395968 28549 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:23.399772 28654 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:23.404378 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:23.405092 21561 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:23.405584 28534 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.406056 28534 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.408110 28534 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:23.408921 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:23.409734 21565 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 21: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:23.414883 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:23.416334 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:23.416738 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:23.416991 21569 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 12.
I20260709 13:09:23.417979 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:23.418900 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:23.420706 21568 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:23.422191 21566 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:23.427474 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:23.428325 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:23.428675 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:23.428825 21532 leader_election.cc:400] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19.
I20260709 13:09:23.428329 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:23.431360 21532 leader_election.cc:403] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:23.433419 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:23.434296 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:23.435104 21561 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:23.435997 28645 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.425639 22212 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:23.437543 28634 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:23.437916 28634 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.438293 28634 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:23.438752 28581 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:23.440328 28669 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.547s	user 0.004s	sys 0.000s
I20260709 13:09:23.444495 28584 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:23.446595 28645 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:23.436231 28610 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.449029 28610 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:23.449800 28624 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19.
I20260709 13:09:23.454120 28640 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:23.455245 28640 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:23.455593 28640 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:23.456358 28640 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.457294 28640 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:23.458942 28671 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.562s	user 0.000s	sys 0.002s
I20260709 13:09:23.492663 21606 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:23.465317 28702 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:09:23.488823 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:23.500211 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:23.513087 21566 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:23.500742 21487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18a391cd0b80409cb0308239137325f8"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:23.514451 21487 raft_consensus.cc:606] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:23.515688 21487 raft_consensus.cc:614] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:23.517271 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:23.519001 22241 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:23.488016 28613 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:23.533304 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:23.534552 21488 raft_consensus.cc:2410] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:09:23.535518 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:23.530367 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:23.599086 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:23.490120 28659 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:23.631183 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 100928us
I20260709 13:09:23.633656 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:23.610350 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.611364 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:23.503439 28610 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:09:23.653671 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45857.3us
I20260709 13:09:23.659696 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:23.519011 28645 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:23.670862 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:23.528024 28667 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:23.698113 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:23.711097 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 56449us
I20260709 13:09:23.534225 28549 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:23.766714 28667 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:23.767720 28667 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.768811 28696 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:23.716590 28654 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:09:23.716427 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 61405.4us
I20260709 13:09:23.497188 28523 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.156s
I20260709 13:09:23.751200 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:23.815035 21493 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:23.761792 28647 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:09:23.762636 28664 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:23.764077 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:23.656440 28697 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:23.830309 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:23.719292 21608 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:23.832151 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:23.836367 21491 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:23.827093 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:23.841179 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 121961us
W20260709 13:09:23.849092 22210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.014s	sys 0.035s
W20260709 13:09:23.879547 22210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.019s	sys 0.039s
W20260709 13:09:23.880030 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 671371us
I20260709 13:09:23.629884 28506 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.827015 28634 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.829634 28431 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.827901 28610 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:23.831765 28549 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.654752 28659 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.832726 28697 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:23.837494 28594 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.720790 21566 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:23.770732 28645 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.916759 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:09:23.922057 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:23.730717 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:23.937564 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:23.945799 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 215169us
I20260709 13:09:23.895365 28647 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:23.946928 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:23.909989 28698 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
W20260709 13:09:23.891475 21441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 43888.8us
I20260709 13:09:23.949606 28594 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:23.952800 28594 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:23.953927 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:23.937754 28697 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.742463 28520 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.186s
I20260709 13:09:23.837543 28664 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:23.960891 28664 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:23.963967 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:23.964831 22246 raft_consensus.cc:2368] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15.
I20260709 13:09:23.965667 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:23.948781 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:23.716769 28644 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:23.900208 28646 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.968417 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46516.6us
I20260709 13:09:23.972752 28650 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:23.974066 28645 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:23.968986 28654 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:09:23.905087 28642 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:09:23.981442 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:23.982496 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:23.998179 21606 leader_election.cc:400] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15.
I20260709 13:09:23.998728 21606 leader_election.cc:403] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:24.000029 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2996) took 1164 ms. Trace:
I20260709 13:09:23.967610 28640 raft_consensus.cc:2764] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:09:24.008742 21493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d6d6e481fd941658a227093848691fa"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:24.010679 21493 raft_consensus.cc:606] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:24.000564 21492 rpcz_store.cc:276] 0709 13:09:22.836045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.836167 (+   122us) service_pool.cc:224] Handling call
0709 13:09:22.836502 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.836713 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:22.876260 (+ 39547us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.042622 (+166362us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.652521 (+609899us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18000f4960. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:09:23.999635 (+347114us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.999689 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:23.999745 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.999826 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.999967 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8347,"prepare.queue_time_us":43318,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":158286,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":191,"spinlock_wait_cycles":25232256,"thread_start_us":498680,"threads_started":2,"wal-append.queue_time_us":234952}
I20260709 13:09:24.015944 22243 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:23.917304 28431 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.018599 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:23.980247 28523 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:24.029932 21488 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:09:24.030728 21492 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:23.943444 28549 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.033867 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:23.938745 28610 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.039177 21493 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:24.039847 21492 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:09:24.047168 28549 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.047966 28549 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:24.048623 28366 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:09:24.051630 28708 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:24.022771 28609 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:24.053893 28705 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:09:24.048624 28549 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:24.054826 28549 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.057852 28549 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.058503 28549 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:24.023087 28647 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:23.978708 28646 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.022145 28644 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.031872 28523 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:24.015602 28645 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:09:24.040750 28640 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:24.037966 28634 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.043527 28614 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:24.042871 28694 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:24.082360 22247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:09:24.051697 28610 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.090701 22247 raft_consensus.cc:606] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:24.065495 28587 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:09:24.090626 28647 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:24.072628 28644 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:24.112433 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 165889us
I20260709 13:09:24.115165 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:24.097221 28694 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:24.121511 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.092543 28614 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.091470 28640 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.105382 28647 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:24.123777 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.111680 28506 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:24.124538 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.126608 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.131484 28716 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:24.140443 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.145483 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:24.146210 21566 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:24.146643 28644 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:24.147501 28713 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
I20260709 13:09:24.155413 28431 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:24.156229 28431 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:24.156600 28431 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:24.157470 28431 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.159845 21485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:24.160444 21566 raft_consensus.cc:2468] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:24.160583 21485 raft_consensus.cc:606] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:24.161041 21485 raft_consensus.cc:614] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:24.160007 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 2998) took 1323 ms. Trace:
I20260709 13:09:24.162019 28614 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.162118 21489 rpcz_store.cc:276] 0709 13:09:22.836603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.836714 (+   111us) service_pool.cc:224] Handling call
0709 13:09:22.836985 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.456335 (+619350us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b1800171940. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef2455 00007f98a9fda060 00007f98a9fdabfb 00007f98a9fe564b
0709 13:09:23.456484 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.456511 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.456960 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.839524 (+382564us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:23.839574 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.839661 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.159696 (+320035us) raft_consensus.cc:1685] finished
0709 13:09:24.159715 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.159946 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6946,"raft.queue_time_us":4742,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":33546,"spinlock_wait_cycles":37570816,"thread_start_us":426923,"threads_started":2,"wal-append.queue_time_us":552565}
I20260709 13:09:24.167335 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 2378) took 1019 ms. Trace:
I20260709 13:09:24.167891 21490 rpcz_store.cc:276] 0709 13:09:23.147818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.147991 (+   173us) service_pool.cc:224] Handling call
0709 13:09:24.167030 (+1019039us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54003f8c54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:24.167247 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525441792}
I20260709 13:09:24.171478 22212 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.172475 28435 raft_consensus.cc:2804] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:24.173023 28435 raft_consensus.cc:697] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:24.174003 28435 consensus_queue.cc:237] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.198549 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.199473 21640 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:24.201189 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:24.203203 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:24.203943 21636 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:24.220549 21635 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:24.107890 28523 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.230217 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:24.219339 28679 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:24.231350 21485 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
W20260709 13:09:24.232919 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 195881us
I20260709 13:09:24.246860 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.225203 28640 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.247638 22240 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:24.225651 28644 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:24.225713 28547 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.251807 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.255101 21636 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:24.256075 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.235708 28610 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:24.259471 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.257781 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.239815 28523 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:24.260977 28646 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.257285 28644 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.263458 22240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:09:24.264196 22240 raft_consensus.cc:606] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:24.264644 22240 raft_consensus.cc:614] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:24.245472 28642 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:24.266153 28642 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.267323 28609 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15.
I20260709 13:09:24.268405 28642 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.229521 28647 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.269786 28647 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:24.270004 28659 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.272578 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.273216 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.245846 28645 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:24.264479 28644 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:24.317349 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 56661us
I20260709 13:09:24.319068 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:24.321604 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 191111us
I20260709 13:09:24.322724 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:24.323333 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.326638 21636 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:09:24.236515 28694 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.260063 28547 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.284538 28650 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:24.283267 28609 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:24.341677 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.351708 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:24.271016 28610 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.359313 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.359802 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.360929 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.361020 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.361467 21493 raft_consensus.cc:1813] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Handling vote request from an unknown peer a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:24.361970 21493 raft_consensus.cc:2410] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:09:24.279618 28645 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.359498 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.362650 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.362778 21493 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:24.372750 21635 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 22: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:09:24.377310 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 58819us
I20260709 13:09:24.378118 21641 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:24.378548 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.387022 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.340696 28644 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:24.363417 28715 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:09:24.341598 28724 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:09:24.403016 28502 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.378s	user 0.010s	sys 0.037s
I20260709 13:09:24.365267 28645 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.385353 28536 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.417272 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.392266 28659 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:24.357285 28675 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:09:24.422147 21634 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:24.423213 22240 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:24.391937 28721 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:24.425424 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.356594 28609 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.406948 28724 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:24.435614 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44116.3us
W20260709 13:09:24.418409 28502 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.387s	user 0.010s	sys 0.037s
I20260709 13:09:24.411806 28650 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:24.448794 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:24.456017 28733 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:24.458528 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.460417 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.462129 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.462517 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.465684 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.466363 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.466504 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.466557 21563 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:09:24.467288 21565 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:24.464047 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.462947 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.468689 21565 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:09:24.468881 21568 raft_consensus.cc:1813] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Handling vote request from an unknown peer a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:24.469043 21565 pending_rounds.cc:85] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 10
I20260709 13:09:24.469305 21565 pending_rounds.cc:107] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:09:24.469632 21565 raft_consensus.cc:2889] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:24.469350 21568 raft_consensus.cc:2368] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15.
I20260709 13:09:24.407246 28644 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.471448 21562 raft_consensus.cc:2410] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:09:24.471889 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:24.474381 21634 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:24.475356 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.449285 28695 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:24.545547 28695 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.473644 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:24.478818 28609 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.481268 28721 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:24.502570 28696 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:24.502954 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:24.549328 28696 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:24.521989 28584 raft_consensus.cc:993] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:09:24.532040 28657 raft_consensus.cc:993] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
W20260709 13:09:24.535501 28728 log.cc:927] Time spent T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:09:24.536537 28725 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:09:24.539816 28431 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:24.541890 28701 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.711s	user 0.002s	sys 0.000s
I20260709 13:09:24.452893 28610 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.450860 28724 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:24.549172 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 75575.7us
I20260709 13:09:24.577085 28609 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:24.577602 28609 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:24.549192 28721 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:24.578182 28609 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.578408 28584 raft_consensus.cc:1081] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:09:24.578577 28721 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:24.470274 28723 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:24.564224 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:24.563400 28696 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.580996 28696 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:24.581836 28644 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.577639 28734 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:24.583122 28734 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:24.583751 28697 consensus_meta.cc:287] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.000s
I20260709 13:09:24.424221 28536 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.584218 28697 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.585131 21459 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:24.585873 28536 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.475951 28664 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:09:24.559214 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.587412 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.587913 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.577107 21608 leader_election.cc:400] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15.
I20260709 13:09:24.589408 21608 leader_election.cc:403] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:24.590324 21641 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:24.590690 28697 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.591029 21640 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:24.591300 28697 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:24.591774 21642 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:24.592023 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.592866 21638 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 13: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:24.593513 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.595106 28547 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.447398 28523 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:09:24.596609 21493 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:24.580143 28723 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:24.597667 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.597913 21634 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:24.598937 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.600273 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.613215 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.604449 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.613550 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:24.613977 21488 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:24.592792 28594 raft_consensus.cc:1081] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:09:24.606045 21635 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:24.615954 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:24.592135 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.616950 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.617425 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:24.456880 28733 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.619477 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2381) took 1457 ms. Trace:
I20260709 13:09:24.619925 21486 rpcz_store.cc:276] 0709 13:09:23.162534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.162668 (+   134us) service_pool.cc:224] Handling call
0709 13:09:23.163054 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.175020 (+ 11966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.175053 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.186272 (+ 11219us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.478982 (+292710us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:23.479049 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.479277 (+   228us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.541266 (+1061989us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:24.606642 (+ 65376us) raft_consensus.cc:1685] finished
0709 13:09:24.606665 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.619410 (+ 12745us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11560,"raft.queue_time_us":13643,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":22563,"spinlock_wait_cycles":15299328,"thread_start_us":235393,"threads_started":1,"wal-append.queue_time_us":311691}
I20260709 13:09:24.624528 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:24.636214 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:24.637461 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.637814 21635 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:24.641808 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.637755 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:24.644182 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.644368 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:24.579506 28695 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.651403 21488 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:09:24.651279 21560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:36572
I20260709 13:09:24.659181 21560 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:24.659570 21560 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:24.587369 28734 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.465158 28650 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.666179 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:24.645596 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.615422 28723 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:24.669214 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:24.668324 21636 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:24.683267 21642 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:24.685202 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:24.685781 21634 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:24.686190 21642 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.687709 21635 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:24.689294 28659 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:24.676951 28718 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.690096 28652 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:24.690184 28718 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.690981 28652 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:24.692708 28733 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.692241 28652 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.694584 21635 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:24.651189 28610 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:24.695574 28610 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:24.695730 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.696130 28610 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:24.677218 28523 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:09:24.673085 28501 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:09:24.700213 28523 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:24.700620 28523 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:24.701498 28613 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:24.701401 28523 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.702145 28613 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:24.704175 28272 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:24.704833 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.707319 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.696420 21635 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:24.708345 28659 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:24.709789 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.710079 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.658601 28525 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:24.670403 28667 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:09:24.721136 28650 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.683091 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.670495 28730 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:24.664690 28647 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:24.724177 28647 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.664896 28549 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:24.722599 21640 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:24.689420 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.727746 21635 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:24.740888 21560 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.737397 21640 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:09:24.736402 21489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.055s	sys 0.065s
W20260709 13:09:24.743217 21489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.055s	sys 0.065s
I20260709 13:09:24.743810 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.740001 21643 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:09:24.654688 28547 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:24.614333 28644 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:09:24.767416 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 57402.7us
I20260709 13:09:24.770457 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:24.772986 21563 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:24.813943 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:24.814846 21568 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.816425 21560 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.818833 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.821713 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.827108 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:24.829818 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 59454.3us
I20260709 13:09:24.831116 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:24.743017 28729 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:24.726775 28647 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.756664 28697 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15.
I20260709 13:09:24.832733 28547 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:24.834213 28698 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:24.834720 28547 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:24.838745 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.843123 28570 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.843765 28612 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:24.843686 28570 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.844879 28718 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.845917 28570 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:24.848129 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.678727 28734 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.150s
I20260709 13:09:24.849851 28624 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:24.850219 28624 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:24.852044 28721 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.853837 28699 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:24.854364 28721 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.855000 21641 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:24.854410 28699 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.770817 28659 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:24.857744 28699 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:24.827072 28549 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:09:24.827677 28272 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.860783 28272 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.817198 28675 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:09:24.770119 28525 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:09:24.816636 28507 consensus_queue.cc:1059] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:09:24.807982 28730 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.100s
I20260709 13:09:24.870960 28282 raft_consensus.cc:3055] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:24.874467 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:24.874500 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 43499.1us
W20260709 13:09:24.877144 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 211259us
I20260709 13:09:24.878309 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:24.883490 21642 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:24.806495 28523 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:24.888559 21457 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:24.891916 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.891501 21642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d6d6e481fd941658a227093848691fa"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58372
I20260709 13:09:24.892737 21634 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:24.897854 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.905403 21642 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:24.908872 21642 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:24.910111 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.916534 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:24.917513 21635 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:24.876519 28282 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:24.893379 28612 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:24.934041 21487 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:09:24.935491 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:24.938213 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:24.899029 28716 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:24.942965 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.942998 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:24.929544 21642 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.950624 28640 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:24.951274 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.951896 28640 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:09:24.951938 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.952414 28640 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:24.953277 28640 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.954489 28640 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:24.954900 21389 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.959108 28272 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.950704 22240 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 21: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:24.960842 21642 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:24.939157 28730 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:09:24.892510 28667 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:09:24.975162 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:24.976953 28525 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:24.977509 28525 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.978422 28657 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:24.978873 28657 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:24.979264 28657 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:24.979353 28613 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.979717 28525 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:24.981594 28613 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:24.982573 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.983546 28721 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:24.983803 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.984517 28282 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.984974 28721 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:24.984910 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:24.985693 21491 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:24.985731 28282 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:24.986188 21491 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:24.987041 21491 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:24.987951 21491 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:24.988555 28570 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.989075 28570 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.985788 28721 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:24.992506 21640 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:24.983328 28609 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:25.001502 21491 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
W20260709 13:09:25.020161 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.022634 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 73815.1us
W20260709 13:09:25.018016 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 67746.4us
W20260709 13:09:25.026715 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.026639 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:25.028051 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:25.020597 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:24.910012 28675 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:25.030545 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 103880us
I20260709 13:09:25.036342 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:24.939692 28733 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:25.055265 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:24.931937 28612 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:25.060938 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:25.061762 21642 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 20: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:24.970185 28610 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:24.922591 28654 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.125s
I20260709 13:09:25.049142 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:25.048000 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:25.067239 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:25.069646 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:25.073832 21641 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:25.075781 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:25.071003 21640 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:25.041541 28644 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:25.040063 28640 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:25.051635 28507 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:25.044840 28549 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:25.039443 28742 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.065793 28612 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:24.956847 21389 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:25.094619 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:25.102824 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:24.921756 28624 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:25.066286 28675 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:25.103099 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:25.104763 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:25.039666 28734 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:09:25.077427 28536 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:25.077584 28570 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:25.114456 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:25.127949 21566 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:25.078086 28584 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:25.129726 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:25.130970 21568 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:25.101611 21389 catalog_manager.cc:5697] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 13 to 17, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 17 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.150318 21389 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 14 to 16, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:09:25.152864 28739 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:09:25.153044 28740 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:25.152571 21389 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 22 to 24, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 24 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.161988 21389 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 17 to 22, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 22 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:25.092115 28507 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.177817 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:25.119526 28431 consensus_meta.cc:287] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 13:09:25.205685 21494 raft_consensus.cc:3060] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:25.110394 28644 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:25.212819 21641 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:25.127033 28536 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:25.089902 28657 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:25.108108 28520 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:09:25.188350 21389 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:25.195277 28507 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:25.228441 22243 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:25.188398 28584 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:25.266148 28675 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:25.184458 28654 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:25.271241 21639 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:25.217362 28431 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.294533 21494 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:25.222186 28624 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:25.118214 28742 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:25.302448 21389 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 20 to 23, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 23 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:25.305457 22243 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:25.329952 21639 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:25.255486 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 164786us
I20260709 13:09:25.238067 28738 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:25.297770 28536 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:25.330117 21389 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:25.330931 22243 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:25.341645 21389 catalog_manager.cc:5697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 16 to 17, leader changed from <none> to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 17 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:25.347137 28736 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.278s	user 0.000s	sys 0.000s
I20260709 13:09:25.348392 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2397) took 1139 ms. Trace:
I20260709 13:09:25.348564 22243 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:25.348783 21489 rpcz_store.cc:276] 0709 13:09:24.209255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.209836 (+   581us) service_pool.cc:224] Handling call
0709 13:09:24.210336 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.210876 (+   540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.210917 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.211568 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.743634 (+532066us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:24.743670 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.743730 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.348163 (+604433us) raft_consensus.cc:1685] finished
0709 13:09:25.348183 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.348316 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1167,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5893,"thread_start_us":521851,"threads_started":1,"wal-append.queue_time_us":697136}
I20260709 13:09:25.353096 28584 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:25.333846 28431 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:25.364171 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.367350 28431 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:25.369128 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 220953us
I20260709 13:09:25.345952 21389 catalog_manager.cc:5697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 13 to 24, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 24 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:25.372709 21389 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:25.322741 28654 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:25.383424 28654 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:25.385074 28657 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:25.388299 22243 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:25.374608 21389 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.403301 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:25.398730 21389 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 18 to 19, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:25.385037 28654 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:25.407193 21389 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:25.387043 22212 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:09:25.417874 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.397089 28609 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:25.431717 21389 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:25.421728 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:25.426155 28640 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:25.428712 21568 raft_consensus.cc:1275] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:25.405735 28431 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:25.433887 21389 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 8 to 14, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 14 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:25.459158 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 329508us
I20260709 13:09:25.399442 28436 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:09:25.484615 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:25.484864 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:25.485246 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:25.487457 21389 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 14 to 17, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 17 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.491850 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:25.386351 28644 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:25.420704 28610 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:25.494283 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:25.494544 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:25.494340 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:25.505184 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:25.443939 28738 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:25.443323 28734 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:25.431376 28667 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:09:25.500625 28570 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:09:25.555938 21634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.009s	sys 0.005s
W20260709 13:09:25.556512 21634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.009s	sys 0.005s
I20260709 13:09:25.558712 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:25.490320 21389 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 16 to 18, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 18 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:25.532541 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 101363us
I20260709 13:09:25.533459 21566 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:25.539348 28757 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:09:25.532866 28738 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:25.571501 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 209455us
W20260709 13:09:25.561138 21563 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.001s	sys 0.013s
W20260709 13:09:25.585246 21563 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.002s	sys 0.013s
I20260709 13:09:25.564025 21389 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 10 to 12, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 12 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:25.559041 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:25.544770 28694 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:25.584590 21459 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:25.563324 21488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.010s	sys 0.005s
I20260709 13:09:25.554980 28699 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.563514 28741 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 13:09:25.589956 21488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.010s	sys 0.005s
I20260709 13:09:25.594590 21566 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:25.545634 28503 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:09:25.589349 28729 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.645828 28734 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:25.647531 28734 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:25.647301 28729 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:25.648613 28734 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:25.649502 28767 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.650154 28767 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:25.628572 28696 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.650722 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2403) took 1049 ms. Trace:
I20260709 13:09:25.651492 28696 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:25.652360 28767 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:25.651640 21492 rpcz_store.cc:276] 0709 13:09:24.601532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.601757 (+   225us) service_pool.cc:224] Handling call
0709 13:09:24.602087 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.614931 (+ 12844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.614962 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.615422 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.887395 (+271973us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:24.887434 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.897054 (+  9620us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.650491 (+753437us) raft_consensus.cc:1685] finished
0709 13:09:25.650515 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.650656 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":10053,"thread_start_us":217387,"threads_started":1,"wal-append.queue_time_us":547380}
W20260709 13:09:25.640790 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 81852.1us
W20260709 13:09:25.653334 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 68849.1us
I20260709 13:09:25.655311 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:25.656579 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:25.659626 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:25.661435 21492 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:25.604481 21389 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 19 to 20, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 20 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:25.549669 28760 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:25.661626 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:25.676470 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:25.691942 21642 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:25.692091 21494 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:25.676752 21487 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:25.677636 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:25.678717 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:25.680097 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:25.697184 28609 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:25.645717 28758 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:09:25.640803 28724 consensus_meta.cc:287] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 1.068s	user 0.006s	sys 0.007s
I20260709 13:09:25.705904 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:25.723163 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 220785us
I20260709 13:09:25.685935 28594 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:25.689342 28721 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:25.693478 28742 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:25.572815 28738 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:25.692612 28719 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:25.701243 28733 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:25.642428 28536 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:25.750200 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4380) took 1008 ms. Trace:
I20260709 13:09:25.730872 28507 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:25.716382 28756 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:25.575753 28640 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:25.716221 28696 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:25.715452 28760 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:25.757465 21561 rpcz_store.cc:276] 0709 13:09:24.741356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.741528 (+   172us) service_pool.cc:224] Handling call
0709 13:09:24.811149 (+ 69621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.811495 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.811528 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.830071 (+ 18543us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.156350 (+326279us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:25.156407 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.156506 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.736752 (+580246us) raft_consensus.cc:1685] finished
0709 13:09:25.736782 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.750097 (+ 13315us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":10891,"thread_start_us":252290,"threads_started":1,"wal-append.queue_time_us":345410}
I20260709 13:09:25.653955 28694 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:25.729768 28609 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:25.748334 28581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.017s	sys 0.001s
I20260709 13:09:25.704134 28613 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:09:25.856304 28771 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:09:25.723405 28667 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 13:09:25.759829 28733 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:09:25.756628 28716 consensus_meta.cc:287] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.002s
I20260709 13:09:25.706254 28699 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:25.751924 28761 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:25.727475 28724 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:25.864004 28716 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:25.857563 28581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.017s	sys 0.002s
I20260709 13:09:25.757331 28742 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.111s
W20260709 13:09:25.897771 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 253259us
W20260709 13:09:25.879953 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 204183us
I20260709 13:09:25.851146 28760 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:25.875233 28761 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.940584 21560 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:25.941152 21562 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:25.950204 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 224445us
I20260709 13:09:25.862043 28609 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:26.027354 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 95031.3us
W20260709 13:09:26.035795 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 300579us
I20260709 13:09:26.040525 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:26.041770 21486 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:09:25.960479 28761 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:26.046626 21459 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:26.047187 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:26.050926 21569 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:26.056910 21639 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:26.058406 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:26.056782 28719 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.059489 28769 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:09:26.059741 28699 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.059569 28719 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.062044 28719 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:26.063011 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2424) took 1033 ms. Trace:
W20260709 13:09:26.063701 28780 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:09:26.064814 28724 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.066457 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2426) took 1027 ms. Trace:
I20260709 13:09:26.070010 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:26.070884 21569 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:26.066898 21640 rpcz_store.cc:276] 0709 13:09:25.038684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.203854 (+165170us) service_pool.cc:224] Handling call
0709 13:09:25.204227 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.204558 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.204589 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.205188 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.677190 (+472002us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:25.677229 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.677291 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.066230 (+388939us) raft_consensus.cc:1685] finished
0709 13:09:26.066253 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.066396 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":946,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5370,"thread_start_us":460640,"threads_started":1,"wal-append.queue_time_us":627303}
I20260709 13:09:26.063475 21635 rpcz_store.cc:276] 0709 13:09:25.029348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.205675 (+176327us) service_pool.cc:224] Handling call
0709 13:09:25.228050 (+ 22375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.228479 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.228520 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.297044 (+ 68524us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.583641 (+286597us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:25.583683 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.583753 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.062744 (+478991us) raft_consensus.cc:1685] finished
0709 13:09:26.062766 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.062937 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9431,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":30154,"thread_start_us":238879,"threads_started":1,"wal-append.queue_time_us":406195}
I20260709 13:09:26.075045 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:26.079216 28696 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:26.079286 28779 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:26.079911 28696 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.072327 28654 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:09:26.080328 28696 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:26.082222 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:26.087512 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:26.090040 21487 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:26.091593 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.049196 28652 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.092773 28788 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.099301 28788 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:26.100795 28747 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.882s	user 0.000s	sys 0.009s
I20260709 13:09:25.943797 28781 consensus_queue.cc:1048] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.138s
I20260709 13:09:26.102840 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1228) took 1265 ms. Trace:
I20260709 13:09:26.104079 21493 rpcz_store.cc:276] 0709 13:09:24.837204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.838696 (+  1492us) service_pool.cc:224] Handling call
0709 13:09:24.839042 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.868155 (+ 29113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.868188 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.868705 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.924715 (+ 56010us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:24.924754 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.924819 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.100210 (+1175391us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:26.102511 (+  2301us) raft_consensus.cc:1685] finished
0709 13:09:26.102534 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.102758 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28722,"raft.queue_time_us":29945,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":7069440,"thread_start_us":55688,"threads_started":1,"wal-append.queue_time_us":242601}
W20260709 13:09:26.100795 28772 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:09:26.109498 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 3028) took 1178 ms. Trace:
I20260709 13:09:26.111635 28609 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:26.112917 28761 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.097719 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.109889 21488 rpcz_store.cc:276] 0709 13:09:24.931516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.936471 (+  4955us) service_pool.cc:224] Handling call
0709 13:09:24.936858 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.937136 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.937173 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.937736 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.650364 (+712628us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:25.650415 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.650489 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.109265 (+458776us) raft_consensus.cc:1685] finished
0709 13:09:26.109288 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.109437 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":654039,"threads_started":1,"wal-append.queue_time_us":871539}
I20260709 13:09:26.096782 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:26.118408 21486 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:26.094228 28695 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:26.124821 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.125084 21642 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:26.051190 28594 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:09:26.086113 28657 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:26.141119 21635 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:26.116904 28536 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.129761 28695 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:26.172628 28695 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.173991 28695 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:26.129318 28525 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:26.178277 28525 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.180820 28525 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:26.185577 28723 consensus_meta.cc:287] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 1.438s	user 0.011s	sys 0.000s
I20260709 13:09:26.143039 28431 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.187098 28431 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.186058 28723 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.150147 28789 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:26.192562 28789 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.193041 28431 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.195255 28761 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.196128 28667 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:26.196488 28667 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:26.197247 28667 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:26.198098 28765 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.663s	user 0.003s	sys 0.000s
I20260709 13:09:26.206411 21486 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:26.216871 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 3034) took 1197 ms. Trace:
I20260709 13:09:26.217240 21491 rpcz_store.cc:276] 0709 13:09:25.019552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.040365 (+ 20813us) service_pool.cc:224] Handling call
0709 13:09:25.040823 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.059671 (+ 18848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.059705 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.081006 (+ 21301us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.416876 (+335870us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:25.416913 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.416975 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.197473 (+780498us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:26.213683 (+ 16210us) raft_consensus.cc:1685] finished
0709 13:09:26.213704 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.216794 (+  3090us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4503,"raft.queue_time_us":4650,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12048,"spinlock_wait_cycles":16813952,"thread_start_us":230917,"threads_started":1,"wal-append.queue_time_us":420348}
W20260709 13:09:26.191640 28282 consensus_meta.cc:287] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.203s	user 0.007s	sys 0.008s
I20260709 13:09:26.199651 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1564) took 1099 ms. Trace:
W20260709 13:09:26.225461 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.190753 28657 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:26.200098 28507 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.134446 28652 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:26.212823 28612 consensus_meta.cc:287] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.086s	user 0.007s	sys 0.007s
I20260709 13:09:26.220093 21637 rpcz_store.cc:276] 0709 13:09:25.100698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.295436 (+194738us) service_pool.cc:224] Handling call
0709 13:09:25.295856 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:25.296263 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:25.315090 (+ 18827us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.703735 (+388645us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b1800445c00. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b8223a 00007f98a9feca2a
0709 13:09:26.035060 (+331325us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:26.044192 (+  9132us) log.cc:844] Serialized 52 byte log entry
0709 13:09:26.044340 (+   148us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:26.044574 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.044758 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.044831 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.199336 (+154505us) raft_consensus.cc:1685] finished
0709 13:09:26.199373 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.199566 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12267,"prepare.queue_time_us":23208,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":7362,"raft.queue_time_us":3997,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":18580,"spinlock_wait_cycles":12834048,"thread_start_us":331054,"threads_started":1,"wal-append.queue_time_us":798573}
I20260709 13:09:26.216578 28694 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.233412 21567 raft_consensus.cc:1240] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:09:26.218153 28789 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.240933 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:26.244127 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:26.233948 28657 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.237967 28612 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.235615 28799 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:26.289202 21492 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
W20260709 13:09:26.303855 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 57122.6us
I20260709 13:09:26.309971 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:26.312222 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:26.319136 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:26.319245 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:26.320576 22240 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 21: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:26.324648 21640 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 24: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:26.325296 21637 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:26.330515 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:26.335389 21494 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:26.335424 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.288854 28789 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:26.290441 28594 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:26.328320 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:26.328846 28614 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:09:26.376137 28806 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:26.372470 28435 consensus_queue.cc:1059] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:09:26.378834 28723 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.384495 28696 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.346702 28789 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.345825 28594 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.374861 28614 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.314568 28799 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.390050 28786 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:09:26.395678 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:26.400058 28738 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.001s
I20260709 13:09:26.418689 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:26.397089 28696 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:26.425215 28746 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.206s	user 0.001s	sys 0.005s
I20260709 13:09:26.426623 28738 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:26.416450 28733 consensus_meta.cc:287] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
I20260709 13:09:26.411541 28523 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:26.415920 28652 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.422245 28723 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.431259 28657 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.442011 28612 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.440598 28282 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:26.446194 28798 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:09:26.446825 28282 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:26.452500 28594 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.454407 28738 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:26.436370 28523 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:09:26.455662 28760 consensus_meta.cc:287] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
I20260709 13:09:26.459872 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1221) took 1846 ms. Trace:
I20260709 13:09:26.461212 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:26.466274 22242 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:26.449607 28282 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.463500 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:26.465785 21490 rpcz_store.cc:276] 0709 13:09:24.613683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.614414 (+   731us) service_pool.cc:224] Handling call
0709 13:09:24.614931 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.639156 (+ 24225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.639202 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.639830 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.861585 (+221755us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b1800336a60. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:09:24.924362 (+ 62777us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:24.924408 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.924479 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.424643 (+1500164us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:26.459637 (+ 34994us) raft_consensus.cc:1685] finished
0709 13:09:26.459662 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.459807 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1368,"raft.queue_time_us":24314,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":13481,"spinlock_wait_cycles":36817536,"thread_start_us":62591,"threads_started":1,"wal-append.queue_time_us":486543}
I20260709 13:09:26.468547 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:26.473423 28799 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.438109 28733 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.463658 28523 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.475066 28523 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:26.475659 28733 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.476991 28760 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.479080 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:26.479302 28760 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.469169 28767 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.480265 28767 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.468902 28734 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.485855 28734 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.488247 28734 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.456365 28723 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.443204 28570 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.491681 22242 raft_consensus.cc:2368] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
W20260709 13:09:26.492774 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 144406us
I20260709 13:09:26.494068 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:26.494691 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:26.498647 28730 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:26.493599 28761 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.503343 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:26.503476 28761 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.505664 28761 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.493321 28431 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.508276 28431 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.509569 28788 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.510363 28431 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.510988 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 3048) took 2045 ms. Trace:
I20260709 13:09:26.511344 21567 rpcz_store.cc:276] 0709 13:09:24.465129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.465251 (+   122us) service_pool.cc:224] Handling call
0709 13:09:24.465555 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:26.239579 (+1774024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.510664 (+271085us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54001f9ad4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:26.510894 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4065095552}
I20260709 13:09:26.512663 28723 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:26.514107 28814 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 13:09:26.494280 28570 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.518291 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.518828 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.519538 21491 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:26.520645 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 3060) took 1035 ms. Trace:
I20260709 13:09:26.522071 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:26.521061 21564 rpcz_store.cc:276] 0709 13:09:25.485404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.529021 (+ 43617us) service_pool.cc:224] Handling call
0709 13:09:25.529465 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.551573 (+ 22108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.551629 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.552202 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:09:26.426143 (+873941us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b18003bbae0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:09:26.457167 (+ 31024us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:26.457230 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.457331 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.520340 (+ 63009us) raft_consensus.cc:1685] finished
0709 13:09:26.520362 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.520584 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21582,"raft.queue_time_us":21743,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":5351,"spinlock_wait_cycles":11066752,"thread_start_us":30766,"threads_started":1,"wal-append.queue_time_us":966598}
I20260709 13:09:26.482625 28767 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.528246 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:26.518360 28570 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.530054 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:26.530525 21491 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:09:26.532863 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.532977 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.533780 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:26.534545 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.535585 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:26.538477 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:26.543448 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.543771 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.547351 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:26.553332 22243 raft_consensus.cc:1813] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:09:26.553932 22243 raft_consensus.cc:2368] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:26.547612 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:26.557794 21489 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:26.558095 21491 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:09:26.548344 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.560889 21486 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:09:26.560370 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:26.564592 21492 raft_consensus.cc:1813] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:09:26.565686 21492 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:26.560139 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.560039 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:26.568622 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:26.544191 28523 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.534700 28760 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:26.546155 28431 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.546416 28767 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.561610 28723 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.572739 28791 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:26.574757 28523 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.681572 28767 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.674028 28431 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.692942 28724 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:26.693873 28525 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:26.569832 28734 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:26.568270 28699 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:26.694554 21489 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
W20260709 13:09:26.742534 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.747938 28741 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:09:26.767266 28734 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:26.768558 28734 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.757227 28525 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:26.771793 28525 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.772751 28523 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.758695 28724 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:26.763893 28699 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.774534 28724 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.776126 28724 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:26.777388 28699 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.634310 28760 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:26.782464 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 210542us
I20260709 13:09:26.750224 28723 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.792515 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:26.796416 21564 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:26.796751 21489 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:09:26.793270 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:26.797808 21567 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:26.798921 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.799562 21489 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:26.803702 22243 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:26.807708 28767 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.810257 28760 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.812391 28723 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:26.812963 28819 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.820417 28819 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:26.814018 28820 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.117s	user 0.004s	sys 0.000s
I20260709 13:09:26.807879 21567 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:09:26.831661 28819 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.851833 28761 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.852576 28761 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.854951 28761 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.861433 28723 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.862514 28723 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.865129 28723 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.866942 28723 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:26.867561 28723 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.869742 28723 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.871652 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.871892 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:26.875461 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.872423 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.873816 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.874526 21491 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:26.878676 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.879330 21486 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:26.879765 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 1828) took 1994 ms. Trace:
I20260709 13:09:26.879926 28823 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:26.880486 28823 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.880177 21563 rpcz_store.cc:276] 0709 13:09:24.885642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.887435 (+  1793us) service_pool.cc:224] Handling call
0709 13:09:24.887798 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.887998 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:09:25.585970 (+697972us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.879253 (+1293283us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b180005c3e0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b8223a
0709 13:09:26.879426 (+   173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.879473 (+    47us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:26.879515 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.879595 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.879711 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":819738,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":255,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":32171392,"thread_start_us":929243,"threads_started":2,"wal-append.queue_time_us":471865}
I20260709 13:09:26.885651 21491 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:26.894618 28610 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.894935 28719 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.895207 28610 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.895416 28719 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.897315 28719 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:26.899575 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 371407us
I20260709 13:09:26.901235 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:26.901968 21563 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:09:26.903208 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:26.904071 21567 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:26.911082 28696 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:26.911747 28696 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.912176 28696 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:26.878149 28675 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:26.893520 28723 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.897332 28610 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:26.919320 28549 consensus_queue.cc:1059] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:09:26.974180 28549 consensus_queue.cc:1243] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:26.934088 28675 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.976464 28675 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.974678 28549 raft_consensus.cc:3055] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:26.977111 28789 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:26.977285 28549 raft_consensus.cc:740] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:26.978143 28549 consensus_queue.cc:260] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:26.979369 28549 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:26.948231 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4390) took 1913 ms. Trace:
W20260709 13:09:26.950435 28773 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 1.115s	user 0.002s	sys 0.009s
W20260709 13:09:26.952930 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.959393 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:26.968531 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:26.984556 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:26.985464 22243 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:26.985571 21490 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:09:26.968724 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.971184 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.986747 21486 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:26.987915 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:26.983062 21562 rpcz_store.cc:276] 0709 13:09:25.034547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.034774 (+   227us) service_pool.cc:224] Handling call
0709 13:09:25.035321 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.026622 (+991301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.947926 (+921304us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54000a0854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:26.948161 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082565376}
I20260709 13:09:26.972131 21485 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:26.973307 28723 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:26.992404 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:27.000371 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.998549 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 97336.6us
I20260709 13:09:26.966320 28696 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.008951 21491 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:09:27.007818 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:27.018751 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:27.021832 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:27.024340 21532 leader_election.cc:400] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:27.024642 21532 leader_election.cc:403] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:27.025558 21485 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:26.994051 28634 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:27.030102 21490 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:27.006492 28781 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:27.037715 21457 leader_election.cc:400] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:09:27.038194 21457 leader_election.cc:403] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:27.033970 28634 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.043241 28634 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:27.043743 28781 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:27.044379 28781 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:27.051616 28696 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:27.036077 28456 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.018s
I20260709 13:09:27.056903 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:27.058842 21567 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:27.052557 28456 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:27.063417 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:27.063793 28456 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:27.061653 28789 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:09:27.064755 28456 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.065212 28786 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:27.065831 28786 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:27.065946 28456 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:27.066852 28786 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.068921 28549 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:09:27.069434 28549 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:27.069985 21567 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:27.058245 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:27.030995 28734 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:27.027964 28724 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:27.052480 28696 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:27.070322 28549 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.036413 28682 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:09:27.121457 28791 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:27.118970 28431 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.126411 28431 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:27.072942 28789 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:27.033799 28767 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.088s
I20260709 13:09:27.132164 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3812) took 2228 ms. Trace:
I20260709 13:09:27.117666 28654 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:27.126245 28791 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.115217 28729 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.118206 28640 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:27.126291 28682 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:27.132705 21634 rpcz_store.cc:276] 0709 13:09:24.899861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.901512 (+  1651us) service_pool.cc:224] Handling call
0709 13:09:24.901907 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.907882 (+  5975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.907924 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.911014 (+  3090us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.557041 (+646027us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:25.557102 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.557367 (+   265us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.949823 (+1392456us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:27.124972 (+175149us) raft_consensus.cc:1685] finished
0709 13:09:27.125003 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.128338 (+  3335us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19431,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":17790,"spinlock_wait_cycles":20244864,"thread_start_us":539083,"threads_started":1,"wal-append.queue_time_us":777458}
I20260709 13:09:27.121862 28696 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:27.073483 28272 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 13:09:27.155824 28272 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:09:27.128618 28789 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:27.156243 28272 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:27.160722 21459 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.981s (SENT) [suppressed 10 similar messages]
I20260709 13:09:27.162593 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 1839) took 1720 ms. Trace:
I20260709 13:09:27.163007 21568 rpcz_store.cc:276] 0709 13:09:25.441799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.441986 (+   187us) service_pool.cc:224] Handling call
0709 13:09:25.442412 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.442661 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:25.732920 (+290259us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.161905 (+1428985us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b1800347320. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b8223a
0709 13:09:27.162169 (+   264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.162236 (+    67us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:27.162299 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.162400 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.162540 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":399134,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"spinlock_wait_cycles":53469568,"thread_start_us":381202,"threads_started":2,"wal-append.queue_time_us":181449,"wal-append.run_cpu_time_us":1405,"wal-append.run_wall_time_us":1151870}
I20260709 13:09:27.154664 28682 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:27.156852 28696 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:27.129148 28431 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.159709 28789 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:27.164901 28756 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:27.166476 28272 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.174005 28756 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.174644 28272 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:27.156594 28640 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.139607 28654 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.190763 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:27.194250 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:27.184662 28640 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.186631 28667 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:27.173010 28823 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.191406 28675 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.200474 28767 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:27.182757 28781 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.242981 28830 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:27.243603 28830 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.244937 28781 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.246244 28431 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.249768 28734 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:27.203171 28624 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:27.240674 28767 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:27.261513 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 242817us
I20260709 13:09:27.185232 28682 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.251386 28675 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.259724 28767 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:09:27.262461 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 187161us
I20260709 13:09:27.255872 28624 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:27.255913 28634 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.268205 28755 raft_consensus.cc:3055] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:27.299309 28654 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.298950 28624 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.275928 28831 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:27.303687 28830 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:27.304229 28791 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.308596 28831 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.321111 28831 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:27.317266 28789 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.328267 28789 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.199795 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:27.376590 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 176703us
I20260709 13:09:27.379619 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:27.389336 21568 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:27.391685 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:27.397382 28847 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:27.397939 28847 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:27.398387 28847 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:27.403597 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 510428us
W20260709 13:09:27.403971 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.405105 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 341597us
I20260709 13:09:27.262530 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:27.408078 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 145496us
I20260709 13:09:27.409364 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:27.295193 28682 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:27.306097 28755 raft_consensus.cc:740] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:27.456370 28640 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:27.463311 28819 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.466805 28431 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:09:27.463109 28770 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:27.468653 28770 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.477270 28830 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.478272 28830 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.481328 28830 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:27.483563 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:27.484688 21562 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:27.484905 28734 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.486076 28734 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.464680 28819 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.489111 28734 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:27.490414 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 79618.2us
I20260709 13:09:27.493683 28819 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.494552 28634 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.494933 28770 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.490688 28436 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:27.496227 28436 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.497464 28831 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:27.497933 28831 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.498291 28831 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:27.503284 28436 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.508191 28834 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:27.508800 28834 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.509231 28834 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:27.517679 28675 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.528589 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.530920 21562 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:27.531515 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:27.537672 21561 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:09:27.484838 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 78032.1us
I20260709 13:09:27.535522 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.536288 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.546368 28644 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.547395 28644 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.555174 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1236) took 1454 ms. Trace:
I20260709 13:09:27.555692 21494 rpcz_store.cc:276] 0709 13:09:26.096290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.096431 (+   141us) service_pool.cc:224] Handling call
0709 13:09:26.096808 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.335981 (+239173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.550297 (+1214316us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540002e4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:27.550625 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":548293632}
I20260709 13:09:27.530618 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:27.570972 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.534480 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:27.572708 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.573734 28549 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:27.580444 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.582428 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.592563 21561 raft_consensus.cc:2368] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:09:27.593673 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.594044 21563 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 13.
I20260709 13:09:27.599159 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.599143 21561 raft_consensus.cc:2368] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24.
I20260709 13:09:27.601773 28854 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:27.550693 28644 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.615450 28823 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:27.618501 21567 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:27.616845 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.637864 28756 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:27.639578 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.645319 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:27.646397 21494 raft_consensus.cc:2393] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 19: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:09:27.648598 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 450778us
I20260709 13:09:27.649611 28719 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:27.651656 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:27.574272 28830 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:27.667737 22240 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 20: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:27.668885 21564 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:27.671269 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:27.671526 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:27.672001 28719 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.674101 22246 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:09:27.674661 21568 raft_consensus.cc:2368] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25.
W20260709 13:09:27.684208 21565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 4394) took 2581 ms (client timeout 1981 ms). Trace:
I20260709 13:09:27.684826 28719 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.685510 22243 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:27.616134 28823 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.688714 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.689946 21563 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:27.686228 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:27.684723 21565 rpcz_store.cc:269] 0709 13:09:25.102337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.102513 (+   176us) service_pool.cc:224] Handling call
0709 13:09:27.683819 (+2581306us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000a0d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:27.683993 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2395935104}
I20260709 13:09:27.620257 28644 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:27.702492 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.713362 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:27.714910 28614 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.715672 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:27.689987 28850 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 13:09:27.736150 28767 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.737612 21566 raft_consensus.cc:2368] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25.
I20260709 13:09:27.736905 28755 consensus_queue.cc:260] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.701059 28719 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:27.739248 21569 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:27.738677 28755 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:27.742988 28456 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:27.744364 28456 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:27.744745 28456 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:27.749037 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 1837) took 2317 ms. Trace:
I20260709 13:09:27.749586 21560 rpcz_store.cc:276] 0709 13:09:25.429749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.430512 (+   763us) service_pool.cc:224] Handling call
0709 13:09:25.430750 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.022952 (+592202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.746802 (+1723850us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54000a2b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:27.747220 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172062080}
I20260709 13:09:27.739127 28830 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.754918 28610 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.755716 28610 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.759346 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:27.768903 28525 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:27.775333 28723 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.777190 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:27.778771 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:27.779958 28788 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:27.780449 28788 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:27.780908 28788 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:27.781757 28614 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:27.782987 28644 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:27.787734 28846 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.272s	user 0.003s	sys 0.003s
I20260709 13:09:27.788195 28644 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:27.745911 28456 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.790088 28456 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:27.793219 28642 consensus_queue.cc:1175] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a87bd86b86e74aa8bb61189215b73439" responder_term: 14 status { last_received { term: 14 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 14 index: 13 } }
I20260709 13:09:27.795306 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:27.796921 28694 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:27.796898 28719 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.801059 28719 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.804890 28823 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.817754 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:27.818606 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:27.819201 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.738765 28767 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.819509 21492 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:09:27.819592 28789 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:27.824307 28834 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:27.827612 28696 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.005s
I20260709 13:09:27.828614 28609 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:27.831601 28830 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.834017 28788 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:27.840210 21561 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:27.843559 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:27.758610 28610 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:27.679004 28549 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.888588 28830 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:27.851245 28667 consensus_meta.cc:287] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.609s	user 0.013s	sys 0.004s
I20260709 13:09:27.858961 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:27.860124 22247 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:09:27.864143 28847 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:27.865566 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 321068us
I20260709 13:09:27.875164 28789 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.895547 22247 pending_rounds.cc:85] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 13
I20260709 13:09:27.899037 22247 pending_rounds.cc:107] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:09:27.899152 28549 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:27.900262 28789 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.900791 28834 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:27.876238 28609 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.901935 28788 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:27.888072 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:27.888358 28610 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.889261 28830 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.889408 28696 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.870427 28644 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.899361 22247 raft_consensus.cc:2889] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:27.911753 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.877238 28719 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:27.923003 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.918169 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:27.928686 28549 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.933317 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:27.934311 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:27.905786 28609 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:27.936525 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 93141.4us
I20260709 13:09:27.939450 21492 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:09:27.940348 28549 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.932554 28610 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:27.949251 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.951283 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.950450 21560 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:27.946955 28847 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:27.964920 28696 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:27.966511 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:27.967087 28549 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:27.967458 21493 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:27.944885 28831 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:27.947403 28644 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.005045 28843 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.005822 28843 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.007151 28851 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:27.948920 28719 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.011861 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:28.018946 28366 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:28.020375 28831 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.021096 28831 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:28.022430 28852 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:28.023343 28852 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.025583 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:28.029198 21492 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 25.
I20260709 13:09:28.030192 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:28.020774 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:28.031997 22247 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:28.020773 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:28.058333 21493 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:09:28.060745 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.068658 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.069993 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.070815 21492 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:28.054920 28696 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:28.045743 28549 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:28.044219 28851 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:28.051448 28834 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:28.066176 28609 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:28.067210 28831 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:28.073549 28852 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:28.095752 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.099924 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.098279 21569 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:09:28.102221 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.107414 28549 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.109707 28549 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:28.110365 28851 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.110913 28624 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:09:28.114864 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1245) took 1096 ms. Trace:
I20260709 13:09:28.115243 21489 rpcz_store.cc:276] 0709 13:09:26.968903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.972433 (+  3530us) service_pool.cc:224] Handling call
0709 13:09:26.972725 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.972930 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:27.613078 (+640148us) log.cc:844] Serialized 14 byte log entry
0709 13:09:28.030993 (+417915us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:28.036510 (+  5517us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:28.036584 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.048703 (+ 12119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.064956 (+ 16253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33038,"prepare.queue_time_us":76901,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":34910,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":738903,"threads_started":2,"wal-append.queue_time_us":393745}
W20260709 13:09:28.114562 28856 log.cc:927] Time spent T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:09:28.087698 28830 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.084365 28834 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.129115 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:28.127503 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 106967us
I20260709 13:09:28.104979 28610 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:28.092393 28696 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.129788 21561 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:09:28.131538 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:09:28.105226 28852 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:28.126214 28830 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.140012 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.142997 21566 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:09:28.124851 28549 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.135659 28831 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.144201 22247 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:28.143527 28719 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.145721 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:28.222539 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 77772.7us
I20260709 13:09:28.236572 21569 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:28.236439 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.237293 21492 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 25: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:28.246676 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:28.248247 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.251235 21486 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:28.202913 28830 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.260954 28729 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:28.261682 28729 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:28.262219 28729 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:28.267411 21493 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:28.268031 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.268570 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:28.269343 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.269992 21489 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:28.269896 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:28.270524 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:28.271397 21565 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 25: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:28.272258 28624 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.272888 28847 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:28.272802 28624 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.280483 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:28.287701 28859 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.140s	user 0.000s	sys 0.010s
I20260709 13:09:28.287860 28624 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:28.281484 21566 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:28.222388 28852 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.297282 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.298744 21489 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:28.307566 28852 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:28.299580 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:28.319998 21569 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:28.317305 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:28.244969 28549 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:28.301277 28755 consensus_meta.cc:287] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.008s
I20260709 13:09:28.329134 28624 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:28.337551 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47692.4us
I20260709 13:09:28.338922 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:28.340544 28847 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:28.340763 28640 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:28.341141 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:28.342067 28847 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:09:28.342716 28847 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 25 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:28.344014 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:28.343895 28847 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.344898 28852 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:28.344934 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.345440 28852 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.345799 28852 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:28.351837 28830 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.356536 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:28.360489 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.331934 28843 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:28.363183 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:28.366698 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:28.368710 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:28.358398 28788 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:09:28.367846 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.380297 21493 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:28.373541 28860 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.092s	user 0.003s	sys 0.003s
I20260709 13:09:28.388970 28610 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.389565 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.389909 28614 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.389727 28610 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.390520 28614 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.391398 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:28.392482 28719 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:28.392679 28610 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:28.393141 28614 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:28.394047 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:28.393888 28861 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:28.394706 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.395265 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:28.395501 21491 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:28.397557 22244 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:28.399538 28862 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.182s	user 0.001s	sys 0.001s
I20260709 13:09:28.401021 28730 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:28.401705 28730 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:28.402828 28730 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.389618 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.393164 28719 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.409571 21488 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:28.411397 28719 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:28.409178 21490 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:28.418818 28854 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:28.419606 28854 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.420579 28861 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:28.419917 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:28.421216 28861 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.421680 28644 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.422329 28854 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:28.422595 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.423120 28624 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.423346 21637 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:28.423522 28861 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.423657 28624 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.425314 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:28.425880 21637 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:28.426028 28624 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:28.430940 21489 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:09:28.432113 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:28.433108 28857 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.333s	user 0.001s	sys 0.001s
I20260709 13:09:28.433383 21634 raft_consensus.cc:2410] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:09:28.371356 28834 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.371706 28696 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:28.435022 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.435792 21634 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:09:28.439821 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.440677 21634 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
W20260709 13:09:28.441247 28865 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:09:28.442016 21459 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:28.442837 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.443073 28778 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:28.444463 21634 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:09:28.445863 28456 consensus_meta.cc:287] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.003s
I20260709 13:09:28.449841 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:28.450157 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:28.451910 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.452733 21642 raft_consensus.cc:1813] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:09:28.452894 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.453348 21642 raft_consensus.cc:2368] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:28.453809 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.454721 21487 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:09:28.455504 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.456287 21485 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:28.456137 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.456758 21491 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 13.
I20260709 13:09:28.456915 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.458140 21642 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 25: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:28.458323 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:28.422330 28644 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:28.459314 28644 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.461462 28644 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:28.462237 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.463189 21642 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:28.463513 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.464339 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:28.465864 21388 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:28.467792 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.469218 28831 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.469990 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.469235 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.470158 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.468815 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.475210 21642 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:28.476404 21637 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:28.469928 28831 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:28.483141 21569 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 26.
I20260709 13:09:28.480413 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:28.485936 21485 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:09:28.478871 21492 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:28.489454 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.489187 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.387408 28830 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:28.739917 28830 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.740320 28830 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:28.511382 28864 log.cc:927] Time spent T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:09:28.503882 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.677312 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.913865 21641 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:28.915171 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.679498 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.916064 21636 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:28.490970 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.683267 21634 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:28.913895 21637 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:28.917909 21564 raft_consensus.cc:2410] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 18 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:09:28.482004 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.489187 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:28.719017 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:28.737025 21607 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:58372 dropped due to backpressure: service queue is full with 50 items [suppressed 2 similar messages]
I20260709 13:09:28.923303 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.924635 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.925173 21488 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 25.
I20260709 13:09:28.922554 21607 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:58372 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3833)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3843)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1598)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1602)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2458)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1588)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1590)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1591)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1593)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1594)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1600)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1604)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1608)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3837)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3838)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3842)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3844)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3846)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3848)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3849)
I20260709 13:09:28.926371 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.747632 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.578246 28549 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.554386 28729 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.584897 28852 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.934108 28729 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:28.934950 28852 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.935362 28609 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:28.560781 28781 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.936971 28781 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:28.938119 28610 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:09:28.484236 28831 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:28.939322 28610 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:28.939635 28831 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:28.941128 28610 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:09:28.941547 28610 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:28.528748 28834 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.023808 28834 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.024976 21635 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:09:29.028075 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.029439 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.749485 28830 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.771373 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.034744 28624 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.035281 21640 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:29.035420 28624 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.036307 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.036896 21640 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:29.037783 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.038743 28624 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:29.039099 21641 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:29.040035 28624 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.040526 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.040526 28624 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.041306 21641 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:09:28.832154 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 374137us
I20260709 13:09:28.835445 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:28.840227 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.043430 21459 leader_election.cc:400] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:09:28.864840 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:29.044045 21560 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:28.865386 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.044554 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:29.045081 21642 raft_consensus.cc:2368] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:29.045405 28788 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:28.869499 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.045930 28788 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.046298 21638 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:29.046437 28788 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:28.877014 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:28.890728 21389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 246) took 10927 ms. Trace:
I20260709 13:09:29.047432 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.896740 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:29.045950 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.048123 21635 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
W20260709 13:09:29.048846 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 152171us
I20260709 13:09:29.049187 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.047431 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.049284 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.892853 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.900309 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:29.051570 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.892853 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:28.904258 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.052145 21640 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:29.052663 21492 raft_consensus.cc:2393] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 27: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:29.052762 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 160005us
I20260709 13:09:28.904793 21388 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 18 to 19, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.053102 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.053797 21640 raft_consensus.cc:2368] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:29.054134 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.054562 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.054060 21388 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 18 to 21, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 21 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.055672 28830 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:29.056988 21388 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: config changed from index 11 to 12, VOTER a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) evicted. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.907526 28755 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.910354 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2437) took 1107 ms. Trace:
I20260709 13:09:28.912482 21489 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:29.047708 21639 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:28.917047 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.051229 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.060235 21636 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 25: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:29.060561 21642 raft_consensus.cc:2368] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 25. Current term is 26.
I20260709 13:09:28.680620 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:28.918612 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:28.918490 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.061911 21637 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:28.927721 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:28.931586 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.059008 21494 rpcz_store.cc:276] 0709 13:09:27.803266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.803558 (+   292us) service_pool.cc:224] Handling call
0709 13:09:27.804036 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.804647 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:27.804681 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:27.805317 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:09:28.065063 (+259746us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:28.065105 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.065177 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:28.910055 (+844878us) raft_consensus.cc:1685] finished
0709 13:09:28.910088 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.910278 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2387,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":259229,"threads_started":1,"wal-append.queue_time_us":294349}
I20260709 13:09:28.936014 28609 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.066998 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.067790 21643 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:09:29.067536 28788 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:28.943691 28781 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:28.950742 28610 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.068775 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.069360 21643 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:29.069504 28610 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:28.935643 28852 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:29.070434 21488 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:28.966549 21607 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:58372 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3833)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3843)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1598)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3858)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3853)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1602)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2458)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1588)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1590)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1591)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1593)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1594)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1600)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1604)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1608)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3837)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3838)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3842)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3844)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3846)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3848)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3849)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3852)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3855)
I20260709 13:09:28.979918 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:28.982242 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 76025.6us
W20260709 13:09:28.997450 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 308317us
I20260709 13:09:29.008348 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.045599 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:29.073215 28851 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:29.073438 28624 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:29.048929 28614 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:09:28.901850 28789 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:29.076485 21388 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 14 to 16, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.078692 28852 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.079440 28863 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:29.067185 28609 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:28.952842 28549 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:28.956279 28831 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.079195 28789 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.059085 28755 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.078990 28854 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:29.081516 28549 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:29.081288 21635 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:29.079958 21388 catalog_manager.cc:5697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 13 to 15, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 15 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.082194 21491 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 25: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:29.082446 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.095541 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.082103 21638 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:29.105132 21643 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:29.107281 21639 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:29.113430 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.070006 28788 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:29.123288 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.124523 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.123579 21488 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:09:29.070890 28834 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:29.122396 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.164515 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.176383 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.169535 28614 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 25 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:29.082074 28781 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.163873 22244 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 27.
I20260709 13:09:29.172356 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.172510 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.173357 21388 catalog_manager.cc:5697] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.126827 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.115363 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:29.084102 28831 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:29.125341 28830 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:29.176414 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.178709 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:29.223106 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 107868us
I20260709 13:09:29.223397 21643 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:29.176798 22240 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
W20260709 13:09:29.216715 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 151563us
I20260709 13:09:29.218688 21485 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 26.
W20260709 13:09:29.177229 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 94594us
I20260709 13:09:29.221843 28882 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:29.225929 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.179572 28729 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.226886 28729 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.228940 28729 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:29.229787 28851 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:29.221979 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.177052 21639 raft_consensus.cc:2376] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15. Re-sending same reply.
I20260709 13:09:29.230749 28834 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:29.230878 28885 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.231200 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.231833 21636 raft_consensus.cc:2376] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20. Re-sending same reply.
I20260709 13:09:29.047691 21389 rpcz_store.cc:276] 0709 13:09:17.963148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.963475 (+   327us) service_pool.cc:224] Handling call
0709 13:09:28.890496 (+10927021us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:26.049345 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:26.101385 (+ 52040us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:26.101425 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:09:26.101449 (+    24us) tablet.cc:662] Decoding operations
0709 13:09:26.103191 (+  1742us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:26.103273 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:26.103315 (+    42us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:09:26.328998 (+225683us) tablet.cc:701] Row locks acquired
0709 13:09:26.329022 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:09:26.346615 (+ 17593us) write_op.cc:270] Start()
0709 13:09:26.357067 (+ 10452us) write_op.cc:276] Timestamp: P: 1783602566344232 usec, L: 0
0709 13:09:26.357110 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:09:26.428338 (+ 71228us) log.cc:844] Serialized 8453 byte log entry
0709 13:09:26.831939 (+403601us) op_driver.cc:464] REPLICATION: finished
0709 13:09:26.864979 (+ 33040us) write_op.cc:301] APPLY: starting
0709 13:09:26.865082 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:26.970905 (+105823us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:26.971005 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:27.323562 (+352557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:27.324118 (+   556us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:09:27.324198 (+    80us) write_op.cc:312] APPLY: finished
0709 13:09:27.325288 (+  1090us) log.cc:844] Serialized 188 byte log entry
0709 13:09:27.326583 (+  1295us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:27.326920 (+   337us) write_op.cc:454] Released schema lock
0709 13:09:27.327020 (+   100us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:27.327634 (+   614us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:27.327681 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6375,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":32386,"apply.run_cpu_time_us":33426,"apply.run_wall_time_us":462607,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91823,"num_ops":21,"prepare.queue_time_us":272368,"prepare.run_cpu_time_us":36078,"prepare.run_wall_time_us":571829,"raft.queue_time_us":31341,"raft.run_cpu_time_us":1451,"raft.run_wall_time_us":36402,"replication_time_us":471559,"thread_start_us":361323,"threads_started":4,"wal-append.queue_time_us":352712,"wal-append.run_cpu_time_us":6679,"wal-append.run_wall_time_us":1545352}]]}
I20260709 13:09:29.179543 28624 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.223884 28831 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:09:29.231611 28885 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.232542 28624 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.233103 28831 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 26 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:29.229689 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 184210us
I20260709 13:09:29.215857 21634 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:29.180644 21642 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:29.235739 21606 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.179731 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.237185 21606 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.224803 21388 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.238931 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.240790 21388 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 14 to 16, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.171701 28863 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:29.247184 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.223865 28767 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.253964 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.255740 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.260243 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.260951 28885 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:29.261626 28755 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:29.256467 21606 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.262367 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.263820 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:29.265283 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.266185 28719 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:29.266947 28719 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:29.267072 28851 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:29.267446 28609 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:29.268977 28852 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:29.269954 28831 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.270658 21640 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:29.260958 21494 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:29.224272 28781 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.271595 28614 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.239418 28667 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.272671 28667 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.273983 28781 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:29.274585 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:29.275074 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.275692 28830 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:29.276160 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.276859 21639 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:29.277743 28549 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.269032 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.278559 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.278934 21637 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:09:29.279135 28549 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:29.278211 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.246201 28854 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:29.244091 28644 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:29.284181 28834 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:29.284598 28767 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.271898 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:29.288108 21560 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
I20260709 13:09:29.317154 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.259039 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.320336 28852 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:29.321125 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.321080 28852 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.321991 21642 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:09:29.322830 21459 leader_election.cc:400] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24.
I20260709 13:09:29.323202 21459 leader_election.cc:403] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:29.322990 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:29.323515 28852 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:29.323832 21490 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:29.323611 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.324070 21459 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:29.324339 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.324952 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.325685 21490 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:29.325587 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.327203 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.327679 21489 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:29.328580 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.329401 21637 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:29.331260 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.332567 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.333504 21642 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:29.332695 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.335433 21493 raft_consensus.cc:1813] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Handling vote request from an unknown peer a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:29.336129 21493 raft_consensus.cc:2410] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:09:29.324417 21643 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:29.339201 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.340010 21488 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:29.340773 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:29.340871 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.342108 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:29.342631 21487 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.343201 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.341477 21561 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:09:29.347519 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.348728 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.349861 21639 raft_consensus.cc:2410] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:09:29.351891 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.368957 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.372270 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.375373 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.376092 21634 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:29.377146 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:29.378223 21492 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:29.379971 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 121067us
I20260709 13:09:29.380964 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:29.381404 21641 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:29.326838 28767 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:29.391185 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 97868.1us
I20260709 13:09:29.392707 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:29.393019 21606 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.384060 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:29.400027 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.401932 21490 raft_consensus.cc:2393] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:29.346580 28854 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.385310 28887 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.374621 28788 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:29.341953 28883 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24.
I20260709 13:09:29.392212 28696 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:29.404412 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.401997 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:29.371734 28610 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:29.250636 28863 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.413254 21532 leader_election.cc:400] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
W20260709 13:09:29.407281 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 81285.9us
I20260709 13:09:29.379647 28852 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.409857 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:29.406699 28861 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:29.402747 28609 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:29.396209 28834 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:29.402119 28851 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:09:29.420291 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.402078 28755 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.421342 22212 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:29.394263 28885 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:09:29.408113 28624 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:29.443148 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.437458 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.442358 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.452438 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.438326 21636 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 27.
I20260709 13:09:29.448102 28667 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:29.313359 28719 consensus_queue.cc:1175] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "549b31ac31b6428994b45938abc223a7" responder_term: 20 status { last_received { term: 19 index: 14 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:29.459841 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.430751 28781 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:29.462556 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.465008 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:29.467242 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.470644 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.440824 28696 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:29.472937 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.439664 28609 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:29.475152 21641 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:29.415159 28854 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.472465 28272 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:29.448817 28881 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:29.574615 21635 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
W20260709 13:09:29.520402 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.477389 28667 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:29.445462 28852 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.532724 21459 leader_election.cc:400] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25.
I20260709 13:09:29.409888 28887 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.466279 28781 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.459538 28729 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:29.435894 28610 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.453971 28755 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.560119 28854 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:29.545563 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.558624 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 116368us
I20260709 13:09:29.506408 28789 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:29.517925 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.524379 21636 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:29.481092 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.537045 21637 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:09:29.522156 21643 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:09:29.512965 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 75535.7us
I20260709 13:09:29.571722 21487 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:29.510195 21640 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:29.478734 28609 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:29.480551 28778 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:09:29.572504 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 172591us
I20260709 13:09:29.596103 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.596201 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:29.597034 28624 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:29.597469 28624 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.481581 28272 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:09:29.557749 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 112384us
I20260709 13:09:29.585644 21638 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:29.585614 21459 leader_election.cc:403] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:29.585196 28667 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.589524 21641 raft_consensus.cc:1240] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:29.590176 28781 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:29.595201 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:29.597810 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:29.630419 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:29.631714 21606 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:29.573125 28863 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:29.600560 21457 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:29.590600 28729 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.599828 28624 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:29.637650 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:29.634734 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:29.618871 28272 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:29.618860 28854 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:29.647010 28788 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:29.647624 28788 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:29.648758 21636 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:29.648649 28788 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.635515 28884 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:29.651146 28884 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:29.651347 28863 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:29.598590 28778 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:29.633394 28696 raft_consensus.cc:2764] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:09:29.635152 28899 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:29.637528 28456 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:09:29.658324 28456 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.658751 28456 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:29.659957 28755 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:29.661945 28610 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:29.664364 21641 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:09:29.630705 28667 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:29.644907 21638 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:29.651589 28884 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:29.668844 28778 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:29.635342 28851 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:29.641676 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.670743 28887 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:29.637866 28896 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25.
I20260709 13:09:29.647652 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:29.673200 28896 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:09:29.673309 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:29.673172 28861 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:29.674978 28896 raft_consensus.cc:2764] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:09:29.675690 28852 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:29.675949 21636 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:29.682104 21639 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
W20260709 13:09:29.634809 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 160269us
I20260709 13:09:29.688766 21642 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:29.637068 28729 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:29.703080 21643 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:29.703330 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:29.702014 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 104180us
I20260709 13:09:29.687847 28851 raft_consensus.cc:2764] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 13:09:29.702761 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:29.711742 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:29.718617 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:29.755136 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:29.716768 28789 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:29.736948 28904 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:29.756476 28456 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.772956 28887 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:29.756719 21664 debug-util.cc:398] Leaking SignalData structure 0x7b0800308d20 after lost signal to thread 20385
I20260709 13:09:29.773655 28887 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:29.774156 28887 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:29.774307 28456 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:29.774925 21664 debug-util.cc:398] Leaking SignalData structure 0x7b080030dda0 after lost signal to thread 21426
I20260709 13:09:29.757225 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:29.713989 28892 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:29.766199 28884 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:29.768409 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48932.3us
I20260709 13:09:29.769045 28781 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.769712 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3838) took 1067 ms. Trace:
I20260709 13:09:29.772835 28767 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.756505 28609 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:29.776736 21664 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2260 after lost signal to thread 21518
W20260709 13:09:29.772799 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52493.6us
I20260709 13:09:29.770391 28667 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.754205 28272 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:29.784085 21664 debug-util.cc:398] Leaking SignalData structure 0x7b08000c92c0 after lost signal to thread 21519
I20260709 13:09:29.775107 28904 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:29.807519 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:29.813306 28904 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:29.805730 28851 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.814600 28851 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.800258 28883 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:09:29.779716 28892 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:29.815940 28892 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:29.816286 28272 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:29.788407 28788 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:29.817687 28851 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:29.787781 28729 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.818120 28788 raft_consensus.cc:2764] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:09:29.795015 21634 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:29.819120 28789 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:29.785250 28767 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.820868 28789 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:29.772912 28896 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:29.821882 28896 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:29.822614 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:29.780846 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.809677 28884 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:29.824057 21664 debug-util.cc:398] Leaking SignalData structure 0x7b080018afa0 after lost signal to thread 21593
I20260709 13:09:29.781988 21640 rpcz_store.cc:276] 0709 13:09:28.702711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.648509 (+945798us) service_pool.cc:224] Handling call
0709 13:09:29.648832 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:29.649232 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:29.649532 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:09:29.705482 (+ 55950us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:29.720078 (+ 14596us) log.cc:844] Serialized 52 byte log entry
0709 13:09:29.767057 (+ 46979us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:29.767625 (+   568us) log.cc:844] Serialized 14 byte log entry
0709 13:09:29.767844 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.767927 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.769356 (+  1429us) raft_consensus.cc:1685] finished
0709 13:09:29.769407 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.769611 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12172,"prepare.queue_time_us":875,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":65,"raft.queue_time_us":3404,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":4294,"thread_start_us":54884,"threads_started":1,"wal-append.queue_time_us":67393}
W20260709 13:09:29.777931 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 59357.4us
I20260709 13:09:29.823189 28896 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.826536 28781 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:29.828066 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:29.831409 21561 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:29.832509 28781 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:29.832996 28781 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.802145 28609 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:29.833089 28624 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.833525 28781 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:29.830648 21459 leader_election.cc:400] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25.
I20260709 13:09:29.843149 21459 leader_election.cc:403] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:29.844229 28883 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25.
I20260709 13:09:29.834609 28767 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:29.845341 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:29.828272 28729 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:29.829489 21664 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf620 after lost signal to thread 21594
I20260709 13:09:29.840538 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:29.840960 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:29.847775 21569 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:09:29.841542 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:29.848798 21560 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:29.823783 28789 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:29.829914 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:29.850311 21664 debug-util.cc:398] Leaking SignalData structure 0x7b08003be800 after lost signal to thread 21667
W20260709 13:09:29.851843 21664 debug-util.cc:398] Leaking SignalData structure 0x7b080037dae0 after lost signal to thread 22277
W20260709 13:09:29.852190 21664 debug-util.cc:398] Leaking SignalData structure 0x7b0800273d00 after lost signal to thread 22278
I20260709 13:09:29.855592 28788 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:29.856048 28788 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:29.856467 28788 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:29.859266 28755 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:29.859819 28755 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.860337 28789 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:29.856073 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:29.861617 28789 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:29.861994 28885 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:29.868384 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.851689 22212 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:29.871407 21569 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:29.876981 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.878051 28755 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:29.879578 28887 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.880834 21568 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:29.881016 28609 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:29.885501 21640 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:09:29.883665 22212 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:29.889868 21560 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 12.
I20260709 13:09:29.894824 21606 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:29.897210 21643 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:09:29.881798 28609 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:29.905340 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:29.905443 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.906127 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.908236 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.910717 28456 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:29.911409 22242 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:29.850189 28911 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:09:29.911629 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:29.913964 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.915163 22244 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:29.915203 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:29.923846 21569 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:09:29.925834 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.886492 28884 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:29.929296 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.937362 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:29.940403 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 95623.5us
I20260709 13:09:29.940667 21562 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:29.941092 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.941197 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.941555 21563 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:29.940016 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:29.938134 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:29.938411 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:29.898115 28755 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:29.939673 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.942755 21560 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:29.943264 22244 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:29.900993 28272 raft_consensus.cc:2804] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:29.946065 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:29.901183 28831 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:29.952054 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:29.958823 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.960390 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:29.962582 21565 raft_consensus.cc:2393] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:29.926919 28624 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:29.964066 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:29.962275 28272 raft_consensus.cc:697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:29.970928 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.971118 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:29.971684 21634 raft_consensus.cc:2376] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16. Re-sending same reply.
I20260709 13:09:29.942165 28436 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:29.940174 28884 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.974680 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.976666 21643 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:29.977413 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.977950 21636 raft_consensus.cc:3060] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:29.979961 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:29.980540 21641 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:29.986196 21639 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:29.944729 28755 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.953615 28861 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:29.953316 28896 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:29.954432 28667 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:29.954627 28729 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:29.991827 22247 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:09:30.000774 21561 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:29.940770 28908 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:09:29.938444 28778 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:29.975715 28831 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:29.978873 28884 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:30.012850 21641 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
W20260709 13:09:30.015215 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 74091.9us
I20260709 13:09:30.022354 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:29.996948 28755 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:29.995115 28830 raft_consensus.cc:2764] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:09:29.997061 28436 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:30.001233 28624 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.015098 28729 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.048799 28729 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:30.051003 28436 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.052582 21532 leader_election.cc:400] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:30.053664 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:30.019757 28896 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.054984 28914 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:30.055464 28914 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.055795 28914 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:30.056370 28896 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:30.054611 21532 leader_election.cc:400] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:30.059715 21532 leader_election.cc:403] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:30.060408 28767 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:30.061729 28272 consensus_queue.cc:237] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.063071 28624 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.064091 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:30.033787 28667 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:30.080250 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:30.080600 28667 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:30.081043 28667 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:30.083026 28788 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.085179 28788 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.068677 21562 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:09:30.064700 28456 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:30.087369 28456 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:30.088418 28456 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.074389 28831 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.048826 28887 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:30.095307 28456 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:30.096378 28914 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.099772 28767 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15.
I20260709 13:09:30.098583 28914 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.107038 28778 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:30.111460 28624 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:30.115160 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51124.1us
I20260709 13:09:30.117529 28624 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:30.118139 28624 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:30.118626 28624 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:30.125478 28904 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.128358 28755 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.132282 28904 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:30.133440 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:30.137337 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:30.138392 28914 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:30.139057 28914 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.139454 28914 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:30.148614 28914 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.148456 28892 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.156572 28892 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.153048 21643 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 28.
I20260709 13:09:30.153832 28781 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.160496 28781 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.165772 28914 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.172605 28914 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:30.173099 28914 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:30.173542 28914 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:30.174598 21636 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:30.176486 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:30.177328 21487 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:09:30.177776 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.179045 21487 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:09:30.178994 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.179550 28904 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:30.179781 21489 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:30.180076 28904 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:30.180672 28904 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:30.181032 21485 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:30.182099 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.183348 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:30.184216 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.184765 21492 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:30.186472 28884 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.188205 21491 raft_consensus.cc:2368] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:30.189201 28884 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.196038 21492 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:30.197351 28916 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:09:30.198153 22247 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:30.198853 28914 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.201447 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:30.203285 22247 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:30.207705 28755 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:30.211163 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:30.214313 28916 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:30.214270 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:30.215080 28916 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.217890 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:30.218118 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:30.222330 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:30.223366 28914 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.227234 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:30.229400 28852 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:30.231905 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:30.233083 28852 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:30.234323 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 95560.1us
I20260709 13:09:30.235731 28852 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:30.245468 28913 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:30.246241 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:30.247335 28914 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:30.247740 28914 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:30.248086 28914 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:30.255686 28913 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:30.255807 28914 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.240998 28830 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:30.242646 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:30.257328 28831 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:30.257882 28831 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:30.258495 28830 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:30.258934 28830 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.259270 28830 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:30.244216 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:30.256453 28913 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:30.263367 21637 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:30.269815 28830 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.240023 28916 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:30.275431 21492 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:30.276219 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:30.276643 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.277285 28914 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.277645 21391 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 21 to 22, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 22 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.274473 21493 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:30.284720 21606 leader_election.cc:400] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:30.312525 21606 leader_election.cc:403] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:09:30.295012 21632 tablet_service.cc:1558] Processing DeleteTablet for tablet 06b5fb42c147456889a1843340b22720 with delete_type TABLET_DATA_TOMBSTONED (TS a87bd86b86e74aa8bb61189215b73439 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:43682
I20260709 13:09:30.307392 21637 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:30.302342 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:30.313700 21487 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 23.
W20260709 13:09:30.315759 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 69896.5us
I20260709 13:09:30.316612 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:30.317811 21388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 251) took 10022 ms. Trace:
I20260709 13:09:30.316215 28852 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:30.313719 28884 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.005s
I20260709 13:09:30.314587 21391 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 18 to 20, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 20 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.318270 21388 rpcz_store.cc:276] 0709 13:09:20.295723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.296004 (+   281us) service_pool.cc:224] Handling call
0709 13:09:30.317724 (+10021720us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:29.526441 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:29.527140 (+   699us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:29.527193 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:09:29.527210 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:29.528266 (+  1056us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:29.528365 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:29.528391 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:09:29.529243 (+   852us) tablet.cc:701] Row locks acquired
0709 13:09:29.529293 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:09:29.529456 (+   163us) write_op.cc:270] Start()
0709 13:09:29.529617 (+   161us) write_op.cc:276] Timestamp: P: 1783602569529384 usec, L: 0
0709 13:09:29.529661 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:09:29.598009 (+ 68348us) log.cc:844] Serialized 3649 byte log entry
0709 13:09:30.047838 (+449829us) op_driver.cc:464] REPLICATION: finished
0709 13:09:30.204515 (+156677us) write_op.cc:301] APPLY: starting
0709 13:09:30.204659 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:30.212470 (+  7811us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:30.212621 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:30.230360 (+ 17739us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:30.230829 (+   469us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:09:30.230926 (+    97us) write_op.cc:312] APPLY: finished
0709 13:09:30.231452 (+   526us) log.cc:844] Serialized 89 byte log entry
0709 13:09:30.235012 (+  3560us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:30.235143 (+   131us) write_op.cc:454] Released schema lock
0709 13:09:30.235218 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:30.246310 (+ 11092us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:30.246360 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":461993,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":156336,"apply.run_cpu_time_us":17280,"apply.run_wall_time_us":41810,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41711,"num_ops":9,"prepare.queue_time_us":200220,"prepare.run_cpu_time_us":30190,"prepare.run_wall_time_us":340900,"raft.queue_time_us":180691,"raft.run_cpu_time_us":2456,"raft.run_wall_time_us":156662,"replication_time_us":518002,"thread_start_us":543876,"threads_started":4,"wal-append.queue_time_us":229875}]]}
I20260709 13:09:30.320647 21391 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 23 to 24, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 24 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:30.322405 21391 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 15 to 17, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 17 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:30.325310 28830 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:30.323990 21391 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 20 to 22, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 22 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.327102 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.327831 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.328483 21490 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 27.
I20260709 13:09:30.328871 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.330396 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.330724 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:30.331709 21391 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:30.337157 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:30.337761 21562 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:30.338958 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:30.339696 21561 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 22: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:30.339744 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:30.185824 28667 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.342000 21457 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:30.335080 21391 catalog_manager.cc:5697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 16 to 20, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 20 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.346347 21569 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:30.258955 28831 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.358883 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:30.359797 21567 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:30.358917 21566 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:30.359704 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:30.361871 21492 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:30.350278 21391 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 20 to 21, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 21 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.366627 21489 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
W20260709 13:09:30.370707 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.372319 21391 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 15 to 18, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 18 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:30.373299 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 56772.5us
I20260709 13:09:30.374056 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:30.300889 28778 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:09:30.374410 21391 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 19 to 21, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 21 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.387996 21391 catalog_manager.cc:5697] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 13 to 15, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 15 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.380034 21492 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 28.
I20260709 13:09:30.359184 28755 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.343575 28789 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:30.399973 21562 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:30.392940 21391 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 24 to 26, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 26 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.386089 28831 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:30.376344 28914 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:30.394090 21568 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:30.386196 28896 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:30.396183 28642 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:09:30.414942 28830 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:30.415563 28830 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.417785 28830 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:30.389209 28915 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:30.432725 21567 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
W20260709 13:09:30.447729 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 46939.5us
I20260709 13:09:30.451308 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:30.451241 21569 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:30.453972 21569 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:09:30.402038 28729 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 13:09:30.393931 28887 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:09:30.399097 28911 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:09:30.458662 21567 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:30.460158 28272 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:30.460620 28272 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:30.461480 28272 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.462755 28272 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:30.463776 28935 tablet_replica.cc:333] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:09:30.465070 28935 raft_consensus.cc:2243] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.446678 28896 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:30.457630 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:30.433880 28915 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:30.456487 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 70025.5us
I20260709 13:09:30.466172 28935 raft_consensus.cc:2272] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.402659 28881 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:09:30.423030 28913 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.403362 28755 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.489701 21457 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:30.402585 28920 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:09:30.507848 21643 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:30.492197 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:30.494149 21567 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 22. Current term is 23. Ops: []
W20260709 13:09:30.498642 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 101499us
I20260709 13:09:30.492044 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:30.515527 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:30.542282 21562 raft_consensus.cc:2368] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
I20260709 13:09:30.517529 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:30.519837 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:30.545060 21566 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:30.521178 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:30.546555 21568 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 25: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:30.522660 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:30.530089 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:30.531318 28624 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.537948 28935 ts_tablet_manager.cc:1916] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:30.539793 28755 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.490556 28915 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:30.557192 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:30.513634 28789 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:30.563215 21561 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:30.564219 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:30.543154 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:30.566651 21568 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:09:30.567198 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:30.568253 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:30.568882 21567 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:30.577283 21566 raft_consensus.cc:2368] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:30.522363 28852 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:09:30.576175 21565 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:30.519259 28904 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.615324 28904 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.612188 28940 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:30.613539 28913 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.576107 28911 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.618719 28911 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.622591 28852 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:30.623118 28852 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:30.624027 28852 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.625358 28852 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:30.638893 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:30.647023 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.650700 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.657990 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:30.658864 22240 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:30.575398 28778 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:30.657752 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:30.674911 22210 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:30.603705 28908 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:30.565995 28781 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.076s
I20260709 13:09:30.689388 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:30.630508 28667 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.714354 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.657677 28789 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:30.716673 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 164647us
I20260709 13:09:30.686712 28908 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.709853 28272 raft_consensus.cc:2804] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:30.723703 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:30.728109 21487 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:30.731204 21486 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:30.732401 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:30.732528 28916 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:30.734099 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:30.737648 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:30.715351 28642 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:09:30.689080 22241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:09:30.751426 22241 raft_consensus.cc:606] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:30.752449 21640 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:30.686491 28778 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.604791 28896 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.730767 28908 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:30.734131 28916 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:30.729784 28880 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:09:30.761072 28272 raft_consensus.cc:697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:30.771837 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.750892 28939 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:30.747758 28882 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:30.779783 28272 consensus_queue.cc:237] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:30.780687 28941 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:09:30.779805 28939 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:30.781380 28939 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:30.772604 28916 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.782248 28916 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.784399 28916 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:30.785660 28910 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
I20260709 13:09:30.789201 28939 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.791918 28939 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.792153 28767 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:30.802125 21490 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:30.804396 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:30.803647 28831 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:30.763303 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 400179us
I20260709 13:09:30.806608 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:30.770047 28642 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 28 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:30.766865 28830 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:09:30.833818 28946 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.855561 28642 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.814208 28939 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:30.826486 21459 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:30.862901 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.861891 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.860034 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:30.865550 22241 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:30.861533 21486 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:30.867228 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:30.868435 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:30.869093 22240 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:30.869362 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:30.870183 21638 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 25: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:30.830684 28624 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:30.817420 28831 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:30.872781 28944 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:30.873131 21640 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:30.874028 28831 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:30.871603 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.875263 28778 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.857378 28767 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:30.871614 28946 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.831797 28789 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.879733 28946 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:30.881719 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 110637us
I20260709 13:09:30.884768 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:30.889516 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 63113.3us
I20260709 13:09:30.895694 21639 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:30.899880 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:30.915082 28755 consensus_queue.cc:1059] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:30.915899 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44662.1us
I20260709 13:09:30.916220 28946 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:30.916741 28946 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:30.918141 28456 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:30.922554 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:30.922772 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:30.939597 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:30.937772 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46657.5us
I20260709 13:09:30.946045 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:30.947081 21639 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:30.885984 28892 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:30.952461 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.915156 28948 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:30.954569 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:30.961943 28955 raft_consensus.cc:3055] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:30.962496 28955 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:30.963632 28955 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.966765 28911 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:30.968159 28915 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:30.969328 28882 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:30.969784 28882 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:30.910125 28880 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:09:30.970697 28882 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.974987 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:30.978462 22240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:09:30.979202 22240 raft_consensus.cc:606] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:30.917605 28946 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:30.992834 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:30.995128 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:30.958467 28907 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:31.002172 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.004674 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:31.006560 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.007762 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:31.008599 21635 raft_consensus.cc:2410] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:09:31.015595 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.016695 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.017362 21635 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:31.017925 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.019011 21642 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 22: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:30.970933 28892 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:31.021763 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.027802 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:31.023376 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.031700 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:31.005995 28907 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:31.041731 21635 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:31.055884 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:31.055785 21459 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:31.063287 22240 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:31.010972 28951 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:09:31.035792 28880 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:31.036643 28614 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:31.066146 21493 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:31.066493 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 149408us
I20260709 13:09:31.048045 28915 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:31.076882 28936 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:09:31.101229 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:31.108830 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47939.2us
I20260709 13:09:31.102458 28883 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:09:31.057663 28755 raft_consensus.cc:2955] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:31.115281 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:31.123320 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:31.116413 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:31.117188 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:31.118180 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.119560 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.120477 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.127641 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.128994 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:31.131398 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:31.103008 28896 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:31.132002 21492 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:31.135462 28908 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:31.131893 28907 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:31.131183 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 121462us
I20260709 13:09:31.117323 28892 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:31.142805 28908 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:31.144701 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.152948 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.154721 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:31.158479 21459 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:31.154757 21560 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:31.159960 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:31.158643 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 87395.2us
I20260709 13:09:31.171923 21459 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:31.178802 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:31.179723 21560 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
W20260709 13:09:31.184176 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 143435us
I20260709 13:09:31.190044 21568 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:31.202404 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.203068 21643 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:31.200091 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:31.201303 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:31.207502 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:31.205816 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:31.193266 21492 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:31.213110 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:31.207515 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:31.218050 21608 leader_election.cc:400] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
I20260709 13:09:31.218415 21608 leader_election.cc:403] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:09:31.219313 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:31.219755 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:31.220193 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:31.220387 21485 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:31.221938 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:31.224735 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:31.189939 28788 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:31.214265 28614 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:31.224485 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:31.228829 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:31.229287 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:31.229831 21642 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:09:31.231045 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:31.231267 21563 raft_consensus.cc:1275] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:31.233397 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:31.192730 28882 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:31.225159 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:31.239416 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:31.239960 22246 raft_consensus.cc:1240] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:31.241518 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:31.241926 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:31.245237 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:31.198486 28896 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:31.248087 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:31.252761 21643 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
I20260709 13:09:31.171254 28789 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:09:31.216924 28610 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:31.223688 28852 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:31.217039 28831 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:31.338975 21569 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:31.195752 28880 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:09:31.202852 28946 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:09:31.251401 28904 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:31.255730 28915 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:31.254257 28940 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:31.264504 28788 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:31.359721 28908 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.352336 28831 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:31.433282 28904 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:09:31.464495 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.343842 28883 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:09:31.372156 28272 raft_consensus.cc:2764] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
W20260709 13:09:31.465827 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 220644us
I20260709 13:09:31.351037 28975 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.203s
W20260709 13:09:31.435003 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 213793us
I20260709 13:09:31.508088 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:31.453150 22246 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:31.369024 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:31.509646 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 140753us
I20260709 13:09:31.518370 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:31.513929 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 255031us
I20260709 13:09:31.525657 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:31.518030 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:31.485090 28852 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21.
I20260709 13:09:31.517803 28940 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:09:31.552681 28978 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:09:31.489705 28831 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:31.571955 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 52201.4us
I20260709 13:09:31.531793 28914 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:31.476315 28896 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:31.552717 28940 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:31.454391 28614 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:31.495216 28908 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:31.667250 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.589864 28456 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:31.590571 28915 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:31.687211 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:31.615653 28975 consensus_queue.cc:1243] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 549b31ac31b6428994b45938abc223a7 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:31.700903 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:31.701977 21492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d6d6e481fd941658a227093848691fa"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:31.703974 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:31.704198 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:31.704586 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 138513us
W20260709 13:09:31.706369 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 180780us
I20260709 13:09:31.712592 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:31.713291 21494 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:31.633293 28788 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:31.729913 28852 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:31.836544 28852 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:31.841769 28974 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.499s	user 0.001s	sys 0.001s
I20260709 13:09:31.813817 28976 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.814857 28998 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:09:31.815761 28979 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:09:31.816614 28994 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:09:31.800973 28995 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:31.825711 28908 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:31.827396 28940 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:31.678846 28904 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:31.795289 28755 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:09:31.803551 28896 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:31.844599 28946 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:31.866005 28998 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:31.856098 28852 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:31.936894 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 223728us
W20260709 13:09:31.942833 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 239601us
I20260709 13:09:31.936462 21494 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
I20260709 13:09:31.973044 28998 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:31.974519 28998 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:31.975080 28988 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:31.975656 28988 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:31.976188 28907 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:31.977873 28988 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:31.974660 28993 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.979204 28993 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:31.981261 28993 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:31.844640 21487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.025s
W20260709 13:09:31.985075 21487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.005s	sys 0.025s
I20260709 13:09:31.944736 28946 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.995895 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:31.994526 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:32.006430 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:32.004655 21639 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:09:32.006928 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:32.017045 21608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.005s	sys 0.008s
W20260709 13:09:32.017429 21608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.005s	sys 0.008s
W20260709 13:09:32.018173 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 784822us
I20260709 13:09:32.019495 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:32.021648 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:32.026845 22241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.012s	sys 0.000s
W20260709 13:09:32.027375 22241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.012s	sys 0.001s
I20260709 13:09:32.041467 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:32.072726 22242 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:09:32.079705 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 85260.9us
I20260709 13:09:32.080875 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:32.089568 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.913513 28976 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.095504 21640 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:32.001664 28946 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:32.128026 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 86713.1us
I20260709 13:09:32.129091 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:32.121937 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48230.6us
W20260709 13:09:32.135872 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 428050us
I20260709 13:09:32.136814 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:32.138731 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:32.150751 21490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.011s	sys 0.017s
I20260709 13:09:32.076475 28642 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:32.152899 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 72135.8us
I20260709 13:09:32.160334 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:32.017448 28456 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 24 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:32.126583 28614 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:32.151218 21490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.011s	sys 0.017s
I20260709 13:09:32.166975 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:32.171347 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:32.176622 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:32.225275 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48750.4us
I20260709 13:09:32.121798 28991 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.215s
I20260709 13:09:32.167611 28999 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:32.237776 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.179378 28904 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:32.174022 29013 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:32.165320 28789 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 13:09:32.243525 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 104867us
I20260709 13:09:32.266844 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:32.244973 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:32.177328 28852 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:32.228165 28887 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:09:32.264832 21460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.006s	sys 0.037s
W20260709 13:09:32.272150 21460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.006s	sys 0.037s
I20260709 13:09:32.272471 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:32.290904 22243 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:32.307945 29007 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:32.308894 29007 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:32.309713 28882 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 1.049s	user 0.019s	sys 0.000s
W20260709 13:09:32.290357 28950 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.013s	sys 0.025s
W20260709 13:09:32.327142 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 160332us
I20260709 13:09:32.290519 28980 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.290290 29008 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:32.288405 28887 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:32.325127 28950 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.014s	sys 0.025s
I20260709 13:09:32.338232 21489 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
W20260709 13:09:32.342420 22210 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.517s (SENT) [suppressed 28 similar messages]
I20260709 13:09:32.326211 28999 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.325368 28989 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:32.337299 28887 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:32.326965 28852 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
W20260709 13:09:32.393491 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 163940us
W20260709 13:09:32.396977 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 130269us
I20260709 13:09:32.397344 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:32.336793 28935 ts_tablet_manager.cc:1929] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:09:32.398655 21608 leader_election.cc:400] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
W20260709 13:09:32.400628 22211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.011s	sys 0.019s
W20260709 13:09:32.402513 22211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.012s	sys 0.020s
I20260709 13:09:32.320797 28456 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.340302 28980 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.408475 22247 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:32.365505 29015 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:32.370328 29005 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:32.340163 29008 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:32.414256 29002 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:09:32.417644 29004 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:32.418200 28477 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.453016 28477 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.453718 29030 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:32.455442 28477 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:32.456732 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:32.457262 28730 raft_consensus.cc:993] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:09:32.457700 21562 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 16.
I20260709 13:09:32.458105 29016 raft_consensus.cc:1081] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:09:32.462951 28976 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:32.376526 28999 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.467133 28982 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:32.468070 28982 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.472510 28852 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.473223 28852 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.477751 21569 raft_consensus.cc:3055] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:32.478456 21569 raft_consensus.cc:740] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:32.479573 21569 consensus_queue.cc:260] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.480842 21569 raft_consensus.cc:3060] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:32.483479 21562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:36572
I20260709 13:09:32.484551 21562 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.485023 21562 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:32.485194 29008 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:32.415166 28935 log.cc:1199] T 06b5fb42c147456889a1843340b22720 P a87bd86b86e74aa8bb61189215b73439: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/wals/06b5fb42c147456889a1843340b22720
I20260709 13:09:32.441789 28946 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:32.489116 28831 consensus_meta.cc:287] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.002s
I20260709 13:09:32.489995 28946 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:32.489816 28831 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.466501 28999 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:32.418371 29017 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:09:32.419070 29028 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:32.419812 29015 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:32.492514 28852 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:32.420339 29021 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:09:32.492358 29028 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.420678 29026 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:32.493665 28995 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.000s
I20260709 13:09:32.493873 29026 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:32.494128 28995 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:32.494299 29026 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:32.494915 28982 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:32.495188 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2472) took 1275 ms. Trace:
I20260709 13:09:32.424579 28980 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:32.512401 29007 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:32.425598 21641 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:32.513422 28935 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43682 (request call id 1) took 2220 ms. Trace:
I20260709 13:09:32.513844 28935 rpcz_store.cc:276] 0709 13:09:30.293067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.293354 (+   287us) service_pool.cc:224] Handling call
0709 13:09:30.463374 (+170020us) ts_tablet_manager.cc:1151] Deleting tablet 06b5fb42c147456889a1843340b22720
0709 13:09:30.463474 (+   100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:31.122757 (+659283us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:32.325150 (+1202393us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:32.513328 (+188178us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":145489,"thread_start_us":102187,"threads_started":1}
I20260709 13:09:32.428263 21492 raft_consensus.cc:606] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:32.516496 21643 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:09:32.430670 28887 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.521957 28887 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:32.529057 28955 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:32.435627 29019 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:09:32.400902 28938 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:32.420946 28940 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:32.533815 28938 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:32.534322 29028 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:32.534720 28938 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.536033 28938 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:32.536209 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.537285 28940 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.537817 28940 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.538425 21561 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:32.539114 28887 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.539361 21563 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:32.539821 21560 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:32.539644 28887 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.541697 28887 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:32.541903 28940 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:32.502676 21569 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:09:32.502435 29026 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.544507 29026 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:32.508805 21562 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.547333 21562 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:32.554044 21492 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:09:32.559902 29022 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.544s	user 0.003s	sys 0.000s
W20260709 13:09:32.562302 29010 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.547s	user 0.000s	sys 0.002s
I20260709 13:09:32.533421 28831 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:32.511229 21487 rpcz_store.cc:276] 0709 13:09:31.191609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.191739 (+   130us) service_pool.cc:224] Handling call
0709 13:09:31.192046 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.204846 (+ 12800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.204894 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.214835 (+  9941us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.465720 (+1250885us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b18000c6940. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1
0709 13:09:32.465962 (+   242us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:32.466019 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.466126 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.466194 (+    68us) raft_consensus.cc:1685] finished
0709 13:09:32.466217 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.466502 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20704,"raft.queue_time_us":13013,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8680,"spinlock_wait_cycles":21368704,"thread_start_us":709606,"threads_started":1,"wal-append.queue_time_us":745845}
I20260709 13:09:32.568115 21487 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:09:32.572654 21562 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:09:32.574896 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:32.627589 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 218714us
I20260709 13:09:32.628616 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:32.642997 21566 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:32.642534 29026 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:32.647691 21376 catalog_manager.cc:5028] TS a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): tablet 06b5fb42c147456889a1843340b22720 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:09:32.648061 29026 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:32.648545 29026 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:32.654243 29035 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:32.654896 29035 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.657176 29035 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:32.659660 22244 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:32.694245 29035 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:32.694965 29035 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.695586 28982 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:32.696201 28982 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.697400 29035 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:32.698065 29035 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:32.694224 28610 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:32.699685 28610 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.700470 29030 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:32.701012 29030 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:32.701939 29023 log.cc:927] Time spent T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:09:32.702028 28610 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:32.698495 28982 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:32.664589 28980 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.664728 29028 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.663254 28831 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:32.665778 28830 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.691545 28852 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:09:32.736809 21494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.006s	sys 0.015s
W20260709 13:09:32.711519 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 369118us
W20260709 13:09:32.779412 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.734177 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 335643us
W20260709 13:09:32.781903 21494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.015s
I20260709 13:09:32.782550 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:32.784039 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:32.793519 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:32.802078 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:32.815033 21564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.016s
W20260709 13:09:32.815577 21564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.015s	sys 0.016s
I20260709 13:09:32.794517 22242 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:32.821439 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:32.833776 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:32.834178 21634 raft_consensus.cc:1275] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:09:32.737113 28982 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:32.743666 28940 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:32.838511 22246 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:32.744503 29030 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:32.857126 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.841325 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:32.842679 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:32.845093 21485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1281) took 1139 ms. Trace:
W20260709 13:09:32.848894 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 790) took 1641 ms (client timeout 1845 ms). Trace:
I20260709 13:09:32.849834 21568 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:32.851408 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:32.698674 29035 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.866750 22245 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:09:32.861755 22247 rpcz_store.cc:269] 0709 13:09:31.207731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.208014 (+   283us) service_pool.cc:224] Handling call
0709 13:09:32.848637 (+1640623us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54006301d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:32.848794 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2517582720}
I20260709 13:09:32.862057 21487 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:32.784320 28830 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.869372 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:32.818001 29033 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:32.860019 21485 rpcz_store.cc:276] 0709 13:09:31.705371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.705525 (+   154us) service_pool.cc:224] Handling call
0709 13:09:31.705818 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.798673 (+ 92855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.798709 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.802866 (+  4157us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.099546 (+296680us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:32.155487 (+ 55941us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.844426 (+688939us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b180046b0a0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6e6fc0a 00007f98b05af219 00007f98a6ef7a40 00007f98a6ef24e4 00007f98a6ef2455 00007f98a9fda060 00007f98a9fec716 00007f98a9ffd287 00007f98a9ffd208
0709 13:09:32.844637 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.844721 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.844771 (+    50us) raft_consensus.cc:1685] finished
0709 13:09:32.844881 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.845032 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90599,"prepare.queue_time_us":63846,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":4818,"raft.queue_time_us":809707,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":193,"spinlock_wait_cycles":2340608,"thread_start_us":219134,"threads_started":1,"wal-append.queue_time_us":408316}
I20260709 13:09:32.874579 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:32.874668 28614 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:32.758553 28831 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.886983 21491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 3102) took 1199 ms. Trace:
I20260709 13:09:32.737329 29028 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.715044 28980 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.883955 28991 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:32.919669 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:32.895390 21487 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:09:32.788808 28852 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.926990 21491 rpcz_store.cc:276] 0709 13:09:31.687923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.688124 (+   201us) service_pool.cc:224] Handling call
0709 13:09:31.693340 (+  5216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.693589 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:32.079303 (+385714us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.886567 (+807264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.886630 (+    63us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:32.886682 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.886759 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.886928 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":593290,"prepare.queue_time_us":142099,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":597786,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":97,"thread_start_us":587746,"threads_started":2,"wal-append.queue_time_us":311715}
I20260709 13:09:32.892799 29030 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:32.891232 28937 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.972108 21487 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:09:32.972976 21637 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:09:32.989264 29039 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:32.992766 28892 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:32.993342 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.993623 28892 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:32.996430 28892 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:32.999747 28852 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:32.932004 28968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.502s	user 0.016s	sys 0.022s
W20260709 13:09:33.000901 28968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.630s	user 0.017s	sys 0.023s
I20260709 13:09:32.990181 29039 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.005131 29039 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:33.006543 28937 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.010274 28831 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:33.012753 28830 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:33.013670 29038 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:33.014488 29038 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.962596 28991 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:33.019433 28991 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.018175 28923 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.859783 28982 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.023047 29042 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:32.867341 28940 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:33.018234 29037 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:09:33.025586 29028 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:32.978624 29030 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:33.039505 21488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.027s	sys 0.046s
W20260709 13:09:33.039909 21488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.027s	sys 0.046s
I20260709 13:09:32.929019 28614 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:32.925176 29033 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.040239 29030 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:33.063057 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 899797us
I20260709 13:09:33.069329 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3908) took 1054 ms. Trace:
W20260709 13:09:33.070241 21489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 1279) took 1354 ms (client timeout 1517 ms). Trace:
W20260709 13:09:33.082585 21489 rpcz_store.cc:269] 0709 13:09:31.703562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.703715 (+   153us) service_pool.cc:224] Handling call
0709 13:09:33.058126 (+1354411us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b5400276fd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:33.058301 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394392832}
I20260709 13:09:33.031133 28923 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.085246 29033 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:33.086138 28923 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:33.052661 29018 log.cc:927] Time spent T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 1.035s	user 0.007s	sys 0.000s
I20260709 13:09:33.040999 29038 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:33.094674 21486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2470) took 1937 ms. Trace:
I20260709 13:09:33.094945 21459 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:33.080421 28887 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:33.095661 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2473) took 1901 ms. Trace:
I20260709 13:09:33.080507 28998 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:33.034272 29042 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.090509 28884 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.098294 28861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.030s	sys 0.034s
I20260709 13:09:33.109371 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.102151 21490 rpcz_store.cc:276] 0709 13:09:31.191968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.192144 (+   176us) service_pool.cc:224] Handling call
0709 13:09:31.192468 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.192666 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:31.337612 (+144946us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.093455 (+1755843us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.093523 (+    68us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:33.093593 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.093682 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.093786 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":682146,"prepare.queue_time_us":642529,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":711175,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"thread_start_us":1193504,"threads_started":3,"wal-append.queue_time_us":970789}
I20260709 13:09:33.120204 21641 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:33.120347 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2474) took 1913 ms. Trace:
W20260709 13:09:33.112175 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.099571 21635 rpcz_store.cc:276] 0709 13:09:32.001718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.001844 (+   126us) service_pool.cc:224] Handling call
0709 13:09:32.126918 (+125074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.128888 (+  1970us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:09:32.164780 (+ 35892us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.569016 (+404236us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b1800476680. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b8223a 00007f98a9feca2a
0709 13:09:33.055331 (+486315us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.055412 (+    81us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:09:33.055482 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.055564 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.055718 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35506,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":4923,"raft.queue_time_us":3771,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":12683,"spinlock_wait_cycles":2446464,"thread_start_us":485053,"threads_started":1}
I20260709 13:09:33.115564 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.095120 21486 rpcz_store.cc:276] 0709 13:09:31.157472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.161019 (+  3547us) service_pool.cc:224] Handling call
0709 13:09:31.170512 (+  9493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.170746 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:31.663224 (+492478us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.163753 (+500529us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.474368 (+310615us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b1800300700. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef5522 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:09:33.094332 (+619964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.094383 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:33.094432 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.094504 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.094621 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1152453,"prepare.queue_time_us":676488,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":748400,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":11186,"spinlock_wait_cycles":6770432,"thread_start_us":1191886,"threads_started":3,"wal-append.queue_time_us":503929}
W20260709 13:09:33.117882 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.095580 28948 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:33.133767 21642 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:09:33.136840 29043 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:09:33.126166 28778 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:33.140295 21488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 3100) took 1920 ms. Trace:
I20260709 13:09:33.140867 21488 rpcz_store.cc:276] 0709 13:09:31.219414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.219532 (+   118us) service_pool.cc:224] Handling call
0709 13:09:31.252155 (+ 32623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.670024 (+417869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.670058 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.980086 (+310028us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b4800080358. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98aef0baa1 00007f98aef02b37 00007f98aef029ca 00007f98aeffa26f 00007f98aeff9f37 00007f98af00e55c 00007f98af00e508 00007f98af00e488 00007f98af00e443 00007f98af00d6ec 00007f98adf37a96
0709 13:09:32.508405 (+528319us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b2c000014c8. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a88dba11 00007f98a88eb372 00007f98aa01da01 00007f98a9fe243a 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2
0709 13:09:32.509150 (+   745us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.040256 (+531106us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:33.040299 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.040371 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.139947 (+ 99576us) raft_consensus.cc:1685] finished
0709 13:09:33.139983 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.140207 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123005,"raft.queue_time_us":238535,"raft.run_cpu_time_us":10694,"raft.run_wall_time_us":479112,"spinlock_wait_cycles":21763072,"thread_start_us":811931,"threads_started":2,"wal-append.queue_time_us":593957}
W20260709 13:09:33.120409 28861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.030s	sys 0.035s
I20260709 13:09:33.150204 28940 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:33.163244 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.164582 21634 raft_consensus.cc:2410] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 22 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:09:33.176666 29042 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:33.188874 28614 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:33.190101 28788 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:33.119951 28884 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.194160 28884 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:33.195494 28982 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:33.113482 28937 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:33.113842 28998 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.199824 28998 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:33.115010 28950 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:09:33.114710 28883 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:33.094009 28642 consensus_queue.cc:1048] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:09:33.205340 28980 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:33.205931 28948 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.118929 28830 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.089s
I20260709 13:09:33.121013 21493 rpcz_store.cc:276] 0709 13:09:31.206739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.207035 (+   296us) service_pool.cc:224] Handling call
0709 13:09:31.231861 (+ 24826us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:31.467000 (+235139us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:31.947325 (+480325us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.878975 (+931650us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:32.879792 (+   817us) log.cc:844] Serialized 52 byte log entry
0709 13:09:32.880004 (+   212us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:33.116610 (+236606us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.119934 (+  3324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.120118 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.120162 (+    44us) raft_consensus.cc:1685] finished
0709 13:09:33.120177 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.120294 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":716200,"prepare.queue_time_us":348838,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":883488,"raft.run_cpu_time_us":830,"raft.run_wall_time_us":40389,"thread_start_us":1024159,"threads_started":4,"wal-append.queue_time_us":364137}
W20260709 13:09:33.215284 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.215914 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.219630 28976 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:33.220378 28976 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.223023 28936 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:33.223788 28936 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.227008 28993 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:33.227730 28993 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.230252 28993 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:33.231316 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.232268 21488 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:33.243803 28880 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:33.244416 28880 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:33.245607 28880 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.250032 28991 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:33.251098 28885 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:33.251489 28885 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:33.252372 28885 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.253629 28885 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:33.256982 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.258315 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.260962 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:33.267750 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 67301.8us
I20260709 13:09:33.268157 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.268870 21490 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 28.
I20260709 13:09:33.271440 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:33.272320 21485 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:33.226450 28936 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:33.279358 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.281442 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.283511 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:33.284366 21488 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:33.294524 28788 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:33.295177 28788 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:33.295876 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1285) took 1589 ms. Trace:
I20260709 13:09:33.296234 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:33.296288 28788 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.298163 28788 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:33.296275 21494 rpcz_store.cc:276] 0709 13:09:31.706533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.131252 (+424719us) service_pool.cc:224] Handling call
0709 13:09:32.131568 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.152625 (+ 21057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.152656 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.168142 (+ 15486us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.782332 (+614190us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:32.782373 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.295440 (+513067us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b54000f5d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:33.295500 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.295552 (+    52us) raft_consensus.cc:1685] finished
0709 13:09:33.295565 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.295803 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":680297,"raft.queue_time_us":743,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":17853,"spinlock_wait_cycles":47578880,"thread_start_us":550888,"threads_started":1,"wal-append.queue_time_us":781878}
I20260709 13:09:33.300374 28975 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:33.301156 28975 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.307279 21565 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:09:33.306991 28996 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:33.307866 28951 consensus_queue.cc:1059] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:33.308822 28996 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:33.309486 28951 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:33.310129 28951 consensus_queue.cc:1243] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:33.310150 28996 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:33.310690 28996 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:33.267675 29028 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.267315 28830 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.315594 22244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 792) took 2091 ms (client timeout 1962 ms). Trace:
I20260709 13:09:33.316447 21562 raft_consensus.cc:1240] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:33.317132 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.325317 22241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1291) took 1087 ms. Trace:
I20260709 13:09:33.332182 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:33.334170 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:33.326965 22244 rpcz_store.cc:269] 0709 13:09:31.224353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.224508 (+   155us) service_pool.cc:224] Handling call
0709 13:09:33.315414 (+2090906us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54005fe954. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:33.315521 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3091040128}
I20260709 13:09:33.328972 22241 rpcz_store.cc:276] 0709 13:09:32.226978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.227150 (+   172us) service_pool.cc:224] Handling call
0709 13:09:32.227473 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.414962 (+187489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.414997 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.415036 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:32.415065 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.313901 (+898836us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54006dc754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:33.313945 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.314095 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430667008}
I20260709 13:09:33.336939 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1288) took 1629 ms. Trace:
W20260709 13:09:33.339526 21532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.069s	sys 0.106s
I20260709 13:09:33.337349 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:33.339845 21532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.069s	sys 0.106s
W20260709 13:09:33.340384 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 556400us
I20260709 13:09:33.341142 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.342530 21485 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:33.344393 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:33.345006 21562 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:33.337459 21492 rpcz_store.cc:276] 0709 13:09:31.707259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.543903 (+836644us) service_pool.cc:224] Handling call
0709 13:09:32.544154 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.554962 (+ 10808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.336637 (+781675us) spinlock_profiling.cc:243] Waited 9.37 ms on lock 0x7b54000b7f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:33.336865 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21551360}
I20260709 13:09:33.347374 21566 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:33.350414 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:33.344154 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:33.353060 21565 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:33.353186 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:33.353952 21563 raft_consensus.cc:2393] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 26: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:33.354988 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.355774 28948 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:33.356050 28887 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:33.353965 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:33.313373 28988 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:09:33.357666 21569 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:33.358834 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.387786 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.388839 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.391326 21493 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 22: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:33.392565 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:33.393460 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:33.335848 29026 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.687s	user 0.013s	sys 0.000s
I20260709 13:09:33.397022 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.398020 29038 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:09:33.287010 28998 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:09:33.392680 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:33.398649 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.334590 28976 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:33.405550 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:33.337610 28830 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.410077 29038 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:33.410907 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.411784 29038 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:33.412647 28830 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:33.413401 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.414341 29038 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:33.357506 28940 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:33.356822 28980 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:33.422624 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.357203 29042 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:33.394528 29053 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.346200 29028 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.429281 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.390049 28988 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:33.426667 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 337077us
I20260709 13:09:33.407593 28997 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:33.501799 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.445525 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.504563 21637 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:33.504683 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.446595 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:33.447950 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.404045 29026 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.511539 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:33.480459 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 51258.5us
I20260709 13:09:33.513325 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.446921 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.514215 21486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:33.449812 21636 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:33.515537 21486 raft_consensus.cc:606] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:33.447400 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:33.513701 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 56993.3us
I20260709 13:09:33.506178 21638 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:33.516433 21640 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:33.521170 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:33.513214 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:33.436401 29053 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.529709 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:33.530402 21569 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:33.531204 29054 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:33.532294 21563 pending_rounds.cc:85] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 8
I20260709 13:09:33.532496 29054 consensus_queue.cc:1059] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:33.533190 28830 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:33.533414 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:33.533892 29054 raft_consensus.cc:3055] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:33.533721 28830 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.534296 29054 raft_consensus.cc:740] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:33.532694 21563 pending_rounds.cc:107] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:09:33.526510 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:33.558563 21563 raft_consensus.cc:2889] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:33.558511 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45359.9us
I20260709 13:09:33.501579 28998 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:33.504309 28940 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:09:33.574676 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.573905 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.562899 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:33.435704 29038 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:33.567543 21643 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
W20260709 13:09:33.570283 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.573635 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:33.560415 29049 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:09:33.570880 28998 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.588376 28998 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:33.577883 28861 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:33.442202 29042 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.587584 21566 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:33.587934 28950 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:33.417510 28996 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.600842 21459 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:33.579875 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:33.524682 28831 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:33.602361 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:33.587685 29049 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:09:33.560133 28975 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:33.572422 28982 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:09:33.566531 28642 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:33.611238 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.630736 21641 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:33.613204 29061 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:33.613968 28950 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.614449 28996 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:33.620321 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 1944) took 1355 ms. Trace:
W20260709 13:09:33.649380 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47106.3us
I20260709 13:09:33.583065 29011 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 13:09:33.627688 28948 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:33.670665 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:33.687192 21485 raft_consensus.cc:2376] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19. Re-sending same reply.
I20260709 13:09:33.671792 28972 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.428377 28980 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.631034 28982 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.596545 28861 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.653438 21564 rpcz_store.cc:276] 0709 13:09:32.265188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.265615 (+   427us) service_pool.cc:224] Handling call
0709 13:09:32.270162 (+  4547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.816047 (+545885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.816095 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.838985 (+ 22890us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.423600 (+584615us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:33.423664 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.423767 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.620035 (+196268us) raft_consensus.cc:1685] finished
0709 13:09:33.620059 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.620219 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150172,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"thread_start_us":1036635,"threads_started":2,"wal-append.queue_time_us":747520}
I20260709 13:09:33.630527 28642 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:33.584026 28988 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.631198 28916 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:33.654173 28884 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:33.624855 28831 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.719780 21642 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:33.718116 28884 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:33.737069 29030 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 13:09:33.714721 28642 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:33.709200 28982 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:09:33.774833 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 193807us
W20260709 13:09:33.775568 21491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.022s	sys 0.036s
I20260709 13:09:33.701272 28948 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:33.778636 21488 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
W20260709 13:09:33.782764 21491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.023s	sys 0.036s
I20260709 13:09:33.659242 29061 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.795217 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:33.627616 29054 consensus_queue.cc:260] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.799429 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:33.779448 28991 consensus_meta.cc:287] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.003s
W20260709 13:09:33.791230 28885 consensus_meta.cc:287] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.002s
W20260709 13:09:33.847572 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 48244.3us
W20260709 13:09:33.848063 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 272123us
I20260709 13:09:33.777155 28884 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:33.851145 22243 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:33.710695 28972 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:33.791352 28938 raft_consensus.cc:2764] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:09:33.859494 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.779953 29053 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:33.790906 28948 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:33.859272 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 296452us
I20260709 13:09:33.865541 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.866238 21636 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
W20260709 13:09:33.866065 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 252218us
I20260709 13:09:33.838323 28830 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:33.839053 29055 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:33.871690 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:33.740530 28916 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.870517 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:33.872030 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.875833 21636 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:33.838620 28789 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:09:33.780380 29030 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.883770 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:33.881970 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.841488 28883 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:09:33.886037 21637 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:33.884356 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:33.853464 28951 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:33.887809 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:33.891626 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:33.891785 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:33.892314 21638 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:33.894454 21457 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:33.877432 28896 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:33.890658 28991 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:33.886168 29026 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:33.937995 21636 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:33.963207 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:33.945336 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45415.4us
I20260709 13:09:33.988531 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:33.904577 29028 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:33.912618 28614 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:33.890842 29053 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:09:33.987514 29011 consensus_queue.cc:1048] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:09:33.979748 29079 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:33.995442 28904 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.046926 28904 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:33.929876 28991 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:34.051293 28991 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:33.929195 29042 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:33.987989 21532 connection.cc:256] RPC call timeout handler was delayed by -1.3664173260001462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:09:34.067080 21532 connection.cc:256] RPC call timeout handler was delayed by -1.2611173260000896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260709 13:09:34.069416 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.070585 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:34.013160 28887 consensus_meta.cc:287] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.626s	user 0.019s	sys 0.010s
I20260709 13:09:34.079299 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:34.076146 21562 raft_consensus.cc:2393] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 13: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:33.989950 28885 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:33.989796 29039 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.085140 21635 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:09:34.085220 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:34.090909 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 185201us
I20260709 13:09:34.091555 21562 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:34.036628 28980 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:34.088987 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:34.091840 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:34.097350 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:34.092022 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:34.098865 21564 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:34.064690 28937 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.038460 28950 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.056674 28614 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:09:34.111095 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.111620 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.095840 21565 raft_consensus.cc:2376] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15. Re-sending same reply.
I20260709 13:09:33.930122 29072 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:34.078940 28830 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:34.111146 28980 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.155714 28980 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:34.159610 29064 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:09:34.086445 29079 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:33.928913 28456 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.166s
I20260709 13:09:34.160476 29079 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:34.146987 29062 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:09:34.127103 28991 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.162775 21639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3919) took 1055 ms. Trace:
I20260709 13:09:34.163200 21639 rpcz_store.cc:276] 0709 13:09:33.107667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.107828 (+   161us) service_pool.cc:224] Handling call
0709 13:09:33.108206 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.108564 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.108591 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.116413 (+  7822us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.627403 (+510990us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:33.627477 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.627576 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.162519 (+534943us) raft_consensus.cc:1685] finished
0709 13:09:34.162541 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.162710 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4521,"thread_start_us":491650,"threads_started":1,"wal-append.queue_time_us":725570}
I20260709 13:09:34.164418 28991 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:34.170076 29035 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:34.158612 28980 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.171680 29038 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:34.172284 29038 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.174393 29038 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.176245 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.100348 29074 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:34.179275 29074 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.181357 29074 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:34.181991 28951 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:34.132052 28972 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:34.114068 28937 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.114262 28614 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:34.135516 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.135790 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:34.137049 28916 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.090682 28887 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:34.141963 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 3922) took 1031 ms. Trace:
I20260709 13:09:34.090301 29069 consensus_queue.cc:1059] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.107s
W20260709 13:09:34.189790 29070 log.cc:927] Time spent T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 13:09:34.220784 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 85062.5us
I20260709 13:09:34.221671 28937 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:34.185026 29028 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:34.213310 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.222114 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.208699 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:34.223565 21569 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:09:34.146435 28998 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:09:34.154654 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.207602 21488 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:34.185534 21494 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:34.222692 29028 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:34.209899 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.225281 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.222944 21485 raft_consensus.cc:1813] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:09:34.182467 21638 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:09:34.104781 28788 consensus_meta.cc:287] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.806s	user 0.015s	sys 0.001s
I20260709 13:09:34.231067 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:34.185298 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 72319.3us
I20260709 13:09:34.227133 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:34.227128 21485 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:09:34.188925 29063 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
W20260709 13:09:34.182528 28996 consensus_meta.cc:287] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 13:09:34.225425 29079 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.236639 21562 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:34.104213 29039 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.182565 28951 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:34.240296 29039 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.240592 28951 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.241724 28951 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:34.241922 29055 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:34.242488 29055 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:34.230135 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.243268 21568 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:34.244194 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.191756 28986 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.232193 21639 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:34.244828 28642 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.245214 28986 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.229013 28998 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.246165 22242 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:34.247196 28861 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:34.247502 28986 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.247844 28998 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.206959 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.185684 28830 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:34.231504 21643 rpcz_store.cc:276] 0709 13:09:33.110385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.120957 (+ 10572us) service_pool.cc:224] Handling call
0709 13:09:33.135823 (+ 14866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.585821 (+449998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.141624 (+555803us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540029f754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:34.141879 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992394624}
I20260709 13:09:34.233379 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:34.249224 28830 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.250027 21638 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:34.235832 21565 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:34.118062 29072 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.253953 29072 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:34.194509 29030 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.247373 29028 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.255223 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.255904 28968 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:34.256695 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:34.256467 28968 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.244828 21568 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:34.258607 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.186146 29061 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:34.200635 21560 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 25: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:34.260079 21490 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:34.259783 21636 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:34.145236 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:34.268951 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.236368 28937 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:34.283914 21568 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:34.202447 29085 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.284245 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.279608 21564 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:34.286691 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.291450 21562 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
W20260709 13:09:34.291937 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 146801us
I20260709 13:09:34.295403 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:34.198863 28904 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.293449 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:34.218298 28885 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:34.298630 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:34.308344 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.309424 21569 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:34.311460 21643 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:34.311551 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:34.317916 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:34.330958 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.331681 21565 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:34.332080 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.262192 28972 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:34.196973 28982 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.283713 28937 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:34.331751 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:34.283643 28923 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.348649 21568 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:34.307227 29005 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:34.291149 28986 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.351704 21565 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 25. Current term is 26. Ops: []
I20260709 13:09:34.354961 21568 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:34.358059 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.359021 21485 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:34.362438 21485 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
W20260709 13:09:34.363926 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.368477 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.370376 21565 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:09:34.329150 28996 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:34.331070 28887 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:34.372032 21565 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:34.372833 21459 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:34.352643 28998 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:34.381839 28998 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.372077 28923 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.381312 28892 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:34.345150 29038 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:34.341557 29033 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.330626 28885 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:09:34.390194 28892 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.403970 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:34.394057 21608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.012s	sys 0.008s
W20260709 13:09:34.407649 21608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.012s	sys 0.008s
I20260709 13:09:34.374977 28996 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:09:34.399718 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 488524us
I20260709 13:09:34.382303 28998 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:34.394207 21568 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:34.307175 29085 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.371101 28991 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:09:34.436988 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:34.407132 28948 consensus_meta.cc:287] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.001s
W20260709 13:09:34.410882 28884 consensus_meta.cc:287] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
W20260709 13:09:34.456449 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.429349 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:34.457726 21485 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
W20260709 13:09:34.482996 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53764.5us
I20260709 13:09:34.483299 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.484068 21485 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:34.484972 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.486308 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.428428 28778 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:09:34.491094 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.492125 29055 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.492751 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.378259 28986 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:34.497071 22212 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.018s	sys 0.010s
I20260709 13:09:34.460445 28923 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.461064 28988 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:09:34.497893 21563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.016s	sys 0.013s
I20260709 13:09:34.411844 28968 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:34.411691 28892 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:34.428016 28996 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:34.473191 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.519804 21488 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:34.411717 29033 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:34.475631 29081 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:09:34.476018 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:34.393179 28861 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.374589 28904 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:09:34.404681 29030 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.403791 29061 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.484447 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:34.476814 29098 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.485719 28975 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:09:34.460210 29085 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.494135 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:34.391010 28997 consensus_queue.cc:1059] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
W20260709 13:09:34.497531 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 508581us
I20260709 13:09:34.465406 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.576885 21490 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
W20260709 13:09:34.505247 21563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.017s	sys 0.013s
I20260709 13:09:34.454842 28940 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.493224 28729 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:34.474545 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.520960 21391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 149) took 7158 ms. Trace:
I20260709 13:09:34.522408 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:34.544947 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 69090.1us
I20260709 13:09:34.581700 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:34.582273 21566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.019s	sys 0.026s
W20260709 13:09:34.582728 21566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.019s	sys 0.026s
I20260709 13:09:34.583963 29093 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:34.550629 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 66272.4us
I20260709 13:09:34.487946 28948 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.487766 28884 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.588590 28884 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:34.589589 21486 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 19: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:34.555097 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:34.591015 21488 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:34.591416 21485 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:34.556777 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.421731 28937 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.594172 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:34.556277 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.597829 21568 raft_consensus.cc:2410] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:09:34.597141 21490 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:09:34.547766 29086 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:34.598680 21608 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:34.602093 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:34.544691 28976 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:09:34.589591 28729 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.611727 29033 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.611485 28998 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.553112 29030 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.595995 28940 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.580189 21391 rpcz_store.cc:276] 0709 13:09:27.356663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.359070 (+  2407us) service_pool.cc:224] Handling call
0709 13:09:27.674232 (+315162us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b54003b1d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4c090 00007f98a9feaf3a 00007f98afda11cc 00007f98afe9f37e 00007f98ae3602a4 00007f98ae360232 00007f98ae360161 00007f98ae3600dc 00007f98ae35f392 00007f98a831d48c 00007f98a831c8c6
0709 13:09:34.514634 (+6840402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:30.650874 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:30.651459 (+   585us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:30.651493 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:09:30.651507 (+    14us) tablet.cc:662] Decoding operations
0709 13:09:30.652542 (+  1035us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:30.652593 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:30.652620 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:09:30.653627 (+  1007us) tablet.cc:701] Row locks acquired
0709 13:09:30.653645 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:09:30.653784 (+   139us) write_op.cc:270] Start()
0709 13:09:30.653908 (+   124us) write_op.cc:276] Timestamp: P: 1783602570653735 usec, L: 0
0709 13:09:30.653931 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:09:30.654602 (+   671us) log.cc:844] Serialized 4910 byte log entry
0709 13:09:30.924539 (+269937us) op_driver.cc:464] REPLICATION: finished
0709 13:09:31.085327 (+160788us) write_op.cc:301] APPLY: starting
0709 13:09:31.103173 (+ 17846us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:31.555424 (+452251us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:31.555575 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:32.344664 (+789089us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:32.407384 (+ 62720us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:09:32.412350 (+  4966us) write_op.cc:312] APPLY: finished
0709 13:09:32.459001 (+ 46651us) log.cc:844] Serialized 113 byte log entry
0709 13:09:32.831077 (+372076us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:32.839389 (+  8312us) write_op.cc:454] Released schema lock
0709 13:09:32.859043 (+ 19654us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:32.981114 (+122071us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:33.005979 (+ 24865us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":144889,"reported_tablets":19,"spinlock_wait_cycles":16729472,"child_traces":[["op",{"apply.queue_time_us":160494,"apply.run_cpu_time_us":94511,"apply.run_wall_time_us":1844058,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":169786,"prepare.run_cpu_time_us":4142,"prepare.run_wall_time_us":57170,"replication_time_us":270425,"thread_start_us":546080,"threads_started":3,"wal-append.queue_time_us":537142,"wal-append.run_cpu_time_us":1348,"wal-append.run_wall_time_us":1040497}]]}
I20260709 13:09:34.618155 29085 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.618696 29003 raft_consensus.cc:3055] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:34.619473 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4489) took 1092 ms. Trace:
I20260709 13:09:34.554629 28642 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:34.621708 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:34.561997 29089 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:34.628167 29093 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:34.643922 21563 rpcz_store.cc:276] 0709 13:09:33.526852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.526973 (+   121us) service_pool.cc:224] Handling call
0709 13:09:33.532009 (+  5036us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:33.846157 (+314148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.846209 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:33.853707 (+  7498us) log.cc:844] Serialized 52 byte log entry
0709 13:09:34.577898 (+724191us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:34.577946 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.578017 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.619246 (+ 41229us) raft_consensus.cc:1685] finished
0709 13:09:34.619268 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.619413 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1251,"raft.queue_time_us":15621,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":957049,"threads_started":2,"wal-append.queue_time_us":738440}
I20260709 13:09:34.631708 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:34.635336 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:34.561841 28951 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:09:34.549775 28861 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.639511 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:34.640851 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:34.642151 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:34.556059 29061 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.642151 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:34.677973 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56339.6us
W20260709 13:09:34.681758 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 420794us
I20260709 13:09:34.705744 22242 raft_consensus.cc:2410] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:09:34.706143 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:34.552500 29055 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:34.548867 29005 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:09:34.680132 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 54232.7us
I20260709 13:09:34.627746 28729 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:34.695241 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 172941us
I20260709 13:09:34.714403 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:34.714560 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:34.716454 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:34.707654 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:34.717831 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:34.561925 29098 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.717661 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:34.711763 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:34.727876 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:34.643734 29003 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:34.683211 29089 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.746524 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:34.633324 28950 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:09:34.702539 28904 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:34.691998 29079 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:34.709710 28982 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.719580 28948 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:34.736202 29035 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:34.770169 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:34.743294 28614 consensus_meta.cc:287] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.000s
I20260709 13:09:34.716982 29075 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:34.676848 29085 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.741319 29074 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:34.753957 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:34.740549 28887 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:34.743943 29039 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:34.751385 29089 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:34.804863 29042 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:34.850342 28937 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:34.807374 29066 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 13:09:34.863384 28940 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.762928 29049 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:34.846863 21489 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:34.864338 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:34.851428 28887 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.853221 28986 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.854246 28831 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:34.828797 29032 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.070s
I20260709 13:09:34.856057 29098 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:34.863765 29069 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.804826 29071 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:34.866209 21490 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:34.770581 28904 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:34.870985 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 117118us
I20260709 13:09:34.901409 28940 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:34.902055 29099 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:09:34.881600 29106 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:34.903229 29106 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:34.904734 29106 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.905874 28729 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.884016 28861 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:34.885003 29030 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:34.885887 29094 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:09:34.882501 29066 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:34.908672 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4486) took 1384 ms. Trace:
I20260709 13:09:34.908689 29066 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:34.909865 29066 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.909204 21567 rpcz_store.cc:276] 0709 13:09:33.523840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.523963 (+   123us) service_pool.cc:224] Handling call
0709 13:09:33.572366 (+ 48403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.908358 (+335992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.908404 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.911579 (+  3175us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.409931 (+498352us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:34.409982 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.410075 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.908375 (+498300us) raft_consensus.cc:1685] finished
0709 13:09:34.908409 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.908596 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14606,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":833261,"threads_started":2,"wal-append.queue_time_us":709794}
I20260709 13:09:34.911011 29069 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.912177 28729 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:34.913270 29069 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:34.829612 29075 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.918995 29054 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:34.925591 28996 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.926061 21494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:34.941962 21494 raft_consensus.cc:606] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:34.942356 21494 raft_consensus.cc:614] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:34.927085 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:34.929672 29072 consensus_meta.cc:287] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.675s	user 0.005s	sys 0.005s
I20260709 13:09:34.929461 21457 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:34.898818 29071 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:34.931187 29005 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:34.931977 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:34.835800 29039 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:34.911418 29066 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:34.963675 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:34.964039 28962 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:34.966378 21634 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 11.
I20260709 13:09:34.827838 28614 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.965874 29071 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:34.975334 29039 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:34.940492 28904 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:34.992292 28975 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:34.992795 28975 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:34.993165 28975 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:34.993244 29071 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.975586 29072 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.000629 22245 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 21: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:34.978235 28982 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:35.000806 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.001180 28982 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.003268 29072 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:35.003271 28982 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:35.013796 29039 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:34.984006 28892 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.095388 29086 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:35.008078 29089 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.056454 21492 raft_consensus.cc:2393] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 26: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:35.099890 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:35.060586 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.062883 21493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.039s	sys 0.050s
W20260709 13:09:35.103302 21493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.040s	sys 0.050s
I20260709 13:09:35.050398 21490 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 29.
I20260709 13:09:35.104121 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:35.091960 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.104650 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:35.105019 22241 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:35.105156 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:35.105662 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:35.105991 21562 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:35.107285 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:35.020259 29028 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:35.022387 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:35.118160 21564 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 22: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:35.125306 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:35.127305 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 105020us
I20260709 13:09:35.050889 29061 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:35.123904 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:35.150858 21376 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.015s
W20260709 13:09:35.151273 21376 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.010s	sys 0.015s
W20260709 13:09:35.094398 29053 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.003s	sys 0.024s
I20260709 13:09:35.145162 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:35.145932 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:35.163432 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:35.107537 28988 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.003s
I20260709 13:09:35.089962 29065 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.171532 29065 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.168864 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:35.180243 28614 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:35.180775 28892 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:35.174484 29065 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:35.191373 29028 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:35.163419 29069 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:35.164244 29033 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.197862 29053 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.003s	sys 0.024s
I20260709 13:09:35.198218 29033 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.200381 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.200733 29033 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:35.201110 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.203029 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.203799 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.206115 22240 raft_consensus.cc:1240] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:35.013823 28975 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.212026 22241 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:35.087347 29072 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
W20260709 13:09:35.223191 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 505557us
I20260709 13:09:35.223270 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.225869 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.207734 29049 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:35.212782 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 45243.2us
I20260709 13:09:35.231138 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.233125 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.235543 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.224526 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:35.249555 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:35.224843 29093 consensus_meta.cc:287] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.004s
I20260709 13:09:35.257385 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.277499 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.280248 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:35.217823 29069 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:35.220142 29035 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:35.234055 29049 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:35.275270 29054 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.274897 29028 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:35.211043 29003 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.283478 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.284210 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.369423 22247 raft_consensus.cc:2368] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
W20260709 13:09:35.288234 29100 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:35.371622 29033 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:35.372241 29033 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.375236 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4490) took 1719 ms. Trace:
I20260709 13:09:35.293499 29069 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.375396 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.375615 21566 rpcz_store.cc:276] 0709 13:09:33.656143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.656303 (+   160us) service_pool.cc:224] Handling call
0709 13:09:33.656752 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.657196 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.657242 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.661833 (+  4591us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.583141 (+921308us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:34.583182 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.583248 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.375002 (+791754us) raft_consensus.cc:1685] finished
0709 13:09:35.375023 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.375167 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5741,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":920925,"threads_started":1,"wal-append.queue_time_us":1483092}
W20260709 13:09:35.377628 29116 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:09:35.283233 28986 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:09:35.302924 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.282728 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:35.328168 21560 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.005s	sys 0.013s
I20260709 13:09:35.286232 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:35.363592 21458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.022s	sys 0.027s
W20260709 13:09:35.382368 21458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.022s	sys 0.027s
W20260709 13:09:35.327764 21606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.009s	sys 0.029s
I20260709 13:09:35.297207 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 3130) took 1186 ms. Trace:
I20260709 13:09:35.308501 22243 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 22: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:35.313853 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:35.398514 21606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.011s	sys 0.031s
W20260709 13:09:35.399077 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 681269us
W20260709 13:09:35.327603 21459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.013s	sys 0.026s
W20260709 13:09:35.401163 21459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.015s	sys 0.027s
I20260709 13:09:35.401580 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:35.378480 28986 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.403395 21485 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:35.407464 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:35.387895 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.408353 21491 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
I20260709 13:09:35.399227 21569 rpcz_store.cc:276] 0709 13:09:34.110587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.330440 (+219853us) service_pool.cc:224] Handling call
0709 13:09:34.350407 (+ 19967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.355768 (+  5361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.355819 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:34.382598 (+ 26779us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.747811 (+365213us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:34.747854 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.747923 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.296993 (+549070us) raft_consensus.cc:1685] finished
0709 13:09:35.297012 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.297149 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15105,"raft.queue_time_us":23401,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":9279,"thread_start_us":294787,"threads_started":1,"wal-append.queue_time_us":815776}
I20260709 13:09:35.410096 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:35.413739 21566 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
W20260709 13:09:35.417742 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49324us
I20260709 13:09:35.374958 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:35.308399 29093 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:35.287554 29051 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:35.444567 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:35.293620 28998 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:35.355451 29042 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:35.425875 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 3124) took 1030 ms. Trace:
I20260709 13:09:35.425989 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:35.318637 29054 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.426868 28940 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:35.427345 29075 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:35.283735 29086 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:35.363384 29005 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.382911 29071 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:35.294243 29049 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:35.438143 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 3125) took 1365 ms. Trace:
I20260709 13:09:35.466976 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:35.430706 29089 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:35.441331 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:35.423012 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.307273 28830 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:35.287461 29059 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.304487 29108 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.443887 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:35.483170 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:35.425321 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:35.485240 21562 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:35.448578 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:35.292263 28975 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:35.452980 21493 rpcz_store.cc:276] 0709 13:09:34.395920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.469858 (+ 73938us) service_pool.cc:224] Handling call
0709 13:09:34.470307 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.481542 (+ 11235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.481594 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:34.493614 (+ 12020us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.103700 (+610086us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:35.103739 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.103806 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.425653 (+321847us) raft_consensus.cc:1685] finished
0709 13:09:35.425681 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.425814 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42507,"raft.queue_time_us":15381,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":5598,"spinlock_wait_cycles":1085312,"thread_start_us":565383,"threads_started":1,"wal-append.queue_time_us":799806}
I20260709 13:09:35.454599 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:35.453171 21567 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:35.487989 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:35.402655 28892 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.484535 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:35.463097 29039 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:35.467080 28962 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.462036 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:35.462743 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:35.441161 28972 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:35.446475 29051 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:35.421754 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:35.467224 21560 rpcz_store.cc:276] 0709 13:09:34.072964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.300084 (+227120us) service_pool.cc:224] Handling call
0709 13:09:34.300544 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.381634 (+ 81090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.381671 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:34.382233 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.760724 (+378491us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:35.381601 (+620877us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.381810 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.437688 (+ 55878us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b5400152054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:35.437741 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.437793 (+    52us) raft_consensus.cc:1685] finished
0709 13:09:35.437892 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.438078 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10010,"prepare.queue_time_us":672022,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":80317,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":17107,"spinlock_wait_cycles":162403584,"thread_start_us":904013,"threads_started":2,"wal-append.queue_time_us":779701}
I20260709 13:09:35.431013 29117 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:35.519435 29117 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.519886 29117 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:35.521047 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.524163 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.525141 21493 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:09:35.502419 29075 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:35.498694 28892 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.528944 28892 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:35.473906 21488 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:35.506757 28972 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:35.531090 28972 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.532122 28972 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:35.532917 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:35.535802 28880 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.361925 28887 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:35.491515 28904 consensus_meta.cc:287] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
I20260709 13:09:35.487679 28991 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:35.509925 21609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.005s	sys 0.009s
W20260709 13:09:35.501920 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 219282us
I20260709 13:09:35.510114 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:35.512591 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 90906.1us
I20260709 13:09:35.513168 29071 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:35.487198 29059 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.493371 28936 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:35.494073 28830 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 20 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:35.467409 28940 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:35.638993 28950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.035s	sys 0.055s
W20260709 13:09:35.645241 28950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.036s	sys 0.055s
I20260709 13:09:35.646917 28940 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:35.510066 28975 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:35.515740 28986 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:35.518898 29051 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:35.649358 29119 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:35.528815 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.457167 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:35.471872 29005 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.653661 29005 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:35.575037 21609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.006s	sys 0.010s
I20260709 13:09:35.583907 21567 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:35.658594 29051 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.661104 29051 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:35.676128 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:35.679196 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:35.681099 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:35.694468 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:35.509328 28962 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.594111 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:35.702622 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.702512 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 108459us
I20260709 13:09:35.602420 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 3122) took 1207 ms. Trace:
I20260709 13:09:35.704522 21492 rpcz_store.cc:276] 0709 13:09:34.395150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.398591 (+  3441us) service_pool.cc:224] Handling call
0709 13:09:35.602140 (+1203549us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54000f4954. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:35.602339 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1492240128}
I20260709 13:09:35.603229 21490 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 25. Current term is 26. Ops: []
W20260709 13:09:35.605911 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 95893.6us
W20260709 13:09:35.618381 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 453162us
I20260709 13:09:35.707114 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:35.709462 29118 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:09:35.710139 29118 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:35.547458 29033 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:35.496097 29108 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.712270 22242 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:35.699263 21634 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:35.591032 29071 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:35.573732 28904 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.713603 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.700331 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:35.715497 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:35.719944 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.572098 28887 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.724876 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.726300 21635 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 21: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:35.726269 21493 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:35.730109 21493 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:35.584300 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:35.735774 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.736923 21493 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:35.739738 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:35.743799 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.745357 28997 raft_consensus.cc:993] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: : Instructing follower 5727b19579474da6a12f79730b924770 to start an election
W20260709 13:09:35.747427 29130 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:09:35.669303 29039 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:09:35.725433 29051 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:35.749125 21564 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:09:35.750095 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:35.751276 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.753144 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.753221 21493 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 25.
I20260709 13:09:35.722307 29071 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:35.756628 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 172404us
I20260709 13:09:35.775955 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:35.770661 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.771039 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.784117 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:35.784775 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:35.785660 21641 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:35.668846 29075 consensus_queue.cc:1059] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
W20260709 13:09:35.791098 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.735071 29005 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:35.754938 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:35.748150 29106 consensus_queue.cc:1059] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:09:35.748612 28996 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:35.785007 21643 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:35.795409 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:35.738363 28940 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:35.788118 21493 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:35.796607 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:35.803445 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:35.814196 21639 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:35.792739 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.815505 21491 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:35.816535 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.780085 29093 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:35.818823 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.820194 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:35.824352 21459 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:35.805639 22245 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 23: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:35.773860 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:35.774575 28975 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:35.779960 29067 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:35.811007 21486 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:35.789453 29066 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.828552 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.836475 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:35.837000 21493 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:35.832347 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:35.802476 28991 raft_consensus.cc:1081] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Signalling peer 5727b19579474da6a12f79730b924770 to start an election
I20260709 13:09:35.844673 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:35.850636 21639 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:35.856667 21641 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
W20260709 13:09:35.867790 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.781562 29051 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.872061 21486 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:35.873342 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:35.811851 29054 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:35.876710 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 102344us
I20260709 13:09:35.878412 21639 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:35.879235 29068 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:35.879835 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:35.880100 29068 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:35.880760 21639 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:35.882093 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:35.883167 21639 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:35.883759 21493 raft_consensus.cc:1240] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 25. Current term is 26. Ops: []
I20260709 13:09:35.828459 29093 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.876358 21561 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:35.888075 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:35.888960 21636 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:35.892483 21643 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:35.831454 28975 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.831704 29087 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:35.882401 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:35.897982 21641 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:35.902163 29075 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:35.844650 29066 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:35.904634 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 58249.7us
W20260709 13:09:35.906167 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 130311us
I20260709 13:09:35.908595 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:35.926182 21488 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:35.829133 29005 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.897001 29131 raft_consensus.cc:3055] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:35.827618 28940 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.941259 21560 raft_consensus.cc:1240] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:35.942037 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 117811us
I20260709 13:09:35.943073 21459 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:35.895516 29093 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:35.944862 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:35.934365 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:35.900274 28975 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:35.946460 21494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.009s
W20260709 13:09:35.947042 21494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.007s	sys 0.009s
I20260709 13:09:35.806207 28830 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.901648 29087 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.880822 29068 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:35.944782 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:35.967950 21457 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:35.813031 29118 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.969482 28789 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:35.934695 21639 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:35.974419 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:35.977890 21639 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:35.961637 21492 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:09:35.982082 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:35.953733 29069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.008s	sys 0.008s
I20260709 13:09:35.937847 29131 raft_consensus.cc:740] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:09:36.022276 21489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.006s	sys 0.021s
W20260709 13:09:36.022862 21489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.006s	sys 0.021s
I20260709 13:09:36.000717 29051 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.003098 28904 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:35.973668 29054 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:09:35.986220 28936 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:09:35.981698 29125 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:36.007844 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:36.025658 29086 consensus_meta.cc:287] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.001s
I20260709 13:09:36.032892 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.033891 29086 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:35.965211 29119 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:09:36.036929 21639 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 25.
I20260709 13:09:36.016101 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:35.922724 29049 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.040045 29049 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:35.920670 29075 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:35.966058 29087 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:36.017814 29069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.008s	sys 0.008s
I20260709 13:09:36.005846 28940 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:35.965739 28950 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.964890 28948 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:35.949476 29059 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.034403 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.016038 29005 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.073184 21636 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:36.051914 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.042657 29075 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:36.062638 21565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.020s	sys 0.047s
W20260709 13:09:36.082095 21565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.021s	sys 0.048s
I20260709 13:09:36.076105 21637 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
W20260709 13:09:36.089843 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 381237us
W20260709 13:09:36.089941 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 73939.6us
I20260709 13:09:36.029484 29035 consensus_queue.cc:1059] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 13:09:36.055474 29108 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.065569 28887 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.059226 28962 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.125382 22245 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:36.135407 21457 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:36.107957 28988 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:36.148109 21637 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:36.075289 28950 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.112838 29086 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.163590 22210 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.021s	sys 0.041s
W20260709 13:09:36.173868 22210 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.021s	sys 0.041s
I20260709 13:09:36.130067 29054 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 26 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:36.172768 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 294835us
I20260709 13:09:36.217780 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:36.168962 28885 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:09:36.240676 29075 raft_consensus.cc:3055] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:09:36.241360 29075 raft_consensus.cc:740] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:36.244240 29139 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:09:36.255533 29144 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:09:36.172329 29086 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:36.261649 29115 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.934s	user 0.001s	sys 0.004s
I20260709 13:09:36.262212 29086 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.110726 29131 consensus_queue.cc:260] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.263497 29131 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:36.267195 28927 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:36.267975 28927 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:36.270299 29117 consensus_meta.cc:287] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.002s
W20260709 13:09:36.279456 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.287055 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 379828us
I20260709 13:09:36.290144 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.272396 28976 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:36.270741 28927 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.236654 29066 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.303207 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.271399 29069 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:36.282125 28885 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.325809 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.321602 29068 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.242489 29075 consensus_queue.cc:260] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.270774 29117 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.333628 28885 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.305354 28976 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:36.333397 28880 consensus_meta.cc:287] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.797s	user 0.009s	sys 0.004s
W20260709 13:09:36.348650 22213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.016s	sys 0.007s
W20260709 13:09:36.353484 22213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.016s	sys 0.007s
I20260709 13:09:36.354563 21487 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:36.324623 28830 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:36.363628 21641 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 13:09:36.363981 21643 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:36.372345 28950 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.353024 29075 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:36.355183 28882 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.375458 28882 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:36.377364 29149 log.cc:927] Time spent T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:36.381515 28885 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.369791 29118 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:36.387070 28976 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.389599 29118 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:36.391494 29148 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:36.322932 29054 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:36.363534 28972 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.831s	user 0.010s	sys 0.006s
I20260709 13:09:36.401819 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4507) took 1839 ms. Trace:
I20260709 13:09:36.400583 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:36.333134 29069 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.405745 21568 rpcz_store.cc:276] 0709 13:09:34.562449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.719963 (+157514us) service_pool.cc:224] Handling call
0709 13:09:34.720959 (+   996us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:35.600645 (+879686us) spinlock_profiling.cc:243] Waited 964 us on lock 0x7b1800257200. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a8292291 00007f98a82ad0ca 00007f98a9fdb4ad 00007f98a9fe1e1b
0709 13:09:35.600815 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.600855 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:35.674844 (+ 73989us) log.cc:844] Serialized 52 byte log entry
0709 13:09:36.175455 (+500611us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:36.175514 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.175594 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.397554 (+221960us) raft_consensus.cc:1685] finished
0709 13:09:36.397576 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.401733 (+  4157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2898,"raft.queue_time_us":119,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":51758,"spinlock_wait_cycles":2252416,"thread_start_us":425713,"threads_started":1,"wal-append.queue_time_us":667846}
I20260709 13:09:36.394304 29118 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:36.408245 29151 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:36.400537 29039 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:36.410220 21642 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 23
W20260709 13:09:36.409623 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.426820 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 277307us
W20260709 13:09:36.439875 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.441795 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.442324 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:36.397773 28830 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.408034 28975 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.421922 29093 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.456648 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:36.447990 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:36.458765 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:36.457051 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:36.459945 21642 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 23.
I20260709 13:09:36.460670 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:36.463922 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.464478 22239 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:36.465090 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:36.463690 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 116036us
I20260709 13:09:36.449721 28972 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:09:36.456211 29160 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:09:36.467765 21606 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.466653 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.485548 21642 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 23.
I20260709 13:09:36.486435 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.486636 21568 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:36.487076 21642 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:36.487912 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:36.488586 21642 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 21: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:36.490105 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:36.490677 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 128794us
I20260709 13:09:36.468636 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:36.472306 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.472746 29131 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:36.491622 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.494637 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:36.495407 21566 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:36.482502 29069 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:36.473224 29066 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.499440 21562 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:36.501279 29176 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:36.473537 21640 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:09:36.475206 28904 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.475008 29087 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.475673 28887 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.503135 28887 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.504325 29087 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.476137 29157 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.505141 29166 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:36.505523 28887 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.505223 29157 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.506165 28887 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:36.506995 21569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a"
dest_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:40994
I20260709 13:09:36.507601 29157 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.507736 21569 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.507884 28830 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.508327 21569 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.508852 28830 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:36.511061 29071 consensus_meta.cc:287] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.719s	user 0.014s	sys 0.000s
I20260709 13:09:36.502771 28904 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.511658 29071 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.513562 28904 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.483362 29117 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.490041 29125 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:36.515125 21638 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:36.515473 29125 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:36.477138 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 254939us
I20260709 13:09:36.497080 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:36.517498 21564 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:36.517562 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.496974 21634 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:36.499189 29066 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.513664 29071 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.483181 21567 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:36.519280 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:36.497059 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:36.515884 29125 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:36.530223 21569 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.473268 29093 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:36.523445 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:09:36.522171 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53620.3us
I20260709 13:09:36.545893 21457 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:36.540670 22210 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.496233 29075 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:36.549006 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.561215 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.565488 29180 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:36.517021 29131 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.536576 28975 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.542485 29087 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:36.572729 21569 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.575639 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.543208 29038 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:36.506711 28887 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.539673 29117 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:09:36.548712 28990 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:36.565140 29071 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:36.558259 29171 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:36.592453 21634 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:36.605264 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.540076 29068 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:09:36.515879 28972 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:36.599821 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.576398 29180 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:36.609586 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.581017 29093 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:36.547721 29158 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:09:36.578347 29087 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:36.607172 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 83796us
I20260709 13:09:36.616997 21642 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
W20260709 13:09:36.617990 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 61591us
I20260709 13:09:36.595244 28990 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.624142 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:36.616325 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.625975 21634 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:36.626976 28990 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:36.615392 29157 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:36.605990 29071 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:36.631204 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:36.598023 29179 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:09:36.633953 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:36.633510 21606 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:36.619983 28975 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.637015 21485 raft_consensus.cc:1240] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:36.617189 29171 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:36.665573 29171 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.670061 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:36.670652 29003 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:36.671413 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:36.673645 29125 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.641741 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:36.638893 29071 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:36.639721 22246 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.689064 29125 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.643666 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:36.690878 22240 raft_consensus.cc:2368] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:36.644012 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:36.691960 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:36.692652 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:36.692961 28830 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:36.647521 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:36.693344 21560 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:36.647634 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:36.648319 21567 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:36.648819 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:36.694543 21489 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:36.637424 29184 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:36.694631 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:36.651995 28887 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.652494 28975 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.695346 29184 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:36.696354 29184 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.697203 28975 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.654749 29028 raft_consensus.cc:3055] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:09:36.699574 29028 raft_consensus.cc:740] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:36.700569 29028 consensus_queue.cc:260] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.702122 29028 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:36.654944 29132 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:36.702997 29132 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:36.704146 29132 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.705688 29132 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.708051 22239 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:09:36.708485 22239 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:36.708693 29142 log.cc:927] Time spent T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.586s	user 0.000s	sys 0.001s
I20260709 13:09:36.709234 22239 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.710215 22239 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:36.712266 29049 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:36.712693 29049 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:36.713570 29049 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.659319 29093 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:36.717283 29093 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:36.717569 29055 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:36.718242 22239 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 18. (term mismatch)
W20260709 13:09:36.718664 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.718305 29093 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.718204 29055 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:36.720533 29165 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:09:36.632750 29157 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:36.721684 29157 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:36.722260 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.675429 29131 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.677039 29085 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.677850 29066 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.680110 28882 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.625875 29087 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:36.680912 22244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 799) took 1480 ms. Trace:
W20260709 13:09:36.691031 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 44158.3us
I20260709 13:09:36.649084 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:36.723749 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:36.742681 22244 rpcz_store.cc:276] 0709 13:09:35.200658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.200799 (+   141us) service_pool.cc:224] Handling call
0709 13:09:36.642660 (+1441861us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540045fbd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:36.680840 (+ 38180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037207808}
I20260709 13:09:36.743367 21489 raft_consensus.cc:2368] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:36.725545 21490 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:09:36.728763 22239 pending_rounds.cc:85] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 17
I20260709 13:09:36.744120 22239 pending_rounds.cc:107] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 28.18
I20260709 13:09:36.732038 29055 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:36.735473 28972 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.740005 28778 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.744491 22239 raft_consensus.cc:2889] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:36.751143 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:36.706475 28990 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.714771 29049 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:36.743057 21565 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:36.747277 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:36.756135 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:36.793147 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 45971.3us
I20260709 13:09:36.793766 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:36.794198 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:36.795679 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44653.9us
I20260709 13:09:36.796749 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:36.801481 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.802994 21638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 3961) took 1106 ms. Trace:
I20260709 13:09:36.803586 21638 rpcz_store.cc:276] 0709 13:09:35.691267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.694133 (+  2866us) service_pool.cc:224] Handling call
0709 13:09:36.797414 (+1103281us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b5400295254. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:36.797540 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885044992}
I20260709 13:09:36.760484 28778 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.807040 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:36.810595 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 176769us
I20260709 13:09:36.812407 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:36.812748 29051 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:36.813413 29051 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.813660 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.813998 29051 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:36.817366 29183 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:09:36.819111 29005 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:36.820377 29005 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:36.820912 29005 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.821374 29005 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:09:36.822257 29175 log.cc:927] Time spent T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.348s	user 0.001s	sys 0.001s
I20260709 13:09:36.823155 29068 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:36.823612 29033 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:36.824774 29033 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:36.824819 28940 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:36.825660 28940 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:36.826474 29177 log.cc:927] Time spent T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.345s	user 0.000s	sys 0.002s
I20260709 13:09:36.828954 28976 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:36.830304 28940 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.825773 29033 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.831921 29033 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:36.831951 21487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41284 (request call id 3109) took 3574 ms (client timeout 1600 ms). Trace:
W20260709 13:09:36.835062 21487 rpcz_store.cc:269] 0709 13:09:33.257951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.258088 (+   137us) service_pool.cc:224] Handling call
0709 13:09:36.831715 (+3573627us) spinlock_profiling.cc:243] Waited 3.1 s on lock 0x7b5400020654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:36.831846 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7119182592}
W20260709 13:09:36.843441 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46821.7us
I20260709 13:09:36.843575 28998 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:36.844303 28998 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.844719 28998 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:36.845466 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:36.847311 29055 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:36.847740 29055 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.847487 28962 consensus_queue.cc:1059] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:36.848112 29055 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:36.799949 29035 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:36.848878 29172 raft_consensus.cc:3055] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:36.848779 29051 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.849401 29172 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:36.759037 28948 consensus_queue.cc:1059] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:09:36.803766 29125 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:36.852015 29120 raft_consensus.cc:3055] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:36.852391 29125 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:36.852563 29138 log.cc:927] Time spent T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.761s	user 0.000s	sys 0.004s
I20260709 13:09:36.852888 29125 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:36.852535 29120 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:36.853307 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:36.803179 29179 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:36.854307 29120 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.855378 21487 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 13:09:36.850337 29172 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.856280 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:36.858511 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 57098.7us
I20260709 13:09:36.859943 21490 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:36.859035 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:36.795708 29075 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:36.861315 29179 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:36.861617 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:36.863521 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:36.869132 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 371992us
I20260709 13:09:36.865157 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:36.872390 22243 raft_consensus.cc:2368] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:36.873433 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:36.873641 21606 leader_election.cc:400] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:36.874284 21606 leader_election.cc:403] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:36.877660 21606 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:36.879866 21490 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:36.880154 29089 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:36.880918 29089 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:36.885406 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:36.892853 21490 raft_consensus.cc:1240] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:36.861618 29121 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:36.842221 29157 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.898746 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:36.872188 29179 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:36.906112 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:36.888289 29172 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.882079 29089 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.888638 29075 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:36.861845 28904 consensus_queue.cc:1059] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:09:36.895236 28975 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:36.897809 29072 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:36.898861 29120 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:36.924062 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.900449 29121 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.929061 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:36.910871 29179 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.921382 29167 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:09:36.934295 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.911397 29086 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:36.937743 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:36.909210 29178 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:36.946979 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:36.919024 29066 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:36.963212 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:36.966004 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.966266 21569 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:36.966734 21606 leader_election.cc:400] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:36.921439 29051 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:36.967136 21606 leader_election.cc:403] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:09:36.925575 29072 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.965567 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:36.967939 21565 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:36.932320 29121 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:36.911239 29071 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.945693 29167 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.987815 29167 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:36.989282 29071 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:36.972788 28729 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:09:36.991029 28729 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:36.991406 28729 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:36.992322 28729 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:36.993546 28729 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:36.998368 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:36.998857 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:36.999230 21488 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:36.940886 29118 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
I20260709 13:09:36.964741 29075 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:09:36.983744 29086 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:37.002089 21637 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:37.002930 21641 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:37.002112 21638 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:37.007454 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.008167 21569 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:36.973827 29066 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:36.970293 29072 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:37.017069 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:37.016628 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.028010 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.031555 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:36.968221 29035 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:36.930488 28975 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.033208 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.034531 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:37.039618 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:36.939641 28927 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
W20260709 13:09:37.042681 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.045866 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 290112us
I20260709 13:09:37.068250 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.070374 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.070207 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.071323 21639 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:37.073432 21639 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:36.972505 29176 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.075s
I20260709 13:09:37.086560 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:37.087641 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.092064 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.033042 29053 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:37.016602 29162 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:09:37.038208 29035 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:37.096647 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.100693 21488 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 25: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:36.998701 28998 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.129522 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.130400 21491 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:37.132174 21565 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:37.043942 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.134143 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.134541 21635 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:37.135046 21569 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:37.138758 21569 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:37.141520 21641 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:37.142463 21634 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:37.103062 29035 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:37.151254 21459 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:37.153748 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.155354 21634 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 24: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:37.161742 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.163205 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.165343 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:37.187004 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.196002 28778 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.202739 21488 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:09:37.214546 29186 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:09:37.214427 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:37.215724 21488 raft_consensus.cc:2368] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
W20260709 13:09:37.216495 29187 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:09:37.226929 29157 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:37.229590 29184 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:37.230314 29184 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.231262 29066 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.234798 29184 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:37.236490 21488 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:37.236666 29179 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.243341 28927 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:37.244149 28927 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.247798 28975 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.143105 28991 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.248833 28991 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.141538 29039 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.251123 29039 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:37.256271 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.255211 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 91135.2us
I20260709 13:09:37.200664 21392 catalog_manager.cc:5697] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 17 to 20, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 20 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.299952 21392 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 15 to 16, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 16 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.301707 21392 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 21 to 22, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 22 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:37.313825 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.316170 21392 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 23, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 23 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:37.298753 21459 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:37.147038 29054 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:09:37.328066 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44156.2us
I20260709 13:09:37.319756 21392 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:37.143811 28990 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.103307 29053 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.328411 21459 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:37.257700 29028 consensus_meta.cc:287] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.006s
I20260709 13:09:37.262903 29042 raft_consensus.cc:3055] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 25 LEADER]: Stepping down as leader of term 25
W20260709 13:09:37.340271 28976 consensus_meta.cc:287] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.016s
I20260709 13:09:37.193022 29085 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:37.323807 29066 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.251255 28778 consensus_queue.cc:1059] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 13:09:37.323925 29176 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:37.380637 29176 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.382086 29182 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:37.382536 29182 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:37.383373 29182 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.384387 29182 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:37.331198 21392 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:37.335770 29171 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:37.387315 29171 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.360260 21637 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 27.
I20260709 13:09:37.388325 29039 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:37.387753 21392 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 21, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 21 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:37.310545 29179 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:37.288605 29121 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:37.387336 29055 consensus_meta.cc:287] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 13:09:37.389581 29055 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.324469 29005 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.391285 29168 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:09:37.391731 29168 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:37.387756 29171 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:37.393019 29087 consensus_meta.cc:287] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.002s
I20260709 13:09:37.392771 29168 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.393913 29168 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:37.395097 21491 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:09:37.350594 28991 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.379606 29180 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:37.399147 29180 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:37.400141 29180 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.353299 29042 raft_consensus.cc:740] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:37.401686 29053 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:37.402631 21492 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:37.403158 28998 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.402869 29042 consensus_queue.cc:260] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.391342 29121 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.379522 29066 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.374460 28927 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.391834 29055 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.259496 29125 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.393103 29005 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.411319 29087 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.414191 29125 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.332430 29054 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.408659 21392 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 17 to 19, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 19 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.409965 21490 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 20. Current term is 21. Ops: []
W20260709 13:09:37.370548 29049 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.566s	user 0.022s	sys 0.000s
I20260709 13:09:37.412124 28880 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:37.421684 21392 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 16 to 20, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 20 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.375082 29085 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.436844 21392 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 18 to 20, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 20 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:37.437824 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.441645 21489 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:37.410910 29086 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
W20260709 13:09:37.441505 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 476717us
W20260709 13:09:37.446199 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.425835 29042 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:37.452672 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:37.456084 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:37.457150 22240 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 23: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:09:37.458647 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.440857 29085 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:37.424842 29176 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.465502 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:37.443867 28880 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:37.470803 21606 leader_election.cc:400] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
W20260709 13:09:37.471726 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.454561 29156 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:37.474972 21641 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:37.475522 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:37.464391 29159 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:09:37.479635 29066 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.479933 29159 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:09:37.480436 29159 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:37.481472 29159 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.483043 29159 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:37.491257 29087 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:37.474905 29167 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.492679 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.494032 29086 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.494127 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:37.494874 21641 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:37.494663 29086 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:37.490592 22210 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.515s (SENT) [suppressed 10 similar messages]
I20260709 13:09:37.497553 29086 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:37.467370 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 316587us
I20260709 13:09:37.500862 29066 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.501420 29066 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.504117 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:37.505362 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.506094 21569 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:37.505422 21565 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:09:37.508953 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 180616us
I20260709 13:09:37.510975 21561 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:37.512935 21569 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:37.513247 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:37.514313 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.515537 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:37.516664 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.517167 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:37.518349 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.509682 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:37.518702 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:37.520275 22238 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:37.520349 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:37.522053 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.523166 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.524112 21569 raft_consensus.cc:2368] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
W20260709 13:09:37.525573 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.526755 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:37.527737 21565 raft_consensus.cc:2368] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17.
I20260709 13:09:37.530359 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:37.532334 21565 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:37.522190 29167 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.536996 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:37.537463 22239 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:37.539996 21569 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:37.541332 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:37.543005 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.544001 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:37.522588 29132 consensus_meta.cc:287] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.813s	user 0.020s	sys 0.010s
I20260709 13:09:37.564864 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.565480 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:37.566108 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:37.544860 21569 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:37.572969 21569 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:09:37.570325 21561 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:37.508867 29066 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.585808 21487 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:37.564440 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.567801 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.586988 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.587038 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:37.587790 21562 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:37.587218 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:37.587752 21561 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:37.576818 21635 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:37.581558 21563 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:37.588896 21562 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:37.589255 21637 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 23.
I20260709 13:09:37.531862 29087 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:37.595046 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.595834 21563 raft_consensus.cc:2393] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:37.596058 21568 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:37.597435 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.599929 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:37.600850 21567 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 26: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:37.604144 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:37.604979 21568 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:37.599993 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.607035 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:37.607779 21566 raft_consensus.cc:2368] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:37.508526 29156 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.610818 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.562902 28976 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:37.613418 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.536829 28962 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:09:37.624567 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:37.631620 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.622759 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:37.613446 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:37.622269 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:37.634296 21562 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:37.594069 29087 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.539223 29089 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:09:37.638127 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.660446 21492 raft_consensus.cc:2393] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 19: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:37.660732 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:37.642979 21485 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:37.661428 21560 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
W20260709 13:09:37.647558 29201 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:09:37.648699 29208 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:09:37.652814 29072 consensus_meta.cc:287] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.616s	user 0.012s	sys 0.000s
I20260709 13:09:37.622344 29132 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:37.656411 29156 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.658672 29035 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.658999 28948 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:37.671768 21562 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:37.671962 21561 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:37.673642 21568 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:37.715114 29035 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:37.724094 21640 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:37.728128 22238 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
W20260709 13:09:37.707981 29152 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:37.700408 29066 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:37.663220 28729 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.003s
I20260709 13:09:37.701767 29208 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.660281 29087 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:37.593394 28880 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.639605 28976 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.728615 29054 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.708833 29085 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.711943 29072 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:37.733853 29066 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:37.737560 29208 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:37.721014 29132 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:37.804826 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 474461us
I20260709 13:09:37.663955 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.808435 21492 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 27: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:37.662537 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 49214.3us
I20260709 13:09:37.819684 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:37.821643 21485 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 19: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:37.822086 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:09:37.826495 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.737753 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 247181us
I20260709 13:09:37.828137 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:37.829962 21486 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:37.833806 29042 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:37.750977 29066 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:37.845570 28976 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:37.845778 21562 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:37.848873 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.851164 29085 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:37.852728 22245 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:09:37.853631 29072 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:37.855656 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.834527 29042 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:09:37.870774 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 240074us
W20260709 13:09:37.874352 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.875411 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.868816 29042 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:37.877526 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:37.892655 29132 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:37.895635 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:37.902029 29072 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:37.909842 28937 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:37.911286 28937 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:37.920132 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.921674 28882 raft_consensus.cc:3055] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:37.922478 28882 raft_consensus.cc:740] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:37.924252 28882 consensus_queue.cc:260] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:37.926177 28882 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:37.926643 29120 consensus_meta.cc:287] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.997s	user 0.016s	sys 0.002s
W20260709 13:09:37.930796 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.931026 21493 raft_consensus.cc:2410] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:09:37.894572 29182 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.001s
W20260709 13:09:37.944542 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.944720 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53783.6us
I20260709 13:09:37.918260 28937 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:37.955699 21490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1315) took 1058 ms. Trace:
I20260709 13:09:37.956283 21490 rpcz_store.cc:276] 0709 13:09:36.896789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.897065 (+   276us) service_pool.cc:224] Handling call
0709 13:09:36.897616 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.420476 (+522860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.955071 (+534595us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54000b7554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:37.955452 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177871744}
I20260709 13:09:37.978156 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 1308) took 1123 ms. Trace:
W20260709 13:09:37.963766 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 81964.3us
I20260709 13:09:37.978842 21489 rpcz_store.cc:276] 0709 13:09:36.854935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.861297 (+  6362us) service_pool.cc:224] Handling call
0709 13:09:37.950290 (+1088993us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54002c9f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:37.977858 (+ 27568us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268955008}
W20260709 13:09:37.998869 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.999615 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.000656 28882 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.001415 28882 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:38.005417 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 186942us
I20260709 13:09:38.016052 28882 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.009992 29132 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:38.025478 29049 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:38.026448 29049 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.028805 29178 consensus_queue.cc:1059] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:38.030272 29178 raft_consensus.cc:3055] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:38.018340 29132 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.030741 29178 raft_consensus.cc:740] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:38.056723 29132 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.058030 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:38.064071 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.064460 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 2505) took 1066 ms. Trace:
I20260709 13:09:38.064975 21493 rpcz_store.cc:276] 0709 13:09:36.998250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.998538 (+   288us) service_pool.cc:224] Handling call
0709 13:09:38.064125 (+1065587us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b540008a554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:38.064386 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140763008}
I20260709 13:09:38.069068 22240 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:38.079769 21488 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
W20260709 13:09:38.080577 29215 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.322s	user 0.001s	sys 0.001s
I20260709 13:09:38.081116 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:38.084013 28880 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:38.082525 21459 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:38.078419 29210 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.320s	user 0.002s	sys 0.000s
I20260709 13:09:38.084643 28880 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:38.067451 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:38.086591 29207 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.089381 29207 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.084385 29066 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.099546 21562 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:38.111724 28990 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:38.112740 29220 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:38.106843 29085 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.116102 28882 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.119200 28882 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.121461 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:38.121646 28882 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.115443 29120 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:38.116349 28880 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:38.125648 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 87722.5us
I20260709 13:09:38.124560 29120 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:38.122308 21635 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:38.128949 29132 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:38.129637 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:38.133939 29180 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:38.129231 29178 consensus_queue.cc:260] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.149530 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:38.149909 29178 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:38.150468 21641 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:38.152002 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:38.152072 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:38.153148 21643 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:38.147807 29085 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.131798 29035 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:38.155313 29035 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.156149 29085 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.156366 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:38.157022 21459 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:38.157928 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 43906.1us
I20260709 13:09:38.160861 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.162775 29085 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:09:38.163534 29085 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 27 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:38.131973 29120 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.136656 29207 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.137284 28990 raft_consensus.cc:2764] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:09:38.138978 21606 leader_election.cc:400] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:38.166965 21606 leader_election.cc:403] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:09:38.143165 21560 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 10 to 13, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:38.145974 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:38.148238 29171 consensus_meta.cc:287] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.755s	user 0.019s	sys 0.001s
I20260709 13:09:38.141072 29182 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 10 to 13, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:38.148543 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:38.169421 21637 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:38.172712 21635 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 23: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:38.172212 29171 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.175302 21494 raft_consensus.cc:2393] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:38.176738 28937 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.178018 29035 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:38.178179 28937 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:38.179111 29171 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.179574 28990 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.180285 28990 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.180681 29087 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.164671 29066 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.184974 28990 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:38.187156 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:38.195693 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 57032.5us
I20260709 13:09:38.197322 29132 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:38.199364 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:38.199471 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:38.200433 22243 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:38.199754 29087 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.200573 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:38.201619 22240 raft_consensus.cc:2368] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:38.201797 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:38.204293 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 164743us
I20260709 13:09:38.205544 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:38.206532 29066 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:38.207376 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 85059.3us
I20260709 13:09:38.209836 21643 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:38.216257 29049 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.218174 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:38.224033 21486 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
W20260709 13:09:38.216289 29213 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.459s	user 0.004s	sys 0.000s
I20260709 13:09:38.230811 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:38.231370 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:38.241971 29178 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:38.243340 29178 raft_consensus.cc:3055] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:38.243813 29178 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:38.230892 29214 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.474s	user 0.002s	sys 0.000s
I20260709 13:09:38.247491 29178 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.248986 29178 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:38.253309 29132 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.254225 29132 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.193553 29042 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.270639 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:38.167484 29085 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.289774 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:38.290843 22238 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:38.267912 29049 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:38.293737 22245 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:38.197340 29208 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.296828 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:38.313759 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:38.316082 21643 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:38.318814 21565 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:38.298384 29049 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:38.324138 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:38.325109 21640 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:09:38.325737 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.322960 29049 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:38.359448 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:38.366496 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 159343us
I20260709 13:09:38.368856 29221 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:38.370880 29066 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:38.376677 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:38.377681 21637 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 23: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:38.379321 21635 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:09:38.382529 21637 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:38.385628 21643 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:38.405426 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:38.406056 29225 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:38.406208 21568 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.406976 29087 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.407713 29087 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.411026 21635 raft_consensus.cc:1240] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:09:38.411237 29171 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:38.412297 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:38.412024 29171 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.412935 21634 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:38.414454 29171 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.415383 29087 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.421121 21568 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:38.421252 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:38.449822 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.452919 21637 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.422457 29132 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:38.423656 29208 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.425581 21634 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:09:38.427879 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.365163 29120 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.434492 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:38.436906 28990 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:38.456905 29120 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.458097 28990 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:38.458503 28990 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:38.438767 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.439628 29042 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.439831 22244 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:38.441120 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:38.449772 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:38.475371 21640 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:38.477650 22238 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:38.481947 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:38.477810 29087 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.491034 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.494208 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.482751 28937 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:38.492712 21641 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:38.493494 21565 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:38.497073 28937 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.503125 29176 consensus_queue.cc:1059] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:38.503536 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:38.504802 28998 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:38.505785 29207 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.506162 28882 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:38.506392 29207 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.502624 29132 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:38.506944 28882 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.507296 28990 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.507764 29132 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.510116 28882 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.510205 29132 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:38.505453 28998 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.482153 29171 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:38.506968 28880 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.511336 29171 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.511785 28880 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.512560 28998 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.506299 29072 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:38.514178 28880 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.514020 29132 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:38.514405 29171 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.520934 21640 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:38.523159 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:38.525838 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.526568 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.518467 29176 consensus_queue.cc:1175] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a87bd86b86e74aa8bb61189215b73439" responder_term: 21 status { last_received { term: 21 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 21 index: 14 } }
I20260709 13:09:38.528304 28937 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:38.497818 29035 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:38.533264 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.500416 29120 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.537880 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.539482 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:38.520465 29228 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.534432 29182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52948 (request call id 0) took 1906 ms. Trace:
I20260709 13:09:38.498664 29087 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.548933 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:38.556198 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 190681us
W20260709 13:09:38.556330 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 51011.7us
W20260709 13:09:38.557878 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.567307 21568 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:38.574007 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:38.548012 29042 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.579447 21565 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:38.579838 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:38.594213 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.548297 29182 rpcz_store.cc:276] 0709 13:09:36.612747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.613071 (+   324us) service_pool.cc:224] Handling call
0709 13:09:36.689906 (+ 76835us) log.cc:844] Serialized 508 byte log entry
0709 13:09:38.492705 (+1802799us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71376,"raft.queue_time_us":80490,"raft.run_cpu_time_us":2136,"raft.run_wall_time_us":223906,"thread_start_us":355089,"threads_started":1,"wal-append.queue_time_us":541982,"wal-append.run_cpu_time_us":2197,"wal-append.run_wall_time_us":1010364}
I20260709 13:09:38.604738 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.606146 29042 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.585353 29035 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.607700 21494 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:38.609824 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.610397 29240 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:38.610922 21634 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.618830 21459 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:38.611302 21563 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:38.623111 21560 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
W20260709 13:09:38.624706 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 121324us
I20260709 13:09:38.611670 29233 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:38.611915 29087 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.614071 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:38.573591 29221 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:09:38.568918 29228 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.615118 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:38.617689 29229 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:09:38.608045 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.620816 21637 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:38.627013 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.628095 21568 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:38.633873 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:38.626386 29233 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:38.638410 29208 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:38.639125 29208 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:38.639415 29233 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.640729 29233 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:38.640273 29208 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.638695 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.642362 21566 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 22: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:38.643204 21567 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:38.638441 21488 raft_consensus.cc:2393] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:38.645493 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.649763 29182 raft_consensus.cc:3055] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:38.650187 29182 raft_consensus.cc:740] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:38.651326 29226 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:09:38.651398 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.652017 29035 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:38.652215 21493 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:09:38.661803 29207 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.637447 28990 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:38.663015 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:38.665256 29228 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:38.655300 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:38.672096 21563 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:38.623865 29240 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.679505 29132 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:38.680246 29132 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.681360 29240 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:38.682288 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 67313.6us
I20260709 13:09:38.678960 29120 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:09:38.667075 29221 raft_consensus.cc:2764] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:09:38.668475 29182 consensus_queue.cc:260] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.682747 29132 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:38.688432 29132 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.689054 29132 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.695135 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:38.696388 29066 raft_consensus.cc:2764] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:09:38.697091 29066 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:09:38.699865 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:38.700759 29066 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:38.700901 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:38.701236 29066 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:38.683300 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:38.702836 29240 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:38.703332 29132 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.683353 29120 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.705360 29120 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:09:38.684756 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 49762.2us
I20260709 13:09:38.686404 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:38.702123 29066 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:38.686293 29182 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:38.711520 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:38.712229 21640 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
I20260709 13:09:38.713122 21606 leader_election.cc:400] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23.
I20260709 13:09:38.714160 29233 raft_consensus.cc:2764] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:09:38.686453 29207 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:38.714430 21606 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:38.715794 29233 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:38.716665 28990 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:38.717003 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:38.717105 28990 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:38.717849 28990 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:38.684949 29228 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:38.719075 29196 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:38.719620 29196 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:38.719769 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.720368 29221 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:38.720824 29221 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:38.720670 29196 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.721239 29221 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.723207 29239 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:38.724705 29178 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:38.725081 29178 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:38.726007 29178 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.727058 29049 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.730270 29049 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.671057 21561 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:38.704562 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:38.734920 21565 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:38.739362 29207 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:38.741248 21634 raft_consensus.cc:2468] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:38.684736 29042 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:38.748667 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 44190.3us
I20260709 13:09:38.749604 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:38.752003 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:38.753249 28882 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:38.753669 28882 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:38.754042 28882 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:38.756319 29087 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:38.756789 29087 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:38.757174 29087 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:38.759661 29207 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:38.762238 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.762974 21493 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:38.764533 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:38.765254 21489 raft_consensus.cc:1240] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 25. Current term is 26. Ops: []
I20260709 13:09:38.765312 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:38.765980 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.766373 21490 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 26: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:38.767127 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:38.767195 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:38.768097 21634 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:38.767324 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.765333 21640 raft_consensus.cc:2393] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 26: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:38.771251 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:38.777187 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:38.726682 28990 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.784874 22239 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:38.780055 21459 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:38.790660 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:38.791658 21634 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 26.
I20260709 13:09:38.790992 21493 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:38.797887 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.798636 21491 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:38.789793 22210 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:09:38.804651 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.806483 29207 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:38.806982 29207 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.807340 29207 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:38.803803 21459 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:38.816638 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.817432 21493 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:38.818488 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.818948 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:38.819631 21634 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:38.818495 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:38.819769 21487 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:38.823367 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.825716 21487 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:38.826314 29233 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:38.826843 29233 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:38.827234 29233 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:38.826313 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:38.832037 29228 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:38.833303 29228 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:38.834746 29132 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:38.835983 29228 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:38.836390 29228 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:38.826333 29240 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:38.837496 29240 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:38.837342 29228 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.838819 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:38.838641 29240 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.844026 29228 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.814283 29178 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.844172 28990 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.871438 28990 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.872134 28990 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.852587 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:38.875769 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.876749 21565 raft_consensus.cc:2410] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:09:38.877545 29228 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:38.877710 29132 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:38.852622 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:38.878964 21493 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.859915 29233 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:38.885288 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 108680us
I20260709 13:09:38.886103 22210 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:38.879565 29228 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.883102 29182 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:38.892334 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.892383 29196 raft_consensus.cc:2804] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:38.894029 29228 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.894881 29196 raft_consensus.cc:697] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:38.888641 28990 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:38.895898 29196 consensus_queue.cc:237] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.896907 29228 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:38.900585 29087 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.901786 21486 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23. Ops: []
W20260709 13:09:38.905431 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.907598 29233 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:38.908386 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:38.908633 21487 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:09:38.915640 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:38.918849 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:38.925069 21634 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:38.919678 28880 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:38.927815 29042 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.928635 28880 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:38.928483 29042 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.929752 28880 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.931020 29042 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.931007 29233 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:38.937736 21459 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:38.942119 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.945297 29208 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.945936 29208 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:38.948397 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.950429 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.916186 29182 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 24 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:38.954295 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.903155 29120 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:38.960035 21565 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:38.960636 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.960683 21376 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6fad88e2e67d44f7adb559c0a8eb0af8 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:38.961647 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.961396 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:38.970382 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:38.968750 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:38.964450 21567 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:38.972640 21486 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:38.951447 29208 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:38.973886 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:38.967911 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.974606 22239 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:38.974993 21488 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:09:38.966836 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:38.976589 21491 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:38.962350 29171 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:38.978394 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:38.932102 28882 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.003348 21640 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:38.981159 21637 raft_consensus.cc:1240] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:09:38.983866 21634 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:38.977818 21561 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:39.006359 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:39.007097 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.007462 21567 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:09:39.008011 21635 raft_consensus.cc:2410] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:09:39.008620 29171 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:39.008817 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:39.009413 21643 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:39.010008 29120 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:39.009672 29171 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.011042 29182 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:38.981339 29244 log.cc:927] Time spent T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:09:39.021270 21643 raft_consensus.cc:2468] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
W20260709 13:09:39.023833 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.966094 29178 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:39.032580 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.032902 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.033442 22239 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 13: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:39.042966 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:39.043818 21638 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:39.046499 29208 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.047205 29208 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.048270 29087 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:39.049410 29208 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:39.049530 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:39.050213 29178 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.050498 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:39.050992 29217 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:39.050081 29208 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:39.052268 21486 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:39.052371 29178 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:39.052525 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:39.051445 29217 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.053280 21565 raft_consensus.cc:2393] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:39.053189 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:39.053611 29217 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:39.044986 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.043237 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.053373 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:39.056697 21493 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:39.056958 22244 raft_consensus.cc:1813] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Handling vote request from an unknown peer 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:39.053246 21561 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:09:39.050583 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:39.072522 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:39.073287 21643 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:39.074035 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:39.075281 21634 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:39.078430 21637 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:39.076530 22244 raft_consensus.cc:2410] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:39.044974 21388 catalog_manager.cc:5697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 24 to 26, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 26 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:39.086587 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.089468 29232 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.090202 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.091586 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.089293 29087 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:39.097043 21569 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:39.092999 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.098498 21643 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:39.084432 28998 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:39.105938 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:39.108309 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.109354 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.110040 21643 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:09:39.111321 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.115015 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:39.119378 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.074766 29221 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.120335 22245 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:39.076725 29066 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.124804 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.104032 29132 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.106518 28998 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.090147 29232 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.130734 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.130051 21564 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 14.
I20260709 13:09:39.133792 21563 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:09:39.134184 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.133917 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:39.133245 21643 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:39.136240 21639 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:39.136313 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.136987 21637 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:39.137311 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.122601 29240 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:39.134594 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:39.140583 21634 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:39.143505 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.132735 28998 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:39.144374 21638 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:39.146950 29231 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:39.147460 29231 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:39.147868 29231 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:39.148751 21563 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 28.
I20260709 13:09:39.150656 28990 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:39.151856 28990 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:39.152243 28990 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:39.152645 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:39.153901 21641 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:09:39.154291 21641 pending_rounds.cc:85] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 11
I20260709 13:09:39.139058 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.124177 29196 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.154505 21641 pending_rounds.cc:107] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:09:39.123046 29207 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.163529 21641 raft_consensus.cc:2889] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.165211 29207 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:39.165395 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:39.134987 29208 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:09:39.167243 29208 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:39.167683 29208 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:39.168066 29208 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:39.168370 28998 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.173694 22245 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
W20260709 13:09:39.180179 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.186373 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56024.9us
W20260709 13:09:39.188741 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.191174 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.194048 28998 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:39.191828 22245 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:39.203962 29121 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:39.205940 29121 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.208171 29121 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:39.208469 29240 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:39.181952 29132 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.216966 29132 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:39.217687 21640 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 25: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:39.218906 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:39.153172 28990 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.223560 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:39.224239 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.228369 29042 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.228569 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:39.229089 29042 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:39.229887 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.232349 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:39.223680 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:39.233016 21640 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:39.229499 21459 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:39.238442 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.238996 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:39.239372 22239 raft_consensus.cc:2368] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20.
I20260709 13:09:39.239672 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:39.241750 21491 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:39.209092 29240 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:39.241932 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:39.252174 21569 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:39.254153 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:39.254204 21643 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:09:39.254897 21487 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:39.257542 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:39.258337 21561 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:39.256289 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:39.266665 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:39.267977 22239 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:39.270377 29066 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:39.247783 28882 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:39.273255 21636 raft_consensus.cc:1240] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:09:39.241191 28998 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:39.274859 29253 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:39.275043 28998 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.275465 28998 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:39.276288 29221 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:39.280840 21635 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:39.190354 29196 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:39.318607 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 116506us
I20260709 13:09:39.287118 21388 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 21 to 22, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 22 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.320942 21639 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:09:39.251962 29121 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:09:39.353964 29049 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.354660 29049 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.356968 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:39.322899 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:39.358412 21637 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:39.334028 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:39.363322 29132 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:39.365852 29066 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:39.366377 29066 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:39.366974 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49279.8us
I20260709 13:09:39.375458 29121 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:39.387559 29121 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:39.408586 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.399567 22244 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:39.366755 29066 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:39.437474 21562 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:39.453909 29085 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:39.413453 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:39.386300 29260 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:39.471447 21640 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
W20260709 13:09:39.481781 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 315029us
I20260709 13:09:39.484321 21564 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:09:39.486195 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 100008us
I20260709 13:09:39.388340 21388 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 10 to 11, term changed from 13 to 16, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to <none>, VOTER 5727b19579474da6a12f79730b924770 (127.19.231.130) evicted. New cstate: current_term: 16 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:39.482453 28937 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:39.501682 21567 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:39.498732 22245 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 12.
W20260709 13:09:39.504166 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 91355.6us
I20260709 13:09:39.506465 22246 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:39.501793 21566 raft_consensus.cc:3055] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:39.509155 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 356626us
I20260709 13:09:39.507633 21566 raft_consensus.cc:740] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:39.511121 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:39.507337 29239 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 13:09:39.513214 21388 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 23 to 25, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 25 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:39.509177 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 152344us
I20260709 13:09:39.480435 29042 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:39.521798 22210 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:39.524118 28937 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:39.498898 28990 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:39.524641 28937 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.529614 28937 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:39.515697 29171 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:09:39.539310 21566 consensus_queue.cc:260] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.540514 21566 raft_consensus.cc:3060] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:39.541422 29263 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:09:39.542146 28937 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.550921 29049 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:39.553983 29231 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.554164 28998 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.565448 21491 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
W20260709 13:09:39.566061 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44415.2us
I20260709 13:09:39.563457 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:39.569911 29265 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:09:39.571081 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 60036us
I20260709 13:09:39.564090 28937 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:39.572189 29259 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:09:39.572548 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.574856 29260 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:39.575794 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:39.576509 29232 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:39.577596 21569 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:39.576416 29208 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:39.581103 29267 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:09:39.529230 28882 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:39.505748 29066 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.563355 29085 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:09:39.586952 21564 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:09:39.588855 29217 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.535s	user 0.002s	sys 0.016s
I20260709 13:09:39.590847 28998 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:39.607757 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44046.8us
I20260709 13:09:39.607831 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:39.621326 21388 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 22 to 24, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 24 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.609284 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:39.611003 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:39.619835 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44157.2us
I20260709 13:09:39.629491 21568 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:39.601531 29233 consensus_queue.cc:1059] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:09:39.635545 21566 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:09:39.636168 21566 pending_rounds.cc:85] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 10
I20260709 13:09:39.636464 21566 pending_rounds.cc:107] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:09:39.636775 21566 raft_consensus.cc:2889] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.610330 29120 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:09:39.641680 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:39.640370 21388 catalog_manager.cc:5697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:09:39.645136 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.649827 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.651417 29254 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.372s	user 0.002s	sys 0.000s
I20260709 13:09:39.651233 29239 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:09:39.653525 21637 raft_consensus.cc:1275] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:39.651297 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:39.657400 21642 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:09:39.658571 21638 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:09:39.629433 29232 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:39.631223 28998 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:39.644254 21388 catalog_manager.cc:5697] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:39.613000 29207 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:09:39.674746 29066 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:39.679886 29208 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:39.683611 29232 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:39.701861 29232 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.665946 21564 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:39.704661 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:39.705930 28990 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:39.707195 29260 raft_consensus.cc:3055] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:39.707690 29260 raft_consensus.cc:740] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:39.710856 29260 consensus_queue.cc:260] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.712324 29260 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:39.687418 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 59442us
I20260709 13:09:39.714336 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:39.714893 28990 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:39.716033 28990 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.716531 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:39.690376 29231 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:39.695160 28998 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:39.718887 28998 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:39.719413 21392 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 242) took 11695 ms (client timeout 15000 ms). Trace:
I20260709 13:09:39.696247 21491 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:09:39.669768 29239 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:09:39.724771 22239 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:09:39.725874 29049 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:39.669284 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:39.697101 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:39.729750 21561 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:39.666612 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:39.670849 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:39.621483 29217 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.731256 21493 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:39.732718 29217 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:39.642127 28937 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:39.668764 29196 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:39.735872 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.736732 29042 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:39.737174 29270 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:39.738068 21388 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 19 to 21, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 21 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:39.739161 29231 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:39.739578 29231 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.739957 29231 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:39.743551 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:39.744447 29066 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:39.751705 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:39.752377 21491 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
I20260709 13:09:39.755918 21493 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
W20260709 13:09:39.719810 21392 rpcz_store.cc:269] 0709 13:09:28.023807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.037619 (+ 13812us) service_pool.cc:224] Handling call
0709 13:09:39.719192 (+11681573us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:37.763520 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:37.764217 (+   697us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:37.883362 (+119145us) write_op.cc:435] Acquired schema lock
0709 13:09:37.895455 (+ 12093us) tablet.cc:662] Decoding operations
0709 13:09:37.897467 (+  2012us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:37.897624 (+   157us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:37.897687 (+    63us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:09:37.971182 (+ 73495us) tablet.cc:701] Row locks acquired
0709 13:09:37.981511 (+ 10329us) write_op.cc:260] PREPARE: finished
0709 13:09:38.041664 (+ 60153us) write_op.cc:270] Start()
0709 13:09:38.068301 (+ 26637us) write_op.cc:276] Timestamp: P: 1783602578035977 usec, L: 0
0709 13:09:38.088764 (+ 20463us) op_driver.cc:348] REPLICATION: starting
0709 13:09:38.149799 (+ 61035us) log.cc:844] Serialized 4059 byte log entry
0709 13:09:38.707469 (+557670us) op_driver.cc:464] REPLICATION: finished
0709 13:09:38.787924 (+ 80455us) write_op.cc:301] APPLY: starting
0709 13:09:38.788062 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:38.801990 (+ 13928us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:38.802125 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:38.948561 (+146436us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:38.948880 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:09:38.948940 (+    60us) write_op.cc:312] APPLY: finished
0709 13:09:38.949303 (+   363us) log.cc:844] Serialized 97 byte log entry
0709 13:09:38.959191 (+  9888us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:38.959348 (+   157us) write_op.cc:454] Released schema lock
0709 13:09:38.959424 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:38.959895 (+   471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:38.959924 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2860,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":76152,"apply.run_cpu_time_us":16526,"apply.run_wall_time_us":175836,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45887,"num_ops":10,"prepare.queue_time_us":283963,"prepare.run_cpu_time_us":13317,"prepare.run_wall_time_us":509179,"raft.queue_time_us":297196,"raft.run_cpu_time_us":6172,"raft.run_wall_time_us":34138,"replication_time_us":615769,"spinlock_wait_cycles":7424,"thread_start_us":577612,"threads_started":4,"wal-append.queue_time_us":163370}]]}
W20260709 13:09:39.764299 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 97771.2us
I20260709 13:09:39.783332 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:39.787832 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 118611us
W20260709 13:09:39.789321 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 45851.4us
I20260709 13:09:39.765523 29196 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:39.808092 29049 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:39.793661 21459 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:39.800304 29066 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:39.801141 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:39.822057 21566 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:39.776746 29217 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:39.835247 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:39.835575 29207 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:39.836225 28880 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:09:39.836763 28880 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 26 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:39.837932 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:39.837697 28880 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.787943 22210 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:09:39.819725 29240 consensus_meta.cc:287] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.541s	user 0.018s	sys 0.002s
W20260709 13:09:39.841502 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47948.2us
W20260709 13:09:39.848667 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 60866.9us
I20260709 13:09:39.852041 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:39.856618 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:39.860410 21566 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
W20260709 13:09:39.861677 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 111339us
I20260709 13:09:39.828076 29217 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:39.854152 29196 raft_consensus.cc:2804] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:39.851475 28882 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:09:39.864748 21608 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.510s (SENT)
I20260709 13:09:39.876945 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:39.877079 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:39.862708 29087 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:39.874310 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:39.853801 29240 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.868145 29085 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:39.884814 29087 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.873277 29217 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:39.903326 29121 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:39.903884 29121 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.904269 29121 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:39.904949 28937 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:39.874104 29207 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:39.893178 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.893735 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:39.895347 21608 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.565s (SENT)
I20260709 13:09:39.883488 29035 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.920400 21608 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:39.891690 29085 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.891666 29232 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:39.906122 29087 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:39.878419 29261 consensus_queue.cc:1048] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:09:39.883193 29120 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:09:39.913466 29208 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:39.910986 28937 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.958490 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64832.8us
I20260709 13:09:39.908452 29239 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:09:39.938869 29085 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:39.945082 29266 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:39.964745 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 87781.2us
W20260709 13:09:39.967926 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 95104.6us
I20260709 13:09:39.922483 29035 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:39.966709 29208 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:39.983922 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:39.959424 28937 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:39.974905 28990 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:39.980194 29196 raft_consensus.cc:697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:39.995078 29275 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 13:09:40.029870 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 134558us
W20260709 13:09:40.050518 21608 leader_election.cc:336] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.637s (SENT)
I20260709 13:09:40.011969 29268 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:40.049794 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:40.061573 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 91467.7us
W20260709 13:09:40.081748 29284 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:40.070490 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:40.086490 21562 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:40.063683 29049 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:40.084508 29266 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.091845 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:40.023552 28990 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.063407 29240 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:40.099032 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.129928 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.121089 29291 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.143406 29291 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.146323 29291 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:40.146835 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:40.147503 21566 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:40.156718 21562 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:40.120575 29232 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.122043 29049 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:40.127513 29233 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.071065 29208 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.138176 29231 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.093605 29266 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.127759 29228 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:40.168264 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 83695.6us
I20260709 13:09:40.117928 29196 consensus_queue.cc:237] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.194207 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:40.177763 29035 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:40.180764 28937 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:40.174223 21459 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:40.180236 28990 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:40.178983 29268 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:40.203346 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 325643us
I20260709 13:09:40.206040 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:09:40.234575 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.214736 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 244540us
I20260709 13:09:40.255175 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:40.201591 29270 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:40.181558 29233 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.256085 21641 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 25.
I20260709 13:09:40.261173 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:40.263281 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.264678 21493 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
W20260709 13:09:40.266309 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64479.3us
I20260709 13:09:40.268606 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.270112 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:40.271170 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.271778 21491 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:09:40.188248 29228 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.267835 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:40.274341 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:40.275871 21641 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 16: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:40.181394 29049 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:40.252440 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet eae01b9fdd5340dc9416e5834263a4d6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 549b31ac31b6428994b45938abc223a7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:40.204059 29042 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:09:40.268150 29275 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:09:40.284485 29087 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.261812 29035 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:40.291764 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:40.260069 29261 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:40.246289 29240 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:40.198654 29232 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.261487 29066 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:40.254161 28882 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 27 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:40.295828 29290 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.082s
I20260709 13:09:40.308807 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:40.312981 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 91334.1us
I20260709 13:09:40.320291 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:40.320991 21640 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:40.321712 21637 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:09:40.330407 21642 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:40.332386 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:40.297550 29261 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.336944 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:40.307372 29035 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.339464 21637 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:40.289904 29121 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.345523 21635 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:09:40.348511 21639 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:40.346346 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:40.331019 28880 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.353286 21640 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:40.357365 29121 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:40.343116 29268 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:40.343776 29261 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:40.358918 29301 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:09:40.375761 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 98072.4us
I20260709 13:09:40.380257 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:40.388855 21640 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:09:40.371371 29270 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:40.370433 29207 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:40.377590 29301 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.397569 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:09:40.389977 29260 consensus_meta.cc:287] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.006s
I20260709 13:09:40.403554 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:40.370354 28880 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.388136 29231 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:40.410143 29260 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.410442 21565 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:40.410710 29260 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:40.411326 29302 log.cc:927] Time spent T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:09:40.411178 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:40.412227 22240 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:40.408972 21637 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
W20260709 13:09:40.415163 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 147382us
I20260709 13:09:40.415376 21639 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:09:40.419878 21639 pending_rounds.cc:85] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 12
I20260709 13:09:40.420253 21639 pending_rounds.cc:107] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:09:40.382165 29217 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.398097 29207 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:40.396047 29270 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:40.413054 29299 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:40.420578 21639 raft_consensus.cc:2889] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.390094 29289 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.151s
I20260709 13:09:40.402884 29301 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:40.438175 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:40.441483 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:40.398448 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:40.448218 22243 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:40.448218 21640 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:40.384569 28882 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.422286 29266 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:40.482339 21640 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
W20260709 13:09:40.490379 21608 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.815s (SENT)
I20260709 13:09:40.452270 29233 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:40.478394 29228 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:40.496052 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.497033 21493 raft_consensus.cc:2410] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 26 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 13:09:40.473894 29240 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:40.485818 29305 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:40.504364 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 66331.7us
I20260709 13:09:40.483049 29087 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:40.506107 21608 leader_election.cc:336] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.818s (SENT)
I20260709 13:09:40.510645 21608 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:40.507583 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.510962 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.478653 28937 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:09:40.494479 29035 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:40.520067 21493 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:09:40.479007 29299 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.523293 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:40.529440 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:40.503895 29232 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:40.556685 29308 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:40.437227 29268 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.558364 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.562384 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:40.572856 29208 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.573149 29319 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:40.509058 29270 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.574220 29270 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:40.579655 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 73573.6us
I20260709 13:09:40.582993 21493 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:40.583086 21642 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 28.
W20260709 13:09:40.584250 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 61087.9us
I20260709 13:09:40.588825 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:40.508361 29207 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.592295 21493 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 22: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:40.605731 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.605041 29233 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:40.609081 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:40.605760 28880 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:40.590709 29208 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.622423 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.629791 29208 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:40.632836 21493 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:40.606720 28937 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.606508 29217 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:40.614750 29310 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.080s	user 0.001s	sys 0.001s
W20260709 13:09:40.640287 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 78056.8us
I20260709 13:09:40.640429 29333 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:40.641371 29330 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:40.643644 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:40.590960 29240 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.646273 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.615301 29307 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:40.602084 29049 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:09:40.612825 29322 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:40.654886 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.661834 21606 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Timed out: RequestConsensusVote RPC to 127.19.231.129:46061 timed out after 1.619s (SENT)
I20260709 13:09:40.612234 29233 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.662967 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.673523 21488 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
W20260709 13:09:40.664191 21608 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.751s (SENT)
I20260709 13:09:40.665162 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:40.645252 28937 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:40.686262 29085 consensus_meta.cc:287] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.003s
I20260709 13:09:40.649827 29333 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.693043 29085 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.694944 29333 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:40.699348 29049 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:40.700043 29049 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:40.700984 29049 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:40.706106 29324 log.cc:927] Time spent T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:09:40.657666 29330 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.709961 29260 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:40.710997 29330 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:40.715771 29261 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.717275 22239 raft_consensus.cc:2368] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:09:40.720779 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:40.691814 21608 leader_election.cc:336] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.980s (SENT)
I20260709 13:09:40.725281 29286 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.734198 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 69172.1us
I20260709 13:09:40.685225 29321 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:40.735406 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:40.741638 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 98038.3us
I20260709 13:09:40.742273 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:40.718588 29261 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:40.744580 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:40.745635 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:40.746286 22245 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:40.749533 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:40.751503 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:40.725868 29290 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:40.754379 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:40.753016 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:40.684810 29322 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:09:40.731881 29299 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:40.756497 22244 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:40.738282 29321 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.757170 22245 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:40.758124 29217 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:40.757999 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:40.753566 29276 raft_consensus.cc:2764] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:09:40.759142 29327 log.cc:927] Time spent T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:09:40.736658 29286 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.759860 29304 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:40.760457 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:40.762982 29292 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:40.765938 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 74165.2us
I20260709 13:09:40.767416 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:40.771162 21641 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:40.770960 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:40.771564 22245 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:09:40.753790 29260 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:40.773126 29085 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:40.767166 29321 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:40.780009 21532 leader_election.cc:400] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20.
I20260709 13:09:40.780403 21532 leader_election.cc:403] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:40.781047 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:40.779239 21608 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.619s (SENT)
I20260709 13:09:40.782331 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:40.784147 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:40.767793 28937 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:40.783680 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:40.786438 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:40.787508 21637 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:40.792783 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:40.789043 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:40.794092 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:40.794086 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:40.791095 28882 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:40.795195 28882 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:40.795329 29208 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:40.795648 28882 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:40.795825 29208 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:40.796411 29208 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:40.798074 29286 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:40.792699 28937 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.799603 28937 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.779134 29304 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:40.779342 29217 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:09:40.764991 29290 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.808176 29035 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:40.809144 29232 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:40.781728 29300 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.808507 29316 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:40.811107 29300 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.811565 29316 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:40.811976 29325 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.812626 29325 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.812767 29316 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.814353 29308 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:40.814837 29308 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:40.815837 29308 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:40.826087 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46877us
I20260709 13:09:40.780112 29240 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:40.838157 21562 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:09:40.840322 29340 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:40.842209 29308 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:40.843039 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 67342.8us
I20260709 13:09:40.844404 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:40.845240 21565 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:40.845659 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:40.802228 29304 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.836038 29270 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:40.847204 28937 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:40.847429 29270 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.795523 29322 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:40.888146 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:40.888991 21565 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:40.889452 29296 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.896767 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46551.8us
I20260709 13:09:40.780791 29260 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:40.837280 29240 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:40.900533 22210 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:40.906651 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:40.901178 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 65569us
W20260709 13:09:40.939491 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 145452us
I20260709 13:09:40.836311 29299 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:40.955559 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:40.888243 29270 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:40.996106 21608 leader_election.cc:336] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.196s (SENT)
I20260709 13:09:40.998277 21562 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:40.955367 29340 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:09:40.956866 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 47417.6us
I20260709 13:09:41.000202 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:40.832022 29268 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:40.890039 29296 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:40.900712 29307 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:41.002183 21565 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:09:41.005059 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:41.017426 21567 raft_consensus.cc:2410] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:09:41.010319 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:41.015030 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:41.019254 22246 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 22: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:41.000303 29228 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.006426 21561 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:41.010278 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.009429 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:41.035060 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.036509 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:41.037357 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:41.038884 29314 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:41.039042 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:41.039546 29314 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:41.040939 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.042263 29314 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:41.043161 21488 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:41.043731 29325 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:41.044880 29260 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:41.009431 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:41.012774 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:40.896091 29305 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:41.039971 21639 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:41.039177 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:41.044428 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:41.034114 21563 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 22: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:41.049573 21486 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:41.051275 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.052201 21564 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:41.056509 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:41.033363 29307 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:41.058528 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.056252 29228 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:41.060524 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:41.058135 29307 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.006007 29240 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:41.076458 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 66998us
I20260709 13:09:41.076956 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:41.061276 21636 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:41.077848 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.077153 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.064620 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:41.008109 29340 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.083940 29340 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:41.085564 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:41.086483 22240 raft_consensus.cc:2393] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 20: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:41.091496 29290 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:41.082664 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.082429 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:41.077761 21493 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:41.100768 21486 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
W20260709 13:09:41.102123 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.108594 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.029719 29299 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:41.098814 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:41.113631 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:41.056983 29300 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:41.122728 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:41.123769 21486 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:41.119086 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:41.126151 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 130085us
I20260709 13:09:41.065932 29305 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:41.121903 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.121269 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:41.134352 22240 raft_consensus.cc:2410] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:09:41.134595 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:41.135880 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.137253 21566 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 27 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 12.
I20260709 13:09:41.097255 29260 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:41.138674 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:41.150210 22210 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:41.159828 21565 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:09:41.162676 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.118703 29319 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:41.160470 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:41.170390 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.174510 21563 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:09:41.132109 29239 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:09:41.153776 29301 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.723s	user 0.015s	sys 0.005s
W20260709 13:09:41.211114 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 50803us
I20260709 13:09:41.178586 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:41.116045 21561 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:41.199934 21565 raft_consensus.cc:3055] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:41.202304 21563 raft_consensus.cc:1240] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:09:41.212065 21566 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:41.212086 21565 raft_consensus.cc:740] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:41.165679 29325 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:41.215256 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:41.216684 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:41.207535 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 90504.6us
I20260709 13:09:41.169269 29196 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:41.154115 29260 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:41.211010 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.164495 29300 consensus_queue.cc:1059] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:09:41.218973 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:41.231241 21567 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:41.221004 21457 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:41.222019 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.154412 29290 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:09:41.232987 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:41.228513 29283 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.174s	user 0.003s	sys 0.010s
I20260709 13:09:41.228750 29260 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:41.224900 21560 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 17.
I20260709 13:09:41.217406 29333 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:41.235435 21561 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 26: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:41.231323 21565 consensus_queue.cc:260] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.241461 21565 raft_consensus.cc:3060] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:41.176226 29314 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:09:41.238752 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:41.210600 29285 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.215034 29325 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.219980 29035 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:41.237653 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:41.254980 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:41.230082 28990 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:41.228425 29196 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:41.277544 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:41.277858 21561 raft_consensus.cc:2368] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:41.227737 29298 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:41.239552 29276 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:41.288944 29196 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.289959 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:41.297708 21562 raft_consensus.cc:2368] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15.
I20260709 13:09:41.299052 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.215813 29085 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:09:41.291780 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:41.292703 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 55155.4us
I20260709 13:09:41.310994 21634 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:41.215440 29301 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:41.317063 29301 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:41.317731 29301 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.318190 29301 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:41.296157 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.321439 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:41.322160 21560 raft_consensus.cc:2368] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:41.324846 29301 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:41.326181 29301 raft_consensus.cc:3055] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:41.296346 21565 raft_consensus.cc:1275] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:41.242516 29171 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:09:41.242754 29333 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.256772 29300 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:41.319429 21637 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 26: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:41.325450 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.340078 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.329773 21640 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:09:41.346259 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:41.306141 21566 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:41.347337 21640 raft_consensus.cc:2368] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 27. Current term is 28.
I20260709 13:09:41.348856 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:41.279263 29325 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:41.230511 29321 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.352985 21636 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
W20260709 13:09:41.326560 29208 consensus_meta.cc:287] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 13:09:41.382699 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:41.383075 28998 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:41.326680 29301 raft_consensus.cc:740] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:41.383088 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:41.343827 28882 consensus_meta.cc:287] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 13:09:41.351423 29333 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:41.412071 22239 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 26: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:41.297359 29296 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:41.326347 29276 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:41.400332 21562 raft_consensus.cc:2368] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16.
I20260709 13:09:41.383464 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.402269 21640 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:41.454053 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:41.388530 29049 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:41.238858 29299 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.389717 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.461616 21566 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 28: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:41.448333 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.279047 29285 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:41.454411 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.467062 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:41.405886 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.457506 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:41.389328 29322 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:41.466251 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.394881 28937 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:41.463116 21560 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:41.469076 21636 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 18: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:41.475081 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 2025) took 1740 ms. Trace:
I20260709 13:09:41.478749 21640 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:41.480777 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.484094 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.459098 29314 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.498579 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.397069 29208 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.292873 29305 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.479223 21568 rpcz_store.cc:276] 0709 13:09:39.726464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.726640 (+   176us) service_pool.cc:224] Handling call
0709 13:09:39.727000 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.727403 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.727431 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.727859 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.924993 (+197134us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:39.925054 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.925156 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.227840 (+1302684us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:41.453558 (+225718us) raft_consensus.cc:1685] finished
0709 13:09:41.453590 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.466810 (+ 13220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10132,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":4582144,"thread_start_us":196690,"threads_started":1,"wal-append.queue_time_us":267671}
I20260709 13:09:41.531867 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:41.532835 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 221366us
I20260709 13:09:41.519028 21608 leader_election.cc:400] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
I20260709 13:09:41.527779 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.533560 21608 leader_election.cc:403] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:09:41.470445 29304 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:41.485854 29292 consensus_meta.cc:287] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.001s
I20260709 13:09:41.534597 21488 raft_consensus.cc:2393] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 19: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:41.534847 21634 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
W20260709 13:09:41.535768 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 290821us
I20260709 13:09:41.394491 29300 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.536403 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:41.484910 29228 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:41.452013 28882 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.534857 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.545917 21566 raft_consensus.cc:2410] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 27 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 12.
I20260709 13:09:41.540273 21493 raft_consensus.cc:1813] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Handling vote request from an unknown peer 5727b19579474da6a12f79730b924770
I20260709 13:09:41.537022 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.542469 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:41.546954 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 376264us
I20260709 13:09:41.547375 21494 raft_consensus.cc:2368] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17.
I20260709 13:09:41.548559 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:41.551985 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.548301 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:41.559609 21493 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:41.567219 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:41.572263 21493 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 15: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:41.573168 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
I20260709 13:09:41.579433 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.534545 29322 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.584138 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.588558 21493 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:41.553076 29292 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:41.597414 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:41.598546 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:41.473482 29049 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:41.611008 21493 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: []
W20260709 13:09:41.614640 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.614513 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 133492us
I20260709 13:09:41.615600 21568 raft_consensus.cc:1240] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:09:41.610040 21560 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 26.
I20260709 13:09:41.543224 29304 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:41.554075 29314 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:41.637662 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.601963 29171 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:09:41.641017 29351 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:09:41.610720 29360 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.667546 21567 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:41.691944 21566 raft_consensus.cc:2410] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
W20260709 13:09:41.688349 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82185.5us
I20260709 13:09:41.540691 29301 consensus_queue.cc:260] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:41.689435 29286 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:09:41.693353 21457 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:41.678580 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 105483us
W20260709 13:09:41.675431 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0916791969999622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 13:09:41.795598 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0457791970000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 13:09:41.797650 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 104495us
I20260709 13:09:41.848430 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:41.612751 29322 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.678988 29368 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:09:41.860388 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61935.4us
W20260709 13:09:41.846151 29316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.029s	sys 0.029s
I20260709 13:09:41.855072 29286 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:41.860810 29372 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.876380 29240 consensus_meta.cc:287] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.003s
W20260709 13:09:41.902690 21608 leader_election.cc:336] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.870s (SENT)
I20260709 13:09:41.912851 21608 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:41.886729 29316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.030s	sys 0.029s
I20260709 13:09:41.875751 29368 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.868680 29321 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:41.677496 29369 consensus_queue.cc:1048] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.247s
I20260709 13:09:41.683894 29360 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:41.958343 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 110019us
I20260709 13:09:41.959200 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:41.915912 29286 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:41.879727 29374 consensus_queue.cc:1059] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:09:41.967568 29066 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.967758 29350 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
W20260709 13:09:41.967963 29364 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:09:41.968616 29286 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:41.970320 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:41.952615 29085 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:41.972036 29322 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:41.972445 29361 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:41.972935 29357 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22.
W20260709 13:09:41.973836 29354 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.424s	user 0.001s	sys 0.001s
W20260709 13:09:41.974768 29355 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 13:09:41.970739 29375 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:41.917479 29372 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:41.975807 29359 log.cc:927] Time spent T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.297s	user 0.000s	sys 0.000s
I20260709 13:09:41.978334 29208 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:41.961761 29285 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:41.921854 29368 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:41.979583 28882 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:42.028215 29374 raft_consensus.cc:3055] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:41.921602 29240 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:41.981791 29300 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:41.971321 29367 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:41.967811 29352 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.442s	user 0.001s	sys 0.001s
W20260709 13:09:42.039269 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 69045us
I20260709 13:09:42.026618 29361 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.024984 29066 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:41.979687 29340 consensus_meta.cc:287] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.895s	user 0.005s	sys 0.007s
I20260709 13:09:42.031268 29085 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:42.045993 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 143335us
I20260709 13:09:42.127246 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 4058) took 1055 ms. Trace:
W20260709 13:09:42.130332 21608 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.591s (SENT)
I20260709 13:09:42.034998 29375 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:42.127861 21642 rpcz_store.cc:276] 0709 13:09:41.007745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.007977 (+   232us) service_pool.cc:224] Handling call
0709 13:09:41.020495 (+ 12518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.059563 (+ 39068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.059599 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.060181 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.498498 (+438317us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:41.498536 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.498603 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.062725 (+564122us) raft_consensus.cc:1685] finished
0709 13:09:42.062757 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.062967 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38540,"raft.queue_time_us":43462,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":21601,"thread_start_us":437869,"threads_started":1,"wal-append.queue_time_us":563181}
I20260709 13:09:42.134395 21487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1345) took 1097 ms. Trace:
I20260709 13:09:42.062103 29383 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.038642 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.130883 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:42.111321 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 377285us
W20260709 13:09:42.168255 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.060544 29314 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:42.169837 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 2031) took 1065 ms. Trace:
W20260709 13:09:42.061878 29353 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.491s	user 0.002s	sys 0.000s
I20260709 13:09:42.159211 29375 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:42.224014 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 93718.9us
I20260709 13:09:42.224318 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:42.173130 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:42.119576 29374 raft_consensus.cc:740] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:42.126842 29304 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:42.227583 29372 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:42.228076 29394 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:42.121344 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:42.142283 21487 rpcz_store.cc:276] 0709 13:09:41.036900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.038727 (+  1827us) service_pool.cc:224] Handling call
0709 13:09:41.039198 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.039637 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.039672 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.040266 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.352355 (+312089us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:41.352403 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.352487 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.134115 (+781628us) raft_consensus.cc:1685] finished
0709 13:09:42.134143 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.134316 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":922,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":42240,"thread_start_us":311609,"threads_started":1,"wal-append.queue_time_us":459894}
I20260709 13:09:42.171345 29300 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.212095 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:42.212708 22238 raft_consensus.cc:1240] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:42.212782 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:42.214169 22247 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:42.215355 29379 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:42.215557 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1716) took 1432 ms. Trace:
W20260709 13:09:42.217854 29308 consensus_meta.cc:287] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 1.375s	user 0.009s	sys 0.002s
I20260709 13:09:42.217743 29377 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.161216 29196 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.198765 29393 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:09:42.199178 29380 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:42.219415 29373 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:42.220191 29240 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:42.174034 21564 rpcz_store.cc:276] 0709 13:09:41.104765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.106722 (+  1957us) service_pool.cc:224] Handling call
0709 13:09:41.117650 (+ 10928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.139160 (+ 21510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.139194 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.158360 (+ 19166us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.468631 (+310271us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:41.468678 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.468747 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.169591 (+700844us) raft_consensus.cc:1685] finished
0709 13:09:42.169614 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.169774 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25971,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7899,"thread_start_us":244892,"threads_started":1,"wal-append.queue_time_us":401095}
I20260709 13:09:42.220495 29233 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:42.221160 29314 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.221652 29389 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.222569 22245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1109) took 1210 ms. Trace:
W20260709 13:09:42.229264 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.211890 22240 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23. Ops: []
W20260709 13:09:42.231865 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.129928 29340 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.311415 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:42.318315 21566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41010 (request call id 3197) took 1003 ms. Trace:
W20260709 13:09:42.302752 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 181525us
W20260709 13:09:42.235175 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 359059us
W20260709 13:09:42.298332 21608 leader_election.cc:336] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.666s (SENT)
I20260709 13:09:42.341307 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:42.339020 22243 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:42.342224 21494 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:42.340619 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:42.343266 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:42.343860 21487 raft_consensus.cc:1240] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:42.344236 21486 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 26: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:42.344466 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:42.274938 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:42.345494 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47226.7us
I20260709 13:09:42.338851 21566 rpcz_store.cc:276] 0709 13:09:41.315283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.569727 (+254444us) service_pool.cc:224] Handling call
0709 13:09:42.317961 (+748234us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54003241d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:42.318196 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202824064}
I20260709 13:09:42.347404 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:42.340957 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:42.337288 22245 rpcz_store.cc:276] 0709 13:09:41.012030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.019306 (+  7276us) service_pool.cc:224] Handling call
0709 13:09:41.019748 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.026102 (+  6354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.026151 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.051068 (+ 24917us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.222775 (+171707us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:41.223439 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.223544 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.222223 (+998679us) raft_consensus.cc:1685] finished
0709 13:09:42.222247 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.222479 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5760,"raft.queue_time_us":14803,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":164640,"threads_started":1,"wal-append.queue_time_us":276145}
I20260709 13:09:42.126072 29361 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:42.350683 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:42.314107 29333 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.846s	user 0.010s	sys 0.002s
I20260709 13:09:42.355974 21569 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:09:42.360816 21569 pending_rounds.cc:85] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 16
I20260709 13:09:42.361101 21569 pending_rounds.cc:107] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:09:42.361469 21569 raft_consensus.cc:2889] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:42.357430 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.337111 21635 rpcz_store.cc:276] 0709 13:09:40.782812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.782924 (+   112us) service_pool.cc:224] Handling call
0709 13:09:40.783229 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.788975 (+  5746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.789023 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.794270 (+  5247us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.259328 (+465058us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:41.259882 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.259979 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.215335 (+955356us) raft_consensus.cc:1685] finished
0709 13:09:42.215362 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.215495 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24339,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":28416,"thread_start_us":441882,"threads_started":1,"wal-append.queue_time_us":630606}
I20260709 13:09:42.362421 21457 leader_election.cc:400] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
I20260709 13:09:42.362964 21457 leader_election.cc:403] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:09:42.358848 21493 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:42.357390 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:42.363889 21494 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:42.351907 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:42.370249 22242 raft_consensus.cc:2368] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 18. Current term is 19.
I20260709 13:09:42.291167 29390 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:42.337085 29373 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:42.346038 29379 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:42.352412 29369 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.376699 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:42.377627 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:42.355813 29395 raft_consensus.cc:2764] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:09:42.359405 29308 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:42.389169 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:42.386930 29384 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:42.392913 29384 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:42.380052 29373 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:42.235086 29383 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:42.382226 29390 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.367937 29333 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.349090 29374 consensus_queue.cc:260] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:42.399989 29374 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:42.400314 29340 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:42.400641 29333 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:42.348573 29389 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.401481 29370 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:42.348444 29196 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.402307 29362 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:42.382079 29379 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:42.406180 29385 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19.
W20260709 13:09:42.380640 29325 consensus_meta.cc:287] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.981s	user 0.008s	sys 0.005s
I20260709 13:09:42.365427 29360 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:42.408448 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:42.419791 29325 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.380508 29304 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.422636 29304 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:42.424943 21608 leader_election.cc:336] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.990s (SENT)
I20260709 13:09:42.425616 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:42.427235 29228 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:42.429412 29347 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:42.430084 29347 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:42.431288 29381 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:42.431166 29347 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.354696 29300 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.407567 29369 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.445888 22247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06b5fb42c147456889a1843340b22720"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:09:42.446705 22247 raft_consensus.cc:606] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
W20260709 13:09:42.455219 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 63486.1us
I20260709 13:09:42.474063 21635 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:09:42.350947 29314 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.446345 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:42.492250 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46007.5us
I20260709 13:09:42.496809 21634 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:09:42.558185 21638 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:09:42.563370 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:42.567560 22247 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:42.494660 29360 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:09:42.350888 29377 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.556097 29393 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.557931 29340 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:42.631721 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 4061) took 1617 ms. Trace:
I20260709 13:09:42.632256 21637 rpcz_store.cc:276] 0709 13:09:41.014675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.043949 (+ 29274us) service_pool.cc:224] Handling call
0709 13:09:42.631404 (+1587455us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540009c754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:42.631604 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619776384}
I20260709 13:09:42.646229 21566 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:09:42.655910 21560 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:09:42.662222 29316 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:42.663079 29316 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:42.663651 29400 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.664438 29400 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:42.680298 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:42.682372 21566 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:09:42.696715 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:42.697616 21491 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:42.628213 29340 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.732059 29381 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:42.747102 29381 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.748524 29240 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
W20260709 13:09:42.497967 29299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.009s	sys 0.000s
I20260709 13:09:42.569164 29385 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:42.576879 29393 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:42.583428 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 1101) took 1839 ms. Trace:
W20260709 13:09:42.835867 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 427517us
W20260709 13:09:42.836427 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 411522us
I20260709 13:09:42.844223 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:42.844875 22247 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:42.845378 21532 leader_election.cc:400] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 27. Current term is 28.
I20260709 13:09:42.845670 21532 leader_election.cc:403] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
I20260709 13:09:42.849192 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:42.854992 21643 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 25: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:42.843178 22239 rpcz_store.cc:276] 0709 13:09:40.744080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.744226 (+   146us) service_pool.cc:224] Handling call
0709 13:09:42.583157 (+1838931us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b5400622854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:42.583331 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509578496}
W20260709 13:09:42.857671 21608 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.121s (SENT)
I20260709 13:09:42.858083 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:42.858134 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:42.858978 22245 raft_consensus.cc:2368] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 25. Current term is 26.
I20260709 13:09:42.868852 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:42.869686 22245 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 22: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:42.870503 29066 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:42.870618 29217 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.870854 29316 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:42.857303 29120 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.871548 29348 log.cc:927] Time spent T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:09:42.872005 29316 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:42.871238 29217 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.840581 29386 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.874049 29386 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:42.867244 29233 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:42.875375 29233 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.876065 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 4060) took 1865 ms. Trace:
I20260709 13:09:42.876152 29386 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:42.877470 29233 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:42.842777 29228 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:42.878324 29228 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.880458 29228 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:42.871619 29120 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:42.876519 21641 rpcz_store.cc:276] 0709 13:09:41.010908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.011974 (+  1066us) service_pool.cc:224] Handling call
0709 13:09:41.012312 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.012652 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.012688 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.019061 (+  6373us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.353766 (+334705us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:41.403149 (+ 49383us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.403420 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.403516 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.749311 (+1345795us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180024d480. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ef53f3 00007f98a6ef77c1 00007f98a6ef7779 00007f98a6ef7709 00007f98a6ef76d1 00007f98a6ef69cd 000000000038f354 000000000038f199 00007f98a6ed883a
0709 13:09:42.875794 (+126483us) raft_consensus.cc:1685] finished
0709 13:09:42.875889 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.876008 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49697,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3644,"raft.queue_time_us":151004,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":34081,"spinlock_wait_cycles":25882368,"thread_start_us":318702,"threads_started":1,"wal-append.queue_time_us":445211}
I20260709 13:09:42.883229 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:42.883450 29120 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:42.884536 29268 consensus_meta.cc:287] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 1.869s	user 0.027s	sys 0.003s
I20260709 13:09:42.885008 29268 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 19. Current term is 20.
I20260709 13:09:42.886004 21563 raft_consensus.cc:2410] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:09:42.886335 29393 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:42.887712 29368 consensus_meta.cc:287] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.843s	user 0.024s	sys 0.000s
I20260709 13:09:42.859614 28990 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:42.888921 28990 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:42.888530 29368 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:42.874584 29217 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:42.854086 29035 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:42.891649 29369 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:42.891532 29035 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.892454 29305 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 27. Current term is 28.
I20260709 13:09:42.894080 29035 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:42.890709 29260 consensus_meta.cc:287] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.636s	user 0.016s	sys 0.014s
I20260709 13:09:42.894744 29400 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:42.895147 29260 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.897550 29260 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:42.899513 29390 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:42.902889 29325 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:42.840728 29171 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.907956 29368 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:42.907320 29171 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:42.909498 29304 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:42.910212 29171 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:42.860131 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:42.911233 29196 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:42.911775 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 44406.3us
I20260709 13:09:42.912125 29304 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:42.912765 29304 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.860131 29385 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:42.913254 29304 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:42.919163 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 59112.8us
I20260709 13:09:42.922572 21491 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:42.930145 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:42.841348 29299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.010s	sys 0.000s
I20260709 13:09:42.933908 22247 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:42.868495 21457 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:42.938943 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 69077.2us
I20260709 13:09:42.836678 29207 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:42.959211 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:42.891496 29217 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.933452 29261 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.004s	sys 0.013s
I20260709 13:09:42.969129 21488 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:42.971494 21487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.016s
I20260709 13:09:42.972266 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:42.972640 21487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.000s	sys 0.016s
I20260709 13:09:42.972975 22245 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
W20260709 13:09:42.960860 21564 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.004s	sys 0.012s
I20260709 13:09:42.962584 21640 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 25. Current term is 26. Ops: []
I20260709 13:09:42.967111 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:42.976917 21564 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.005s	sys 0.012s
I20260709 13:09:42.976114 22238 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:42.976298 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:42.938912 29400 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:42.978739 22247 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:09:42.979389 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:42.980160 22239 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:42.981163 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:42.958149 29171 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:42.990628 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:42.997694 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:42.969265 29261 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.004s	sys 0.013s
I20260709 13:09:43.014266 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:43.015039 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:42.980041 29286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.005s	sys 0.011s
I20260709 13:09:42.961452 29385 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.021452 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.044633 29035 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:43.015944 29260 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:09:43.046845 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:43.016530 29373 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.621s	user 0.013s	sys 0.004s
I20260709 13:09:43.018173 29377 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:43.053449 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:43.058139 22246 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:43.060213 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:43.064505 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:43.065587 21641 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 22: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:09:43.046896 29286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.005s	sys 0.011s
W20260709 13:09:43.015304 29379 consensus_meta.cc:287] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.016s
I20260709 13:09:43.071241 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.036324 29381 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.015141 29171 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:43.031467 29340 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:43.090551 21491 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:42.979136 29217 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.057286 29373 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.117066 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.080399 29384 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:43.081972 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.121106 21486 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:43.081972 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:43.082643 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.083834 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:43.122578 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.085822 22246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:09:43.075161 29233 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:43.120366 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.077026 29316 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:09:43.123549 22246 raft_consensus.cc:606] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:43.089941 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.092582 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 355141us
I20260709 13:09:43.027894 29314 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.136942 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.137260 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:43.137982 22241 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:43.100759 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.139446 21489 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 26.
I20260709 13:09:43.120266 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.121311 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:43.135630 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.139842 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:43.140779 21485 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
W20260709 13:09:43.159260 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 301594us
I20260709 13:09:43.159826 21492 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 25: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:43.162813 21608 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.968s (SENT)
I20260709 13:09:43.163416 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.075548 29379 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.075978 28990 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:43.166558 21608 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.994s (SENT)
I20260709 13:09:43.099017 29228 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 13:09:43.173403 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.179301 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:43.170931 29393 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:43.186733 29393 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:43.180836 21608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.187s (SENT) [suppressed 23 similar messages]
I20260709 13:09:43.164851 29314 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:43.173192 29381 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:43.281602 21532 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:43.177832 29395 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:43.185185 29316 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:09:43.263743 22238 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:43.177058 29384 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:43.281241 22246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:09:43.296909 22246 raft_consensus.cc:606] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:43.167469 29385 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:09:43.283133 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 140529us
W20260709 13:09:43.263160 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.304111 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.297508 22246 raft_consensus.cc:614] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:43.200855 29380 consensus_meta.cc:287] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.846s	user 0.030s	sys 0.046s
I20260709 13:09:43.301532 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.306551 29373 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:43.307156 29393 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:43.308728 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:43.310173 29366 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 1.334s	user 0.001s	sys 0.002s
I20260709 13:09:43.177596 29411 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.119s
I20260709 13:09:43.312233 21487 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:43.292315 29299 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:09:43.314802 29066 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:43.314113 29381 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:43.278119 29305 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:43.259841 29268 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:43.312269 29207 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:43.282090 29314 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:43.296814 29398 log.cc:927] Time spent T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.243s	user 0.002s	sys 0.002s
I20260709 13:09:43.324913 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:43.283401 29410 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:43.337080 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 2047) took 1093 ms. Trace:
I20260709 13:09:43.323483 29276 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.296743 29395 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.299058 28880 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:09:43.346678 29286 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:43.316660 29307 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:09:43.360110 21564 rpcz_store.cc:276] 0709 13:09:42.243751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.367434 (+123683us) service_pool.cc:224] Handling call
0709 13:09:42.380306 (+ 12872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.380512 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:42.982952 (+602440us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.336590 (+353638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.336670 (+    80us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:43.336735 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.336831 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.336998 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":631833,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":7386,"raft.queue_time_us":6113,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":7306,"thread_start_us":921267,"threads_started":2}
I20260709 13:09:43.327646 29393 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:43.327780 29386 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:43.323599 29384 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.342185 29380 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:43.345170 29316 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:43.358106 29314 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:43.360044 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 98914.4us
W20260709 13:09:43.368471 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 106471us
W20260709 13:09:43.374090 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 72654.9us
I20260709 13:09:43.396221 21532 leader_election.cc:400] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17.
I20260709 13:09:43.396597 21532 leader_election.cc:403] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:09:43.362077 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 180959us
I20260709 13:09:43.396497 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4645) took 2087 ms. Trace:
I20260709 13:09:43.397832 21562 rpcz_store.cc:276] 0709 13:09:41.308873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.604361 (+295488us) service_pool.cc:224] Handling call
0709 13:09:42.319632 (+715271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.319819 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.319842 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.319887 (+    45us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:42.319917 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.319969 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.396271 (+1076302us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54003241d0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:43.396426 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643931008}
I20260709 13:09:43.417392 21532 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:43.299330 29171 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.350517 29066 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.414374 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.354732 29268 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.350576 29305 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.346995 29381 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.430074 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.365026 29410 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.458509 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.459168 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 2046) took 1217 ms. Trace:
I20260709 13:09:43.461920 21567 rpcz_store.cc:276] 0709 13:09:42.242130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.242945 (+   815us) service_pool.cc:224] Handling call
0709 13:09:42.243265 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.280753 (+ 37488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.280786 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.293642 (+ 12856us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.570467 (+276825us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:42.570528 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.570630 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.458920 (+888290us) raft_consensus.cc:1685] finished
0709 13:09:43.458942 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.459097 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37083,"raft.queue_time_us":47214,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"thread_start_us":276370,"threads_started":1,"wal-append.queue_time_us":667950}
I20260709 13:09:43.471992 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.446036 29299 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:09:43.447113 29417 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:43.367025 29276 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.448439 29393 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:43.424592 29386 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 16. Current term is 17.
I20260709 13:09:43.449002 29380 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:43.426481 29411 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:09:43.415005 29316 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.502038 22246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:09:43.503535 29416 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:09:43.504375 29414 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:09:43.505195 29415 log.cc:927] Time spent T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:09:43.534461 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 141824us
W20260709 13:09:43.537710 29361 consensus_meta.cc:287] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.165s	user 0.015s	sys 0.015s
I20260709 13:09:43.533463 22246 raft_consensus.cc:606] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:43.465305 29347 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:09:43.500170 29307 consensus_queue.cc:1059] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
W20260709 13:09:43.601861 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 152780us
W20260709 13:09:43.641913 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 317093us
W20260709 13:09:43.499203 29306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.007s	sys 0.000s
I20260709 13:09:43.583910 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.495685 29217 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.499776 29379 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:43.611914 29421 log.cc:927] Time spent T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:09:43.600782 29423 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:09:43.657274 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.590018 29380 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:43.648304 21640 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
W20260709 13:09:43.563406 29407 log.cc:927] Time spent T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
W20260709 13:09:43.552150 29403 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:43.528800 29299 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 26 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:43.600979 29395 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:43.663828 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.664100 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:43.667742 29410 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.535683 29416 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:43.672286 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:43.563552 29418 log.cc:927] Time spent T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:09:43.585937 29232 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:43.680496 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.681890 21567 raft_consensus.cc:2393] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 26: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:43.715073 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.715793 21567 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:43.716694 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.717032 29301 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.717371 21567 raft_consensus.cc:2393] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 28: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:43.694334 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.714581 21560 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:43.718258 21561 raft_consensus.cc:2410] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:09:43.538318 29385 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.135s
I20260709 13:09:43.695657 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.724534 21564 raft_consensus.cc:2410] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:09:43.696015 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:43.656669 29307 raft_consensus.cc:3055] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:43.700776 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.560652 29431 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.140s
I20260709 13:09:43.658708 29427 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.054s
W20260709 13:09:43.710274 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 238373us
I20260709 13:09:43.538169 29361 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:43.695152 29374 consensus_meta.cc:287] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.295s	user 0.017s	sys 0.013s
I20260709 13:09:43.694187 29417 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:43.740607 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.740996 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:43.742030 21642 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:09:43.742588 29260 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.743059 29260 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.744098 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.744882 21561 raft_consensus.cc:2410] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:09:43.694694 29268 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:43.725217 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.727679 21566 raft_consensus.cc:2368] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 15. Current term is 16.
I20260709 13:09:43.728205 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.728613 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.779347 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.777113 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.730655 21568 raft_consensus.cc:2410] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 28 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
I20260709 13:09:43.682018 29379 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:09:43.702970 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:43.727011 29304 consensus_meta.cc:287] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.813s	user 0.013s	sys 0.000s
I20260709 13:09:43.717269 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:43.800910 21639 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:09:43.750428 29233 consensus_meta.cc:287] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.000s
I20260709 13:09:43.705677 29384 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:43.737629 29305 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.812077 29447 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.812676 29447 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.813249 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.814059 29439 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:09:43.750881 29066 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.751030 29427 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:09:43.815131 29427 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:43.815719 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.816489 29390 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:43.816020 29427 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.816835 29447 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.817451 29427 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:43.817863 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.752866 29316 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.752601 29299 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.750485 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:43.820688 21637 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:43.820746 21639 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:43.759253 21638 raft_consensus.cc:2393] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:43.760600 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:43.761804 29400 consensus_meta.cc:287] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.004s
W20260709 13:09:43.761977 22242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 831) took 1550 ms (client timeout 1516 ms). Trace:
I20260709 13:09:43.765401 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.825367 21636 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 11.
W20260709 13:09:43.825126 22242 rpcz_store.cc:269] 0709 13:09:42.211318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.223888 (+ 12570us) service_pool.cc:224] Handling call
0709 13:09:43.761760 (+1537872us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400a56ed4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:43.761902 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320716544}
I20260709 13:09:43.826450 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:43.767701 29375 consensus_meta.cc:287] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 1.544s	user 0.017s	sys 0.013s
I20260709 13:09:43.768239 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.769461 29383 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:43.770339 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 122737us
I20260709 13:09:43.780870 21640 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:09:43.779947 21560 raft_consensus.cc:2468] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:43.801083 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.725042 29416 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:43.730279 29307 raft_consensus.cc:740] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:43.789849 29417 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:43.804746 29233 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:43.814489 29448 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:43.752104 29441 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:43.821033 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.821307 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.822382 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.818434 29286 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:43.819044 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 121837us
I20260709 13:09:43.823740 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.828140 29447 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:43.834404 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 60176.1us
I20260709 13:09:43.837113 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:43.837723 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.835815 29417 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.836344 21641 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:43.854974 29409 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.837724 29443 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:09:43.855549 29409 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.854820 29417 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:43.856529 29443 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:43.827224 29400 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:43.856946 29417 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:43.861191 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.861505 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.861690 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:43.861871 21566 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 15.
I20260709 13:09:43.862252 21561 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:43.804842 29304 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.836711 29441 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.864868 21562 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:43.837793 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.838510 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.869783 21634 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:43.839094 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.840772 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:43.830401 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.847527 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.874091 21636 raft_consensus.cc:2410] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:43.874336 21635 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 26.
I20260709 13:09:43.875566 21643 raft_consensus.cc:2410] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:09:43.880867 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.882712 21637 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:43.883886 21561 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:43.888134 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:43.888813 21492 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:43.889848 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:43.890442 21568 raft_consensus.cc:1813] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Handling vote request from an unknown peer 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.891057 21568 raft_consensus.cc:2410] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:43.896080 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:43.896987 21489 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:43.898231 21608 leader_election.cc:336] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.625s (SENT)
I20260709 13:09:43.898905 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.899158 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.837890 29233 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:43.895637 21457 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:43.900789 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.847723 29381 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.895135 29066 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:43.904659 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.904386 29066 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.904908 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.906128 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.906828 21634 raft_consensus.cc:2393] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 25: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:43.907459 29451 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:09:43.907613 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:43.836468 29448 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:43.899895 21485 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:43.903786 29447 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:43.876152 29304 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.887089 29362 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:43.902648 21643 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:43.879601 29383 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:43.914829 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.835487 29292 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:09:43.916169 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:43.918984 21486 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:43.924714 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.899305 29305 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:09:43.926191 21608 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.900s (SENT)
I20260709 13:09:43.837459 29449 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:09:43.912209 29381 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.929248 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:43.830073 29375 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.926250 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.908155 29451 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 25 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:43.908847 29066 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:43.927341 21643 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 26.
I20260709 13:09:43.912580 29448 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:43.913946 29362 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:43.951368 21486 raft_consensus.cc:2468] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:09:43.952260 29441 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:43.954255 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:43.836172 29307 consensus_queue.cc:260] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.958976 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:43.960070 21568 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:09:43.957638 21634 raft_consensus.cc:2410] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:09:43.963294 21643 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.937455 29171 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.966048 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:43.996165 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:43.979008 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 82780.6us
I20260709 13:09:43.997745 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.998976 21485 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:09:43.916347 29314 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:43.999862 21492 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 26.
I20260709 13:09:43.953953 29233 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:43.959282 29379 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:44.016351 29379 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.019202 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.025271 29375 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:44.025660 21641 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
W20260709 13:09:44.007905 29457 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:44.010608 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:43.937753 29383 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.031656 21485 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:44.031788 22247 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:44.032239 29451 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.033056 29383 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:44.035233 21568 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:44.036386 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:44.036710 29416 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.955981 29381 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.080513 21641 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:44.082124 21489 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:09:44.002130 29171 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:43.959434 29362 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:44.088821 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:44.018653 29379 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:43.943450 29305 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.083595 29307 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:44.123759 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 178480us
I20260709 13:09:44.133438 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:44.144593 21457 leader_election.cc:400] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 25. Current term is 26.
I20260709 13:09:44.145062 21457 leader_election.cc:403] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:09:44.146494 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:44.153390 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:44.156585 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:44.261350 21565 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:44.263051 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:44.267048 22212 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:09:44.370975 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 405003us
I20260709 13:09:44.275931 29233 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:44.354854 29306 raft_consensus.cc:2804] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:44.367722 29292 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:44.415491 21568 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:44.386467 29464 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:44.364435 29448 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.422014 29292 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:44.429350 29427 consensus_meta.cc:287] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.611s	user 0.013s	sys 0.000s
I20260709 13:09:44.444551 29461 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:44.453115 29345 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 3.235s	user 0.008s	sys 0.017s
I20260709 13:09:44.423594 29375 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:44.424979 29306 raft_consensus.cc:697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:44.409421 29233 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.443240 29464 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.455562 29292 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:44.468725 29375 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:44.481653 29459 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:09:44.481987 29375 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:44.482271 29467 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 25. Current term is 26.
I20260709 13:09:44.483166 29469 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:44.483768 29469 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:44.484695 29469 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.488689 29448 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:44.489976 29305 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:44.495152 21641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1734) took 1009 ms. Trace:
I20260709 13:09:44.495716 21641 rpcz_store.cc:276] 0709 13:09:43.485674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.084017 (+598343us) service_pool.cc:224] Handling call
0709 13:09:44.084317 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.084542 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:09:44.105704 (+ 21162us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.494758 (+389054us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:44.494834 (+    76us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:09:44.494882 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.494976 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.495095 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9051,"prepare.queue_time_us":45048,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3565,"thread_start_us":388731,"threads_started":1}
I20260709 13:09:44.470367 29464 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:44.473882 29314 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:44.518464 21640 raft_consensus.cc:1240] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:44.491346 29171 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:44.473367 29461 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.575263 29448 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:44.578560 29448 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.580945 29448 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:44.552898 29314 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:44.587729 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.590195 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.591909 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.593258 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:44.597095 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.588789 28880 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:44.587602 29239 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:44.554700 29306 consensus_queue.cc:237] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.605049 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:44.605468 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.605789 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.604627 28880 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.617822 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.592267 29314 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.620929 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.623087 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:44.622610 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 469435us
W20260709 13:09:44.620894 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 247903us
I20260709 13:09:44.653709 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.657879 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:44.658865 21489 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:44.663232 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.664460 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.665079 21485 raft_consensus.cc:2468] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:44.668201 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:44.671867 21563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 4643) took 3440 ms (client timeout 2634 ms). Trace:
I20260709 13:09:44.605317 29239 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.656239 29171 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:44.675079 21563 rpcz_store.cc:269] 0709 13:09:41.222390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.232621 (+ 10231us) service_pool.cc:224] Handling call
0709 13:09:44.661367 (+3428746us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54001d8654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:44.663066 (+  1699us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3799059328}
I20260709 13:09:44.656122 29286 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:44.667126 29233 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:44.687530 29475 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:09:44.688385 29476 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:09:44.698330 21489 raft_consensus.cc:2468] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:44.698910 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:44.686534 29307 consensus_meta.cc:287] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.006s
I20260709 13:09:44.702975 29085 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:44.707754 29276 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:44.709201 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.676998 29347 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:44.712949 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.714527 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:44.685462 28880 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:44.718158 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:44.718727 21485 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:44.722965 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:44.714370 29362 consensus_meta.cc:287] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.006s
I20260709 13:09:44.684942 29171 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.697861 29286 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.735826 29362 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.739339 29239 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:44.769116 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 2035) took 3601 ms. Trace:
I20260709 13:09:44.761626 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.763340 21493 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:09:44.713486 29347 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.772572 21569 rpcz_store.cc:276] 0709 13:09:41.135524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.135700 (+   176us) service_pool.cc:224] Handling call
0709 13:09:41.158757 (+ 23057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.361890 (+1203133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.736430 (+2374540us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400151654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:44.736625 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741200256}
I20260709 13:09:44.774729 21487 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:44.766640 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:44.779302 21492 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:44.741232 29171 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:44.760991 29049 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:44.747648 29314 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:44.759181 29461 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:44.760612 29232 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:44.742866 29286 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:44.793583 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 127042us
I20260709 13:09:44.779768 29035 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:44.744585 29292 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.833801 29035 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:44.852388 29035 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.853538 29035 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:44.857065 29362 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:44.752887 29464 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.806267 29232 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:44.804057 29469 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:44.889308 29487 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.893401 28990 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:44.894550 29389 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:44.896059 21635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1725) took 1507 ms (client timeout 1773 ms). Trace:
I20260709 13:09:44.897109 29381 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:44.900827 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 4071) took 2416 ms. Trace:
I20260709 13:09:44.908689 21606 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:44.909040 21642 rpcz_store.cc:276] 0709 13:09:42.484407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.485125 (+   718us) service_pool.cc:224] Handling call
0709 13:09:42.499088 (+ 13963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.742409 (+1243321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.900548 (+1158139us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540005cdd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:44.900733 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2857727872}
I20260709 13:09:44.902220 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1735) took 1373 ms. Trace:
I20260709 13:09:44.904443 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:44.910286 21641 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 19: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:44.906711 29409 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:44.908732 21635 rpcz_store.cc:269] 0709 13:09:43.388824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.740763 (+351939us) service_pool.cc:224] Handling call
0709 13:09:44.895882 (+1155119us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002e1b54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:44.895997 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266951936}
I20260709 13:09:44.912302 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:44.909953 21643 rpcz_store.cc:276] 0709 13:09:43.529332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.405510 (+876178us) service_pool.cc:224] Handling call
0709 13:09:44.405818 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.478386 (+ 72568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.478420 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:44.478462 (+    42us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:44.478493 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.901974 (+423481us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b5400295754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:44.902026 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.902158 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165782784}
I20260709 13:09:44.913640 29228 raft_consensus.cc:2804] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:44.916441 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:44.916651 29228 raft_consensus.cc:697] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:44.916469 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:44.917645 29228 consensus_queue.cc:237] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.918623 21643 raft_consensus.cc:2393] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 17: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:44.924149 21489 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:44.924425 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:44.925160 21643 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:44.917663 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:44.927029 21642 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:44.928754 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:44.933292 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:44.935493 21643 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:44.937161 21643 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:44.937961 29427 raft_consensus.cc:3060] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:44.908082 29469 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:44.943051 29469 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:44.934749 29378 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:09:44.948167 29464 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:44.914600 29487 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.951258 28880 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:44.962608 29378 consensus_queue.cc:1059] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:44.968432 21642 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:44.975445 21485 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:44.957864 28880 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.976907 28880 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:44.979353 29292 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:44.981371 29427 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:44.987658 29488 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:44.982082 29232 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:44.988154 29488 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:44.989049 29488 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.989563 29487 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:44.990222 29488 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:44.990933 29386 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:44.991338 29386 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:44.992162 29386 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:44.993156 29386 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:44.998631 21492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44644 (request call id 1363) took 1041 ms. Trace:
I20260709 13:09:44.999488 21492 rpcz_store.cc:276] 0709 13:09:43.957329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.020365 (+ 63036us) service_pool.cc:224] Handling call
0709 13:09:44.020698 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.779990 (+759292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.998366 (+218376us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54002c9f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:44.998565 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744005888}
I20260709 13:09:44.982174 29482 consensus_queue.cc:1059] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:09:45.006707 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:45.010612 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:45.016594 21641 raft_consensus.cc:1240] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:45.011683 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:45.007800 29456 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.623s	user 0.003s	sys 0.011s
I20260709 13:09:45.000811 29232 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:45.021369 29340 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:45.032788 29340 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.007943 29443 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:45.009568 21491 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:45.034277 29443 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.027448 29369 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:45.035574 29369 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.012102 21457 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:45.004362 29482 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:09:45.037369 29482 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:45.038252 29482 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:45.039065 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:45.039417 29482 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:45.040243 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.039412 29385 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:09:45.041862 21532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.005s	sys 0.011s
W20260709 13:09:45.047513 21532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.005s	sys 0.011s
I20260709 13:09:45.048111 29300 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:45.049003 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:45.051041 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1121) took 2032 ms. Trace:
W20260709 13:09:45.051816 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.052192 29478 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.446s	user 0.000s	sys 0.001s
I20260709 13:09:45.053227 21641 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 22: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:45.054077 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4663) took 1186 ms. Trace:
I20260709 13:09:45.054180 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.063303 29395 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:45.063895 29395 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.064046 29361 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:45.027719 21488 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 26.
I20260709 13:09:45.011255 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:45.069953 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:45.070912 29361 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:45.071403 29361 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:45.028427 21485 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 13.
I20260709 13:09:45.051512 22238 rpcz_store.cc:276] 0709 13:09:43.018443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.024298 (+  5855us) service_pool.cc:224] Handling call
0709 13:09:43.024641 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.295337 (+270696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.050742 (+1755405us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b5400733554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:45.050972 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402578304}
I20260709 13:09:45.072255 29361 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.073894 29385 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:45.022900 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:45.064288 29395 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:45.077356 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:45.079521 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 56728.7us
I20260709 13:09:45.080255 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:45.080474 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.081365 22210 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:45.100688 21642 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:09:45.089130 21641 raft_consensus.cc:2393] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 26: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:09:45.103415 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.147595 21642 raft_consensus.cc:1240] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:45.135277 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:45.103585 29306 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:09:45.087790 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.086611 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:45.054507 21560 rpcz_store.cc:276] 0709 13:09:43.868112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.868244 (+   132us) service_pool.cc:224] Handling call
0709 13:09:43.868573 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.900195 (+ 31622us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:44.102987 (+202792us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.459414 (+356427us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.493772 (+ 34358us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.493941 (+   169us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:44.494197 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.494405 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.494479 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.051609 (+557130us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:45.053849 (+  2240us) raft_consensus.cc:1685] finished
0709 13:09:45.053880 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.054020 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22212,"prepare.queue_time_us":373956,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":4108,"raft.queue_time_us":38705,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":21221,"spinlock_wait_cycles":12335360,"thread_start_us":450443,"threads_started":2,"wal-append.queue_time_us":435854}
W20260709 13:09:45.086732 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.142412 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41284 (request call id 3211) took 2168 ms. Trace:
I20260709 13:09:45.131629 29260 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:45.154635 21493 rpcz_store.cc:276] 0709 13:09:42.967251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.967828 (+   577us) service_pool.cc:224] Handling call
0709 13:09:42.968203 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.773267 (+1805064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.135765 (+362498us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b540008aa54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:45.136019 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4127519104}
I20260709 13:09:45.088532 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:45.156646 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 68168.9us
I20260709 13:09:45.162899 21560 raft_consensus.cc:1240] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:45.158654 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:45.151872 21637 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:45.094197 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:45.130909 29340 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:45.130121 29465 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:09:45.093628 29196 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:45.105710 29261 raft_consensus.cc:2804] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:09:45.153884 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 67338.8us
W20260709 13:09:45.237639 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 79072.2us
I20260709 13:09:45.238832 22210 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:45.110486 29431 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:45.132076 29369 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:45.228700 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 134559us
I20260709 13:09:45.210157 29482 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.279675 21637 raft_consensus.cc:2410] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:09:45.208618 29371 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.208312 29260 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:45.110809 29385 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.217092 29306 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:09:45.175958 29427 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:45.319922 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82558us
I20260709 13:09:45.323181 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:45.238341 29196 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:09:45.300967 29321 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.209s	user 0.028s	sys 0.024s
I20260709 13:09:45.259949 29239 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:45.237949 29340 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.403954 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.404027 29340 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.325677 29371 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:45.406286 29340 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:45.406472 29371 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:45.260520 29307 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:45.401892 29049 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:45.407016 29307 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.407490 29307 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:45.409385 29469 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.319265 29482 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.420960 29482 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:45.319450 29261 raft_consensus.cc:697] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:45.423573 29261 consensus_queue.cc:237] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.426420 29469 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:45.265051 29431 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:45.271298 29347 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:45.265938 29443 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:45.429991 28880 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:45.265677 29461 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:45.301378 29232 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.327894 29260 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:45.428860 29465 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:45.401997 29321 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.325s	user 0.028s	sys 0.049s
I20260709 13:09:45.400709 29196 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:45.428051 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 96197.9us
I20260709 13:09:45.445310 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:45.439831 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 107043us
I20260709 13:09:45.442514 29461 raft_consensus.cc:697] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:45.438392 29232 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.447551 29461 consensus_queue.cc:237] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.449077 29232 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:45.433375 29431 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:45.451812 21668 heartbeater.cc:646] Failed to heartbeat to 127.19.231.190:34603 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.231.190:34603 timed out after 15.000s (SENT)
I20260709 13:09:45.452107 29260 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:45.402993 29306 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:45.463155 21643 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:09:45.468145 21487 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:09:45.442413 28880 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:45.468621 21560 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:45.469183 28880 consensus_queue.cc:1059] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:45.469746 21493 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:09:45.470242 28880 raft_consensus.cc:3055] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:45.472020 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.473999 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:45.476858 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.478945 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:45.480170 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:45.485800 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.520448 21485 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:09:45.520273 21493 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:09:45.522711 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:45.523855 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 49969.5us
I20260709 13:09:45.528621 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:45.528687 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.533105 21565 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:09:45.523334 21643 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:45.538830 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.540232 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:45.463788 29232 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:45.542284 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:45.552793 21564 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:45.520179 28880 raft_consensus.cc:740] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:45.544255 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:45.554807 21563 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:45.523674 29260 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:45.560294 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:45.561579 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.564700 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:45.568454 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:45.529563 29035 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:45.575837 28880 consensus_queue.cc:260] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.577044 28880 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:45.579819 29416 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:45.581117 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:45.582231 29368 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:45.583199 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:45.584326 29425 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:45.586127 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:45.586823 21566 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:45.583395 29494 log.cc:927] Time spent T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:09:45.587703 21643 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:45.520270 29372 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:09:45.561151 29347 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.564653 29386 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.592801 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.591091 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:45.541589 29314 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:09:45.582651 29368 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:45.598770 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 358538us
I20260709 13:09:45.605419 29307 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:45.586422 29035 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.609537 29368 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:45.610746 28990 consensus_queue.cc:1059] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:09:45.611773 29340 raft_consensus.cc:3055] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:45.574324 29049 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:45.612710 21642 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:45.599306 29386 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.595737 29416 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.563127 29232 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:45.614518 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:45.623607 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.629174 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:45.629716 21638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 4094) took 2456 ms (client timeout 1835 ms). Trace:
I20260709 13:09:45.629983 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:45.630017 21634 raft_consensus.cc:1240] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:45.630640 21635 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:45.630439 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:45.632936 21637 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:45.634330 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:45.635849 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:09:45.630127 21638 rpcz_store.cc:269] 0709 13:09:43.173706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.642220 (+468514us) service_pool.cc:224] Handling call
0709 13:09:45.629483 (+1987263us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b540024c554. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:45.629652 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222289280}
I20260709 13:09:45.643553 21641 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:09:45.644083 21563 raft_consensus.cc:2410] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:09:45.612526 29484 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:45.613484 29035 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:45.648700 21566 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:45.615144 29340 raft_consensus.cc:740] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:45.655519 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:45.668365 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:45.669379 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:45.643865 29239 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:45.670624 29239 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:45.671092 29239 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:45.624158 29049 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:45.676721 29049 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:45.599900 29347 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:45.679512 29340 consensus_queue.cc:260] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.680932 29340 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:45.681363 29347 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:45.617081 28990 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:09:45.631001 29416 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.684973 29416 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:45.686416 29500 log.cc:927] Time spent T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:45.694151 21642 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:45.664722 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:45.686846 29292 consensus_queue.cc:1059] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:09:45.596771 29306 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:45.695791 29395 consensus_meta.cc:287] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 13:09:45.700413 29171 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:45.664520 29261 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:45.782102 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:45.785281 21635 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:45.790915 22246 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:45.827303 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:45.738667 29307 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:45.781100 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:45.829476 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:45.830003 22238 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:45.740607 29504 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:45.700587 29464 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
W20260709 13:09:45.840868 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 205108us
I20260709 13:09:45.687646 29484 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:45.866539 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:45.841185 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:45.843559 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:45.867117 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:45.840920 22244 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:45.867935 22243 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:45.769230 28990 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.879480 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:45.880551 22247 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:45.773244 29171 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:45.721733 29431 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:45.773754 29385 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:45.829495 29261 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:45.962143 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 134961us
I20260709 13:09:45.966344 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:45.966720 21532 connection.cc:256] RPC call timeout handler was delayed by -1.0290342580000242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
I20260709 13:09:45.932482 22243 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
W20260709 13:09:45.924008 21608 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.187s (SENT)
I20260709 13:09:45.752897 29395 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:45.973803 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.838631 29504 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.006157 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.004483 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:45.934973 29171 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:46.011389 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 87421.6us
W20260709 13:09:45.974108 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.012387 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.014261 22242 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:09:46.012300 21608 leader_election.cc:336] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.228s (SENT)
I20260709 13:09:46.017459 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:45.915361 29307 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:46.022729 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.024521 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:45.938527 29385 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.018643 29372 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:45.962435 29261 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:46.030591 21485 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:46.018102 29321 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:46.031261 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 361935us
I20260709 13:09:45.933998 28990 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.032797 21489 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 22: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:46.034494 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.045673 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:46.031590 21564 raft_consensus.cc:1240] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:09:46.011618 29504 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.041381 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:45.968003 29482 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:46.018525 29509 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:46.050477 21490 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 26.
I20260709 13:09:46.013830 29347 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 13:09:46.050279 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 206828us
I20260709 13:09:46.127224 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.164234 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:46.140337 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:46.105937 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 88584.6us
W20260709 13:09:46.104887 21608 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.897s (SENT)
W20260709 13:09:46.166646 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 62216.1us
I20260709 13:09:46.167120 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.167582 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.110384 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.169056 22243 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 16.
I20260709 13:09:46.165819 22242 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 29.
I20260709 13:09:46.184765 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.199856 21568 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:09:46.147336 29514 log.cc:927] Time spent T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:46.201092 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.214533 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:46.143288 29508 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:09:46.216182 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52049.3us
I20260709 13:09:46.127332 29522 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:46.153321 29506 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 13:09:46.076388 29511 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:46.222852 29517 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.216578 29527 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:09:46.167407 29505 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.416s	user 0.001s	sys 0.000s
I20260709 13:09:46.055644 29372 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:46.247392 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:46.126118 29232 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:46.053726 29386 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:46.092912 29482 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:46.248104 21568 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: []
W20260709 13:09:46.247622 29512 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:09:46.054418 29307 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:46.255986 29395 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:46.219149 29308 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:09:46.049372 29321 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.257846 21568 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:46.266634 29321 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:46.169242 29385 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:46.224260 29431 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:46.247784 29509 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.200425 29239 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.276247 21566 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:09:46.280382 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 59167.8us
I20260709 13:09:46.251693 29484 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:46.264071 29522 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:09:46.256515 28880 consensus_meta.cc:287] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.002s
I20260709 13:09:46.264395 29527 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:46.268714 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 229495us
I20260709 13:09:46.316243 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4671) took 1155 ms. Trace:
I20260709 13:09:46.316653 21569 rpcz_store.cc:276] 0709 13:09:45.160902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.161073 (+   171us) service_pool.cc:224] Handling call
0709 13:09:45.161538 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.165637 (+  4099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.165684 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.229195 (+ 63511us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.591621 (+362426us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:45.591659 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.591727 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.316009 (+724282us) raft_consensus.cc:1685] finished
0709 13:09:46.316030 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.316183 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3545,"raft.queue_time_us":66663,"spinlock_wait_cycles":67004800,"thread_start_us":264336,"threads_started":1,"wal-append.queue_time_us":381637}
W20260709 13:09:46.308043 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 93633.3us
I20260709 13:09:46.320106 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:46.309577 29522 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:46.309480 29371 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.012s	sys 0.013s
I20260709 13:09:46.330206 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.330518 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:46.328601 21608 leader_election.cc:336] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.577s (SENT)
I20260709 13:09:46.331574 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:46.316114 28990 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:46.336429 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.337510 21459 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.334081 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.342587 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2561) took 2960 ms. Trace:
I20260709 13:09:46.343068 21634 rpcz_store.cc:276] 0709 13:09:43.382628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.963571 (+580943us) service_pool.cc:224] Handling call
0709 13:09:45.629813 (+1666242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.642423 (+ 12610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.342366 (+699943us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540024c550. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:46.342521 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3743824128}
I20260709 13:09:46.345124 29516 raft_consensus.cc:993] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: : Instructing follower a87bd86b86e74aa8bb61189215b73439 to start an election
I20260709 13:09:46.344818 29261 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.345626 29516 raft_consensus.cc:1081] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Signalling peer a87bd86b86e74aa8bb61189215b73439 to start an election
W20260709 13:09:46.346186 29499 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.732s	user 0.013s	sys 0.000s
I20260709 13:09:46.347002 22243 raft_consensus.cc:2393] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 14: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:46.347882 29239 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:46.348558 29472 raft_consensus.cc:3055] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:09:46.348990 29472 raft_consensus.cc:740] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:46.354979 29308 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:46.354523 29196 consensus_meta.cc:287] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.891s	user 0.008s	sys 0.000s
W20260709 13:09:46.333555 29371 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.012s	sys 0.014s
I20260709 13:09:46.358934 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.365860 22243 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:09:46.329185 29522 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:46.370028 29519 log.cc:927] Time spent T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:09:46.337790 29361 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:46.365929 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4672) took 1204 ms. Trace:
I20260709 13:09:46.315323 29171 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.361727 29425 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:46.380673 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:46.381075 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 44728.3us
I20260709 13:09:46.318995 29530 consensus_queue.cc:1059] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:09:46.372889 21562 rpcz_store.cc:276] 0709 13:09:45.161226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.161379 (+   153us) service_pool.cc:224] Handling call
0709 13:09:45.161814 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:45.228459 (+ 66645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.228492 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:45.229215 (+   723us) log.cc:844] Serialized 52 byte log entry
0709 13:09:45.577526 (+348311us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b1800277720. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ed7e07 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b820d1 00007f98a9f9da0f
0709 13:09:45.967076 (+389550us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:46.109144 (+142068us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.109442 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.109551 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.359047 (+249496us) raft_consensus.cc:1685] finished
0709 13:09:46.365636 (+  6589us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.365836 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3416,"prepare.queue_time_us":151804,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":117312,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":28303,"spinlock_wait_cycles":16184704,"thread_start_us":472199,"threads_started":2,"wal-append.queue_time_us":782347}
I20260709 13:09:46.383539 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.383823 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.386111 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:46.428782 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 53059.4us
I20260709 13:09:46.498850 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:46.499594 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.442828 21608 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 2.015s (SENT)
I20260709 13:09:46.500149 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:46.501574 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:46.504119 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 118112us
W20260709 13:09:46.505120 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.379490 29524 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:46.507460 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64707.8us
W20260709 13:09:46.374215 29520 log.cc:927] Time spent T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:09:46.515565 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:46.520210 22246 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:46.518858 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.518823 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.523363 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.382340 29464 consensus_queue.cc:1059] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.143s
I20260709 13:09:46.252777 29517 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:46.384738 29425 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:46.529773 22244 raft_consensus.cc:2410] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:09:46.560026 29425 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:46.514140 29261 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:46.279841 29509 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:46.567531 29531 log.cc:927] Time spent T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
W20260709 13:09:46.568660 29532 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:09:46.349812 29472 consensus_queue.cc:260] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:46.569707 29509 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:46.521113 29361 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:46.361618 29482 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:46.572942 21641 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 13:09:46.519445 29512 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:46.370882 29232 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.149s
I20260709 13:09:46.570421 29472 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:46.312819 29504 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.511987 29510 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:46.587532 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:46.588464 22245 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:46.368893 29196 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:46.571645 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.382493 29477 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.144s
I20260709 13:09:46.381700 29537 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:46.385159 29484 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:46.518355 29527 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:09:46.577006 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 53790.1us
I20260709 13:09:46.627645 22239 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:46.628337 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:46.575616 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 161828us
I20260709 13:09:46.628628 22245 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:46.580725 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:46.629196 22243 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 18: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:09:46.581420 29340 consensus_meta.cc:287] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.900s	user 0.012s	sys 0.001s
W20260709 13:09:46.612749 21608 leader_election.cc:336] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Timed out: RequestConsensusVote RPC to 127.19.231.130:41371 timed out after 1.696s (SENT)
I20260709 13:09:46.584952 29464 raft_consensus.cc:3055] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:46.647279 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.647730 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.557497 29389 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:46.628680 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.634227 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:46.587347 29510 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.617437 22246 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:46.644989 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.647951 21569 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:46.662957 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.663030 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.579581 29307 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:46.654342 22247 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 16: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:46.646265 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.658337 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.581836 29261 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:09:46.666653 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:46.669214 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 56506.9us
I20260709 13:09:46.669763 21569 raft_consensus.cc:2468] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:46.670912 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.671186 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.671838 21562 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:46.685197 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:46.643663 29347 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:46.724190 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:46.724385 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.647076 29464 raft_consensus.cc:740] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:46.715744 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.609109 29530 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.052s
I20260709 13:09:46.726164 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:46.728264 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 60545us
I20260709 13:09:46.731400 21569 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:09:46.733850 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.734972 22246 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:46.729143 21566 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:46.665745 29510 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:46.664785 29509 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:46.736984 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:46.637008 29527 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.659806 29308 consensus_queue.cc:1059] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:09:46.660506 29534 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:09:46.758824 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.759100 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:46.759644 22246 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:46.665295 29395 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 13:09:46.740576 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.744627 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:46.762241 21562 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:46.749781 29527 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:46.750514 21560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 4675) took 1305 ms. Trace:
I20260709 13:09:46.770079 21560 rpcz_store.cc:276] 0709 13:09:45.444937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.445075 (+   138us) service_pool.cc:224] Handling call
0709 13:09:46.750319 (+1305244us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b54003246d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:46.750430 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52026752}
I20260709 13:09:46.771350 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:46.771350 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:46.750705 21566 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:46.751436 21561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4693) took 1169 ms. Trace:
I20260709 13:09:46.751893 29517 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:46.754781 29196 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:46.754982 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40994 (request call id 4683) took 1190 ms. Trace:
I20260709 13:09:46.738605 29171 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:46.725505 29548 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:09:46.760748 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:46.767609 22244 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:09:46.768065 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.773839 22242 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:46.781343 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.772825 21561 rpcz_store.cc:276] 0709 13:09:45.581977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.582107 (+   130us) service_pool.cc:224] Handling call
0709 13:09:45.582377 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.696596 (+114219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.696639 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.699343 (+  2704us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.035498 (+336155us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:46.035541 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.751001 (+715460us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400152054. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:46.751064 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.751106 (+    42us) raft_consensus.cc:1685] finished
0709 13:09:46.751121 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.751374 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7964,"raft.queue_time_us":8094,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":40341,"spinlock_wait_cycles":243365504,"thread_start_us":265605,"threads_started":1,"wal-append.queue_time_us":361410}
I20260709 13:09:46.782394 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:46.734093 29523 log.cc:927] Time spent T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:46.776119 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.664376 29371 consensus_queue.cc:1059] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:09:46.779882 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:46.773294 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.775345 21563 rpcz_store.cc:276] 0709 13:09:45.564147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.564316 (+   169us) service_pool.cc:224] Handling call
0709 13:09:46.754770 (+1190454us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b54001d8654. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:46.754927 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179855232}
I20260709 13:09:46.807444 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.789145 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.790941 29431 raft_consensus.cc:3055] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:46.779119 29511 raft_consensus.cc:3055] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:46.795994 29171 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.819124 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:46.801990 29524 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:46.802657 29545 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:46.786108 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:46.803637 21569 raft_consensus.cc:2393] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:46.804622 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.829475 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:46.830024 21561 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:46.832154 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:46.810241 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.820915 21563 raft_consensus.cc:2393] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:46.822817 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:46.825592 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:46.827402 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 173815us
I20260709 13:09:46.840440 21566 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:46.845081 21566 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:46.840163 21560 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:46.849265 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:46.860289 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:46.859436 29534 raft_consensus.cc:3055] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:46.863256 29534 raft_consensus.cc:740] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:46.864238 29534 consensus_queue.cc:260] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.865396 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4691) took 1284 ms. Trace:
I20260709 13:09:46.866228 29527 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:46.868126 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:46.868988 29232 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:46.870098 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:46.870591 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:46.871840 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:46.872483 21643 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:46.873319 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:46.874050 21643 raft_consensus.cc:2393] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:46.875422 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4694) took 1293 ms. Trace:
I20260709 13:09:46.819128 29511 raft_consensus.cc:740] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:09:46.876688 29385 consensus_meta.cc:287] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.609s	user 0.001s	sys 0.008s
I20260709 13:09:46.875910 21567 rpcz_store.cc:276] 0709 13:09:45.582224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.583013 (+   789us) service_pool.cc:224] Handling call
0709 13:09:45.583313 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.583521 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:45.751478 (+167957us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.874845 (+1123367us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b1800098740. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a9b8a4bc 00007f98a6ed848b 00007f98afd32ab9 00007f98a6ef469b 00007f98a6ef293f 00007f98a6ef4c02 00007f98a9b7c20b 00007f98a9b81d23 00007f98a9b8223a
0709 13:09:46.875065 (+   220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.875117 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:46.875160 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.875235 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.875347 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1127,"prepare.queue_time_us":446567,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":6306,"spinlock_wait_cycles":47227648,"thread_start_us":470827,"threads_started":2,"wal-append.queue_time_us":449311}
I20260709 13:09:46.876607 29511 consensus_queue.cc:260] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:46.877213 29385 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.875610 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.865753 29534 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:46.865870 21564 rpcz_store.cc:276] 0709 13:09:45.581406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.585779 (+  4373us) service_pool.cc:224] Handling call
0709 13:09:45.595865 (+ 10086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.049024 (+453159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.865082 (+816058us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54000a0d54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:46.865327 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999511296}
I20260709 13:09:46.875303 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.880990 22244 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 22: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:46.881458 21643 raft_consensus.cc:1275] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:46.882889 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:46.891975 21635 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 24: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:46.820389 29431 raft_consensus.cc:740] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:46.896158 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:46.898381 21562 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 27.
I20260709 13:09:46.877887 29511 raft_consensus.cc:3060] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.879045 29484 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:46.903245 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.879514 29509 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:46.892896 29232 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:46.828397 29171 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:46.896347 29376 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:46.899528 29549 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.916623 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:46.920207 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:46.929275 22244 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 26.
I20260709 13:09:46.930218 22244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d"
dest_uuid: "549b31ac31b6428994b45938abc223a7"
mode: GRACEFUL
new_leader_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:58620
I20260709 13:09:46.901345 29371 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:09:46.932226 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 56703.7us
W20260709 13:09:46.932247 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 89750.3us
I20260709 13:09:46.909586 29389 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:46.917773 29527 consensus_queue.cc:1243] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 549b31ac31b6428994b45938abc223a7 log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:09:46.934011 21532 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:46.946448 29527 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:46.940068 29549 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.949054 29482 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:46.949218 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:46.950119 29549 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:46.947027 29527 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:46.950630 29482 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:46.951260 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.951520 29527 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.952888 29482 raft_consensus.cc:2764] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:09:46.953635 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.953549 21457 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:46.954921 29373 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:46.955446 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.955914 29411 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:46.955891 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.956421 29482 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:09:46.957890 29427 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:46.961069 29373 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:46.965724 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:46.969362 21642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58372 (request call id 4132) took 1430 ms (client timeout 1599 ms). Trace:
I20260709 13:09:46.969628 21637 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
W20260709 13:09:46.969875 21642 rpcz_store.cc:269] 0709 13:09:45.539036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.540008 (+   972us) service_pool.cc:224] Handling call
0709 13:09:46.969153 (+1429145us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b54001149d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:46.969294 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165457280}
I20260709 13:09:46.971393 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2584) took 1422 ms. Trace:
I20260709 13:09:46.971802 21637 rpcz_store.cc:276] 0709 13:09:45.548627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.666848 (+118221us) service_pool.cc:224] Handling call
0709 13:09:46.969312 (+1302464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.970234 (+   922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.971196 (+   962us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001149d0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:46.971332 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2994493184}
I20260709 13:09:46.972556 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.973778 29535 raft_consensus.cc:3055] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:46.974170 29450 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:46.974478 29522 consensus_meta.cc:287] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.000s
I20260709 13:09:46.899816 29307 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:09:46.974200 29535 raft_consensus.cc:740] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:46.927117 29376 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:46.983685 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:46.978492 21494 raft_consensus.cc:1240] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:46.979110 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:46.979799 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:46.919242 29504 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:46.975394 29373 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:46.983369 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:46.986230 21487 raft_consensus.cc:1240] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:09:46.987365 29522 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:46.988598 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:46.998777 21561 raft_consensus.cc:1275] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:47.000021 22244 raft_consensus.cc:606] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Received request to transfer leadership to TS a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.000505 22244 raft_consensus.cc:614] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:47.001659 22240 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
W20260709 13:09:47.005944 29554 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:09:46.989179 29461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.396s	user 0.007s	sys 0.019s
I20260709 13:09:46.989714 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:47.008713 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:46.989579 21637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b"
dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
 from {username='slave'} at 127.0.0.1:36050
I20260709 13:09:47.012115 21637 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.012689 21637 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.990702 29535 consensus_queue.cc:260] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:47.014928 21490 raft_consensus.cc:1275] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:09:46.934036 29371 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:46.991775 29171 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:46.992551 29385 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:46.986402 29376 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:46.996001 29482 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.984508 29450 consensus_queue.cc:1059] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:09:47.015398 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:47.020452 21641 raft_consensus.cc:1240] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:47.027858 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.021989 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:47.031582 21608 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:47.032493 21643 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:47.033213 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:47.024372 21487 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:47.032439 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:47.023217 29561 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:47.011309 29461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.420s	user 0.008s	sys 0.019s
I20260709 13:09:47.044493 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:47.046042 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:47.046989 21641 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:47.047564 21565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4685) took 1468 ms. Trace:
I20260709 13:09:47.047734 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:47.031410 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:47.041877 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:47.051340 21635 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 13:09:47.040865 29449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.010s	sys 0.030s
I20260709 13:09:47.039971 29530 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:47.059738 29450 raft_consensus.cc:3055] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:47.060312 29450 raft_consensus.cc:740] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:47.061430 29444 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:09:47.061129 29450 consensus_queue.cc:260] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:47.061838 29444 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:47.049096 21634 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:47.020521 29534 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:47.048017 21565 rpcz_store.cc:276] 0709 13:09:45.579466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.587539 (+  8073us) service_pool.cc:224] Handling call
0709 13:09:45.598010 (+ 10471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.687465 (+ 89455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.687495 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.687544 (+    49us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:45.687581 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.047348 (+1359767us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b5400128254. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:47.047396 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.047509 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205255936}
I20260709 13:09:47.021449 29371 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:47.049772 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:47.052156 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:47.062494 29450 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:47.074954 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.086036 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:47.087244 21490 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:47.084111 21641 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:47.026352 29535 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:47.042436 29561 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.039803 29232 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:47.087419 21485 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 26.
W20260709 13:09:47.090965 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.093108 21457 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:47.039637 29509 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:47.065764 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:47.023651 29511 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:09:47.056535 29314 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:47.095000 29472 consensus_meta.cc:287] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.006s
W20260709 13:09:47.083544 29449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.010s	sys 0.030s
I20260709 13:09:47.056399 29389 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:47.105772 29497 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 1.531s	user 0.018s	sys 0.010s
I20260709 13:09:47.055505 29361 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:47.123560 29510 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:47.125349 29495 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 1.654s	user 0.011s	sys 0.002s
I20260709 13:09:47.126904 21642 raft_consensus.cc:2368] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 26. Current term is 27.
I20260709 13:09:47.126021 29510 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:47.127311 21640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 4099) took 2223 ms. Trace:
I20260709 13:09:47.062644 29444 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:47.128463 29444 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:47.042682 29504 consensus_queue.cc:1048] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:09:47.093490 21637 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:47.109527 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.043056 29482 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:47.095623 29561 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:47.118315 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:47.141683 21639 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:47.141848 21485 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:47.100508 29207 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:47.144846 29207 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:47.147989 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.149214 21485 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 23.
I20260709 13:09:47.150763 29482 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:47.149214 29534 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:47.151580 29522 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:47.152154 29534 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:47.159381 29232 raft_consensus.cc:2764] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:09:47.160847 29561 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:47.103521 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:47.127871 21640 rpcz_store.cc:276] 0709 13:09:44.903806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.903933 (+   127us) service_pool.cc:224] Handling call
0709 13:09:44.906191 (+  2258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.906545 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.906574 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.907113 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.156177 (+249064us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:45.156236 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.156330 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.124597 (+1968267us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:47.126886 (+  2289us) raft_consensus.cc:1685] finished
0709 13:09:47.126919 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.127226 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":791,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":12516,"spinlock_wait_cycles":37825280,"thread_start_us":212403,"threads_started":1,"wal-append.queue_time_us":494548}
W20260709 13:09:47.169385 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 65953.2us
I20260709 13:09:47.175241 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:47.183658 29482 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:47.184192 29482 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.184566 29482 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:47.145987 29207 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:47.101408 29411 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:47.205040 21490 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:47.205125 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:47.205673 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:47.207530 21485 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 22. Ops: []
I20260709 13:09:47.095440 29347 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:09:47.099228 29488 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.072s
I20260709 13:09:47.216570 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:47.221104 21637 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:47.222870 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:47.100860 29385 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:09:47.162732 29389 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:47.233613 29389 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:47.162386 29171 consensus_queue.cc:1175] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a87bd86b86e74aa8bb61189215b73439" responder_term: 26 status { last_received { term: 26 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 26 index: 13 } }
I20260709 13:09:47.238104 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:47.235558 29085 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 13:09:47.264314 21488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6"
dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
mode: GRACEFUL
new_leader_uuid: "5727b19579474da6a12f79730b924770"
 from {username='slave'} at 127.0.0.1:60708
I20260709 13:09:47.265305 21488 raft_consensus.cc:606] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Received request to transfer leadership to TS 5727b19579474da6a12f79730b924770
I20260709 13:09:47.265725 21488 raft_consensus.cc:614] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:47.266835 21457 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:47.266459 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:47.271229 21457 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:47.188426 29392 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:09:47.283732 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:47.288121 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 238397us
I20260709 13:09:47.294687 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:47.294461 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:47.273403 29373 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.290683 29496 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 1.722s	user 0.005s	sys 0.017s
I20260709 13:09:47.287351 29385 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:47.302028 29385 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.302413 29385 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:47.304821 29482 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:47.306332 29561 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:47.297703 29347 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:47.307158 29347 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:47.307941 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:47.299851 22245 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:09:47.301174 29373 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:47.309391 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:47.307201 21636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 4114) took 2394 ms. Trace:
I20260709 13:09:47.287181 29378 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:09:47.310672 21491 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:09:47.311983 22243 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:09:47.299335 21488 raft_consensus.cc:2393] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 21: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:47.313544 21487 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:47.310026 21636 rpcz_store.cc:276] 0709 13:09:44.912368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.999176 (+ 86808us) service_pool.cc:224] Handling call
0709 13:09:44.999524 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.999849 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.999889 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.000414 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.319464 (+319050us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:45.319510 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.319601 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.258508 (+1938907us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:47.306898 (+ 48390us) raft_consensus.cc:1685] finished
0709 13:09:47.306922 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.307146 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":880,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":53806976,"thread_start_us":318664,"threads_started":1,"wal-append.queue_time_us":465255}
I20260709 13:09:47.291805 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:47.319617 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:47.322222 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:47.323503 21485 raft_consensus.cc:2410] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:09:47.326370 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:47.326907 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.329077 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:47.330380 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:47.330967 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.316423 29378 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.332394 29378 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:47.319743 29472 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.335312 29472 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:47.337611 29472 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:47.325527 29510 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:47.339107 29510 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:09:47.339597 29510 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 27 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:47.340545 29510 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:47.341248 21485 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:47.346009 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:47.308163 29347 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:47.347630 29347 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:47.348608 29373 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:47.351725 29232 consensus_queue.cc:1048] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:47.352604 29232 consensus_queue.cc:1243] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:47.357906 29232 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.358590 29232 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:47.359242 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 1370) took 1051 ms. Trace:
I20260709 13:09:47.359365 22241 raft_consensus.cc:1240] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:47.359637 22247 rpcz_store.cc:276] 0709 13:09:46.308362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.308522 (+   160us) service_pool.cc:224] Handling call
0709 13:09:47.359029 (+1050507us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54006dc754. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:47.359183 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730161408}
I20260709 13:09:47.360973 29232 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:47.365453 29261 consensus_queue.cc:1059] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:47.367141 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.368741 29261 raft_consensus.cc:3055] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:47.369541 29261 raft_consensus.cc:740] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:47.370654 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 842) took 1583 ms. Trace:
I20260709 13:09:47.371104 22239 rpcz_store.cc:276] 0709 13:09:45.786901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.787024 (+   123us) service_pool.cc:224] Handling call
0709 13:09:45.787348 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.628239 (+840891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.370405 (+742166us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b540073f854. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:47.370594 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1926572416}
W20260709 13:09:47.374507 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.376479 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:47.378252 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.379825 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 49007.1us
I20260709 13:09:47.389015 21568 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:47.382115 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.396420 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:47.399577 29314 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:47.401377 21643 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:47.403446 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:47.408206 29340 consensus_queue.cc:1059] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:47.409521 29530 raft_consensus.cc:3055] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:47.409919 29530 raft_consensus.cc:740] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:47.410729 29530 consensus_queue.cc:260] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:47.413645 22212 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.416836 29522 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:47.420161 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:47.433369 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:47.454617 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:47.377077 29561 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:47.473383 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:47.428341 29376 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:47.771453 29389 consensus_meta.cc:287] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.009s
I20260709 13:09:47.366163 29361 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:47.710985 21564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.028s	sys 0.057s
I20260709 13:09:47.780457 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:47.781430 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.380827 29373 raft_consensus.cc:2749] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:47.384622 29307 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.101s
W20260709 13:09:47.783659 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.383396 29392 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:47.371838 29261 consensus_queue.cc:260] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:47.787472 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.788214 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 406422us
I20260709 13:09:47.381170 29306 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:47.813787 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:47.383656 29548 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:09:47.808213 29444 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.679s	user 0.014s	sys 0.007s
W20260709 13:09:47.797617 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.850428 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:47.797694 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 378460us
I20260709 13:09:47.800635 21560 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 26. Current term is 27. Ops: [26.13-26.13]
I20260709 13:09:47.851217 21641 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:47.851744 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:47.802834 21564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.030s	sys 0.057s
I20260709 13:09:47.777742 21639 raft_consensus.cc:2955] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 10 to 13, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:47.853107 21636 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: []
W20260709 13:09:47.840692 21459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.857769 21493 raft_consensus.cc:2410] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 27 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 12.
W20260709 13:09:47.803725 29371 consensus_meta.cc:287] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.708s	user 0.018s	sys 0.002s
I20260709 13:09:47.789050 21563 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:47.846527 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:47.806437 29511 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:09:47.849134 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.809211 29171 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:47.826546 29535 consensus_meta.cc:287] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.014s
I20260709 13:09:47.875643 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.845768 29522 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:47.904505 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:47.905900 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:47.907610 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:47.923935 21636 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 22: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:47.804554 29389 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:47.813320 29378 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:47.889348 29261 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:47.885468 29373 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:47.878582 29510 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:47.845575 29392 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:47.919325 29511 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:47.882848 29371 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:47.979586 29577 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:47.982364 29461 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:47.868196 29534 consensus_queue.cc:1059] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:09:47.912117 29395 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:48.046581 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.028286 29529 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.897468 29464 consensus_queue.cc:260] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.052975 29529 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.049960 21560 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:47.980974 29580 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:48.053774 29395 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:47.998361 29510 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.021143 29561 consensus_queue.cc:1059] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
W20260709 13:09:48.081792 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.082563 29392 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:48.087288 29570 log.cc:927] Time spent T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:09:48.038196 29511 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 13:09:48.078548 29385 consensus_meta.cc:287] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.776s	user 0.018s	sys 0.003s
I20260709 13:09:48.099555 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.103742 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.104663 21561 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:48.106244 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:48.097462 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:48.090289 29561 consensus_queue.cc:1243] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 549b31ac31b6428994b45938abc223a7 log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:09:48.100697 29347 consensus_meta.cc:287] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.749s	user 0.020s	sys 0.000s
I20260709 13:09:48.120347 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.121609 21566 raft_consensus.cc:2410] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:09:48.056052 29577 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.135880 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:48.138346 29510 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:48.109711 29376 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.140066 21486 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:09:48.149020 21561 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:48.128042 29568 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:09:48.159864 21641 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
W20260709 13:09:48.160372 29569 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:09:48.149425 29488 consensus_queue.cc:1059] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:09:48.160146 29376 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.162088 29376 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:48.163060 29581 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:09:48.165081 21564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 2078) took 1009 ms. Trace:
W20260709 13:09:48.165436 29575 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:48.165940 29362 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:09:48.167661 29362 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:48.168036 29530 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:48.165669 21564 rpcz_store.cc:276] 0709 13:09:47.155376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.155512 (+   136us) service_pool.cc:224] Handling call
0709 13:09:47.155903 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.156271 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.156302 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.156770 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.852923 (+696153us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:09:48.110281 (+257358us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.111640 (+  1359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.112669 (+  1029us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.164846 (+ 52177us) raft_consensus.cc:1685] finished
0709 13:09:48.164869 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.165017 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":191,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":198,"thread_start_us":924583,"threads_started":2,"wal-append.queue_time_us":812538}
I20260709 13:09:48.172958 29482 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.175102 21564 raft_consensus.cc:1240] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:48.175680 21642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36050 (request call id 1749) took 1192 ms. Trace:
I20260709 13:09:48.176057 21642 rpcz_store.cc:276] 0709 13:09:46.983337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.983476 (+   139us) service_pool.cc:224] Handling call
0709 13:09:48.175493 (+1192017us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54000bcf54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:48.175626 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327183104}
I20260709 13:09:48.164945 29376 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.187233 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
W20260709 13:09:48.188203 21606 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.231.132:40323 timed out after 2.896s (SENT) [suppressed 27 similar messages]
I20260709 13:09:48.195258 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:48.196030 21485 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 27.
I20260709 13:09:48.107708 29385 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.202540 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:48.203450 21492 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:09:48.204519 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 293092us
I20260709 13:09:48.208132 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:48.208197 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:48.209957 21642 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
I20260709 13:09:48.213847 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:48.214088 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:48.196055 29529 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.220696 21489 raft_consensus.cc:2368] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 24. Current term is 25.
I20260709 13:09:48.217593 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:48.228807 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:48.219134 22245 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:09:48.232530 22245 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:48.233747 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:48.217144 29376 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:09:48.240343 29347 raft_consensus.cc:3055] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:48.240816 29347 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:48.240718 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:48.243090 22243 raft_consensus.cc:2393] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 16: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:48.249554 29171 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:48.250608 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:48.250937 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:48.252725 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:48.253942 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:48.215299 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.266530 21643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 4161) took 1215 ms. Trace:
I20260709 13:09:48.267210 21643 rpcz_store.cc:276] 0709 13:09:47.052934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.063845 (+ 10911us) service_pool.cc:224] Handling call
0709 13:09:47.064124 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.401914 (+337790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.266171 (+864257us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54001153d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:48.266436 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775066368}
I20260709 13:09:48.218693 29389 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.276999 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:48.277621 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:48.278887 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:48.279852 21485 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 27.
I20260709 13:09:48.271773 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.284220 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:48.284993 21640 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 26.
I20260709 13:09:48.274241 21492 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 27.
I20260709 13:09:48.250723 29371 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.241895 29347 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.283972 29451 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.275741 29376 consensus_queue.cc:1059] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:09:48.308732 29451 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.309461 29376 consensus_queue.cc:1243] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 5a34fd3290de493eb6bbe828dd742772 log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:09:48.310773 29573 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:09:48.311848 29451 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.292372 29389 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:09:48.327821 29582 log.cc:927] Time spent T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:09:48.289937 29583 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:09:48.318109 29347 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.343295 29577 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:48.399976 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 147074us
I20260709 13:09:48.402561 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:48.408149 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 272193us
I20260709 13:09:48.283360 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:48.411980 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:48.415446 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.417727 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:48.293967 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.420274 21564 raft_consensus.cc:2393] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:48.420502 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.421602 21565 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:09:48.421902 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.421970 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.425483 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.425721 21567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4702) took 1040 ms. Trace:
I20260709 13:09:48.433162 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.432137 21567 rpcz_store.cc:276] 0709 13:09:47.385102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.385242 (+   140us) service_pool.cc:224] Handling call
0709 13:09:47.385627 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.385976 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.386007 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.468520 (+ 82513us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.207860 (+739340us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:48.207897 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.210201 (+  2304us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.425096 (+214895us) raft_consensus.cc:1685] finished
0709 13:09:48.425143 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.425517 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":499,"raft.run_cpu_time_us":16764,"raft.run_wall_time_us":402351,"thread_start_us":367486,"threads_started":1,"wal-append.queue_time_us":492036}
I20260709 13:09:48.435914 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.422917 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:48.437742 21565 raft_consensus.cc:2376] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24. Re-sending same reply.
I20260709 13:09:48.438385 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:48.439476 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.426994 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:48.443913 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.444314 22210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.007s	sys 0.007s
W20260709 13:09:48.444952 22210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.007s
W20260709 13:09:48.446359 22211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.434494 21564 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 27: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:48.430370 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:48.444020 21635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58372 (request call id 4172) took 1107 ms. Trace:
I20260709 13:09:48.451761 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:48.452250 21635 rpcz_store.cc:276] 0709 13:09:47.336783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.337327 (+   544us) service_pool.cc:224] Handling call
0709 13:09:47.337686 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.774363 (+436677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.774395 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.774900 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.996892 (+221992us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:09:47.996940 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.997014 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.443199 (+446185us) raft_consensus.cc:1685] finished
0709 13:09:48.443261 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.443721 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15978,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"thread_start_us":381956,"threads_started":2,"wal-append.queue_time_us":430988}
I20260709 13:09:48.451252 21563 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:48.455564 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 603878us
I20260709 13:09:48.465158 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:48.466970 22239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1379) took 1075 ms. Trace:
I20260709 13:09:48.468206 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:48.479537 29171 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:48.475982 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.468789 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:48.476337 21565 pending_rounds.cc:85] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 9
I20260709 13:09:48.470399 22247 raft_consensus.cc:2410] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:09:48.467770 22239 rpcz_store.cc:276] 0709 13:09:47.391777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.454006 (+ 62229us) service_pool.cc:224] Handling call
0709 13:09:47.783135 (+329129us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.793365 (+ 10230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.793493 (+   128us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.803941 (+ 10448us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.110754 (+306813us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:48.465472 (+354718us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.465969 (+   497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.466132 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.466250 (+   118us) raft_consensus.cc:1685] finished
0709 13:09:48.466265 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.466616 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9242,"prepare.queue_time_us":247521,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":11054,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":11130,"thread_start_us":548582,"threads_started":2,"wal-append.queue_time_us":380939}
W20260709 13:09:48.469111 22241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.005s	sys 0.009s
W20260709 13:09:48.527135 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 338718us
W20260709 13:09:48.529286 21606 connection.cc:256] RPC call timeout handler was delayed by -1.4925366600000416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23470000000000002s for a response
W20260709 13:09:48.532974 21606 connection.cc:256] RPC call timeout handler was delayed by -1.2360656220000692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:09:48.532765 29504 consensus_queue.cc:1048] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:09:48.535902 21487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44644 (request call id 1380) took 1496 ms (client timeout 1992 ms). Trace:
W20260709 13:09:48.536495 21487 rpcz_store.cc:269] 0709 13:09:47.043955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.044229 (+   274us) service_pool.cc:224] Handling call
0709 13:09:48.535404 (+1491175us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54000b7f54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:48.535657 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408425344}
I20260709 13:09:48.538913 21494 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:09:48.540616 29451 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:48.541594 29484 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:09:48.542116 29484 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.542480 29484 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:09:48.547341 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.548403 22241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.009s	sys 0.016s
I20260709 13:09:48.512406 21565 pending_rounds.cc:107] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:09:48.556599 21565 raft_consensus.cc:2889] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:48.576875 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 100317us
I20260709 13:09:48.579641 22238 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:09:48.582188 29530 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
W20260709 13:09:48.580653 22242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 1368) took 2364 ms (client timeout 2186 ms). Trace:
I20260709 13:09:48.587191 29292 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:48.587596 29566 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:48.588053 29292 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.591185 29567 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:48.592216 29567 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.593302 29577 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:48.594250 29577 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:48.587611 22242 rpcz_store.cc:269] 0709 13:09:46.206592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.207400 (+   808us) service_pool.cc:224] Handling call
0709 13:09:48.547555 (+2340155us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54005fdcd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:48.570686 (+ 23131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":910142848}
I20260709 13:09:48.597236 29577 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:48.597661 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 129751us
I20260709 13:09:48.599457 29461 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:09:48.600435 29306 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:09:48.601732 29306 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:09:48.586952 29361 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:48.604368 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:48.611649 29584 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:48.613143 29510 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:48.614085 29510 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:48.616297 29261 consensus_meta.cc:287] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.010s
I20260709 13:09:48.610157 29385 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.591266 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:48.602198 29306 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:48.622900 29583 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:48.585063 29604 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:48.624541 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 156045us
I20260709 13:09:48.619848 29368 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:48.627518 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.630260 22241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1380) took 1237 ms. Trace:
I20260709 13:09:48.630748 22241 rpcz_store.cc:276] 0709 13:09:47.393224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.393890 (+   666us) service_pool.cc:224] Handling call
0709 13:09:47.781121 (+387231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.792177 (+ 11056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.792214 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.802356 (+ 10142us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.629787 (+827431us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:48.629881 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.629988 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.630029 (+    41us) raft_consensus.cc:1685] finished
0709 13:09:48.630039 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.630201 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10609,"raft.queue_time_us":11692,"spinlock_wait_cycles":24764160,"thread_start_us":687593,"threads_started":1,"wal-append.queue_time_us":513378}
W20260709 13:09:48.634042 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 114632us
I20260709 13:09:48.635483 29361 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:48.635954 21563 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:48.636022 29361 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.636776 29361 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:48.639079 29292 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.639912 29602 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.609021 29461 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:48.640772 29602 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.641767 29461 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.643211 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:48.644830 29306 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.645327 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:48.647019 29566 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:48.648098 29566 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:48.649353 29566 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:48.649833 29566 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:48.650326 29566 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:48.655786 21635 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:48.660429 29549 consensus_queue.cc:1059] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:09:48.662971 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.668219 21637 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:09:48.671710 21489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 2578) took 1367 ms. Trace:
I20260709 13:09:48.672269 21489 rpcz_store.cc:276] 0709 13:09:47.303839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.309168 (+  5329us) service_pool.cc:224] Handling call
0709 13:09:48.671292 (+1362124us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b540030d4d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:48.671512 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091179776}
I20260709 13:09:48.672979 29307 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:48.673945 29307 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.675673 29602 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.676407 29602 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.677026 29307 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.677167 21562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 2079) took 1503 ms. Trace:
I20260709 13:09:48.680745 21562 rpcz_store.cc:276] 0709 13:09:47.173523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.173661 (+   138us) service_pool.cc:224] Handling call
0709 13:09:47.173973 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.418292 (+1244319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.418339 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.418412 (+    73us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:48.418488 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.676734 (+258246us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540031f6d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:48.676781 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.676964 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2859799808}
I20260709 13:09:48.685197 29373 raft_consensus.cc:3055] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:48.685935 29373 raft_consensus.cc:740] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:48.686064 29567 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.650519 29510 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.677137 29602 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.720719 21493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 2571) took 1483 ms. Trace:
I20260709 13:09:48.721161 21493 rpcz_store.cc:276] 0709 13:09:47.237405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.237751 (+   346us) service_pool.cc:224] Handling call
0709 13:09:48.720179 (+1482428us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b540005c3d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:48.720506 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406935808}
I20260709 13:09:48.727521 21569 raft_consensus.cc:3055] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:48.728009 21569 raft_consensus.cc:740] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:48.728664 29450 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.729262 21569 consensus_queue.cc:260] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.729610 29450 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:48.731997 22240 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 1126) took 2349 ms (client timeout 2896 ms). Trace:
W20260709 13:09:48.732645 22240 rpcz_store.cc:269] 0709 13:09:46.382917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.383022 (+   105us) service_pool.cc:224] Handling call
0709 13:09:48.731444 (+2348422us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54006d2254. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:48.731772 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154274560}
I20260709 13:09:48.735090 22246 raft_consensus.cc:1240] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:48.736930 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 846) took 1976 ms. Trace:
I20260709 13:09:48.736634 29431 consensus_queue.cc:260] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.737283 22246 rpcz_store.cc:276] 0709 13:09:46.760665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.760851 (+   186us) service_pool.cc:224] Handling call
0709 13:09:48.734582 (+1973731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.735600 (+  1018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.736724 (+  1124us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54006d2250. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:48.736863 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4538129792}
I20260709 13:09:48.738615 29431 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:48.741775 29590 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:48.742875 29590 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.735000 21494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41300 (request call id 2577) took 1431 ms. Trace:
I20260709 13:09:48.743942 21494 rpcz_store.cc:276] 0709 13:09:47.303546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.308728 (+  5182us) service_pool.cc:224] Handling call
0709 13:09:48.538058 (+1229330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.539542 (+  1484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.734643 (+195101us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000b7f50. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:48.734904 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2826179456}
I20260709 13:09:48.744719 21568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40994 (request call id 4705) took 1352 ms. Trace:
I20260709 13:09:48.745482 29590 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.718602 29240 raft_consensus.cc:3055] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:48.747416 29240 raft_consensus.cc:740] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:48.747910 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:48.749210 29240 consensus_queue.cc:260] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.751120 29477 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:48.751526 29240 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:48.755009 21389 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 14 to 15, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 15 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:48.756553 29362 raft_consensus.cc:3055] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:48.756556 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:48.759298 29464 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:48.762250 21639 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:09:48.762552 29511 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.763243 21569 raft_consensus.cc:3060] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:48.745134 21568 rpcz_store.cc:276] 0709 13:09:47.392492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.392733 (+   241us) service_pool.cc:224] Handling call
0709 13:09:47.393135 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.036052 (+642917us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:48.285005 (+248953us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.660822 (+375817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.661084 (+   262us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:48.661196 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.744342 (+ 83146us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54001f90d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:48.744385 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.744557 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":255682,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":135,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":139,"spinlock_wait_cycles":1478025600,"thread_start_us":559028,"threads_started":2,"wal-append.queue_time_us":333272}
I20260709 13:09:48.763640 29395 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.766191 29307 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.766902 22238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1376) took 2193 ms. Trace:
I20260709 13:09:48.769639 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60044 (request call id 1381) took 1375 ms. Trace:
I20260709 13:09:48.773471 29378 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.775206 29369 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:48.780089 29510 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:48.790911 22238 rpcz_store.cc:276] 0709 13:09:46.573430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.573601 (+   171us) service_pool.cc:224] Handling call
0709 13:09:48.576607 (+2003006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.580168 (+  3561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.766589 (+186421us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54005fdcd0. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe18ad 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:48.766802 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4539973504}
I20260709 13:09:48.746619 29602 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.791291 22247 rpcz_store.cc:276] 0709 13:09:47.394349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.394999 (+   650us) service_pool.cc:224] Handling call
0709 13:09:48.769182 (+1374183us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400603454. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:48.769520 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561310592}
W20260709 13:09:48.707075 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 47538.6us
I20260709 13:09:48.798396 29427 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.799052 29427 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.785597 29362 raft_consensus.cc:740] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:48.803325 29427 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.803975 29362 consensus_queue.cc:260] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.808626 29362 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:48.811079 29511 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.813954 29511 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:48.811108 29510 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.815692 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:48.816660 29567 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:48.816936 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 109481us
I20260709 13:09:48.817271 29577 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:48.817935 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:48.817926 29577 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.766101 29373 consensus_queue.cc:260] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.820721 29373 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:48.821754 29577 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:48.796064 29307 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.826632 29450 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.792186 29306 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:09:48.784934 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 193934us
I20260709 13:09:48.845832 21569 raft_consensus.cc:1275] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:09:48.847015 21569 pending_rounds.cc:85] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 15
I20260709 13:09:48.851581 21569 pending_rounds.cc:107] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:09:48.851931 21569 raft_consensus.cc:2889] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.818692 29484 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.864483 21569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36572 (request call id 2069) took 2124 ms. Trace:
W20260709 13:09:48.866212 29347 consensus_meta.cc:287] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.519s	user 0.003s	sys 0.012s
I20260709 13:09:48.866147 29584 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.865046 21569 rpcz_store.cc:276] 0709 13:09:46.742401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.829392 (+ 86991us) service_pool.cc:224] Handling call
0709 13:09:46.891630 (+ 62238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.727233 (+1835603us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b54001e9c20. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9f59dc0 00007f98a9fe41c0 00007f98a9fe5231 00007f98a9fe1d8f 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c
0709 13:09:48.858487 (+131254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.864426 (+  5939us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120272128}
W20260709 13:09:48.918747 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.863214 29577 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:48.922327 21567 raft_consensus.cc:2368] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
W20260709 13:09:48.870707 29308 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 13:09:48.930887 29527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.881s	user 0.009s	sys 0.017s
W20260709 13:09:48.931360 29527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.968s	user 0.009s	sys 0.017s
I20260709 13:09:48.868566 29584 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:48.939424 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 75448.2us
I20260709 13:09:48.940418 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:48.864890 29361 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.944376 29361 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:48.945322 29527 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:48.948854 29239 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.954000 29484 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.957683 21494 raft_consensus.cc:1240] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:09:48.958297 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:48.962806 21489 raft_consensus.cc:1240] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260709 13:09:48.959386 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 141580us
I20260709 13:09:48.960897 29567 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:09:48.965016 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:48.972301 21637 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:48.971208 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:48.974864 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:48.960295 29577 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:48.958969 29239 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:48.977375 29577 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.972975 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7
W20260709 13:09:48.969527 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.956523 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 90257.8us
I20260709 13:09:48.971092 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:48.983526 21638 raft_consensus.cc:2393] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 24: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:09:48.983621 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.987463 29510 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:48.991025 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:48.991875 21568 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 28: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:48.992928 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:48.996948 29566 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:48.997645 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:48.998219 21560 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:48.999461 21569 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:49.000828 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:49.001422 21569 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:49.001502 21561 raft_consensus.cc:1240] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:49.002349 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:49.002971 21561 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:49.003528 21562 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:09:49.003902 21562 pending_rounds.cc:85] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 12
I20260709 13:09:49.004163 21562 pending_rounds.cc:107] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:09:49.004390 21562 raft_consensus.cc:2889] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.964262 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:49.006614 21569 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:48.954747 29307 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.014961 21563 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:49.020677 21638 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:09:49.021150 21638 pending_rounds.cc:85] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 10
I20260709 13:09:49.021410 21638 pending_rounds.cc:107] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:09:49.021651 21638 raft_consensus.cc:2889] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.023087 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:49.025610 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:49.026324 22246 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:49.026644 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:49.026684 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:49.027599 22244 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:49.027626 22238 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:48.961024 29615 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:49.033638 29615 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:49.034909 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.036108 29615 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.042618 21637 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:48.867379 29378 consensus_queue.cc:1059] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.128s
W20260709 13:09:49.045966 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.055940 21560 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:48.978771 29239 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:48.981313 29567 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 27 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:49.078683 21561 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:09:49.082154 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:49.081534 21389 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 24 to 25, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 25 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:49.074631 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:49.082924 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:48.959199 29527 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:49.086261 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.086637 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.036768 29615 consensus_queue.cc:1059] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:09:49.092414 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.093459 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.094177 29567 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.097930 21562 raft_consensus.cc:1240] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:09:49.090415 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:49.094210 21642 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 26.
W20260709 13:09:49.100446 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.101049 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:49.086525 29584 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.105360 29566 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.106288 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:49.109210 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:49.111090 21494 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:49.115093 29425 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:49.116091 29602 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:49.123422 21608 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:49.126943 22240 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:49.100600 29549 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:49.128087 21638 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
W20260709 13:09:49.132828 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 159965us
W20260709 13:09:49.133736 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 96429us
I20260709 13:09:49.125809 29362 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:09:49.142045 21490 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:49.143293 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:49.149878 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:49.150338 21490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41300 (request call id 2575) took 1847 ms (client timeout 1704 ms). Trace:
I20260709 13:09:49.129338 29464 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:49.150816 21490 rpcz_store.cc:269] 0709 13:09:47.302807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.307661 (+  4854us) service_pool.cc:224] Handling call
0709 13:09:49.150079 (+1842418us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54003f9154. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:49.150256 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4150842752}
I20260709 13:09:49.130304 29602 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:49.139709 21389 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 17 to 19, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 19 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:49.132169 29549 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:49.155191 22238 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:49.157989 22238 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:49.159723 22238 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.160194 29603 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:09:49.160717 29603 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.161115 29603 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:49.161231 22238 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:49.162850 21535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.166978 29425 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:49.168140 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.147415 29307 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.169464 29425 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.169806 29307 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.171993 29307 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.173445 29527 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.146970 29589 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.170163 22238 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
I20260709 13:09:49.174291 29589 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.177529 29589 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.178319 29461 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.178893 29461 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.179828 29510 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:49.180429 29510 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:49.180949 29602 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.181380 29510 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.182369 29602 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:49.183663 29621 log.cc:927] Time spent T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:49.183349 29464 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:49.185082 21388 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 247) took 18761 ms (client timeout 15000 ms). Trace:
I20260709 13:09:49.185607 29464 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.183357 21552 tablet_service.cc:1558] Processing DeleteTablet for tablet cc9f5258ae3f4790a9bc1813d73ec987 with delete_type TABLET_DATA_TOMBSTONED (TS 5727b19579474da6a12f79730b924770 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:36498
W20260709 13:09:49.192318 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.159736 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:49.195426 21532 leader_election.cc:400] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 24. Current term is 25.
I20260709 13:09:49.195313 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:49.195775 21532 leader_election.cc:403] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:49.201864 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 46088.6us
I20260709 13:09:49.203123 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:49.205794 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:49.209295 29361 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:49.210100 29361 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:49.210079 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:49.210899 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:49.197343 29362 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 27 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:49.202124 29527 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 24. Current term is 25.
I20260709 13:09:49.204466 29577 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:49.236531 21563 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 28.
I20260709 13:09:49.219213 29450 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:49.242486 22244 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
W20260709 13:09:49.249922 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.221897 29307 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:09:49.222471 29425 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:49.258602 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45881.4us
W20260709 13:09:49.260139 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53500.9us
I20260709 13:09:49.241500 29308 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:49.265663 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.266942 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:49.265322 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 111572us
I20260709 13:09:49.267627 21642 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:49.268603 21389 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:49.273438 21534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.273571 29522 consensus_queue.cc:1048] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:09:49.274322 21459 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:49.275286 29482 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:09:49.275699 29482 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.276093 29604 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:09:49.259451 29425 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.276690 29604 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 25 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:49.276830 29425 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:49.277700 29085 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:49.277796 29604 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.276098 29482 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:49.279219 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.280063 21640 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:09:49.290975 21638 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:09:49.291232 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.292270 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.292887 29308 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.293537 29308 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.295181 29239 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:49.295457 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 85471.7us
I20260709 13:09:49.295876 29239 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.297556 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:49.298530 22210 leader_election.cc:400] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 26. Current term is 27.
I20260709 13:09:49.292932 21642 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
I20260709 13:09:49.292275 21635 raft_consensus.cc:2410] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 25 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
W20260709 13:09:49.185490 21388 rpcz_store.cc:269] 0709 13:09:30.423794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.425441 (+  1647us) service_pool.cc:224] Handling call
0709 13:09:49.184856 (+18759415us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:39.865484 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:39.925456 (+ 59972us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:39.937514 (+ 12058us) write_op.cc:435] Acquired schema lock
0709 13:09:39.945472 (+  7958us) tablet.cc:662] Decoding operations
0709 13:09:40.064930 (+119458us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:40.068130 (+  3200us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:40.083399 (+ 15269us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:09:40.191019 (+107620us) tablet.cc:701] Row locks acquired
0709 13:09:40.191054 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:09:40.191258 (+   204us) write_op.cc:270] Start()
0709 13:09:40.191444 (+   186us) write_op.cc:276] Timestamp: P: 1783602580191202 usec, L: 0
0709 13:09:40.191473 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:09:40.192313 (+   840us) log.cc:844] Serialized 3239 byte log entry
0709 13:09:40.571482 (+379169us) op_driver.cc:464] REPLICATION: finished
0709 13:09:40.779720 (+208238us) write_op.cc:301] APPLY: starting
0709 13:09:40.785242 (+  5522us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:41.139433 (+354191us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:41.158439 (+ 19006us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:41.982132 (+823693us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:42.018007 (+ 35875us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:09:42.024316 (+  6309us) write_op.cc:312] APPLY: finished
0709 13:09:42.058384 (+ 34068us) log.cc:844] Serialized 81 byte log entry
0709 13:09:42.367809 (+309425us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:42.380095 (+ 12286us) write_op.cc:454] Released schema lock
0709 13:09:42.382343 (+  2248us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:42.404288 (+ 21945us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:42.404325 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":261434,"reported_tablets":35,"spinlock_wait_cycles":14592,"child_traces":[["op",{"apply.queue_time_us":188994,"apply.run_cpu_time_us":68032,"apply.run_wall_time_us":1631768,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37535,"num_ops":8,"prepare.queue_time_us":63965,"prepare.run_cpu_time_us":32766,"prepare.run_wall_time_us":393854,"raft.queue_time_us":113020,"raft.run_cpu_time_us":9302,"raft.run_wall_time_us":149014,"replication_time_us":364971,"thread_start_us":499939,"threads_started":5,"wal-append.queue_time_us":527053,"wal-append.run_cpu_time_us":14064,"wal-append.run_wall_time_us":2295585}]]}
W20260709 13:09:49.313967 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 118765us
I20260709 13:09:49.315346 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.311729 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:49.302875 29527 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:49.315371 21389 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 11 to 12, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 12 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.317770 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:49.267390 29577 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.333693 29369 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:49.335741 29369 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.335927 29239 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.336176 29369 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:49.335400 21389 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 reported cstate change: leader changed from <none> to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 16 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.337646 29627 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.338326 29627 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.339855 29373 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.340539 29373 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.340895 29627 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.341910 29389 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.320255 29527 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.342495 29389 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.343063 29527 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:49.344707 29389 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.346028 29461 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.347640 29308 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.348344 29577 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.348556 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:49.348692 29628 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.349463 21568 raft_consensus.cc:2393] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 24: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:49.349357 29628 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.353997 29566 raft_consensus.cc:3055] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:49.354529 29566 raft_consensus.cc:740] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:49.354909 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.355593 21634 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:09:49.358624 29549 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.360371 29549 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:49.360484 29630 log.cc:927] Time spent T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:09:49.363991 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:49.364666 21635 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 27 LEADER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:49.366042 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:49.367726 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:49.368775 29368 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:49.370390 29368 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:49.320271 29307 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:49.322082 29522 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:49.337766 21389 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.380751 29567 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:49.383637 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:49.390446 29628 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.371244 29472 consensus_queue.cc:1059] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:09:49.390672 29567 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.391218 29548 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.370766 29368 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.370985 29427 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:09:49.375891 29362 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.392961 29567 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.393603 29584 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:09:49.394317 29584 consensus_queue.cc:1243] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 27.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 13:09:49.354166 29482 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.396600 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:49.403982 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:49.342716 29373 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.405820 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:49.406991 21568 raft_consensus.cc:2410] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:09:49.391803 29368 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:49.394920 29461 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:09:49.384581 29522 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.387768 29308 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:49.388075 29389 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:49.387373 29484 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.418218 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.419278 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.391799 29548 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.406042 29511 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:49.407024 29628 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:49.443933 29482 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.418256 29461 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:49.451462 29602 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:49.451809 29425 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.452497 29566 consensus_queue.cc:260] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.453748 29464 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:49.421663 29522 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:49.410943 29307 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.457219 21634 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 22.
I20260709 13:09:49.460819 21389 catalog_manager.cc:5697] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.468602 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:49.472973 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.471081 21635 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:49.499315 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:49.507800 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 135596us
W20260709 13:09:49.505916 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 223572us
I20260709 13:09:49.510162 21459 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:49.510462 21533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.438445 29484 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.519712 29566 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:49.520545 29484 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:49.515116 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 180183us
I20260709 13:09:49.505199 29602 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.517580 29425 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.529384 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:49.532662 29527 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.533072 29369 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.534201 29604 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:09:49.535777 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:49.537037 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:49.538828 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:49.539920 21642 raft_consensus.cc:2410] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:09:49.540490 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:49.545104 21561 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:49.473897 29464 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:49.545300 21564 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:49.467702 29589 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.079s
I20260709 13:09:49.561808 21562 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:49.559331 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:49.565084 21643 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:49.565582 29464 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.566685 29464 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:49.563093 21389 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.571508 29369 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.579094 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:49.579869 21561 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:49.580796 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:49.549196 29604 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:49.585810 29632 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:49.591148 29368 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.591804 29522 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.591930 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:49.592903 21567 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 28: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:49.593469 29368 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.594885 29604 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.596187 29548 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.561424 29628 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:49.601696 29602 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:49.585989 29613 log.cc:927] Time spent T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:09:49.610005 29633 log.cc:927] Time spent T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:09:49.610672 29635 tablet_replica.cc:333] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:09:49.594975 29522 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.585848 29527 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:49.640154 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 103217us
W20260709 13:09:49.667517 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.672217 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:49.688244 21490 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 23.
I20260709 13:09:49.673255 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:49.673818 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:49.674017 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:49.689507 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 218830us
I20260709 13:09:49.674408 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:49.675163 21485 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:49.675446 29635 raft_consensus.cc:2243] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.577416 29461 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.629804 29389 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:49.682860 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 122505us
I20260709 13:09:49.673743 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:49.664695 21389 catalog_manager.cc:5697] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.666682 29639 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:49.686399 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:49.689167 21486 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
I20260709 13:09:49.698685 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:49.690032 21487 raft_consensus.cc:2376] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14. Re-sending same reply.
W20260709 13:09:49.691871 29603 consensus_meta.cc:287] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.003s
I20260709 13:09:49.730755 21489 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:49.730947 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 45798.1us
I20260709 13:09:49.659253 29307 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.722411 21643 raft_consensus.cc:2410] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:09:49.732882 22210 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:49.732486 21493 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:49.735745 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:49.736435 21637 raft_consensus.cc:3060] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:49.736809 29472 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:49.737546 29472 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.740150 29509 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.740450 29472 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.740840 29509 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:49.744102 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 45533.9us
I20260709 13:09:49.744896 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:49.747103 29643 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:49.747650 29643 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:49.748046 29643 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:49.750901 29629 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.751754 29629 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.751030 29362 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:49.752724 29362 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:49.753255 29362 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:49.754292 29629 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.755640 29635 raft_consensus.cc:2272] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.761798 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 75479.3us
I20260709 13:09:49.692749 29510 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.766203 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:49.768852 21561 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:49.770751 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.770946 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:49.771775 21634 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:49.768556 21459 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:49.721161 29566 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:49.783002 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.742554 29472 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:49.791378 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 208563us
I20260709 13:09:49.789124 21389 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 18 to 19, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 19 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.793264 21606 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:49.767432 29461 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:49.795706 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:49.770694 29482 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:49.797806 21565 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:49.773861 29085 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:49.781702 29369 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:49.802098 21389 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 17 to 18, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 18 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:49.787567 29427 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:49.760928 29603 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.809695 29472 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.818428 29619 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.819077 29619 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.821264 29619 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.828540 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:49.829452 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:49.831777 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:49.832465 22242 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
W20260709 13:09:49.834399 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 46914.6us
I20260709 13:09:49.835031 29369 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:49.801034 29482 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.806165 29085 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.829551 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:49.845808 22244 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 23: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:49.837680 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:49.796239 29567 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.788578 29510 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.842907 21637 raft_consensus.cc:2468] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 23.
I20260709 13:09:49.836308 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:49.851296 21639 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:49.843637 29369 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.796065 29566 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.852762 21634 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 25.
I20260709 13:09:49.839618 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:49.855100 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:49.859220 21563 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:49.866269 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:49.847357 29482 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:49.847756 29085 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:49.873214 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.873309 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:49.874042 21643 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:49.847842 29509 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.857985 29369 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:49.862385 29629 raft_consensus.cc:2764] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election decision vote started in defunct term 24: won
I20260709 13:09:49.896282 21643 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 28.
W20260709 13:09:49.897248 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 114179us
I20260709 13:09:49.896867 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:49.904083 29472 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.915145 29389 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:49.915691 29389 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:49.916136 29389 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:49.904470 29306 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:49.926203 29306 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.926743 29306 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:49.927783 29652 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.110s	user 0.001s	sys 0.002s
W20260709 13:09:49.928188 29647 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:49.870411 29567 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:49.930946 29648 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:49.926501 21641 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
W20260709 13:09:49.938097 29646 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:09:49.938146 29566 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.944792 29603 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:49.949195 29567 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.955075 29635 ts_tablet_manager.cc:1916] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:49.955377 29510 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:49.957479 29362 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:49.960669 29362 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:49.974597 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 77832.4us
I20260709 13:09:50.001511 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:49.974494 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 134985us
W20260709 13:09:49.978001 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 70452.5us
I20260709 13:09:49.984297 21639 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
W20260709 13:09:50.000360 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.983619 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 70819.8us
W20260709 13:09:50.012027 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.070036 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.011219 29484 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:50.072702 22242 raft_consensus.cc:2368] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
I20260709 13:09:50.072870 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.075525 22244 raft_consensus.cc:2393] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:50.079537 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.079502 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.011078 29602 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:50.079792 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.073889 29648 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:50.087502 29648 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.088394 29464 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.089241 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.089198 29464 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:50.091066 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 82095us
W20260709 13:09:50.091110 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 81071.2us
I20260709 13:09:50.092381 21459 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:50.095152 29654 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:50.095705 29654 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:50.096686 29654 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.071072 29527 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.074800 29589 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.099260 29527 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.099807 29589 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.101452 29527 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:49.990343 29643 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.103765 29643 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:50.092324 29464 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:50.109274 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.109071 29389 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.111068 22243 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:50.112524 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.114859 22210 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:50.082934 29510 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:50.131469 22210 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:50.131296 29510 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.132198 29650 raft_consensus.cc:2804] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:50.115825 29482 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.133591 29510 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:50.134280 29482 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:50.098094 29369 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.126240 29602 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.122984 29527 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:50.130419 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 62246.2us
I20260709 13:09:50.074601 29484 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:50.085501 29603 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.102602 29589 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:50.166592 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.168936 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.169612 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:50.170589 21634 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 28: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:50.172057 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.135087 29650 raft_consensus.cc:697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 23 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:50.142912 29584 raft_consensus.cc:2804] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:09:50.178007 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.178695 29369 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:50.179271 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.180235 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.180794 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.175765 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:50.169615 21493 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:50.181532 21608 leader_election.cc:400] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
I20260709 13:09:50.181939 21608 leader_election.cc:403] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:50.154357 29484 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:50.185954 21494 raft_consensus.cc:2393] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 28: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:50.188786 22242 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:50.191617 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.193717 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.195045 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:50.195626 21488 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.195798 29510 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:50.201215 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.202760 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.203727 21493 raft_consensus.cc:2393] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:50.204936 29650 consensus_queue.cc:237] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.164413 29527 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.217041 29527 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:50.217970 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.221251 29648 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:50.221367 21488 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:50.167207 29603 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.224148 29603 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:50.233408 29085 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.236941 29306 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.239245 29389 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:50.245615 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 151785us
I20260709 13:09:50.247783 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:50.249502 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 156253us
I20260709 13:09:50.282913 21457 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:50.286417 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.288739 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.292245 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:50.293118 21561 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:50.302191 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:50.302814 21560 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 13:09:50.303270 21565 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:50.307648 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.309437 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.309330 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.310549 21560 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:50.311895 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.314675 21560 raft_consensus.cc:2393] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 23: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:50.308645 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.316300 21567 raft_consensus.cc:2410] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
W20260709 13:09:50.316992 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 141215us
I20260709 13:09:50.266474 29389 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:50.321735 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:50.322032 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.322408 21494 raft_consensus.cc:3060] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:50.296605 29584 raft_consensus.cc:697] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 25 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:50.325383 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.325466 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:50.340031 22243 raft_consensus.cc:3060] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.286092 29527 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:50.326324 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.326217 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
W20260709 13:09:50.335309 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 177420us
I20260709 13:09:50.318221 29657 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:09:50.326188 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.335323 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.344765 21493 raft_consensus.cc:2410] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 13:09:50.345103 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.337975 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:50.338678 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.346624 21564 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:09:50.327224 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.346828 22244 raft_consensus.cc:2368] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21.
I20260709 13:09:50.340031 22245 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:50.348209 21488 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:50.343288 21489 raft_consensus.cc:2393] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:50.343962 21486 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:50.349646 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.351719 21566 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:09:50.353009 21606 leader_election.cc:400] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
I20260709 13:09:50.353302 21561 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 28.
I20260709 13:09:50.357367 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:50.358126 21567 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:09:50.358592 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:50.348460 29527 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.344362 29307 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.362725 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.327857 29389 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.361214 21566 raft_consensus.cc:1240] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:50.364907 29527 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:50.379002 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 43850.4us
I20260709 13:09:50.381073 21459 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:50.351343 29306 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:50.382187 29472 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:50.368530 21606 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:50.371615 21567 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:09:50.384418 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.360101 29602 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:50.385938 22243 raft_consensus.cc:2468] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:50.385823 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:50.387636 21567 raft_consensus.cc:2368] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 27. Current term is 28.
I20260709 13:09:50.360428 29639 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.367405 29085 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:50.387313 29629 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.387681 29590 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:50.394438 29590 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.394886 29590 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.397596 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.399215 29584 consensus_queue.cc:237] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.424786 29484 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.367463 29657 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:50.431773 29657 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.434454 29639 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.367151 29307 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.443334 29461 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.443929 29461 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.459092 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:50.463245 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 79356.4us
I20260709 13:09:50.464071 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:50.482973 21562 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 27. Current term is 28. Ops: []
I20260709 13:09:50.494532 21494 raft_consensus.cc:2468] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 25.
W20260709 13:09:50.483827 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 109916us
W20260709 13:09:50.495371 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 133426us
W20260709 13:09:50.496062 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.496706 21564 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:50.498345 22212 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:50.501911 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.502946 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:50.509826 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 141343us
I20260709 13:09:50.511816 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:50.513221 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:50.513873 21641 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:09:50.515498 29629 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:50.515658 29389 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:50.517273 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.520027 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.525170 21641 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 28.
I20260709 13:09:50.528198 21635 raft_consensus.cc:3055] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:09:50.528752 21635 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:50.533032 21565 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:50.535738 21562 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:50.539021 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:50.540782 21564 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:50.514691 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.541659 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.542303 21494 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 29.
I20260709 13:09:50.497563 29472 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:09:50.546404 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:50.553954 21489 raft_consensus.cc:3060] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:50.554841 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:50.555527 21487 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:50.558211 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:50.560798 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:50.557669 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:50.560892 21459 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:50.553800 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.564687 21640 raft_consensus.cc:2368] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25.
I20260709 13:09:50.525110 29389 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.567726 21494 raft_consensus.cc:1240] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:50.572021 21564 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:50.565333 22212 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:50.573071 21642 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:09:50.536173 29522 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:50.497267 29667 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:09:50.546993 29240 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.576691 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.544080 29484 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:50.553828 29369 raft_consensus.cc:2804] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:50.579082 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.579349 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.587286 21634 raft_consensus.cc:2410] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:09:50.579696 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.579358 21643 raft_consensus.cc:3055] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:09:50.587718 21643 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:50.526007 29654 consensus_queue.cc:1059] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:09:50.552817 29461 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:50.582357 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.589493 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.563699 29472 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:50.591636 21640 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:50.596122 21493 raft_consensus.cc:2368] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 23. Current term is 24.
I20260709 13:09:50.601802 29307 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:50.577471 29389 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.604523 29389 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:50.588307 29240 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.584069 29522 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.608848 21562 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:09:50.609294 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 51725us
I20260709 13:09:50.611004 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:50.608628 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:50.614573 21640 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:09:50.617198 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:50.585602 29619 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:50.589939 21643 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.620236 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.621264 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:50.623338 29671 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:50.586396 29589 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:50.624310 21493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.627311 29650 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:50.627789 29650 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.628131 29650 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.589596 29672 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:50.631310 21635 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.631966 29619 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:50.632283 21635 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:50.632972 29619 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.637293 29674 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:50.637867 29674 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:50.637604 29650 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.638296 29674 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:50.638923 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:50.639510 21636 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:50.640344 29650 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:50.623680 29679 log.cc:927] Time spent T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:09:50.646509 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:50.647784 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.648257 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.648931 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.649840 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.650094 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.650226 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:50.651157 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:50.651541 21491 raft_consensus.cc:1240] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 27. Current term is 28. Ops: []
I20260709 13:09:50.651615 29589 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:50.651965 21488 raft_consensus.cc:2410] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
W20260709 13:09:50.652807 29680 log.cc:927] Time spent T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:09:50.652756 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.653743 21643 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:50.652690 29589 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.654690 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.657629 29629 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.658249 29629 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.659134 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.659921 21564 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:50.660374 29240 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:50.652913 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.670153 21488 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:50.670491 21494 raft_consensus.cc:1240] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 25 LEADER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:50.671315 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:50.668880 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 88315.1us
W20260709 13:09:50.662981 29652 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:09:50.677529 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.675575 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:50.631246 29672 raft_consensus.cc:697] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:50.615532 29369 raft_consensus.cc:697] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:50.600435 29590 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.678597 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:50.692700 21485 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:09:50.697543 22243 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:50.695839 21489 raft_consensus.cc:2468] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
W20260709 13:09:50.698535 21608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.702574 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.703648 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.704329 22245 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:09:50.705638 21562 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:50.707780 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:50.709400 29672 consensus_queue.cc:237] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.715935 29522 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:50.719966 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.721287 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.679374 29650 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.725729 22244 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 18. (term mismatch)
I20260709 13:09:50.726117 21459 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:50.717845 21608 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:50.720642 21485 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:50.697160 29450 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:50.741130 21491 raft_consensus.cc:2368] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:09:50.732287 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.728230 21643 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 15. (term mismatch)
I20260709 13:09:50.744884 21643 pending_rounds.cc:85] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 14
I20260709 13:09:50.745090 22244 pending_rounds.cc:85] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 17
I20260709 13:09:50.747514 22244 pending_rounds.cc:107] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 26.18
I20260709 13:09:50.747915 22244 raft_consensus.cc:2889] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.731788 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.746543 29603 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:50.749122 21643 pending_rounds.cc:107] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 27.15
I20260709 13:09:50.749945 21606 leader_election.cc:400] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 23. Current term is 24.
I20260709 13:09:50.751538 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.751680 21606 leader_election.cc:403] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:50.752240 21489 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:09:50.752509 21643 raft_consensus.cc:2889] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.751179 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:50.727324 29510 consensus_meta.cc:287] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.003s
I20260709 13:09:50.756285 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:50.748880 21488 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:50.761263 22244 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 19. (term mismatch)
I20260709 13:09:50.761807 22244 pending_rounds.cc:85] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 18
I20260709 13:09:50.762126 22244 pending_rounds.cc:107] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 26.19
I20260709 13:09:50.762887 22244 raft_consensus.cc:2889] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:50.763589 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45843us
I20260709 13:09:50.727033 29648 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:50.765209 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.765511 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:50.766117 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:50.763698 21457 leader_election.cc:400] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25.
I20260709 13:09:50.766927 21457 leader_election.cc:403] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:09:50.771345 21532 leader_election.cc:400] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21.
I20260709 13:09:50.748183 29567 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:50.771792 21532 leader_election.cc:403] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:50.759390 21568 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:50.771579 29684 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:50.779138 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:50.782815 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:50.783463 29681 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:09:50.784132 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.784811 22241 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:50.786131 29650 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:09:50.786598 29650 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:50.786978 29650 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:09:50.789234 29522 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:50.789814 29522 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.795507 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.796227 22246 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:50.797489 29650 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.783326 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:50.774858 21608 leader_election.cc:400] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 27. Current term is 28.
I20260709 13:09:50.799820 29590 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:50.799954 29657 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 24. Current term is 25.
I20260709 13:09:50.800318 29635 ts_tablet_manager.cc:1929] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:09:50.800737 29527 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for earlier term 20. Current term is 21.
I20260709 13:09:50.867223 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:50.868160 21488 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.800918 29604 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:09:50.801214 29389 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:50.750349 29472 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.754383 29674 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.803192 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:50.804138 29427 raft_consensus.cc:3055] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:50.772277 29510 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 12. Current term is 13.
I20260709 13:09:50.807515 29648 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.809566 21562 raft_consensus.cc:1240] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:50.776407 29629 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:50.757828 29603 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:50.812708 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.815330 21608 leader_election.cc:403] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
W20260709 13:09:50.880268 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 112899us
I20260709 13:09:50.881023 21608 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:50.776798 21636 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:50.816637 21635 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 13:09:50.882237 21635 pending_rounds.cc:85] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Aborting all ops after (but not including) 13
I20260709 13:09:50.817075 21487 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:50.882493 21635 pending_rounds.cc:107] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 13:09:50.883252 21635 raft_consensus.cc:2889] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.885149 21608 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:50.877466 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:50.886965 22244 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:50.887781 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.825359 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
W20260709 13:09:50.885782 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82668.8us
I20260709 13:09:50.889245 21457 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:50.890025 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 111689us
I20260709 13:09:50.890691 21532 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:50.876664 29389 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.897691 21459 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:50.898700 29510 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:50.899019 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:50.899569 29510 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.900426 29510 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:50.902254 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 148622us
I20260709 13:09:50.903648 21606 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:50.904485 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:50.878098 29427 raft_consensus.cc:740] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:50.886500 29635 log.cc:1199] T cc9f5258ae3f4790a9bc1813d73ec987 P 5727b19579474da6a12f79730b924770: Deleting WAL directory at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/wals/cc9f5258ae3f4790a9bc1813d73ec987
I20260709 13:09:50.913447 21488 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:50.909826 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:50.895124 21637 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 13.
I20260709 13:09:50.885798 29629 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 27. Current term is 28.
I20260709 13:09:50.896253 29362 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:50.800794 29369 consensus_queue.cc:237] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:50.912565 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.912906 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:50.913311 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:50.899611 29666 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:50.906692 29389 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:50.907678 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:50.894383 29527 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:50.924393 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.925343 29635 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36498 (request call id 5) took 1742 ms. Trace:
I20260709 13:09:50.925887 29510 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:50.930882 29667 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:50.911685 29307 raft_consensus.cc:2804] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:50.932437 29427 consensus_queue.cc:260] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.933121 29648 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:50.933511 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.934157 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.937976 29666 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.909801 29604 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:50.940996 22210 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:50.912112 29684 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:09:50.956207 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 52641.5us
I20260709 13:09:50.990257 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.991307 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:50.956784 21638 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:50.956395 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.993396 21639 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 27.
I20260709 13:09:50.967378 21641 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:50.933728 29603 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:50.942536 29527 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.999344 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:50.999971 21636 raft_consensus.cc:3060] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.979249 29427 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:50.946923 29584 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.955967 29484 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:50.996560 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:51.010771 21635 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:51.011300 21490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:50.972106 29307 raft_consensus.cc:697] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:50.998189 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:51.037415 21635 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:09:51.037357 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:50.983994 29666 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:51.012064 29527 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:50.967867 29240 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:09:51.036800 21636 raft_consensus.cc:2468] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:09:51.039168 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:50.983124 29691 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:51.041698 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:51.042351 21635 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 13:09:50.997032 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 87309.1us
I20260709 13:09:51.107326 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.102262 21640 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:50.968007 29368 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:09:51.036556 29639 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:51.109205 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:51.112855 29694 log.cc:927] Time spent T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:51.110466 29510 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:51.127645 29535 raft_consensus.cc:2804] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:09:51.133905 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 94980.5us
I20260709 13:09:51.049175 29650 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:51.041268 29695 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:51.137908 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.126897 21492 raft_consensus.cc:1275] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:09:51.049732 29484 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:51.140365 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:51.099617 29085 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.153155 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:51.109079 29509 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 23. Current term is 24.
I20260709 13:09:51.143850 29619 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:51.144078 29684 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 13:09:51.219471 29692 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:09:51.220696 29699 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:51.221704 29699 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:51.227224 21607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.228096 21492 raft_consensus.cc:1275] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:09:51.150615 29484 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:51.158452 29674 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:51.230877 29307 consensus_queue.cc:237] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.232003 29484 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:51.144337 29535 raft_consensus.cc:697] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:51.233137 29535 consensus_queue.cc:237] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.234351 21491 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
I20260709 13:09:51.234827 29619 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:51.156211 29085 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:51.269810 21492 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:50.946252 29635 rpcz_store.cc:276] 0709 13:09:49.182694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.183014 (+   320us) service_pool.cc:224] Handling call
0709 13:09:49.519024 (+336010us) ts_tablet_manager.cc:1151] Deleting tablet cc9f5258ae3f4790a9bc1813d73ec987
0709 13:09:49.519120 (+    96us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:50.229916 (+710796us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:50.770984 (+541068us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:50.925214 (+154230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38255,"tablet-delete.queue_time_us":327212,"thread_start_us":121642,"threads_started":1}
I20260709 13:09:51.267923 29619 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:51.294389 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 296300us
I20260709 13:09:51.313858 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:51.315323 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 363625us
I20260709 13:09:51.322376 21606 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:51.324137 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:51.324751 21643 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:09:51.334641 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 196851us
I20260709 13:09:51.335282 21606 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:51.335459 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.318758 29695 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:51.379105 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 43720.5us
I20260709 13:09:51.381796 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:51.384706 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:51.386135 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 50909.6us
I20260709 13:09:51.387071 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:51.387791 21643 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:51.394115 21640 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:09:51.398404 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.390923 29484 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:51.399348 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:51.400123 21378 catalog_manager.cc:5028] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): tablet cc9f5258ae3f4790a9bc1813d73ec987 (table test-workload [id=4d35304567724c40bebbf345e7e61b0b]) successfully deleted
I20260709 13:09:51.401443 29085 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:51.377028 29684 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:51.391800 21492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:51.396561 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:51.391060 29510 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:51.394114 29699 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:51.416203 21492 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:51.391582 29710 raft_consensus.cc:2749] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:51.403111 29695 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:51.411259 29484 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.441462 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:51.448822 29707 log.cc:927] Time spent T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:09:51.451300 29704 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:09:51.422597 29307 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:51.467207 21640 raft_consensus.cc:2393] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 23: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:51.461786 29527 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.454077 29484 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:51.482746 29527 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:51.464178 29715 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:51.430308 29699 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:51.500484 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 59101.4us
I20260709 13:09:51.501444 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.503019 29684 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:51.503700 29684 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:51.506528 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:51.507611 29389 consensus_meta.cc:287] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.002s
I20260709 13:09:51.508016 29389 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.510083 29389 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:51.515650 29666 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.516353 21561 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:51.517450 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:51.517773 29666 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:51.518033 21566 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:51.520049 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 133038us
I20260709 13:09:51.521308 21606 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:51.522219 21490 raft_consensus.cc:2368] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20.
I20260709 13:09:51.523046 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:51.490375 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58388 (request call id 2615) took 1176 ms. Trace:
I20260709 13:09:51.527817 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:51.523736 21637 rpcz_store.cc:276] 0709 13:09:50.314175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.314314 (+   139us) service_pool.cc:224] Handling call
0709 13:09:51.490169 (+1175855us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b540009ae54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:51.490288 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1259383680}
I20260709 13:09:51.539835 21634 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:09:51.542153 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:51.542814 21491 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:51.547093 29684 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:51.547605 29684 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:51.547972 29684 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:51.576428 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:51.577160 22246 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:51.558315 21606 leader_election.cc:400] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:09:51.587172 21606 leader_election.cc:403] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:51.589385 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:51.596714 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:51.597615 21637 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:51.537469 29510 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:51.467561 29711 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:51.606614 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48546.8us
I20260709 13:09:51.579695 29710 consensus_queue.cc:1059] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:09:51.608122 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:51.608897 22246 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:51.610500 29691 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19.
I20260709 13:09:51.520939 29307 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:51.624563 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:51.633245 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.629645 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:51.500530 29699 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:51.641171 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:51.644603 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:51.645347 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:51.647471 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.537775 29629 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:51.650933 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:51.666020 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:51.667788 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:51.668514 22246 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:09:51.642493 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:51.674427 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.666740 29604 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:09:51.683183 29522 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:51.687361 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:51.688269 22242 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:51.580284 29509 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.060s
I20260709 13:09:51.660161 29389 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:09:51.693909 21491 raft_consensus.cc:2468] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 15.
I20260709 13:09:51.695514 21532 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:51.697182 21566 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:51.690479 29695 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:51.616907 29667 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:51.709801 21637 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:51.700995 21459 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:51.615571 29549 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:09:51.724308 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:51.724985 22244 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:09:51.725270 29684 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:51.725958 29307 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:51.711179 29369 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:51.727283 29369 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.695775 29527 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:51.650023 29482 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.064s
I20260709 13:09:51.718379 29604 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:51.623361 29484 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.728924 29604 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:51.729454 29369 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:51.684332 29362 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:51.720343 29648 consensus_queue.cc:1059] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:09:51.746891 21568 raft_consensus.cc:2368] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20.
I20260709 13:09:51.711488 29667 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:51.751907 29671 raft_consensus.cc:3055] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:09:51.752354 29671 raft_consensus.cc:740] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:51.753218 29671 consensus_queue.cc:260] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.728281 29527 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.730281 29484 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:51.656188 29711 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.764496 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:51.766335 29711 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:51.762274 21642 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:09:51.718887 29522 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.614694 29619 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.730906 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:51.691720 29368 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:09:51.703526 29715 raft_consensus.cc:2804] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:51.733731 21491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:51.772702 21491 raft_consensus.cc:2393] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:51.696702 29717 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:51.737797 21489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:51.738729 21485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:51.779369 29484 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:51.741878 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:51.779995 29484 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:51.744125 21487 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:51.741043 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:51.781808 21494 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 23: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:51.782177 29484 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:51.759752 29527 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:51.762214 29684 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:51.768296 29522 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.763799 21486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:51.729869 29604 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:51.771255 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:51.771365 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:51.813287 22244 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:51.782766 29715 raft_consensus.cc:697] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:51.785547 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:51.758883 22242 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:51.789438 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:51.814998 29461 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:09:51.815425 29461 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.786974 21532 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:51.815753 29461 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:51.816689 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.816977 29699 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.818334 21567 raft_consensus.cc:2368] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 24. Current term is 25.
I20260709 13:09:51.818516 29684 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:51.818365 29389 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:51.818960 29584 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:51.819392 29389 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:51.820346 29389 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.820627 29584 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:51.771313 29368 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.822953 29368 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:51.823215 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:51.805586 29667 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:51.826009 29693 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.714s	user 0.002s	sys 0.000s
I20260709 13:09:51.826730 29667 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:51.814663 29715 consensus_queue.cc:237] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.813205 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.831974 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.833590 29650 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:51.833796 29699 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:51.834335 29650 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:09:51.834497 29699 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.835017 29699 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:51.836675 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60044 (request call id 1407) took 1054 ms. Trace:
I20260709 13:09:51.837105 29699 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:51.840673 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:51.842301 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:51.848940 29484 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:51.853174 29724 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:09:51.856112 21494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:51.856666 29522 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:51.856765 21494 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:51.859161 21487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772" is_pre_election: true
I20260709 13:09:51.860170 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:51.860800 21636 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:51.861830 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:51.837218 22247 rpcz_store.cc:276] 0709 13:09:50.782234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.846746 (+ 64512us) service_pool.cc:224] Handling call
0709 13:09:50.877139 (+ 30393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.896588 (+ 19449us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:50.959492 (+ 62904us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.042357 (+ 82865us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.042411 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:51.042459 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.834590 (+792131us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b1800431980. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98afdbdde1 00007f98afdca5b1 00007f98a6ec32a6 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419
0709 13:09:51.836334 (+  1744us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5400870354. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:51.836402 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.836570 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2654,"prepare.queue_time_us":92735,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":90,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":36131,"spinlock_wait_cycles":47737600,"thread_start_us":127522,"threads_started":2,"wal-append.queue_time_us":190149}
I20260709 13:09:51.870901 21486 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:51.871307 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:51.887750 21563 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:09:51.888792 21532 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:51.871953 21389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 150) took 15276 ms (client timeout 15000 ms). Trace:
I20260709 13:09:51.852705 29368 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.883143 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:51.892007 21566 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:51.894426 21562 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:09:51.897446 21563 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:09:51.900630 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:51.901717 21563 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 20: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:51.884779 21494 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 25.
I20260709 13:09:51.905646 21532 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:51.906230 29484 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:09:51.910820 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d46f34ab738d4d38b09f9d1228d68c7d with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 549b31ac31b6428994b45938abc223a7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:51.893693 29389 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:51.944599 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:09:51.944593 21488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.052s	sys 0.070s
I20260709 13:09:51.950048 21638 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:09:51.950352 21488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.052s	sys 0.071s
I20260709 13:09:51.943080 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 
W20260709 13:09:51.955518 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 48733.3us
I20260709 13:09:51.867105 29527 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:51.941566 29711 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:09:51.890249 21389 rpcz_store.cc:269] 0709 13:09:36.596051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.606983 (+ 10932us) service_pool.cc:224] Handling call
0709 13:09:51.871856 (+15264873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:50.140222 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:50.141143 (+   921us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:50.141205 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:09:50.141224 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:50.142446 (+  1222us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:50.142573 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:50.142607 (+    34us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:09:50.179049 (+ 36442us) tablet.cc:701] Row locks acquired
0709 13:09:50.179109 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:09:50.179325 (+   216us) write_op.cc:270] Start()
0709 13:09:50.179514 (+   189us) write_op.cc:276] Timestamp: P: 1783602590179252 usec, L: 0
0709 13:09:50.179547 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:09:50.180422 (+   875us) log.cc:844] Serialized 4786 byte log entry
0709 13:09:50.623349 (+442927us) op_driver.cc:464] REPLICATION: finished
0709 13:09:50.927108 (+303759us) write_op.cc:301] APPLY: starting
0709 13:09:50.927242 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:51.226907 (+299665us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:51.227054 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:51.420299 (+193245us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:51.420646 (+   347us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:09:51.420692 (+    46us) write_op.cc:312] APPLY: finished
0709 13:09:51.421100 (+   408us) log.cc:844] Serialized 113 byte log entry
0709 13:09:51.421282 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:51.421429 (+   147us) write_op.cc:454] Released schema lock
0709 13:09:51.421490 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:51.421904 (+   414us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:51.421934 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":300286,"reported_tablets":19,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":285351,"apply.run_cpu_time_us":23082,"apply.run_wall_time_us":494802,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":317646,"prepare.run_cpu_time_us":28483,"prepare.run_wall_time_us":219091,"raft.queue_time_us":155326,"replication_time_us":443591,"spinlock_wait_cycles":7826688,"thread_start_us":746411,"threads_started":4,"wal-append.queue_time_us":280446}]]}
I20260709 13:09:51.944967 29389 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.982609 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:51.983160 21606 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:51.979039 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 261281us
I20260709 13:09:51.946398 29484 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:51.932293 29584 consensus_queue.cc:1048] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:09:51.977547 29522 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:51.965581 29566 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:51.907086 29461 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.006882 29389 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:51.946607 29535 consensus_queue.cc:1048] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260709 13:09:52.032857 21494 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 27. Current term is 28. Ops: [27.18-27.18]
I20260709 13:09:52.018497 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:52.004978 29684 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.965349 29567 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
I20260709 13:09:52.015707 29695 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:52.009905 29711 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 25 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:51.982005 29369 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:09:51.965811 29725 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 13:09:52.026446 29566 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:52.080448 29461 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:52.058161 29603 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:09:52.084446 29527 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:52.056052 29684 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.086591 21488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5a34fd3290de493eb6bbe828dd742772"
I20260709 13:09:52.087323 29368 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:52.087523 21488 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:52.088315 29711 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.089330 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:52.089903 21637 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:52.101615 29425 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:52.106446 29590 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:52.107452 21488 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:09:52.109884 29708 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:52.115408 29709 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:52.061213 29566 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:52.124220 21459 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:52.133558 29727 log.cc:927] Time spent T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:09:52.060595 29730 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 13:09:52.138465 29484 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:52.139432 29685 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:52.139868 29685 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.140192 29685 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:52.057399 29672 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:52.154465 21637 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:09:52.128203 29684 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:52.166368 29590 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:09:52.167507 29733 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:09:52.171020 29708 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:52.171749 29427 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:09:52.172631 29736 log.cc:927] Time spent T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:09:52.176352 29695 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:09:52.162508 29735 log.cc:927] Time spent T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:09:52.180269 29723 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.415s	user 0.001s	sys 0.002s
I20260709 13:09:52.183619 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:52.188802 21488 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:52.189517 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 180732us
I20260709 13:09:52.195655 21532 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:52.218921 22212 leader_election.cc:400] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20.
I20260709 13:09:52.219303 22212 leader_election.cc:403] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:52.222821 29732 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.100s	user 0.003s	sys 0.000s
I20260709 13:09:52.220534 29510 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:09:52.223836 29510 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:09:52.224462 29737 log.cc:927] Time spent T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 13:09:52.224799 29510 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.230001 22212 leader_election.cc:400] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 24. Current term is 25.
I20260709 13:09:52.231221 29602 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20.
I20260709 13:09:52.237712 29672 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:52.239449 21561 raft_consensus.cc:1240] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:52.244156 21566 raft_consensus.cc:1275] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:09:52.245224 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.248466 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:52.249132 22244 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:52.250627 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:52.215489 29699 raft_consensus.cc:2804] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:52.162595 29685 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:52.263804 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:52.261905 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:52.267222 22240 raft_consensus.cc:2393] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 20: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
W20260709 13:09:52.264390 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 245998us
I20260709 13:09:52.267519 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:52.268615 22210 leader_election.cc:400] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061) with higher term. Message: Invalid argument: T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20.
I20260709 13:09:52.271399 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:52.272109 22247 raft_consensus.cc:3060] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:52.271534 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:52.276597 22238 raft_consensus.cc:1240] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:52.278926 22241 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 27. Current term is 28. Ops: [27.19-27.19]
I20260709 13:09:52.252528 29510 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:52.282188 22245 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:52.286861 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 28 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:52.282262 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:52.289467 22242 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:52.290942 21457 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:52.264222 29307 raft_consensus.cc:493] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:52.293860 22212 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:52.297698 22210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.267192 29522 raft_consensus.cc:697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 24 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:52.302021 21635 raft_consensus.cc:1275] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:52.251120 29717 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:09:52.272122 29699 raft_consensus.cc:697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 24 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:52.271867 29684 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:52.298478 29740 consensus_queue.cc:1048] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:09:52.330540 29730 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:52.287858 29484 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:52.316128 29464 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:52.321949 29715 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:52.295229 29461 consensus_queue.cc:1059] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:09:52.342955 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:52.342181 29484 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.320165 29590 consensus_queue.cc:1059] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 13:09:52.363137 29522 consensus_queue.cc:237] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.313498 29307 raft_consensus.cc:515] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:52.373852 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 112091us
I20260709 13:09:52.345407 29715 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:52.385068 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 83565.4us
I20260709 13:09:52.386967 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:52.381626 22242 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 28.
W20260709 13:09:52.391873 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 49006.8us
I20260709 13:09:52.332134 29684 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.362597 29671 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:52.386049 29461 consensus_queue.cc:1243] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer 5727b19579474da6a12f79730b924770 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:52.389000 29464 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:52.409090 21642 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:52.393414 29715 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:52.411815 29757 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:52.398434 29450 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:52.447391 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:52.407580 29362 consensus_queue.cc:1059] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.025s
W20260709 13:09:52.442647 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 52343.9us
I20260709 13:09:52.456820 29756 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:52.463367 22247 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:09:52.426836 29566 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.487957 21488 raft_consensus.cc:1275] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:52.398993 29699 consensus_queue.cc:237] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.478899 29464 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.479417 29527 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.504662 21643 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:52.505482 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:52.454906 29619 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:52.510516 21642 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:52.478969 29685 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:52.519654 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58069.8us
I20260709 13:09:52.522073 22247 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:52.531796 22247 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 27. Current term is 28. Ops: [27.18-27.18]
I20260709 13:09:52.507445 29425 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.542119 22245 raft_consensus.cc:1240] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 29. Current term is 30. Ops: []
I20260709 13:09:52.563786 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:52.624424 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 67692.1us
I20260709 13:09:52.515401 29527 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.517802 29742 consensus_queue.cc:1048] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
I20260709 13:09:52.616941 29484 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:52.544486 29425 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.646596 29684 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:52.652510 29307 leader_election.cc:290] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:52.672693 29749 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:09:52.683116 29389 consensus_meta.cc:287] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.004s
I20260709 13:09:52.683609 29389 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:52.684710 29425 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:52.684831 21565 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:09:52.685765 29389 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:52.659368 29566 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:52.689704 29744 log.cc:927] Time spent T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.346s	user 0.008s	sys 0.031s
I20260709 13:09:52.692303 29527 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:52.693128 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:52.697045 29369 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:52.698508 29657 raft_consensus.cc:3055] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:52.699024 29657 raft_consensus.cc:740] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:52.659889 29362 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.766883 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:52.750634 29715 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:52.769063 29754 log.cc:927] Time spent T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:09:52.770035 29740 raft_consensus.cc:3055] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:52.699944 29657 consensus_queue.cc:260] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:52.787400 29761 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:09:52.756698 29362 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.793009 29362 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:52.766031 29711 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.020s	sys 0.040s
I20260709 13:09:52.798736 21642 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:52.801028 21563 raft_consensus.cc:1240] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:52.800431 29671 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.811542 29671 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.814014 29671 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:52.818318 29715 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:52.820995 29510 consensus_meta.cc:287] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 13:09:52.782533 29740 raft_consensus.cc:740] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:52.832540 29740 consensus_queue.cc:260] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:52.833772 29740 raft_consensus.cc:3060] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:52.844308 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:52.850582 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:52.844493 29768 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
W20260709 13:09:52.802420 29711 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.020s	sys 0.040s
I20260709 13:09:52.854800 21494 raft_consensus.cc:1240] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:52.861744 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:52.863936 21457 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:52.949002 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 85146us
W20260709 13:09:53.071756 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.072748 29746 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 13:09:53.081739 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 131106us
I20260709 13:09:53.098975 29771 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:53.110189 29757 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.110818 29757 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.112984 29757 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.080139 29756 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:53.081301 29715 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.132195 22245 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
W20260709 13:09:53.128643 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d46f34ab738d4d38b09f9d1228d68c7d with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 549b31ac31b6428994b45938abc223a7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:52.863035 29768 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.087779 29699 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.137069 29757 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:53.137811 29757 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.130694 29759 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.129679 29771 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:53.132609 29730 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:53.135525 29715 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.155745 29771 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.156895 29715 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.154867 29730 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.162832 29768 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.162874 29730 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.142071 29699 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.165733 29699 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.133729 29756 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.151139 29759 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.168577 29756 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.169162 29759 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.186628 29389 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:53.187543 29389 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.190444 29389 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.204978 29757 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:53.216979 21457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.213498 29757 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.221235 29757 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.233218 29757 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.237335 29691 raft_consensus.cc:3055] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:53.237775 29691 raft_consensus.cc:740] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:53.238647 29691 consensus_queue.cc:260] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.250866 29667 raft_consensus.cc:3055] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:09:53.251147 29691 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:53.251349 29667 raft_consensus.cc:740] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:53.252221 29667 consensus_queue.cc:260] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.247109 29768 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:53.255321 29768 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.255697 29567 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:53.256147 29567 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:53.257745 29768 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.268978 29715 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.269563 29715 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:09:53.277702 20382 tablet_server.cc:179] TabletServer@127.19.231.129:0 shutting down...
I20260709 13:09:53.286653 29657 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:53.291229 29699 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:53.291850 29699 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.294417 29699 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.295567 29715 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.302184 21566 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:09:53.304078 21566 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:53.310551 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:53.328096 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:53.328754 21567 raft_consensus.cc:2468] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:53.330240 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:53.332123 21567 raft_consensus.cc:2468] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:53.341485 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:53.369149 22244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 876) took 1117 ms. Trace:
I20260709 13:09:53.331354 29240 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:53.369613 22244 rpcz_store.cc:276] 0709 13:09:52.251897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.252050 (+   153us) service_pool.cc:224] Handling call
0709 13:09:53.368957 (+1116907us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400595bd4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe62fa 00007f98aefa7b17 00007f98a85226d4 00007f98a8522662 00007f98a8522591 00007f98a852250c 00007f98a85217c2 00007f98a831d48c 00007f98a831c8c6 00007f98a831c26f
0709 13:09:53.369087 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627845504}
I20260709 13:09:53.374814 29240 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.380896 29240 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.392442 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:53.395473 21560 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 14: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:53.409561 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:53.412823 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:53.416947 21643 raft_consensus.cc:1240] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:53.392655 29757 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.395596 29715 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.424780 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:53.425344 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:53.397029 29699 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:53.436146 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.422020 29755 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.426662 29685 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.441232 29710 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:53.445477 29710 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.446941 29755 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.447716 29710 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.449177 29755 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:53.451150 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:53.453713 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:53.451375 29695 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.467478 29695 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.451107 29368 consensus_queue.cc:1059] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:09:53.424077 29757 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.450933 29786 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.433341 29699 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:53.487771 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.459493 29472 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:09:53.491969 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 94021.4us
I20260709 13:09:53.494727 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:53.492146 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:53.485236 21606 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:53.470489 29695 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:53.430979 29715 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.516429 21641 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 17.
I20260709 13:09:53.475416 29717 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.529136 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:53.516170 21532 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 13:09:53.473099 29450 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:09:53.531642 21641 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:53.491539 29510 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.458798 29685 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.546711 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.547446 22241 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:09:53.528563 29657 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.528323 29566 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.530463 29695 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.563298 29566 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.564107 29657 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.568217 29699 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.569149 29425 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.570420 29685 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.587813 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:53.580835 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:53.514219 29710 consensus_queue.cc:1059] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 29.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.056s
I20260709 13:09:53.589236 21567 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 14.
I20260709 13:09:53.581856 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:53.517309 29786 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.529937 29783 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:09:53.588580 21564 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 25.
I20260709 13:09:53.592140 21567 raft_consensus.cc:1275] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:53.580639 29509 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:53.578557 29725 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.547005 29510 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.597208 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:53.540234 29717 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:53.600821 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 158265us
I20260709 13:09:53.622143 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.584718 29695 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.626289 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.630017 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.628080 21563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41010 (request call id 3294) took 1176 ms. Trace:
I20260709 13:09:53.606159 29509 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:53.604832 29691 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.630662 21563 rpcz_store.cc:276] 0709 13:09:52.451955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.452081 (+   126us) service_pool.cc:224] Handling call
0709 13:09:52.452349 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.801560 (+349211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.627850 (+826290us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54003237d4. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:53.628021 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801249536}
I20260709 13:09:53.637354 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:53.590553 29425 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.606869 29602 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.679141 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.678603 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.623893 29584 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.695721 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:53.696439 21640 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
I20260709 13:09:53.625977 29793 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.702471 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.703154 22245 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 14.
I20260709 13:09:53.600844 29725 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.707527 21606 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:53.708470 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.709738 22245 raft_consensus.cc:1275] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:09:53.706634 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 190499us
I20260709 13:09:53.729486 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.730681 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.731130 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.731805 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.732563 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db3d7d8520484b9eb6da32f2bc86ed" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.734066 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:53.691052 29788 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.765419 29788 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.698176 29798 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.768435 29798 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.773512 29567 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.743391 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.740763 29797 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.745404 29757 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:53.744745 29785 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:09:53.764509 29794 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.783612 29667 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:53.784307 29657 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.785373 29786 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.708303 29793 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.787374 29715 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.789302 29717 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:53.790891 29796 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.825258 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:53.753895 29695 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:53.710220 29629 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:53.691654 29691 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.738109 29710 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:53.697711 29602 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.705977 29584 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.770627 29798 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:53.828473 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 108712us
I20260709 13:09:53.811440 29567 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:53.842259 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:53.852196 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:53.742261 29509 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.854723 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:53.857462 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.827754 29755 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.808319 29797 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.838644 29710 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:53.880596 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:53.831830 29715 consensus_queue.cc:1048] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:09:53.854439 29566 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.860363 29461 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:53.866081 29619 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:53.883461 29425 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.885687 29602 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:53.835987 29629 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.831557 29796 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.870107 29798 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:53.909276 29798 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.909704 29798 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:53.911702 29793 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.866358 29759 consensus_queue.cc:1048] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:09:53.918385 29691 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:53.889739 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:53.927870 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:53.928785 22245 raft_consensus.cc:2393] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 21: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:53.890714 29461 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.930994 29657 raft_consensus.cc:2804] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:53.931416 29461 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:53.876075 29710 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:53.936299 29797 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:53.940675 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 60152us
I20260709 13:09:53.941880 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:53.942121 29590 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:09:53.942883 29590 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:53.943630 29603 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:53.919276 29725 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:53.944173 29590 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.921747 29629 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:53.871110 29755 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:53.878885 29757 consensus_queue.cc:1048] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:09:53.947255 29757 consensus_queue.cc:1243] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [LEADER]: Peer 549b31ac31b6428994b45938abc223a7 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:53.891474 29427 raft_consensus.cc:3055] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:53.947842 29427 raft_consensus.cc:740] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:53.948683 29427 consensus_queue.cc:260] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.949678 29427 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:53.931468 29657 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:53.951011 29657 raft_consensus.cc:3060] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:53.955255 29584 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.955734 29755 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:53.956681 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:53.957499 29767 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:53.959359 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:53.875308 29510 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:53.814672 29794 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:53.896430 29771 raft_consensus.cc:2804] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:09:53.979494 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 147217us
I20260709 13:09:53.892422 29619 raft_consensus.cc:493] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.979267 29368 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:53.993774 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.982224 29771 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:53.997331 29771 raft_consensus.cc:3060] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:53.981266 29790 raft_consensus.cc:3055] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:09:54.003180 29790 raft_consensus.cc:740] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:54.003978 29619 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:53.902103 29788 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:54.017355 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:54.018483 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:54.020102 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:54.029528 21564 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:09:54.029399 21567 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:09:54.030498 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:54.053396 21560 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 25: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:54.058521 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:54.063369 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.063566 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:54.064204 21563 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:54.039670 21392 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.076402 21392 catalog_manager.cc:5697] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index 10 to 13, term changed from 17 to 19, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 19 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:54.079576 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.082973 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:54.087622 21563 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:09:54.082468 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 220674us
W20260709 13:09:54.092739 21532 leader_election.cc:336] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:54.094071 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:54.099154 21563 raft_consensus.cc:1240] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:09:54.100061 21532 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:54.002600 29710 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:54.101709 21532 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:54.048885 29759 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
W20260709 13:09:54.111454 21532 leader_election.cc:336] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:54.054188 29510 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:54.065508 29629 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.115092 21532 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:54.115491 21569 raft_consensus.cc:3055] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:54.121381 21569 raft_consensus.cc:740] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:54.117511 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:54.122130 21569 consensus_queue.cc:260] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.124642 21569 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:54.120362 21532 leader_election.cc:336] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:54.126081 21532 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:54.126691 21532 leader_election.cc:336] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:54.130621 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:54.130939 21532 leader_election.cc:336] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:54.131430 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:54.101107 29715 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:54.131848 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:54.004007 29790 consensus_queue.cc:260] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:54.132580 21532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.132514 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:54.130640 22247 raft_consensus.cc:1240] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 27. Current term is 28. Ops: [27.19-27.19]
I20260709 13:09:54.135412 22246 raft_consensus.cc:3055] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:09:54.138324 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:54.140748 22240 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:54.107379 29240 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.138964 22246 raft_consensus.cc:740] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:54.145025 21532 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:54.145697 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:54.155043 29793 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:54.149019 22246 consensus_queue.cc:260] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.155979 29793 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:54.156332 22246 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:54.156370 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.157025 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:54.158191 21532 leader_election.cc:304] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.158963 29808 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:54.160661 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:54.161924 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.164253 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.184383 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:54.187039 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 46144.3us
I20260709 13:09:54.118619 29797 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:54.192540 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.122056 21392 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 16 to 18, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 18 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:54.159898 29788 raft_consensus.cc:2749] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:54.188926 21459 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:54.195698 29710 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:54.183459 29808 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:54.196233 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:54.197422 29766 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:54.198995 29786 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:54.145648 29604 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.203155 29604 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.205389 29604 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:54.205565 29766 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:54.206336 29766 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.208295 29461 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.209261 29766 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:54.195901 29709 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:54.216280 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:54.218020 29795 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:54.218847 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:54.221143 29802 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.336s	user 0.000s	sys 0.002s
I20260709 13:09:54.226212 21392 catalog_manager.cc:5697] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.241546 29461 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:54.241873 29808 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:54.242452 29808 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.242930 29808 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.119710 29759 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.239820 21532 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.256414 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.257347 21639 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:09:54.259274 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.128228 29510 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.170744 29794 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:54.247503 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 121772us
I20260709 13:09:54.235967 22246 raft_consensus.cc:1275] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
I20260709 13:09:54.133512 29629 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.271994 22246 pending_rounds.cc:85] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 15
I20260709 13:09:54.275489 22246 pending_rounds.cc:107] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:09:54.217231 29793 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:54.276014 22246 raft_consensus.cc:2889] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:54.264295 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 130849us
I20260709 13:09:54.278221 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.222205 29715 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:54.222764 29709 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.279533 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:54.261778 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.284608 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.246496 21392 catalog_manager.cc:5697] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:54.292699 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.305505 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.164620 29240 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.201756 29771 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.307670 21569 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:09:54.391957 21569 pending_rounds.cc:85] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Aborting all ops after (but not including) 12
I20260709 13:09:54.392261 21569 pending_rounds.cc:107] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 13:09:54.392494 21569 raft_consensus.cc:2889] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.324836 21392 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 16 to 17, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 17 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.269421 29788 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:54.308269 29755 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:54.308602 29795 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:54.288900 29709 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:54.222419 29797 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:54.385735 21532 consensus_peers.cc:597] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:54.386264 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:54.389014 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 99020.3us
W20260709 13:09:54.415203 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 113195us
I20260709 13:09:54.293614 21643 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 16.
I20260709 13:09:54.390292 21637 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:09:54.390662 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 102836us
I20260709 13:09:54.406064 21392 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:09:54.409408 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 122399us
W20260709 13:09:54.416844 21532 leader_election.cc:336] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:54.410933 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 264743us
W20260709 13:09:54.417927 21532 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:54.418748 21532 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:54.419504 21532 consensus_peers.cc:597] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:54.420153 21532 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:54.420881 21532 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:54.421454 21532 leader_election.cc:336] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:54.422379 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.415408 21639 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 25.
I20260709 13:09:54.424424 21392 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 21 to 22, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 22 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.426020 21392 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 22 to 25, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 25 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:09:54.422194 21532 consensus_peers.cc:597] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:54.427454 21392 catalog_manager.cc:5697] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:54.388604 29794 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.431224 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.432623 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.436053 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.436591 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:54.439013 21636 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:54.437924 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.440562 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:54.453562 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.454476 21636 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:54.408629 29795 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.459043 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.435258 21392 catalog_manager.cc:5697] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 26 to 28, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 28 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.430148 29800 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.464624 21639 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 23.
I20260709 13:09:54.450156 29794 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.465564 21392 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 22, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 22 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.482774 21392 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.450263 29566 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.485316 21392 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 20 to 22, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 22 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.489044 21392 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 25 to 27, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 27 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.487576 21636 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:09:54.425683 29657 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.456045 29806 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.495479 21392 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 15 to 18, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 18 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:54.483240 29771 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:54.465663 29795 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:54.498598 21392 catalog_manager.cc:5697] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 18 to 19, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 19 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:54.508505 21392 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:09:54.515339 21608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.021s	sys 0.052s
W20260709 13:09:54.515820 21608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.021s	sys 0.052s
W20260709 13:09:54.516148 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 713970us
W20260709 13:09:54.516664 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 221831us
W20260709 13:09:54.523018 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.527820 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:54.480207 29800 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.505578 29796 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:54.555299 21392 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 23 to 27, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 27 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.564577 29584 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.565316 29584 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.570384 21392 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.584960 29584 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:54.588719 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.610723 29657 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:54.613289 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 75779.9us
W20260709 13:09:54.614151 29427 consensus_meta.cc:287] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.000s
I20260709 13:09:54.615289 29509 consensus_queue.cc:1059] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:54.527390 29629 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:54.620428 29755 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.621163 29755 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:54.622043 29619 consensus_meta.cc:287] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
I20260709 13:09:54.515656 29759 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:54.622467 29619 raft_consensus.cc:515] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.507131 29806 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.535670 29725 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.624500 22244 raft_consensus.cc:2393] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 26: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:54.624476 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.622522 29796 raft_consensus.cc:3055] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:09:54.644141 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 209337us
I20260709 13:09:54.657397 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:54.504042 29566 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.654834 29796 raft_consensus.cc:740] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:54.538697 29510 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:54.623828 29798 consensus_meta.cc:287] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: Time spent flushing consensus metadata: real 0.714s	user 0.015s	sys 0.005s
I20260709 13:09:54.623617 29755 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:54.656601 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 127641us
I20260709 13:09:54.572278 21392 catalog_manager.cc:5697] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.620673 29629 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.670370 21460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.673936 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:54.681157 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:54.679335 21392 catalog_manager.cc:5697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 11 to 12, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 12 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:54.663229 29759 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:54.699072 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d46f34ab738d4d38b09f9d1228d68c7d with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 549b31ac31b6428994b45938abc223a7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:54.696115 21392 catalog_manager.cc:5697] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.657500 29725 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.800419 29566 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:54.698954 29567 consensus_meta.cc:287] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: Time spent flushing consensus metadata: real 0.839s	user 0.013s	sys 0.000s
I20260709 13:09:54.696601 29240 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:54.771191 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:54.774107 21568 raft_consensus.cc:1240] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 25 LEADER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:54.752645 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.704968 21392 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:54.805488 21638 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:54.808620 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:54.809705 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:54.772074 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.700834 29510 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:54.695979 29819 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:54.816092 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:54.816982 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 44995.5us
I20260709 13:09:54.818495 21457 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:54.763506 29368 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.831573 29368 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.833616 29368 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:54.696018 29629 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.839323 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:54.799211 29806 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:54.746759 29794 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:54.683830 29798 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:54.741230 29817 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:54.797837 29797 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:54.821182 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.821498 29711 consensus_queue.cc:1048] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:54.741501 29795 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.825681 29786 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:54.826578 29828 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:54.830036 29827 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:54.794201 29709 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.835903 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:54.836158 21457 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:54.705305 29831 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:54.838496 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:54.695855 29808 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.812774 29793 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.815364 29535 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:54.813911 29510 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.814949 29783 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:54.840538 29240 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:54.820897 29819 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.868628 21638 raft_consensus.cc:2410] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 29 because replica has last-logged OpId of term: 27 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 13:09:54.855581 29639 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.855849 29771 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.888206 21563 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 15: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:09:54.890189 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 54130.3us
I20260709 13:09:54.902060 21457 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.858865 29825 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:09:54.861872 29725 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:54.709915 29796 consensus_queue.cc:260] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:54.892649 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 71541.8us
I20260709 13:09:54.904922 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:54.892858 29831 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:54.910106 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.897887 29535 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:54.900660 29510 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:54.876799 29786 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.899380 29793 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.900727 29819 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:54.943751 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.941704 29808 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:54.909219 29768 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:54.953171 29793 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:54.927161 29836 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.955145 29786 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:54.955299 29836 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.911742 29831 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:54.918469 29796 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:54.918359 29450 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:54.917891 29783 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.936022 29535 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.910866 29837 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:54.931279 29838 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.905561 29771 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.935750 29711 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.904242 29639 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.968999 29629 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:54.949776 29843 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:54.970639 29827 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:54.988320 29827 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:54.983248 29711 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.994880 29711 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:54.995611 29790 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:09:54.980926 29838 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.976977 29783 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:54.992965 29522 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.986677 29639 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.004029 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:54.969203 29836 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.006340 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:54.979928 29845 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:54.978569 29837 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:55.024199 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:09:55.028182 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.032305 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:55.033915 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.034827 22212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.024294 29837 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:55.044087 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:55.047346 21562 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 21: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:55.045360 29827 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.030874 29795 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.004144 29522 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.038705 29798 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.048043 29709 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.080314 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:55.080963 22241 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:55.081245 21562 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:55.052306 29725 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:55.068477 29815 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.100102 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 195227us
I20260709 13:09:55.101565 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:55.094053 29725 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.099303 29815 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.106247 29838 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.108384 29725 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.113260 29771 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.117756 29522 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:55.118819 29815 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.127480 29783 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.133678 21643 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 30.
W20260709 13:09:55.104475 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 202470us
I20260709 13:09:55.137200 29831 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:55.139722 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.141165 29510 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:55.141855 29804 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.959s	user 0.008s	sys 0.002s
I20260709 13:09:55.104635 29743 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.143746 29771 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:55.143558 29743 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.144146 29771 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.144528 29771 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:55.145776 29743 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.146971 29639 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:55.147032 29837 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:55.149528 29837 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.154058 29771 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.155156 29619 leader_election.cc:290] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.156932 29771 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.158241 29831 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:55.160024 21562 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 26.
I20260709 13:09:55.160283 29510 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:55.167527 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.168170 21638 raft_consensus.cc:3060] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:55.176184 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.178018 21636 raft_consensus.cc:1240] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 22. Current term is 23. Ops: []
W20260709 13:09:55.184346 21606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.178604 21639 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 30.
I20260709 13:09:55.197837 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.199103 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.200034 21635 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 27.
I20260709 13:09:55.201560 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.202389 21635 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:55.203563 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.188045 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.207906 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.208273 21635 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:09:55.208492 22244 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 14.
I20260709 13:09:55.216184 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.217152 21639 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:55.230156 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.230876 21641 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:55.231763 21634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36050 (request call id 1814) took 2535 ms. Trace:
I20260709 13:09:55.196776 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.232389 21636 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:09:55.230818 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 139019us
I20260709 13:09:55.232234 21634 rpcz_store.cc:276] 0709 13:09:52.674897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.675022 (+   125us) service_pool.cc:224] Handling call
0709 13:09:52.675356 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.601121 (+925765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:53.601150 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.606811 (+  5661us) log.cc:844] Serialized 26 byte log entry
0709 13:09:53.964234 (+357423us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:53.964276 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.964976 (+   700us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.141308 (+1176332us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b4400022b4c. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a6d7ddb1 00007f98a6e1bc85 00007f98a6e1c6a2 00007f98a9b8e1db 00007f98a9b89aaf 00007f98a9b7d86e 00007f98a9b7cbb6 00007f98a9b7c7d8 00007f98a9b86221 00007f98a9b861d9 00007f98a9b86169
0709 13:09:55.184681 (+ 43373us) raft_consensus.cc:1685] finished
0709 13:09:55.184700 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.210644 (+ 25944us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":791159,"raft.queue_time_us":759307,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7278,"spinlock_wait_cycles":63905152,"thread_start_us":429889,"threads_started":2,"wal-append.queue_time_us":418250}
I20260709 13:09:55.238867 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.241550 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:55.243637 21606 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.244050 21606 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.229871 29815 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:09:55.244985 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.245705 22244 raft_consensus.cc:2393] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 28: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:55.247844 29509 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:55.254124 22239 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:55.229576 29535 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.256400 22212 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:55.260530 29535 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.260555 29743 raft_consensus.cc:2804] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:09:55.264521 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.265259 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:55.265700 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.266273 22243 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:55.266225 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:55.257541 21606 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.263846 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.267920 21639 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:55.267866 22244 raft_consensus.cc:2468] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:55.269284 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:55.268368 21606 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:55.270702 21606 leader_election.cc:336] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.271291 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.271756 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.247094 29815 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:55.276435 20382 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 21475)
I20260709 13:09:55.275996 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.261255 29743 raft_consensus.cc:697] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:55.277757 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.277879 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.278561 22239 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 28.
I20260709 13:09:55.278568 29743 consensus_queue.cc:237] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.279947 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.280545 22242 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:55.261641 29629 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:55.281539 29629 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.283783 29629 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.287233 21643 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 18.
I20260709 13:09:55.271345 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.279040 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.292840 22238 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 28.
I20260709 13:09:55.293416 21636 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 21.
I20260709 13:09:55.288482 29815 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Advancing to term 31
W20260709 13:09:55.335413 29861 log.cc:927] Time spent T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:09:55.287335 29800 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:55.293630 21563 raft_consensus.cc:1240] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:55.334836 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64130.1us
W20260709 13:09:55.339641 21606 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:55.341082 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 82885.1us
I20260709 13:09:55.342830 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.344861 29759 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:55.321861 29629 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:55.340692 22212 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:55.341821 21606 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.345348 29759 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:55.350852 29759 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.336638 29509 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.352341 29509 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.346678 29859 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:55.355566 29859 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.355938 29859 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:55.360262 21609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.366370 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.368140 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.368980 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.371695 21638 raft_consensus.cc:2468] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 26.
I20260709 13:09:55.371382 29819 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.372989 22246 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 24: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:55.373807 29846 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:09:55.374256 29841 consensus_queue.cc:1059] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:55.375185 29685 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:09:55.378262 21637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58388 (request call id 2645) took 1117 ms. Trace:
I20260709 13:09:55.337811 29619 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:55.349504 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.378717 21637 rpcz_store.cc:276] 0709 13:09:54.260625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.260746 (+   121us) service_pool.cc:224] Handling call
0709 13:09:54.261023 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.415947 (+154924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.377945 (+961998us) spinlock_profiling.cc:243] Waited 77.1 ms on lock 0x7b540009ae54. stack: 00007f98a6ec3343 00007f98a6ec3240 00007f98a68521d4 00007f98b0590304 00007f98b0590299 00007f98a9f4b571 00007f98a9fe2e01 00007f98a9fe183e 00007f98aefa6419 00007f98a851dbd4 00007f98a851db62 00007f98a851da91 00007f98a851da0c 00007f98a851ccc2 00007f98a831d48c 00007f98a831c8c6
0709 13:09:55.378187 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177345408}
I20260709 13:09:55.374302 29846 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting leader election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:55.377345 29639 raft_consensus.cc:3055] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:55.382413 29846 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:09:55.377457 29685 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.377377 29535 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:55.375404 29841 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:55.386040 21560 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:55.388418 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.395300 29819 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.396870 29509 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.385089 29685 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:55.382450 29639 raft_consensus.cc:740] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:55.403592 29798 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:09:55.403723 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 302232us
I20260709 13:09:55.385370 29629 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:55.404976 29389 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:55.405593 29815 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.385789 29800 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:09:55.407025 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.409627 29859 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.410512 29841 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.416105 29834 consensus_queue.cc:1059] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:55.418396 29639 consensus_queue.cc:260] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:55.424345 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:55.431443 21457 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.426191 29629 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.431402 29362 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:55.460876 22240 raft_consensus.cc:2368] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 30. Current term is 31.
I20260709 13:09:55.461356 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.461506 21457 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:09:55.446908 29509 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:09:55.448194 29841 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:55.465335 21532 leader_election.cc:304] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.457901 29798 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:55.481606 21643 raft_consensus.cc:1240] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 23. Current term is 24. Ops: []
W20260709 13:09:55.482244 21606 leader_election.cc:336] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.485365 22241 pending_rounds.cc:85] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 11
I20260709 13:09:55.485648 22241 pending_rounds.cc:107] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:09:55.485955 22241 raft_consensus.cc:2889] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:55.447050 29389 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:55.460731 29362 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.459318 29800 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:55.484529 21606 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.463169 29629 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:55.491523 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.482713 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:55.492805 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.528841 21637 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 28.
I20260709 13:09:55.493002 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.467617 29834 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:55.469338 29795 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:55.495723 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.538341 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.538890 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.539182 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.540160 21636 raft_consensus.cc:2393] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 21: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:55.467942 29509 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.499776 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.511684 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.509225 29639 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:55.514302 22238 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:09:55.515348 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397e2c83e814a908887a9e44184de0a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:55.515379 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.507820 29362 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:55.521420 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.521258 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.521660 29859 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:55.523154 21606 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.523679 29510 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:55.524085 29851 raft_consensus.cc:3055] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:55.524890 29857 raft_consensus.cc:2764] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 13:09:55.526278 29815 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 31 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.484115 29840 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:55.468894 29768 consensus_queue.cc:1059] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:09:55.530069 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.582741 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:55.530319 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 47693.8us
I20260709 13:09:55.532105 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.533203 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:55.585151 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:55.585968 22242 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 15: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:55.533627 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.586118 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.538359 29795 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:55.538343 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:55.512449 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.546777 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.550348 21636 raft_consensus.cc:1275] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:09:55.475473 29837 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:09:55.562876 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:55.560638 21606 leader_election.cc:336] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.516273 29798 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:55.565104 29834 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:55.542775 29378 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:55.547775 29509 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:55.542944 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.544860 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.587397 21608 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:55.576066 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:55.605162 21606 leader_election.cc:336] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.607957 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:55.608152 21606 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:55.595981 21567 raft_consensus.cc:2368] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 25. Current term is 26.
I20260709 13:09:55.565369 29851 raft_consensus.cc:740] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:55.591866 29831 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:55.601797 22210 leader_election.cc:336] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.614833 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:55.530118 29800 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:55.608594 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:55.608706 21606 leader_election.cc:336] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.610926 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:55.593488 29795 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:55.616212 21606 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.594832 29840 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:55.618148 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.618506 21569 raft_consensus.cc:2393] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 19: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
W20260709 13:09:55.618634 21606 leader_election.cc:336] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.619987 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:55.621083 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.583678 29685 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.623699 21563 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:55.612305 29790 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:55.638502 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:55.632891 29840 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:55.618018 29464 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.618189 29725 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:55.635502 29389 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:55.636617 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 51559.6us
I20260709 13:09:55.619129 21606 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.633299 29768 raft_consensus.cc:3055] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:55.645699 29851 consensus_queue.cc:260] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:55.647265 29685 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 29 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:55.659181 29864 log.cc:927] Time spent T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.277s	user 0.002s	sys 0.002s
I20260709 13:09:55.598624 29798 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:55.660912 21606 leader_election.cc:336] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.662235 29798 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.644326 29654 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:55.655444 29768 raft_consensus.cc:740] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:55.663731 29725 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:55.621973 29858 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:09:55.664186 29768 consensus_queue.cc:260] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:55.665545 29768 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:55.650230 29846 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.674571 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:09:55.701570 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.703738 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 87027.5us
W20260709 13:09:55.704324 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:55.704614 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.705224 21640 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Advancing to term 29
I20260709 13:09:55.655401 29464 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.693640 29786 raft_consensus.cc:2804] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:09:55.711624 22210 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.716615 22210 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.717865 22210 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.722344 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.726720 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:55.701157 29851 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:55.736348 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 152014us
W20260709 13:09:55.737089 22210 leader_election.cc:336] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.737602 22210 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.738476 29873 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:55.722031 29786 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:55.738811 22210 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:55.689815 29834 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:55.747629 22210 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.744623 29841 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.749800 29629 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:55.750173 29795 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:55.757978 21640 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 29.
W20260709 13:09:55.758421 22210 leader_election.cc:336] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.761935 29846 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:55.767969 22210 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.713909 29792 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 13:09:55.769889 22210 leader_election.cc:336] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:55.770825 22210 leader_election.cc:336] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.771250 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:55.773183 22210 leader_election.cc:336] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.773605 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:55.759109 29786 raft_consensus.cc:3060] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:55.781803 29464 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.785048 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.786514 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.773932 29873 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:55.789047 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.792361 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.797362 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:55.803463 21640 raft_consensus.cc:1240] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Rejecting Update request from peer 5727b19579474da6a12f79730b924770 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:09:55.806294 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.807108 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.808260 21642 raft_consensus.cc:2393] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 24: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:55.810267 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.812194 29857 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:09:55.812609 29857 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:55.812994 29857 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:55.813884 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.814505 21642 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:09:55.821403 21642 raft_consensus.cc:2468] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 31.
I20260709 13:09:55.821214 29857 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:55.826231 21457 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.828198 29472 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:09:55.828716 29472 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 29 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:55.829949 29472 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:55.832355 21606 leader_election.cc:336] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.832861 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.833992 29837 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:55.835481 29857 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.776338 29619 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:55.852134 22210 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:55.854408 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.855173 21635 raft_consensus.cc:2368] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 30. Current term is 31.
I20260709 13:09:55.861941 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:55.862568 21637 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:09:55.863529 21532 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.864007 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:55.864490 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 75522.1us
I20260709 13:09:55.873153 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:55.881189 21637 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 29.
W20260709 13:09:55.887391 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 55062.4us
W20260709 13:09:55.888371 21606 leader_election.cc:336] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.888891 21606 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:55.888831 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d46f34ab738d4d38b09f9d1228d68c7d with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 549b31ac31b6428994b45938abc223a7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:55.889099 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.890228 22247 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:55.788579 29725 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:55.850617 29831 raft_consensus.cc:2749] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:55.897680 21457 leader_election.cc:400] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 30. Current term is 31.
W20260709 13:09:55.890204 21532 leader_election.cc:336] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.924435 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:55.928946 21457 leader_election.cc:403] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 election: Cancelling election due to peer responding with higher term
W20260709 13:09:55.929680 21532 leader_election.cc:336] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.930271 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:55.937983 21532 leader_election.cc:336] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.938869 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:55.939163 29510 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:55.940630 21532 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.941087 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:55.939756 29378 raft_consensus.cc:3060] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:09:55.911051 29882 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:55.909857 29800 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:55.891829 29743 raft_consensus.cc:2804] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:09:55.953718 21636 raft_consensus.cc:3060] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:56.009819 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 136722us
I20260709 13:09:56.010708 21608 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:55.892699 29837 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:09:55.957712 21532 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:55.867964 29857 consensus_queue.cc:1059] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:09:55.947722 29389 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:55.953730 29840 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:55.955730 29855 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:55.979387 29629 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.985759 29831 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:55.991547 29841 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:55.995440 29795 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:55.946035 29798 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:55.959446 29510 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:56.002688 29715 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:56.011843 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:56.039696 21608 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:56.019784 29725 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:09:56.076658 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 188305us
I20260709 13:09:56.018328 29743 raft_consensus.cc:697] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 31 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
W20260709 13:09:56.083361 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45012.1us
W20260709 13:09:56.084556 21606 leader_election.cc:336] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.091137 21636 raft_consensus.cc:2468] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:09:56.089340 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:56.018915 29362 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.038050 29855 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.084316 29629 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:56.083092 29887 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:56.016043 29509 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:56.109515 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 151841us
W20260709 13:09:56.131345 21532 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.131861 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:56.132915 21532 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.133335 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:56.113183 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:56.111014 29715 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:56.117383 29362 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:56.117684 29378 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 31 FOLLOWER]: Leader election lost for term 30. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 30. Current term is 31.
I20260709 13:09:56.118350 29743 consensus_queue.cc:237] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.139528 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:56.139643 29509 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:56.140434 21642 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 28. Current term is 29. Ops: []
I20260709 13:09:56.119755 29725 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:56.143055 29795 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:56.146610 29883 consensus_queue.cc:1059] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:09:56.148180 29786 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:56.130187 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 45657.6us
I20260709 13:09:56.130363 21608 leader_election.cc:400] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 25. Current term is 26.
I20260709 13:09:56.151829 21608 leader_election.cc:403] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
W20260709 13:09:56.152001 21606 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.038621 29837 raft_consensus.cc:3055] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:56.137658 21532 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.156862 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:56.134384 21638 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:56.158085 29786 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:56.159507 29725 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:56.167317 29710 raft_consensus.cc:3055] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:56.167785 29710 raft_consensus.cc:740] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:56.136981 29798 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:56.168648 29710 consensus_queue.cc:260] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.169888 29710 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:56.170819 29855 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:56.172601 29882 raft_consensus.cc:2749] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) with higher term. Message: Invalid argument: T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for earlier term 25. Current term is 26.
I20260709 13:09:56.177557 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:56.152473 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:56.182050 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:09:56.187021 21606 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.187498 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:56.187711 21638 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:56.177491 21532 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:56.189692 21532 consensus_peers.cc:597] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.191682 29715 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:09:56.192245 29715 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 29 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:56.198836 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:56.199965 21562 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 18: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:56.036583 29840 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.199008 21457 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:56.208098 29685 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:56.208665 29685 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:56.209564 29685 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.211970 21634 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 28. Current term is 29. Ops: []
W20260709 13:09:56.190747 21532 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.215073 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:56.184963 29725 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:56.188164 29855 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:56.216826 21606 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.186236 29798 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:56.218830 21606 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:56.221482 21606 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.221977 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:56.157112 29837 raft_consensus.cc:740] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:09:56.218495 21532 leader_election.cc:336] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.195387 29790 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:56.219259 29389 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:56.230197 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:56.193208 29715 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:56.219113 29725 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.219664 29882 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:56.226025 29509 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:56.215802 29839 consensus_queue.cc:1059] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 28.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:09:56.224929 29855 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.236202 29798 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:56.216490 29472 consensus_queue.cc:1059] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 13:09:56.247478 29472 consensus_queue.cc:1243] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer a87bd86b86e74aa8bb61189215b73439 log is divergent from this leader: its last log entry 27.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 13:09:56.247936 29855 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:56.248452 29472 raft_consensus.cc:3055] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:09:56.249325 29472 raft_consensus.cc:740] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:56.240412 21532 leader_election.cc:336] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.275105 29837 consensus_queue.cc:260] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.274477 21532 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:56.279054 21642 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:09:56.281702 21640 raft_consensus.cc:1240] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Rejecting Update request from peer 549b31ac31b6428994b45938abc223a7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:56.283303 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:56.284085 21636 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:09:56.287050 29783 consensus_queue.cc:1048] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:09:56.295455 21532 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.296271 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:56.302021 29795 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:09:56.302680 21532 leader_election.cc:336] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.304177 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:56.304934 29857 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:56.305330 29857 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.305676 29857 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:56.307260 29837 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:56.308552 21568 raft_consensus.cc:1275] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:09:56.293051 29788 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:56.310853 29839 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:56.380577 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:56.387399 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 71665.4us
I20260709 13:09:56.371505 29584 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:56.388475 22210 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:56.396495 29840 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:56.442058 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 217845us
I20260709 13:09:56.445319 21606 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:56.439747 29619 raft_consensus.cc:2804] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:56.439327 29798 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:56.439464 29887 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:56.388504 29839 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.451489 29725 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:56.451918 29710 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:56.428504 29584 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.472903 29657 raft_consensus.cc:3055] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:09:56.473325 29657 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:56.474529 29839 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:56.474207 29657 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:56.470671 29619 raft_consensus.cc:697] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:56.476820 29809 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:09:56.478067 29619 consensus_queue.cc:237] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.465978 29798 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:56.489462 29798 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:56.491269 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:56.496604 21532 leader_election.cc:336] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.497206 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:56.501037 29798 raft_consensus.cc:2749] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:56.426527 29472 consensus_queue.cc:260] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:56.504875 29892 log.cc:927] Time spent T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
I20260709 13:09:56.505263 29472 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:56.521601 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:56.522063 22238 raft_consensus.cc:1240] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Rejecting Update request from peer a87bd86b86e74aa8bb61189215b73439 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:09:56.513365 29857 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.524893 29857 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:56.514513 29809 consensus_queue.cc:1059] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:09:56.526575 29809 raft_consensus.cc:3055] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:56.526944 29809 raft_consensus.cc:740] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:56.534917 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:56.538625 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:56.544219 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47661.8us
I20260709 13:09:56.556166 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:56.557133 22246 raft_consensus.cc:3060] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:56.566423 21640 raft_consensus.cc:1240] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 13:09:56.578087 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:56.528514 29809 consensus_queue.cc:260] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.598184 21641 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:56.536471 29685 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.548872 29710 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:56.613569 29788 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.623205 29788 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:56.625712 29788 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:56.631126 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:56.645501 21457 leader_election.cc:400] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Vote denied by peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) with higher term. Message: Invalid argument: T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for earlier term 30. Current term is 31.
W20260709 13:09:56.644136 21532 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:56.652251 21606 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.655349 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:56.666824 21640 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:09:56.691232 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:56.691622 21563 raft_consensus.cc:1240] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:56.692603 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:56.693225 22242 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:09:56.657716 29828 raft_consensus.cc:493] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.657716 29809 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:56.651137 29685 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:56.721632 22246 raft_consensus.cc:2468] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 29.
I20260709 13:09:56.660564 29710 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:56.699383 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:56.724411 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:56.724627 21636 raft_consensus.cc:2410] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:09:56.723801 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:56.725610 21641 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:56.726907 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:56.729750 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:56.736783 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:56.727478 22247 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:56.737957 22246 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:09:56.738909 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b18ad2e6f014e20be78478bc402f892" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:56.740283 21563 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:56.719803 29846 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.751662 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:56.723384 29584 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:56.722862 29828 raft_consensus.cc:515] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.765472 29828 leader_election.cc:290] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:56.766839 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:56.768467 29685 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:56.769019 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:56.750268 29798 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:56.778371 29657 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:56.779937 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:56.780848 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:56.787700 21641 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:56.789270 21532 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:56.791721 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.793658 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:56.793817 29788 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:56.794181 22243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:56.794399 29788 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:09:56.795430 29788 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.797868 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:56.790648 29798 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:56.804579 29710 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:56.805747 29815 consensus_queue.cc:1048] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:09:56.772854 29837 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:56.808236 29837 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.810402 29837 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:56.815105 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:56.815773 21639 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:56.817216 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:56.818276 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.819986 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:56.820842 22247 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 29.
W20260709 13:09:56.822095 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 207820us
I20260709 13:09:56.831388 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:56.832319 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.833094 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:56.834100 21634 raft_consensus.cc:2368] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20.
I20260709 13:09:56.842233 21606 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:56.844056 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773b0d389ce4ab991f6892abb4882e7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:56.851120 22210 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.853200 22239 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:09:56.756553 29846 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:56.819255 29792 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:09:56.852645 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:56.825846 29604 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:56.855906 22246 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:09:56.847550 29882 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:56.863428 21563 raft_consensus.cc:1240] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 29 LEADER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 28. Current term is 29. Ops: []
W20260709 13:09:56.864212 22210 leader_election.cc:336] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.865465 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:56.866358 22210 leader_election.cc:336] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:56.850371 29710 raft_consensus.cc:2804] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:09:56.858714 29766 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.855245 29851 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:09:56.888047 21641 raft_consensus.cc:1275] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 31 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 13:09:56.888911 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:56.889541 21568 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:56.861340 29792 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:56.879611 29710 raft_consensus.cc:697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:56.914028 21459 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:56.880702 29766 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:56.892974 29815 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:56.920254 29768 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:56.920200 29798 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:57.043759 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 189408us
I20260709 13:09:57.008172 29887 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:57.073786 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 77720.9us
I20260709 13:09:57.087769 21457 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:57.031045 29725 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.031248 29619 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:57.030336 29788 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:57.037526 29710 consensus_queue.cc:237] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.105093 21459 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:57.083506 29898 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.074914 29472 consensus_queue.cc:1059] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:09:57.034734 29798 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:57.117962 21606 leader_election.cc:336] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.120040 21641 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:09:57.073706 29887 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:57.107831 29768 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:57.129038 29786 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:57.113034 29788 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:57.133898 29788 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.134976 29768 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.135502 29768 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:57.158164 29792 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.107362 29619 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.160499 29619 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.102257 29840 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
W20260709 13:09:57.165733 21532 consensus_peers.cc:597] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:57.167024 21532 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.105993 29771 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:09:57.130380 29798 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:57.167810 21532 leader_election.cc:336] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.102051 29725 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.174853 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.175918 21634 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:57.164038 29768 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:57.183087 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.184381 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.185444 21638 raft_consensus.cc:2393] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 23: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:57.187466 22244 raft_consensus.cc:2410] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:09:57.188138 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.189270 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:09:57.200865 21458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.120854 29898 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.190834 29887 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:57.192031 29766 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.228958 21638 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
W20260709 13:09:57.220396 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 115381us
I20260709 13:09:57.248309 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:57.210635 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:57.221714 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:57.260592 21564 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:57.218394 29667 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.286978 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 48173.3us
W20260709 13:09:57.295007 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 84522.3us
I20260709 13:09:57.293787 29667 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:57.298415 29906 log.cc:927] Time spent T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:09:57.298547 29768 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:57.299315 29910 log.cc:927] Time spent T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:09:57.297049 21457 leader_election.cc:304] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:57.303897 29828 raft_consensus.cc:493] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.304517 29828 raft_consensus.cc:515] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.329548 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.316774 21459 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:57.334798 22210 leader_election.cc:400] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20.
I20260709 13:09:57.335175 22210 leader_election.cc:403] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:57.333525 22212 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:09:57.270991 29857 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:57.338038 21635 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 13:09:57.294741 29715 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:57.345908 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.346534 21636 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:57.306749 29828 leader_election.cc:290] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:57.299350 29667 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.351374 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.350379 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:57.310545 29834 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:09:57.298563 29898 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.332115 29792 raft_consensus.cc:2749] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:57.352509 21636 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:57.353125 21634 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:57.355039 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.353415 29639 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:57.358743 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.365746 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:57.336941 29604 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
W20260709 13:09:57.372977 22213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.360734 29743 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:57.361403 29873 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367) with higher term. Message: Invalid argument: T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for earlier term 19. Current term is 20.
I20260709 13:09:57.351087 29857 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:57.387203 29882 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.387766 29857 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.389209 29922 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:57.387797 29882 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.369824 29859 consensus_queue.cc:1048] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.022s
I20260709 13:09:57.397236 29882 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:57.397411 29725 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:57.397955 29920 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:57.377720 29743 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:09:57.398947 29743 raft_consensus.cc:3060] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.377053 29839 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:09:57.410024 29715 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:57.423453 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 90001.9us
I20260709 13:09:57.434198 22247 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:09:57.434592 22247 pending_rounds.cc:85] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Aborting all ops after (but not including) 15
I20260709 13:09:57.434834 22247 pending_rounds.cc:107] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 13:09:57.435063 22247 raft_consensus.cc:2889] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:57.435853 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b45f3e8b8e428ea4709e7e9ee43868" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:57.438458 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.439280 21639 raft_consensus.cc:1275] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:09:57.439541 21643 raft_consensus.cc:2410] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:09:57.441026 22240 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 13:09:57.443998 29786 raft_consensus.cc:3055] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:57.444451 29786 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:57.445425 29846 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:57.445287 29786 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:57.446341 29839 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:09:57.447903 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:57.441295 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:57.455510 22241 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:57.458683 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.458876 21643 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:57.466967 21634 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:57.446707 29786 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:57.440477 29788 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:57.480396 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:57.465613 29768 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:57.478536 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:57.464972 29584 consensus_queue.cc:1048] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 13:09:57.496415 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:57.503396 29839 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:57.503866 29839 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.500119 21568 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:57.511790 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:57.513540 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:57.514221 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:57.514588 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:57.514873 21569 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 23.
I20260709 13:09:57.515142 21562 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:57.519511 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:57.520102 21560 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
W20260709 13:09:57.521528 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 126990us
I20260709 13:09:57.523303 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:57.525030 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:57.495457 29768 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.504235 29839 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:57.544083 22210 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.478232 29715 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:09:57.544775 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:57.504405 29389 raft_consensus.cc:2749] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:57.536278 21457 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:57.546799 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:57.556779 22210 leader_election.cc:336] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.540948 29882 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.557796 22210 leader_election.cc:336] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.489737 29788 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:57.558331 29857 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:09:57.548532 29768 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:57.577891 21562 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 20.
I20260709 13:09:57.556300 29362 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.556559 29840 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.564481 29930 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:09:57.581400 21532 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.588622 21388 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 28 to 29, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 29 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.563041 29882 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:57.593505 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 50802.6us
I20260709 13:09:57.605567 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:57.597954 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 61756.7us
I20260709 13:09:57.598970 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:57.586346 29839 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:57.591022 29425 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:57.636210 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 81065.6us
W20260709 13:09:57.645455 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 64066.2us
I20260709 13:09:57.604947 29900 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:57.648437 29783 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:57.607645 29840 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.652794 29839 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.634004 29667 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:09:57.667395 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 60656.9us
I20260709 13:09:57.635938 29809 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:57.607758 29362 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:57.695752 29882 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:57.698812 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:57.704036 29788 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.710891 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:57.712437 20382 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 21519)
I20260709 13:09:57.713219 22240 raft_consensus.cc:1275] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
W20260709 13:09:57.724025 21532 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:57.725732 29907 log.cc:927] Time spent T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:57.731596 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:57.738080 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:57.760389 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:57.761080 21642 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:57.761466 21566 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 15.
I20260709 13:09:57.765448 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:57.737740 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45394.3us
I20260709 13:09:57.729418 29766 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.773164 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:57.733001 29809 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.756814 29901 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.785175 21642 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:57.770838 29425 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.774762 29725 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:57.784828 29901 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.776361 29667 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:57.778403 29921 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:57.778255 29809 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:57.799536 29725 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.813520 29667 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:57.775991 29766 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.820348 29768 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:57.797079 29425 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.780877 29710 consensus_queue.cc:1048] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.026s
I20260709 13:09:57.822726 29425 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:57.820804 29766 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:57.828586 29840 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:57.830399 21459 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:57.837809 29768 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.812387 29725 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:57.851024 29362 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.855227 29743 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:57.929662 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:09:57.938088 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 76230.3us
I20260709 13:09:57.848690 29768 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:09:57.940335 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 169582us
I20260709 13:09:57.945115 21566 raft_consensus.cc:2468] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 15.
I20260709 13:09:57.946429 21457 leader_election.cc:304] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:57.948163 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:57.949295 21566 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:57.937768 29940 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.959589 21457 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:57.961223 29425 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:57.961825 29425 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
W20260709 13:09:57.963874 21606 leader_election.cc:336] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.964681 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:09:57.966068 21606 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.966574 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:57.967188 21639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:57.967892 21606 leader_election.cc:336] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.953859 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:57.968400 21606 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:57.968617 21564 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:57.973685 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:57.975075 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:57.976600 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:57.977383 21635 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:57.978468 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:57.979394 21560 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:57.993242 29882 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:58.014544 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:57.969077 29425 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:58.029125 21566 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
W20260709 13:09:58.031948 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 96677.9us
I20260709 13:09:58.052760 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:58.054154 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:57.952638 29768 raft_consensus.cc:2749] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:58.058527 21564 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:57.994733 29710 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:58.064848 22242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:58.069759 21635 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 19.
I20260709 13:09:58.000106 29887 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:09:57.948860 29915 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.112s
I20260709 13:09:57.998343 29940 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:58.077474 21636 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 24.
I20260709 13:09:58.047984 29882 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:58.079648 29882 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.082154 29882 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:58.084964 29901 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:57.965975 29834 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.099s
I20260709 13:09:58.088429 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:58.078433 29362 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.090234 29841 raft_consensus.cc:493] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.090025 29949 raft_consensus.cc:493] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.115561 29940 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:58.107477 29949 raft_consensus.cc:515] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:58.117236 29936 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
W20260709 13:09:58.117616 29938 log.cc:927] Time spent T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:09:58.118187 29949 leader_election.cc:290] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:58.098937 29362 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.123659 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:58.129912 21564 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:09:58.132426 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:58.104970 29841 raft_consensus.cc:515] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.136010 29940 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:58.165728 29743 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:58.171551 29956 log.cc:927] Time spent T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:58.176740 29725 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.181741 29841 leader_election.cc:290] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:58.185727 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:58.186555 21564 raft_consensus.cc:3060] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:58.197232 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:58.198031 21643 raft_consensus.cc:2393] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 15: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:58.201758 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:09:58.203413 21376 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d46f34ab738d4d38b09f9d1228d68c7d with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 549b31ac31b6428994b45938abc223a7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:58.204666 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:58.206387 29920 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.206939 29920 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:58.209331 29920 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:58.206961 21606 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:58.213467 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:58.216594 21564 raft_consensus.cc:2468] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:09:58.217721 21608 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:58.159060 29940 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.238293 29940 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:09:58.258174 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 147910us
I20260709 13:09:58.261226 21457 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:58.262651 21457 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:58.259243 29968 raft_consensus.cc:2804] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:58.250367 29725 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:58.255018 29957 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:58.315574 29841 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.318523 29725 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:58.318868 29828 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:58.319415 29828 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.319660 29362 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:58.319832 29828 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:58.319168 29725 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:58.321216 29715 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:58.321776 29715 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:58.322165 29920 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:58.322671 29920 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:58.318773 29841 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:58.324344 29962 log.cc:927] Time spent T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:09:58.325197 29841 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:58.326884 29715 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:58.318758 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:58.264883 29425 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:58.336225 29425 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:58.337131 29425 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:58.337679 29809 consensus_meta.cc:287] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.001s
I20260709 13:09:58.338183 29809 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.339192 29725 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:58.340366 29960 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:09:58.340590 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:09:58.342660 29828 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:58.356113 21638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:58.362246 22241 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 16: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:09:58.360594 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:58.352109 29968 raft_consensus.cc:697] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:09:58.368265 29725 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:58.377079 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 323437us
I20260709 13:09:58.377872 22212 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:58.380949 29968 consensus_queue.cc:237] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.383997 29828 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:58.375226 29715 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:58.388458 29715 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:58.392550 29920 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:58.393179 29809 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:58.378578 29725 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:58.397670 29725 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:58.399257 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:58.418509 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d086ed254594401ae567a7d3681c987" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:58.419507 21564 raft_consensus.cc:2393] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 549b31ac31b6428994b45938abc223a7 in current term 16: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:09:58.427268 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 81242.7us
W20260709 13:09:58.428900 21606 consensus_peers.cc:597] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:58.415483 29809 raft_consensus.cc:2804] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:58.430966 29809 raft_consensus.cc:697] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:09:58.431984 29809 consensus_queue.cc:237] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.433826 29425 raft_consensus.cc:493] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.434404 29425 raft_consensus.cc:515] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.436820 29940 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:58.437187 29425 leader_election.cc:290] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:58.444833 22244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9f5258ae3f4790a9bc1813d73ec987" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:58.422209 29715 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:58.450088 29940 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:58.446336 21640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:58.452925 21640 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a34fd3290de493eb6bbe828dd742772 in current term 25: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:09:58.447079 22240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:58.457481 21560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:58.459765 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e6cfe6efc04bc98ae2183731b5ae40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:58.457525 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:58.460863 21567 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:58.462600 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:58.465114 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:58.468411 21563 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:58.481652 21567 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 25.
I20260709 13:09:58.483033 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:58.485297 29667 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:09:58.488178 21457 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:58.496186 22212 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:58.500236 29819 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:58.504788 29969 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:58.511092 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fad88e2e67d44f7adb559c0a8eb0af8" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:09:58.511760 29945 log.cc:927] Time spent T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.569s	user 0.011s	sys 0.008s
I20260709 13:09:58.523197 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67538f399a3e491e97d3a4c5585bf44a" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:58.529989 21459 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:58.580606 21457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 72106.8us
I20260709 13:09:58.582731 21457 leader_election.cc:304] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:58.594980 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 65114.6us
I20260709 13:09:58.584806 29974 raft_consensus.cc:2749] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:58.596207 29974 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:58.594842 21457 leader_election.cc:304] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:58.602398 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:58.605660 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:58.608724 29915 raft_consensus.cc:2749] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:09:58.610160 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:58.612064 21457 leader_election.cc:304] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:09:58.612633 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 144749us
I20260709 13:09:58.612953 29955 raft_consensus.cc:2749] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:58.613394 22210 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 125 similar messages]
I20260709 13:09:58.617799 21459 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:58.621053 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:58.622083 21561 raft_consensus.cc:2393] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 17: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:09:58.621198 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:58.622819 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:58.623493 21562 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 25: Already voted for candidate 5a34fd3290de493eb6bbe828dd742772 in this term.
I20260709 13:09:58.623458 21569 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:09:58.626667 29944 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:09:58.627918 21459 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:58.629655 29944 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:58.630003 29604 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:09:58.631330 29604 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 25 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:58.628984 21459 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:58.635774 29969 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:58.637475 29604 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:58.641283 21532 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:58.641798 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:58.657284 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:09:58.643378 29788 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:58.661597 29887 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:58.662151 29887 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:09:58.676651 21532 leader_election.cc:336] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:58.662683 29887 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:58.678061 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:58.684056 29715 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:58.693943 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 80579.1us
W20260709 13:09:58.695256 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:58.715271 29887 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:09:58.761304 20382 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 21519)
W20260709 13:09:58.747277 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 74045.6us
I20260709 13:09:58.818274 29887 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:09:58.832902 21606 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:58.841142 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:58.842116 22210 leader_election.cc:336] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:58.842748 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:58.856628 29859 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:58.858532 21388 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 19 to 20, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 20 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:58.875185 21388 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.879825 21562 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:09:58.881733 21532 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:58.887451 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:58.888521 29798 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:58.880164 21388 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 16 to 17, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 17 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:58.895439 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 53459us
I20260709 13:09:58.891393 29917 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:58.892354 21532 leader_election.cc:336] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:58.901813 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:58.901007 21606 leader_election.cc:336] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:58.916509 29792 raft_consensus.cc:493] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.919072 21634 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:58.907132 21388 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 24 to 27, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 27 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.922199 21392 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40780 (request call id 243) took 9356 ms. Trace:
I20260709 13:09:58.914230 29798 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:58.928211 29792 raft_consensus.cc:515] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.928913 29657 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:58.929826 29657 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:09:58.924021 21532 consensus_peers.cc:597] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:58.933612 29657 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:58.934664 29792 leader_election.cc:290] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:09:58.926926 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6fad88e2e67d44f7adb559c0a8eb0af8: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:09:58.936693 21388 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 20 to 22, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 22 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:58.937954 29887 raft_consensus.cc:493] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:58.938529 21532 consensus_peers.cc:597] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:58.939872 29887 raft_consensus.cc:515] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.944240 29887 leader_election.cc:290] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:58.945488 21562 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:58.944149 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:58.947151 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:58.948253 21569 raft_consensus.cc:2410] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:09:58.957073 21565 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:58.963011 29859 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:09:58.955350 29887 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:09:58.964167 29859 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:58.938730 21388 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 24 to 26, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 26 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:58.979861 29859 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:58.981019 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:58.981215 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:58.927940 21392 rpcz_store.cc:276] 0709 13:09:49.565687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.565957 (+   270us) service_pool.cc:224] Handling call
0709 13:09:58.921958 (+9356001us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:55.073849 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:55.074403 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:55.074436 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:09:55.074453 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:55.076169 (+  1716us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:55.076254 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:55.076279 (+    25us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:09:55.078129 (+  1850us) tablet.cc:701] Row locks acquired
0709 13:09:55.078149 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:09:55.078298 (+   149us) write_op.cc:270] Start()
0709 13:09:55.078414 (+   116us) write_op.cc:276] Timestamp: P: 1783602595078243 usec, L: 0
0709 13:09:55.078434 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:09:55.079359 (+   925us) log.cc:844] Serialized 9494 byte log entry
0709 13:09:55.371494 (+292135us) op_driver.cc:464] REPLICATION: finished
0709 13:09:55.603959 (+232465us) write_op.cc:301] APPLY: starting
0709 13:09:55.609083 (+  5124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:55.988805 (+379722us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:55.988909 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:56.243661 (+254752us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:56.244072 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:09:56.244123 (+    51us) write_op.cc:312] APPLY: finished
0709 13:09:56.244792 (+   669us) log.cc:844] Serialized 212 byte log entry
0709 13:09:56.245015 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:56.245233 (+   218us) write_op.cc:454] Released schema lock
0709 13:09:56.245303 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:56.261733 (+ 16430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:56.261770 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45729,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":214345,"apply.run_cpu_time_us":36660,"apply.run_wall_time_us":649800,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104351,"num_ops":24,"prepare.queue_time_us":104896,"prepare.run_cpu_time_us":28736,"prepare.run_wall_time_us":147498,"raft.queue_time_us":146174,"raft.run_cpu_time_us":28555,"raft.run_wall_time_us":98545,"replication_time_us":292884,"spinlock_wait_cycles":2816,"thread_start_us":442237,"threads_started":4,"wal-append.queue_time_us":141826,"wal-append.run_cpu_time_us":34824,"wal-append.run_wall_time_us":2063301}]]}
W20260709 13:09:58.968169 21532 consensus_peers.cc:597] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.999261 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 45480.4us
I20260709 13:09:58.979413 21388 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 15 to 17, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 17 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.003121 29963 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:09:59.025827 29604 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:09:59.047160 21637 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:59.053100 21568 raft_consensus.cc:1275] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:59.053638 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:59.054325 21634 raft_consensus.cc:1240] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Rejecting Update request from peer 5a34fd3290de493eb6bbe828dd742772 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:59.056507 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:59.056973 21634 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:59.060683 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a0423f397042e3aed0ddbf0c111bd4" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:59.056831 29963 consensus_queue.cc:1048] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:59.074220 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:59.083568 22238 raft_consensus.cc:1275] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:59.085777 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e78f55a98514b6b95c6ea1b508ac13e" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:59.095467 21388 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.096050 21606 leader_election.cc:304] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:59.097734 29887 consensus_queue.cc:1048] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:59.115005 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
W20260709 13:09:59.118314 21532 consensus_peers.cc:597] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:59.120177 29963 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:59.136531 29887 raft_consensus.cc:2749] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:59.201678 21388 catalog_manager.cc:5697] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 15 to 18, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 18 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:59.204224 22210 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:59.203572 21388 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 21 to 22, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 22 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:59.215212 21457 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:59.216122 29792 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:59.250733 29792 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:59.258165 21635 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:09:59.246971 21606 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:59.266939 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:59.279770 29887 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:59.287321 29944 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.288040 29944 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:59.290274 29944 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:59.292867 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:59.320348 29657 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:59.319988 29917 consensus_queue.cc:1059] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:09:59.329479 29917 raft_consensus.cc:3055] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:59.329982 29917 raft_consensus.cc:740] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:59.337277 29887 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:59.339361 29917 consensus_queue.cc:260] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:59.340442 21566 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:09:59.347244 21457 leader_election.cc:304] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:09:59.348906 29914 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:59.356097 29917 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:59.362365 29914 raft_consensus.cc:2749] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:59.369583 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 138609us
I20260709 13:09:59.378523 29841 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
W20260709 13:09:59.380643 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet 1fbb59e66fd74778a9cbae5114efa101: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:59.375331 21606 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:59.388572 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:59.394543 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca05d89c0a6b4f8ca791df1da0bad1f1" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:59.395413 29657 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.395998 29657 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:59.398126 29657 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:09:59.407222 29887 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.404663 21457 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:59.407902 29887 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:59.411880 29841 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:09:59.413970 29887 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:09:59.415235 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:59.414309 29997 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:09:59.426990 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:59.426900 29914 raft_consensus.cc:493] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.427820 21561 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:59.428263 29914 raft_consensus.cc:515] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:59.434944 29914 leader_election.cc:290] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:59.439656 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:09:59.440393 21635 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 17.
I20260709 13:09:59.446393 21457 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:09:59.447431 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet 18a391cd0b80409cb0308239137325f8: Illegal state: Replica 5727b19579474da6a12f79730b924770 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.448702 29657 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:59.449179 29657 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.449501 29657 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:59.454273 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 83119.9us
I20260709 13:09:59.464046 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:59.473821 29657 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:59.488866 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f1cc6194a54e7d8fb8d72776638772" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:59.492395 21637 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:09:59.496493 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet 2002b234371248e3aaaecd1014e30086: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:59.493898 21606 leader_election.cc:336] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:59.501791 21606 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:59.507355 29887 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:59.515343 29917 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:09:59.522569 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet e2ba3136589046f7ada398d9210f305d: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:59.521725 21459 leader_election.cc:304] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:59.527751 29657 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:09:59.530946 21606 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:59.532743 21606 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:09:59.533296 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:09:59.531580 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:09:59.533887 21636 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:59.534256 21569 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:59.534693 29887 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:59.530593 29917 raft_consensus.cc:2749] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:59.562953 21636 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:59.567633 21569 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a34fd3290de493eb6bbe828dd742772 in term 18.
I20260709 13:09:59.570600 21459 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772; no voters: 
I20260709 13:09:59.580796 29841 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:59.581821 29841 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Becoming Leader. State: Replica: 5a34fd3290de493eb6bbe828dd742772, State: Running, Role: LEADER
I20260709 13:09:59.583449 29841 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:09:59.739203 21392 catalog_manager.cc:5697] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 20 to 24, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 24 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.740833 21392 catalog_manager.cc:5697] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.742425 21392 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.744024 21392 catalog_manager.cc:5697] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:59.750057 21392 catalog_manager.cc:5697] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:59.751706 21392 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.754698 21392 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:09:59.762120 20382 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 21519)
I20260709 13:09:59.764526 21392 catalog_manager.cc:5697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.766289 21392 catalog_manager.cc:5697] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 14 to 17, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 17 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.772795 21392 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.786861 21388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40790 (request call id 248) took 10319 ms. Trace:
I20260709 13:09:59.779824 21392 catalog_manager.cc:5697] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 15, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 15 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.791070 29792 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:09:59.791851 29792 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:09:59.794766 29792 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:09:59.795316 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:09:59.797274 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:09:59.791538 21392 catalog_manager.cc:5697] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:59.799769 21457 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:09:59.799585 21392 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 20 to 24, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 24 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.800938 29792 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:59.801287 21392 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.787431 21388 rpcz_store.cc:276] 0709 13:09:49.459755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.459945 (+   190us) service_pool.cc:224] Handling call
0709 13:09:59.779059 (+10319114us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:59.350063 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:59.350745 (+   682us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:59.350828 (+    83us) write_op.cc:435] Acquired schema lock
0709 13:09:59.350850 (+    22us) tablet.cc:662] Decoding operations
0709 13:09:59.351996 (+  1146us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:59.352095 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:59.352124 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:09:59.353178 (+  1054us) tablet.cc:701] Row locks acquired
0709 13:09:59.353228 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:09:59.353379 (+   151us) write_op.cc:270] Start()
0709 13:09:59.353536 (+   157us) write_op.cc:276] Timestamp: P: 1783602599353322 usec, L: 0
0709 13:09:59.353583 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:09:59.354305 (+   722us) log.cc:844] Serialized 4489 byte log entry
0709 13:09:59.516056 (+161751us) op_driver.cc:464] REPLICATION: finished
0709 13:09:59.590284 (+ 74228us) write_op.cc:301] APPLY: starting
0709 13:09:59.590391 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:59.636535 (+ 46144us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:59.636652 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:59.643608 (+  6956us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:59.643952 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:09:59.644023 (+    71us) write_op.cc:312] APPLY: finished
0709 13:09:59.644454 (+   431us) log.cc:844] Serialized 105 byte log entry
0709 13:09:59.644659 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:59.644791 (+   132us) write_op.cc:454] Released schema lock
0709 13:09:59.644858 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:59.653578 (+  8720us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:59.653616 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1264938,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":73578,"apply.run_cpu_time_us":16162,"apply.run_wall_time_us":63234,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50063,"num_ops":11,"prepare.queue_time_us":54492,"prepare.run_cpu_time_us":21575,"prepare.run_wall_time_us":61840,"raft.queue_time_us":64655,"raft.run_cpu_time_us":13729,"raft.run_wall_time_us":73606,"replication_time_us":162272,"spinlock_wait_cycles":504064,"thread_start_us":211821,"threads_started":4,"wal-append.queue_time_us":58554}]]}
I20260709 13:09:59.802632 21392 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 26 to 29, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 29 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.812582 21392 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 20 to 22, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 22 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:59.817587 21392 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 24 to 28. New cstate: current_term: 28 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.822314 21392 catalog_manager.cc:5697] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:59.824031 21392 catalog_manager.cc:5697] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 13 to 16, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 16 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:59.839419 21392 catalog_manager.cc:5697] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.849870 21392 catalog_manager.cc:5697] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 12 to 15, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 15 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:59.857746 21392 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 25. New cstate: current_term: 25 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.860225 21392 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 27 to 28, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 28 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:09:59.861941 21392 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 17 to 20, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 20 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.863823 21392 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:09:59.865206 21392 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
W20260709 13:09:59.956701 21532 consensus_peers.cc:597] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:59.994010 29792 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.994654 29792 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:00.006465 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:00.010859 29792 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:00.011934 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae2bb9c133344078cc4f963e7188776" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:00.013927 21457 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:00.014751 29792 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:10:00.063551 21636 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:00.067031 29792 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:00.111924 21566 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Refusing update from remote peer 5a34fd3290de493eb6bbe828dd742772: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:00.113665 29767 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:00.135848 21390 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 25 to 28. New cstate: current_term: 28 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:00.136888 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:00.175261 21390 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 21 to 24, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 24 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:00.205447 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6fad88e2e67d44f7adb559c0a8eb0af8: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:10:00.207639 29767 raft_consensus.cc:493] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.208539 29767 raft_consensus.cc:515] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:00.220248 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:00.220626 29767 leader_election.cc:290] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:00.223721 29767 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.224225 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb07a26963247f383d1e9c7990b92ac" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:00.224370 29767 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:00.224968 21392 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:10:00.226444 21392 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } }
I20260709 13:10:00.228061 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:00.229866 21457 leader_election.cc:304] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:10:00.223929 21606 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:00.234115 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:00.235864 21457 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:00.236775 29792 raft_consensus.cc:2749] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:00.237596 29792 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:10:00.231310 29767 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:00.260839 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:00.283118 29767 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:00.283831 29767 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:00.286182 29767 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:00.288437 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:00.288486 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:00.292191 21459 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:00.293035 29841 raft_consensus.cc:2749] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:00.296245 21391 catalog_manager.cc:5697] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 reported cstate change: term changed from 16 to 21, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 21 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:00.297308 22210 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:00.297598 21390 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 253) took 4043 ms. Trace:
I20260709 13:10:00.297988 21390 rpcz_store.cc:276] 0709 13:09:56.254279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.254506 (+   227us) service_pool.cc:224] Handling call
0709 13:10:00.297512 (+4043006us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:00.196121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:00.196698 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:00.196740 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:10:00.196759 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:00.197237 (+   478us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:00.197298 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:00.197331 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:00.197670 (+   339us) tablet.cc:701] Row locks acquired
0709 13:10:00.197690 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:10:00.197843 (+   153us) write_op.cc:270] Start()
0709 13:10:00.197961 (+   118us) write_op.cc:276] Timestamp: P: 1783602600197799 usec, L: 0
0709 13:10:00.197997 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:10:00.198674 (+   677us) log.cc:844] Serialized 925 byte log entry
0709 13:10:00.208008 (+  9334us) op_driver.cc:464] REPLICATION: finished
0709 13:10:00.208501 (+   493us) write_op.cc:301] APPLY: starting
0709 13:10:00.208593 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:00.210165 (+  1572us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:00.210276 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:00.213490 (+  3214us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:00.213674 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:10:00.213732 (+    58us) write_op.cc:312] APPLY: finished
0709 13:10:00.213951 (+   219us) log.cc:844] Serialized 33 byte log entry
0709 13:10:00.214136 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:00.214230 (+    94us) write_op.cc:454] Released schema lock
0709 13:10:00.214279 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:00.214660 (+   381us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:00.214693 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":222216,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":270,"apply.run_cpu_time_us":4406,"apply.run_wall_time_us":6114,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8352,"num_ops":2,"prepare.queue_time_us":337,"prepare.run_cpu_time_us":2861,"prepare.run_wall_time_us":2860,"replication_time_us":9863}]]}
W20260709 13:10:00.343123 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:00.348194 21389 catalog_manager.cc:5697] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 21 to 25, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 25 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:00.354470 21391 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40776 (request call id 252) took 24984 ms (client timeout 15000 ms). Trace:
I20260709 13:10:00.355607 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:10:00.355031 21391 rpcz_store.cc:269] 0709 13:09:35.370544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.370997 (+   453us) service_pool.cc:224] Handling call
0709 13:10:00.354379 (+24983382us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:00.304034 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:00.304627 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:00.304668 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:10:00.304683 (+    15us) tablet.cc:662] Decoding operations
0709 13:10:00.305055 (+   372us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:00.305117 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:00.305148 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:00.305337 (+   189us) tablet.cc:701] Row locks acquired
0709 13:10:00.305352 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:10:00.305500 (+   148us) write_op.cc:270] Start()
0709 13:10:00.305605 (+   105us) write_op.cc:276] Timestamp: P: 1783602600305451 usec, L: 0
0709 13:10:00.305625 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:10:00.306251 (+   626us) log.cc:844] Serialized 539 byte log entry
0709 13:10:00.308514 (+  2263us) op_driver.cc:464] REPLICATION: finished
0709 13:10:00.309286 (+   772us) write_op.cc:301] APPLY: starting
0709 13:10:00.309366 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:00.310185 (+   819us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:00.310269 (+    84us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:00.310977 (+   708us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:00.311125 (+   148us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:10:00.311169 (+    44us) write_op.cc:312] APPLY: finished
0709 13:10:00.311340 (+   171us) log.cc:844] Serialized 25 byte log entry
0709 13:10:00.311507 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:00.311590 (+    83us) write_op.cc:454] Released schema lock
0709 13:10:00.311625 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:00.311963 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:00.311993 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22939,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":547,"apply.run_cpu_time_us":2625,"apply.run_wall_time_us":2625,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4176,"num_ops":1,"prepare.queue_time_us":209,"prepare.run_cpu_time_us":2527,"prepare.run_wall_time_us":2526,"replication_time_us":2769}]]}
I20260709 13:10:00.358505 20382 tablet_replica.cc:333] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.360200 20382 raft_consensus.cc:2243] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:00.360994 20382 raft_consensus.cc:2272] T 67538f399a3e491e97d3a4c5585bf44a P 5a34fd3290de493eb6bbe828dd742772 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.360652 21389 catalog_manager.cc:5697] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 17 to 19, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 19 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.363044 21389 catalog_manager.cc:5697] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.364477 20382 tablet_replica.cc:333] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.365783 20382 raft_consensus.cc:2243] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.382865 20382 raft_consensus.cc:2272] T 2002b234371248e3aaaecd1014e30086 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.386204 20382 tablet_replica.cc:333] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.387802 20382 raft_consensus.cc:2243] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.388950 20382 raft_consensus.cc:2272] T e0950a4a64c4484ba4b753d544c7f1eb P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.406424 21388 catalog_manager.cc:5697] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 29 to 31, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 31 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:00.409837 21388 catalog_manager.cc:5697] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 20 to 22, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 22 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:00.416000 20382 tablet_replica.cc:333] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.417218 21388 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 24 to 29, leader changed from 549b31ac31b6428994b45938abc223a7 (127.19.231.132) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 29 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:00.419366 21388 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 17 to 19, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 19 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:00.422175 21388 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 22 to 24, leader changed from a87bd86b86e74aa8bb61189215b73439 (127.19.231.131) to 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129). New cstate: current_term: 24 leader_uuid: "5a34fd3290de493eb6bbe828dd742772" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:00.417992 20382 raft_consensus.cc:2243] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.425318 20382 raft_consensus.cc:2272] T 13befc0ae0be496ea458eb0ed6662d3d P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.421167 21389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52850 (request call id 151) took 6975 ms. Trace:
W20260709 13:10:00.434142 22210 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:00.439452 22210 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:00.431811 21389 rpcz_store.cc:276] 0709 13:09:53.445511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.445680 (+   169us) service_pool.cc:224] Handling call
0709 13:10:00.382500 (+6936820us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:00.382526 (+    26us) write_op.cc:454] Released schema lock
0709 13:10:00.421090 (+ 38564us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:00.369054 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:00.369616 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:00.369662 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:10:00.369683 (+    21us) tablet.cc:662] Decoding operations
0709 13:10:00.370245 (+   562us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:00.370301 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:00.370332 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:00.370672 (+   340us) tablet.cc:701] Row locks acquired
0709 13:10:00.370700 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:10:00.370872 (+   172us) write_op.cc:270] Start()
0709 13:10:00.371003 (+   131us) write_op.cc:276] Timestamp: P: 1783602600370826 usec, L: 0
0709 13:10:00.371026 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:00.371687 (+   661us) log.cc:844] Serialized 1311 byte log entry
0709 13:10:00.374140 (+  2453us) op_driver.cc:464] REPLICATION: finished
0709 13:10:00.374595 (+   455us) write_op.cc:301] APPLY: starting
0709 13:10:00.374684 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:00.376695 (+  2011us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:00.376791 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:00.378805 (+  2014us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:00.380906 (+  2101us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:10:00.380952 (+    46us) write_op.cc:312] APPLY: finished
0709 13:10:00.381189 (+   237us) log.cc:844] Serialized 41 byte log entry
0709 13:10:00.381999 (+   810us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:00.382096 (+    97us) write_op.cc:454] Released schema lock
0709 13:10:00.382135 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":12142,"reported_tablets":28,"spinlock_wait_cycles":25344,"child_traces":[["op",{"apply.queue_time_us":234,"apply.run_cpu_time_us":5295,"apply.run_wall_time_us":7788,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"num_ops":3,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":2903,"prepare.run_wall_time_us":2902,"replication_time_us":3003}]]}
I20260709 13:10:00.440503 20382 tablet_replica.cc:333] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.455159 20382 raft_consensus.cc:2243] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:00.457969 20382 raft_consensus.cc:2272] T 630b1c2cf4484981883df8266fc20ac4 P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.439673 21388 catalog_manager.cc:5697] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 28 to 29, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 29 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.469736 20382 tablet_replica.cc:333] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.479722 20382 raft_consensus.cc:2243] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:00.491598 20382 raft_consensus.cc:2272] T cc9f5258ae3f4790a9bc1813d73ec987 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.497167 20382 tablet_replica.cc:333] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.498816 20382 raft_consensus.cc:2243] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.499948 20382 raft_consensus.cc:2272] T 4d6d6e481fd941658a227093848691fa P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.531549 20382 tablet_replica.cc:333] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.537459 20382 raft_consensus.cc:2243] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.538676 20382 raft_consensus.cc:2272] T 3e2e35d97e8c4c319144e4d36af40d14 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.541862 20382 tablet_replica.cc:333] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.550599 20382 raft_consensus.cc:2243] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.554457 20382 raft_consensus.cc:2272] T 1f372659e8e14c5d86dae03fcd58b963 P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.560631 20382 tablet_replica.cc:333] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.561671 20382 raft_consensus.cc:2243] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:00.562242 20382 raft_consensus.cc:2272] T 470cdc8938f2464c96c100ae314a56b7 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.579465 20382 tablet_replica.cc:333] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.580299 20382 raft_consensus.cc:2243] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.581403 20382 raft_consensus.cc:2272] T 545ee5e8315344d387b7e32a6fe5984b P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.584381 20382 tablet_replica.cc:333] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.585512 20382 raft_consensus.cc:2243] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.586616 20382 raft_consensus.cc:2272] T 05ff2c5405fa4d388804a95695e2b592 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.589402 20382 tablet_replica.cc:333] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.590253 20382 raft_consensus.cc:2243] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:00.596577 22210 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:00.605415 20382 raft_consensus.cc:2272] T 12f1cc6194a54e7d8fb8d72776638772 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.608595 20382 tablet_replica.cc:333] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.619848 20382 raft_consensus.cc:2243] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:00.620426 20382 pending_rounds.cc:70] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Trying to abort 1 pending ops.
I20260709 13:10:00.620687 20382 pending_rounds.cc:77] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772: Aborting op as it isn't in flight: id { term: 28 index: 18 } timestamp: 7305636230297079808 op_type: NO_OP noop_request { }
I20260709 13:10:00.621140 20382 raft_consensus.cc:2889] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:00.621476 20382 raft_consensus.cc:2272] T cae2bb9c133344078cc4f963e7188776 P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.628362 20382 tablet_replica.cc:333] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.629348 20382 raft_consensus.cc:2243] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.630380 20382 raft_consensus.cc:2272] T 3d0b012cfcad4a71a65a1e83d453cfca P 5a34fd3290de493eb6bbe828dd742772 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.633088 20382 tablet_replica.cc:333] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.633865 20382 raft_consensus.cc:2243] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.643123 20382 raft_consensus.cc:2272] T 5057458c15c04db7a727b0b401a36bdc P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.646231 20382 tablet_replica.cc:333] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.647162 20382 raft_consensus.cc:2243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:00.647768 20382 raft_consensus.cc:2272] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5a34fd3290de493eb6bbe828dd742772 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.650480 20382 tablet_replica.cc:333] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.651353 20382 raft_consensus.cc:2243] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.652550 20382 raft_consensus.cc:2272] T 18a391cd0b80409cb0308239137325f8 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.683511 20382 tablet_replica.cc:333] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.684616 20382 raft_consensus.cc:2243] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.692378 20382 raft_consensus.cc:2272] T b14a1dff9e774b09a93b9bf00960df20 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.706117 20382 tablet_replica.cc:333] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
W20260709 13:10:00.716313 21532 consensus_peers.cc:597] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:00.733567 21459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 64330.4us
I20260709 13:10:00.755678 20382 raft_consensus.cc:2243] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 31 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:00.757869 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:00.759990 20382 raft_consensus.cc:2272] T 35e6cfe6efc04bc98ae2183731b5ae40 P 5a34fd3290de493eb6bbe828dd742772 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.769161 20382 tablet_replica.cc:333] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.779099 20382 raft_consensus.cc:2243] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:00.781075 20382 raft_consensus.cc:2272] T bbb07a26963247f383d1e9c7990b92ac P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.783391 29798 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:00.784049 29798 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:00.787101 20382 tablet_replica.cc:333] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.790380 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:00.791247 21637 raft_consensus.cc:2393] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 18: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:10:00.791131 21532 leader_election.cc:336] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:00.788674 29798 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:00.792447 21532 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:00.793745 29798 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:00.791155 20382 raft_consensus.cc:2243] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:00.794724 20382 raft_consensus.cc:2272] T 5b18ad2e6f014e20be78478bc402f892 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.799467 20382 tablet_replica.cc:333] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.810467 20382 raft_consensus.cc:2243] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:00.812119 20382 raft_consensus.cc:2272] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.821009 29798 raft_consensus.cc:2749] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:00.825279 20382 tablet_replica.cc:333] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.826398 20382 raft_consensus.cc:2243] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.827726 20382 raft_consensus.cc:2272] T 4d0597072fba4deebec5c1ddaeff142f P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.831158 20382 tablet_replica.cc:333] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.838269 20382 raft_consensus.cc:2243] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.839777 20382 raft_consensus.cc:2272] T c7bfc9f63b5d484f83f58360423d19e3 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.854262 29792 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.855033 29792 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:00.857781 29792 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:00.858896 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:00.859455 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5a34fd3290de493eb6bbe828dd742772" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:00.861039 21459 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a34fd3290de493eb6bbe828dd742772; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:10:00.863003 29792 raft_consensus.cc:2749] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:00.861100 20382 tablet_replica.cc:333] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.864705 20382 raft_consensus.cc:2243] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.872999 20382 raft_consensus.cc:2272] T 0cf7884717c9466486b7e5eb6b4626c5 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.878338 20382 tablet_replica.cc:333] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.883744 20382 raft_consensus.cc:2243] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:00.884522 20382 raft_consensus.cc:2272] T e214d67cdc8f4690b393c47800e8e3e6 P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.903194 20382 tablet_replica.cc:333] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.904246 20382 raft_consensus.cc:2243] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.929394 20382 raft_consensus.cc:2272] T b4a9406eef59405b975ed9c99811d69a P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.933007 20382 tablet_replica.cc:333] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.942744 20382 raft_consensus.cc:2243] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.944173 20382 raft_consensus.cc:2272] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.951009 20382 tablet_replica.cc:333] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.954909 20382 raft_consensus.cc:2243] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.960140 20382 raft_consensus.cc:2272] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5a34fd3290de493eb6bbe828dd742772 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:00.969084 21532 consensus_peers.cc:597] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:00.983037 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet d6080cb4ff0f4e5aae18e38fa86b1fa1: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:00.987733 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet 1a421c4648b143d58ea851d133ca3863: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:00.990451 20382 tablet_replica.cc:333] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:00.995369 21569 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:00.998582 20382 raft_consensus.cc:2243] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.005626 20382 raft_consensus.cc:2272] T 47fdde72d59a41308bcdd5d0e303c5cb P 5a34fd3290de493eb6bbe828dd742772 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.010064 29887 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.010891 29887 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.011857 20382 tablet_replica.cc:333] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.012840 20382 raft_consensus.cc:2243] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.014636 29887 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:01.018095 21532 consensus_peers.cc:597] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 470cdc8938f2464c96c100ae314a56b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.014722 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:01.019680 21566 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
W20260709 13:10:01.020857 21606 leader_election.cc:336] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:01.022035 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.023342 29887 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:01.023874 29887 raft_consensus.cc:493] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.024279 21637 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 13:10:01.024360 29887 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:01.032131 29798 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:01.024541 20382 raft_consensus.cc:2272] T c670f1ebdec3444e9e371f0fca10d38d P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.038018 20382 tablet_replica.cc:333] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.038929 20382 raft_consensus.cc:2243] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.040055 20382 raft_consensus.cc:2272] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.048115 20382 tablet_replica.cc:333] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.054117 20382 raft_consensus.cc:2243] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.055290 20382 raft_consensus.cc:2272] T a85b464a0e924904be2840142de89c0d P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.058091 20382 tablet_replica.cc:333] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.058944 20382 raft_consensus.cc:2243] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.059934 20382 raft_consensus.cc:2272] T 300e225ec8c14d76921637fefe0d57eb P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:01.060747 21532 consensus_peers.cc:597] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.064410 29887 raft_consensus.cc:515] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.077172 29887 leader_election.cc:290] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:01.078944 21606 leader_election.cc:336] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:01.079911 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630b1c2cf4484981883df8266fc20ac4" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:01.080616 21569 raft_consensus.cc:3060] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:01.083803 20382 tablet_replica.cc:333] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.085013 20382 raft_consensus.cc:2243] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.086719 20382 raft_consensus.cc:2272] T eae01b9fdd5340dc9416e5834263a4d6 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.092746 20382 tablet_replica.cc:333] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.093560 20382 raft_consensus.cc:2243] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.094115 20382 raft_consensus.cc:2272] T 22b45f3e8b8e428ea4709e7e9ee43868 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.110507 20382 tablet_replica.cc:333] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.114499 20382 raft_consensus.cc:2243] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.115676 20382 raft_consensus.cc:2272] T e2ba3136589046f7ada398d9210f305d P 5a34fd3290de493eb6bbe828dd742772 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:01.123520 21532 consensus_peers.cc:597] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:01.129343 21569 raft_consensus.cc:2468] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:10:01.130519 20382 tablet_replica.cc:333] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.131825 20382 raft_consensus.cc:2243] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.133386 20382 raft_consensus.cc:2272] T 05a0423f397042e3aed0ddbf0c111bd4 P 5a34fd3290de493eb6bbe828dd742772 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.136690 20382 tablet_replica.cc:333] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.137773 20382 raft_consensus.cc:2243] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.138643 20382 raft_consensus.cc:2272] T 06b5fb42c147456889a1843340b22720 P 5a34fd3290de493eb6bbe828dd742772 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.139614 30017 raft_consensus.cc:2955] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 29 LEADER]: Committing config change with OpId 29.16: config changed from index -1 to 16, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:10:01.144066 21608 leader_election.cc:304] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.145526 29887 raft_consensus.cc:2804] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:01.145041 21637 raft_consensus.cc:2955] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Committing config change with OpId 29.16: config changed from index -1 to 16, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:10:01.166628 20382 tablet_replica.cc:333] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.171890 20382 raft_consensus.cc:2243] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.173069 20382 raft_consensus.cc:2272] T 1a421c4648b143d58ea851d133ca3863 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.176693 20382 tablet_replica.cc:333] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.177695 20382 raft_consensus.cc:2243] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.178382 20382 raft_consensus.cc:2272] T bd6859210b204263aedc975d7586330c P 5a34fd3290de493eb6bbe828dd742772 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:01.180948 21440 auto_rebalancer.cc:629] Failed to schedule move for tablet a85b464a0e924904be2840142de89c0d: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:01.189675 20382 tablet_replica.cc:333] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.193663 20382 raft_consensus.cc:2243] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.194412 20382 raft_consensus.cc:2272] T d46f34ab738d4d38b09f9d1228d68c7d P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.203258 29887 raft_consensus.cc:697] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:01.204531 29887 consensus_queue.cc:237] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.206698 20382 tablet_replica.cc:333] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.208657 20382 raft_consensus.cc:2243] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.209306 20382 raft_consensus.cc:2272] T 92e37e086e4a48aa8d09172d1b43518d P 5a34fd3290de493eb6bbe828dd742772 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.212430 20382 tablet_replica.cc:333] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.213330 20382 raft_consensus.cc:2243] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.214540 20382 raft_consensus.cc:2272] T 1fbb59e66fd74778a9cbae5114efa101 P 5a34fd3290de493eb6bbe828dd742772 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:01.218003 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:01.237246 21388 catalog_manager.cc:5697] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 17 to 19, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 19 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.242113 21389 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 reported cstate change: config changed from index -1 to 16, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 29 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.248121 20382 tablet_replica.cc:333] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.250128 20382 raft_consensus.cc:2243] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.252085 20382 raft_consensus.cc:2272] T b773b0d389ce4ab991f6892abb4882e7 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.258214 20382 tablet_replica.cc:333] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.260845 20382 raft_consensus.cc:2243] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.262807 20382 raft_consensus.cc:2272] T 32891f0cc92c44afbc3bd39c2c408597 P 5a34fd3290de493eb6bbe828dd742772 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.274894 20382 tablet_replica.cc:333] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.275667 20382 raft_consensus.cc:2243] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.276744 20382 raft_consensus.cc:2272] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5a34fd3290de493eb6bbe828dd742772 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.285363 20382 tablet_replica.cc:333] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.286170 20382 raft_consensus.cc:2243] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.287294 20382 raft_consensus.cc:2272] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 5a34fd3290de493eb6bbe828dd742772 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.299199 20382 tablet_replica.cc:333] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772: stopping tablet replica
I20260709 13:10:01.299988 20382 raft_consensus.cc:2243] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.301131 20382 raft_consensus.cc:2272] T 852aa9ec17544a9eb8f44e067743d0c6 P 5a34fd3290de493eb6bbe828dd742772 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:01.307494 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:01.327996 21376 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 47867.2us
W20260709 13:10:01.331696 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6fad88e2e67d44f7adb559c0a8eb0af8: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:10:01.451393 29887 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.451967 29887 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:01.453367 21606 consensus_peers.cc:597] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:01.454144 29887 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:01.455806 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:10:01.457336 21606 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:01.458176 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.459077 29887 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:01.461419 30017 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.462123 30017 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.464547 30017 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:01.467644 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:10:01.472008 21532 leader_election.cc:336] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:01.472541 21532 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:01.473721 30017 raft_consensus.cc:2749] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:01.494935 30017 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.495608 30017 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.498045 30017 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:01.500577 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:01.502560 21637 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:10:01.504431 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:10:01.506466 21532 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:01.507530 30017 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:01.508104 30017 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.508826 30017 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:01.534817 30017 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:01.545826 21532 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:01.557109 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2002b234371248e3aaaecd1014e30086" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:01.557852 21637 raft_consensus.cc:3060] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:01.584594 30017 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:01.583961 21637 raft_consensus.cc:2468] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:10:01.595110 30017 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.595743 30017 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.603232 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:01.621124 21532 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.625912 29924 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.627696 30021 raft_consensus.cc:2804] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:01.628275 30021 raft_consensus.cc:697] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:10:01.629225 30021 consensus_queue.cc:237] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.598003 30017 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:01.642582 30021 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.643209 30021 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.645282 30021 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:01.646247 21532 leader_election.cc:336] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.646713 21532 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:01.653376 30021 raft_consensus.cc:2749] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:10:01.655822 30036 ts_tablet_manager.cc:933] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:01.655507 21388 catalog_manager.cc:5697] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 21 to 22, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 22 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.658630 30021 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.626688 29924 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:01.659276 30021 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.661394 30021 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:01.661770 29809 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.662324 29809 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:01.666500 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:01.666700 29809 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:01.668720 30017 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.669301 30017 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.670446 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:01.671320 30017 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:01.672569 29924 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:01.678221 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:01.678934 30036 tablet_copy_client.cc:323] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.130:41371
I20260709 13:10:01.680276 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:01.681066 21579 tablet_copy_service.cc:140] P 5727b19579474da6a12f79730b924770: Received BeginTabletCopySession request for tablet 470cdc8938f2464c96c100ae314a56b7 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36572)
I20260709 13:10:01.681682 21579 tablet_copy_service.cc:161] P 5727b19579474da6a12f79730b924770: Beginning new tablet copy session on tablet 470cdc8938f2464c96c100ae314a56b7 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36572: session id = 549b31ac31b6428994b45938abc223a7-470cdc8938f2464c96c100ae314a56b7
I20260709 13:10:01.683792 29887 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.684358 29887 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.686282 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:01.686574 29887 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:01.687541 30017 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.688138 30017 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:01.690116 30017 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:01.704762 21579 tablet_copy_source_session.cc:215] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:01.708195 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:01.715211 22241 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
W20260709 13:10:01.718024 21606 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.718284 30036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470cdc8938f2464c96c100ae314a56b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.718353 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:01.719187 21569 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 28.
I20260709 13:10:01.722632 29887 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.723312 29887 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.725365 29887 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:01.738075 21532 leader_election.cc:336] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.738687 21532 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:01.739708 30021 raft_consensus.cc:2749] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:01.741276 21532 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.741755 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:01.745944 30021 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:01.747041 21532 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.747500 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:01.748375 30021 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:01.756577 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:01.759877 30038 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:10:01.757010 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 
I20260709 13:10:01.760737 30038 raft_consensus.cc:493] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.762724 30038 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:10:01.763317 30021 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:01.763751 30021 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.764133 30021 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:01.782419 21606 leader_election.cc:336] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:01.782094 21532 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.785562 30036 tablet_copy_client.cc:806] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:01.790994 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:01.791374 30036 tablet_copy_client.cc:670] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:01.793450 30038 raft_consensus.cc:515] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:01.795346 21606 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.796134 30036 tablet_copy_client.cc:538] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:01.797699 30039 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.798243 30039 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.801070 30039 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:01.802662 30038 leader_election.cc:290] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:01.794256 30021 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:01.806147 30038 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.806708 30038 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.817922 30038 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:01.820202 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0950a4a64c4484ba4b753d544c7f1eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:01.820827 21566 raft_consensus.cc:3060] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:10:01.810613 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.812817 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f372659e8e14c5d86dae03fcd58b963" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
W20260709 13:10:01.813170 21606 leader_election.cc:336] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.821604 22241 raft_consensus.cc:3060] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:01.821924 21606 leader_election.cc:336] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.807402 30021 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:01.823697 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:01.826499 30038 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:01.830381 30036 tablet_bootstrap.cc:492] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:10:01.847607 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:01.848335 21569 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
W20260709 13:10:01.849272 21532 consensus_peers.cc:597] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:01.849788 21532 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.850210 21566 raft_consensus.cc:2468] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 29.
I20260709 13:10:01.850967 21608 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.864882 30039 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:01.854847 30038 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.865584 21569 raft_consensus.cc:1275] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:01.866032 30038 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:01.868131 29809 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.868377 30038 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:01.862877 22241 raft_consensus.cc:2468] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
W20260709 13:10:01.858992 21606 leader_election.cc:336] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.868700 29809 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:01.871050 29809 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:01.871714 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.872514 30038 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:01.872402 21532 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.872958 30038 raft_consensus.cc:493] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.873275 21608 leader_election.cc:304] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.873934 30039 consensus_queue.cc:1048] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:01.873350 30038 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:01.875458 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:01.879161 30017 raft_consensus.cc:2804] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:01.879784 30017 raft_consensus.cc:697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:10:01.880803 30017 consensus_queue.cc:237] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:01.882844 29798 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:10:01.883375 21606 leader_election.cc:336] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.883463 29798 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.884409 29887 raft_consensus.cc:2804] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:10:01.888803 29798 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:01.892030 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:01.892829 21637 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:10:01.894268 30021 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
W20260709 13:10:01.894877 21532 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:01.895026 30021 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.895792 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.899530 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:01.900309 21637 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 22.
I20260709 13:10:01.902469 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:01.904281 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:01.904850 22241 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 29.
I20260709 13:10:01.897645 30021 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:01.906020 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:01.908601 30021 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:01.901340 29798 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:01.912822 29798 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.913260 29798 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:01.911099 30039 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:10:01.915241 30039 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.915685 30039 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:10:01.911720 30021 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.917511 30038 raft_consensus.cc:515] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.933051 30044 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.940225 30042 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.927199 30021 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:01.961139 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 58731.3us
I20260709 13:10:01.931870 29887 raft_consensus.cc:697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:01.949123 21388 catalog_manager.cc:5697] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 20 to 21, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 21 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.976936 30038 leader_election.cc:290] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:01.978755 30038 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.952637 30044 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.983449 30044 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:01.979350 30038 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.988142 30038 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:01.989558 29887 consensus_queue.cc:237] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:01.991313 30039 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.021085 30017 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.030934 30043 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:01.952891 30042 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.031736 30043 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.037333 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b012cfcad4a71a65a1e83d453cfca" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:10:02.039434 30038 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.039760 22241 raft_consensus.cc:3060] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:10:02.040123 30038 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.042497 30038 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.025002 29798 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.052937 30047 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.053615 30047 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.036429 30039 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:02.028481 30017 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.067678 30047 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.071432 29798 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.077716 30017 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.085760 30042 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.092559 22241 raft_consensus.cc:2468] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 30.
I20260709 13:10:02.095674 30043 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.097016 30042 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.097625 30042 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.099831 30042 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.102957 30043 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.103462 30043 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.105168 30043 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.108425 30021 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.109493 29887 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.110038 29887 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.112485 29887 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.122996 21388 catalog_manager.cc:5697] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 28 to 29, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 29 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.134014 30043 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.134665 30043 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.139547 21606 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.140461 30047 raft_consensus.cc:2804] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:10:02.140971 30047 raft_consensus.cc:697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 30 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:10:02.142155 21606 leader_election.cc:336] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.141834 30047 consensus_queue.cc:237] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:02.144668 21606 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.145241 21606 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.145732 21606 leader_election.cc:336] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.146422 21606 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.154960 21606 leader_election.cc:336] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.155651 21606 leader_election.cc:336] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.156625 21606 leader_election.cc:336] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.157191 21606 leader_election.cc:336] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.162029 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 124600us
I20260709 13:10:02.110687 30021 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.164033 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13befc0ae0be496ea458eb0ed6662d3d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:02.164644 21569 raft_consensus.cc:3060] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:02.171483 30051 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.172123 30051 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.174602 30051 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.180721 21569 raft_consensus.cc:2468] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:10:02.181485 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.181679 30043 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.182149 21566 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:10:02.190657 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.191388 21562 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:10:02.192317 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.192859 21562 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 27.
I20260709 13:10:02.193174 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.193686 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.194463 21565 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:10:02.194525 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.195501 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.196139 21561 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:10:02.193771 21569 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:10:02.190210 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.199189 21566 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:10:02.200275 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545ee5e8315344d387b7e32a6fe5984b" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:02.200999 21642 raft_consensus.cc:3060] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:02.203274 21606 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.209702 21642 raft_consensus.cc:2468] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
I20260709 13:10:02.213661 30043 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.214242 30043 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:02.217765 21532 leader_election.cc:336] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.218900 30047 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.219484 30047 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.221666 30047 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:02.222033 30039 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.222563 30039 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.223580 30043 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:02.225613 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:02.225589 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:02.226753 22241 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:10:02.228292 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.229243 21637 raft_consensus.cc:1275] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:10:02.232829 21606 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.233485 21606 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.230897 30039 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.232874 21388 catalog_manager.cc:5697] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 29 to 30, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 30 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.234226 30043 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:02.236677 30053 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.236766 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.237613 30043 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:02.238031 30043 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.238445 30043 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:02.241986 30051 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.242563 30051 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.244774 30051 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.237362 30053 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.251205 30051 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.252012 30053 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.251775 30051 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.253787 30051 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:02.258380 21606 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.259256 21606 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.260108 30039 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.260267 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.260952 21637 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 27.
I20260709 13:10:02.260679 30039 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.261332 30043 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.266731 29887 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.263550 30043 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:02.267313 29887 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.269160 30039 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.269812 29887 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:02.270588 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.271361 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0597072fba4deebec5c1ddaeff142f" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:02.270570 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc9f63b5d484f83f58360423d19e3" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:10:02.271942 21637 raft_consensus.cc:3060] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:02.272128 22241 raft_consensus.cc:3060] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:02.273126 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:02.276226 30053 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.276839 30053 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.279081 30053 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.280272 21608 leader_election.cc:304] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.281364 29887 raft_consensus.cc:2804] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:02.281877 29887 raft_consensus.cc:697] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:02.283496 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.282742 29887 consensus_queue.cc:237] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.284139 21642 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:10:02.285261 21637 raft_consensus.cc:2468] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:10:02.288920 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.290087 22241 raft_consensus.cc:2468] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
W20260709 13:10:02.290994 21606 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.290135 30039 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:02.291570 21606 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.291836 30039 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.292411 30039 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:02.292944 21606 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.294344 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.299400 30053 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.300004 30053 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.301972 30042 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.302181 30053 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.302531 30042 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.303783 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.306653 30042 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.307153 30047 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:02.307557 30047 raft_consensus.cc:493] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.307948 30047 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:02.310948 30044 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.311579 30044 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:02.313509 21606 leader_election.cc:336] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.314182 21606 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.319403 30040 raft_consensus.cc:2749] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:02.322321 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.320477 30040 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:10:02.324460 30040 raft_consensus.cc:493] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.324873 30040 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:10:02.325217 30044 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.333310 30040 raft_consensus.cc:515] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.320585 30043 raft_consensus.cc:2804] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:02.336467 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:10:02.336678 21378 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d46f34ab738d4d38b09f9d1228d68c7d with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 5727b19579474da6a12f79730b924770 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 24 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:02.337386 21637 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 25.
I20260709 13:10:02.339668 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.340147 30043 raft_consensus.cc:697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:02.340276 21637 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
W20260709 13:10:02.344033 21532 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.336400 30047 raft_consensus.cc:515] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:02.344944 21532 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.346570 30047 leader_election.cc:290] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.341930 30043 consensus_queue.cc:237] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.348573 30040 leader_election.cc:290] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:02.350888 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 47188.9us
I20260709 13:10:02.351683 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.352927 21608 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.354048 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.355157 30038 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:02.355573 30038 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.355978 30038 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:02.359368 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.362310 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.362402 30058 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:02.363008 30040 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:02.363436 30040 raft_consensus.cc:493] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.363483 21637 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 18.
I20260709 13:10:02.363972 30040 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:02.372035 30040 raft_consensus.cc:515] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.374229 30040 leader_election.cc:290] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.379761 29809 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.380539 29809 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.393395 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.394052 21637 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:10:02.395169 30047 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.395296 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.395768 30047 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.396350 30028 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:02.396807 30028 raft_consensus.cc:493] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.397178 30028 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:02.397881 30047 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:02.399401 30040 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.399893 30040 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.394109 29809 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.401932 30040 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:02.404273 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 44978.8us
I20260709 13:10:02.405202 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.410223 30047 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:02.410642 30047 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.411042 30047 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:02.411669 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.377352 30038 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.412873 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.413527 21642 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:10:02.419827 30059 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.420413 30059 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.358050 30039 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.429481 30028 raft_consensus.cc:515] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.431218 30058 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.431632 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:02.431862 30058 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.432714 30044 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.433228 30044 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.434062 30058 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.435709 30044 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.422734 30059 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.437690 30038 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.439312 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a9406eef59405b975ed9c99811d69a" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:02.440425 21636 raft_consensus.cc:3060] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:02.414372 30040 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:02.443135 30040 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.443583 30040 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:02.442972 21388 catalog_manager.cc:5697] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 21 to 22, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 22 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.439805 30028 leader_election.cc:290] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.448457 21636 raft_consensus.cc:2468] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
I20260709 13:10:02.461341 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.461665 22210 leader_election.cc:304] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.461959 21562 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:10:02.463414 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a391cd0b80409cb0308239137325f8" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:02.463923 21562 raft_consensus.cc:3060] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:02.449666 30047 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.457196 30039 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.458005 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.459167 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.465929 30028 raft_consensus.cc:2804] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:02.469466 21569 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:10:02.469796 30028 raft_consensus.cc:697] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:10:02.459841 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.470470 21563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.471095 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.467640 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ff2c5405fa4d388804a95695e2b592" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:02.468686 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5057458c15c04db7a727b0b401a36bdc" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:02.471630 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.471943 21564 raft_consensus.cc:3060] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:02.472307 21569 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:10:02.471809 21567 raft_consensus.cc:3060] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:10:02.470534 21561 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:10:02.466030 21565 raft_consensus.cc:1275] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:10:02.477388 30053 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.477640 30036 tablet_bootstrap.cc:492] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=4 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:02.477985 30053 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.479642 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.479882 21567 raft_consensus.cc:2468] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 28.
I20260709 13:10:02.480108 30053 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.470805 30028 consensus_queue.cc:237] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.481108 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:02.482236 21569 raft_consensus.cc:3060] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:02.480289 21565 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 16.
I20260709 13:10:02.483628 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:02.484225 21561 raft_consensus.cc:3060] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:02.480199 21532 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.486488 30053 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.487728 30053 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.489854 30053 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.492170 21564 raft_consensus.cc:2468] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:10:02.492703 21562 raft_consensus.cc:2468] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:10:02.490996 30044 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.493718 30044 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.494222 21532 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:02.495054 29798 raft_consensus.cc:2804] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:02.491485 30059 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.495564 29798 raft_consensus.cc:697] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:10:02.495782 30059 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.496536 30044 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.497439 30051 raft_consensus.cc:2749] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:02.497854 30059 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:02.497641 21606 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.498682 30051 consensus_queue.cc:1048] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:10:02.499297 21606 leader_election.cc:336] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.499866 21606 leader_election.cc:336] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.491915 30042 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.500524 30042 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.501150 21532 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.496503 29798 consensus_queue.cc:237] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.503321 30053 raft_consensus.cc:2764] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 13:10:02.504573 21388 catalog_manager.cc:5697] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 24 to 25, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 25 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.506587 21569 raft_consensus.cc:2468] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:10:02.508412 30036 tablet_bootstrap.cc:492] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:10:02.509668 30042 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:02.505709 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.512876 21561 raft_consensus.cc:2468] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:10:02.512285 21532 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.514156 30042 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:02.514541 30042 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.513783 30043 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.515049 30042 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:02.515218 30043 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.517921 30043 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.518875 30036 ts_tablet_manager.cc:1403] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.689s	user 0.057s	sys 0.021s
I20260709 13:10:02.520884 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.521767 30021 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:02.522158 30021 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.522521 30021 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:02.523339 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.525722 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:10:02.527163 21606 leader_election.cc:336] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.529431 21606 leader_election.cc:336] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.529544 30049 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:02.529844 21606 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.530267 30049 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.530861 30049 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:02.534965 30040 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.536542 29924 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.537315 29924 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.528824 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.547792 30017 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:02.548243 30017 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.548597 30017 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:02.550776 29809 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.551321 29809 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.554239 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.554924 21636 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:10:02.555781 29809 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:02.558734 21606 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.559602 21606 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.557981 21532 leader_election.cc:336] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.561491 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
W20260709 13:10:02.562664 20382 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21515)
I20260709 13:10:02.558941 30043 raft_consensus.cc:2749] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:02.556463 30051 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:02.574438 21532 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.574337 21568 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 22.
I20260709 13:10:02.577486 21532 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:02.575634 30042 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:02.579531 21532 leader_election.cc:336] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.581418 21532 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.582181 21532 consensus_peers.cc:597] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:02.582661 21532 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.588822 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:02.524667 30053 raft_consensus.cc:2804] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:10:02.599300 21606 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.580057 30045 raft_consensus.cc:2749] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:02.605696 30045 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:02.578034 30051 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.606634 30051 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:02.611333 21606 leader_election.cc:336] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.585968 30040 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:02.612675 21606 leader_election.cc:336] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.600939 30043 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.616562 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.617202 21636 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
I20260709 13:10:02.616035 29924 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.620507 22212 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.621306 30028 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:02.608178 30036 raft_consensus.cc:359] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:02.623706 30036 raft_consensus.cc:740] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:10:02.623059 21388 catalog_manager.cc:5697] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 20, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 20 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.624806 30042 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.624394 30036 consensus_queue.cc:260] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 29.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:02.621711 30028 raft_consensus.cc:493] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.614050 30053 raft_consensus.cc:697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:10:02.629479 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.632128 30043 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.632330 21389 catalog_manager.cc:5697] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 19 to 20, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 20 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.636680 29809 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:02.636157 30028 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:02.638593 29809 raft_consensus.cc:493] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.642369 29809 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:02.647826 30047 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.649166 30017 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.664384 30036 ts_tablet_manager.cc:1434] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.145s	user 0.002s	sys 0.009s
I20260709 13:10:02.666514 21579 tablet_copy_service.cc:342] P 5727b19579474da6a12f79730b924770: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-470cdc8938f2464c96c100ae314a56b7 received from {username='slave'} at 127.0.0.1:36572
I20260709 13:10:02.667086 21579 tablet_copy_service.cc:434] P 5727b19579474da6a12f79730b924770: ending tablet copy session 549b31ac31b6428994b45938abc223a7-470cdc8938f2464c96c100ae314a56b7 on tablet 470cdc8938f2464c96c100ae314a56b7 with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:10:02.667537 30028 raft_consensus.cc:515] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:02.645561 21606 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.669636 21606 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.670198 21606 leader_election.cc:336] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.641186 30053 consensus_queue.cc:237] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:02.672004 21606 leader_election.cc:336] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.679132 21606 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.679654 21606 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.679836 30021 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.671685 30043 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:02.684568 21606 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.684315 29809 raft_consensus.cc:515] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.686642 29809 leader_election.cc:290] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.688395 30066 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.689196 30066 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:02.692353 21606 consensus_peers.cc:597] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:02.692898 21606 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.699669 30028 leader_election.cc:290] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: Requested vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.700826 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:02.701493 21568 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:02.704578 30049 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.709308 30017 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.709390 21568 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 23.
I20260709 13:10:02.714758 30021 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.718190 30066 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.721009 30049 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:02.730136 21606 consensus_peers.cc:597] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.730806 30051 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:02.732148 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 94178.8us
W20260709 13:10:02.739490 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 156832us
W20260709 13:10:02.740074 21532 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.740779 21532 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.738173 21606 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:02.748113 30047 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.748754 30047 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.753149 30047 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.754546 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:02.755332 21642 raft_consensus.cc:3060] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:02.756273 21388 catalog_manager.cc:5697] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 22 to 23, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 23 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.758647 22241 raft_consensus.cc:1275] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:10:02.761055 30051 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:02.763671 21642 raft_consensus.cc:2468] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 23.
W20260709 13:10:02.774436 21606 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.778018 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.779982 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.781234 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.781641 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.782260 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:02.783337 22241 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 23: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:10:02.785018 22210 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.786177 22238 raft_consensus.cc:1275] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260709 13:10:02.786409 21608 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.786144 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.782315 21642 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 25.
I20260709 13:10:02.787326 21569 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 27.
I20260709 13:10:02.788287 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.788627 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.788934 21636 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 28.
I20260709 13:10:02.789291 21561 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:10:02.791118 30043 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:02.791491 29924 raft_consensus.cc:2804] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:02.791599 30043 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.792160 29924 raft_consensus.cc:697] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 23 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:10:02.792212 30043 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:10:02.793581 22210 leader_election.cc:336] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.794055 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:02.794880 30040 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:02.795075 30046 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:10:02.795370 30040 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.795508 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7e8b71ee674ed4b42ef0ba024cf600" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:02.795806 30040 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:02.796240 21637 raft_consensus.cc:3060] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:02.798988 30047 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:10:02.801465 22210 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.801967 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.802770 29809 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:02.804816 22210 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.805294 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:02.793365 29924 consensus_queue.cc:237] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.807109 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae01b9fdd5340dc9416e5834263a4d6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.816274 21636 raft_consensus.cc:2393] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 23: Already voted for candidate 549b31ac31b6428994b45938abc223a7 in this term.
I20260709 13:10:02.807945 29809 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:02.808846 22210 leader_election.cc:336] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.817864 22210 leader_election.cc:336] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.818622 22210 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:02.819808 22210 leader_election.cc:336] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.821976 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.822592 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.822696 21561 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 28.
I20260709 13:10:02.823925 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.824327 21637 raft_consensus.cc:2468] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 25.
I20260709 13:10:02.825631 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:02.826103 30059 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:02.826324 30047 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:02.826860 30047 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.827361 21561 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 22: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:10:02.827315 30047 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:02.830107 30040 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.831127 30059 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:02.847505 30059 raft_consensus.cc:493] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.848053 30059 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:02.839043 30044 consensus_queue.cc:1048] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:02.840132 21608 leader_election.cc:304] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.851917 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.851950 30044 raft_consensus.cc:2804] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:10:02.853395 30058 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:02.853925 30058 raft_consensus.cc:493] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.854002 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:02.854579 30058 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:02.853176 21608 leader_election.cc:304] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.842388 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.856003 21568 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:10:02.842617 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:02.844995 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:02.836153 30043 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.847838 21635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:02.874475 21635 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 26: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:10:02.875746 30043 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.854858 21637 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 23.
I20260709 13:10:02.856195 21608 leader_election.cc:304] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:10:02.878858 21606 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.856928 21569 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:10:02.857151 21636 raft_consensus.cc:2393] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 22: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:10:02.846896 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:10:02.862690 21532 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.841228 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
W20260709 13:10:02.880828 21532 leader_election.cc:336] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.882807 21561 raft_consensus.cc:3060] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:02.873282 30040 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.863031 22210 leader_election.cc:304] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.853787 30044 raft_consensus.cc:697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 28 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:02.882767 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:02.870951 30039 raft_consensus.cc:2804] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:02.883903 29809 raft_consensus.cc:2804] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:02.883692 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:02.888797 21636 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 20: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
W20260709 13:10:02.886917 21532 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.850401 30047 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.896390 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:02.897152 21641 raft_consensus.cc:3060] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:02.897919 30047 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.895715 30039 raft_consensus.cc:697] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:02.899348 30039 consensus_queue.cc:237] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.884720 30038 consensus_queue.cc:1048] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.017s
I20260709 13:10:02.907970 21642 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 20: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:10:02.909042 21641 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 19.
I20260709 13:10:02.888144 29887 raft_consensus.cc:2804] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:10:02.919092 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 62974.6us
I20260709 13:10:02.920213 21608 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.916347 21389 catalog_manager.cc:5697] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 22 to 23, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 23 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.891770 30053 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:10:02.922260 21608 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.925210 30044 consensus_queue.cc:237] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.929680 21561 raft_consensus.cc:2468] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 26.
I20260709 13:10:02.930809 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.933626 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.934326 30047 raft_consensus.cc:2804] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:02.934465 30040 raft_consensus.cc:2804] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:02.936131 30021 consensus_queue.cc:1048] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 13:10:02.942992 30066 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:10:02.943485 30066 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.943900 30066 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:10:02.943977 30059 raft_consensus.cc:515] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:02.947506 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 60066.9us
W20260709 13:10:02.949218 22210 leader_election.cc:336] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.950870 21532 leader_election.cc:304] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:10:02.951100 22210 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.954844 29809 raft_consensus.cc:697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 25 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:10:02.908409 30058 raft_consensus.cc:515] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.957124 30068 raft_consensus.cc:2749] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:02.958388 30043 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:10:02.958869 30043 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.959254 30043 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:10:02.955962 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.965508 30051 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:02.969650 30051 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.970072 30051 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:02.964825 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.967557 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.974777 29809 consensus_queue.cc:237] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:02.979424 30038 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:02.979764 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.980139 30038 raft_consensus.cc:493] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.980756 30038 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:02.981207 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.983999 21532 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:02.969126 30043 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:02.990662 30043 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:02.991307 30043 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:10:02.991679 30043 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:02.992054 30043 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:10:02.999995 21532 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:03.000881 21532 leader_election.cc:336] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:02.999549 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:10:03.003582 21532 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.005285 21532 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:03.006132 30021 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:10:03.008620 21532 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:03.009150 21532 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.009508 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:03.010267 30021 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:10:03.012288 30043 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.015206 30043 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:03.015954 30043 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:03.019934 21608 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:02.983314 30053 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:10:03.010416 21532 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:03.029471 21532 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:03.030650 21532 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.021446 30068 raft_consensus.cc:2804] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:03.031263 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:03.036366 30039 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:03.037393 30044 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:03.041472 30039 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:03.042030 30039 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:03.044868 22245 raft_consensus.cc:1275] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:10:03.028458 30053 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:03.047276 21608 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:03.031234 29887 raft_consensus.cc:697] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:03.112711 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf7884717c9466486b7e5eb6b4626c5" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:03.047118 30068 raft_consensus.cc:697] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:10:03.044344 30021 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:03.054385 30076 raft_consensus.cc:2804] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:10:03.076031 30059 leader_election.cc:290] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:03.077513 30058 leader_election.cc:290] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:03.077863 22239 raft_consensus.cc:1217] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 LEARNER]: Deduplicated request from leader. Original: 29.15->[29.16-29.16]   Dedup: 29.16->[]
I20260709 13:10:03.045961 30044 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5a34fd3290de493eb6bbe828dd742772)
I20260709 13:10:03.127899 30044 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:03.128547 29887 consensus_queue.cc:237] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.131441 30068 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.089998 30066 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.094844 21562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:03.131690 21391 catalog_manager.cc:5697] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 24 to 25, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 25 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.134011 30039 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.134408 30066 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:03.097007 21564 raft_consensus.cc:1275] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:10:03.146605 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 53349.1us
I20260709 13:10:03.097208 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:03.110137 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:03.094019 21569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:03.147459 21565 raft_consensus.cc:3060] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:10:03.147821 21569 raft_consensus.cc:2393] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:10:03.147679 21567 raft_consensus.cc:3060] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:10:03.148679 22210 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.051398 21606 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.049815 30053 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:03.128106 30076 raft_consensus.cc:697] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 26 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:03.088521 30051 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.133206 21566 raft_consensus.cc:3060] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:03.094404 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:03.153796 21568 raft_consensus.cc:2393] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 26: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:10:03.133200 21562 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 20: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:10:03.141048 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6080cb4ff0f4e5aae18e38fa86b1fa1" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:03.091063 30047 raft_consensus.cc:697] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 23 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:03.159829 21642 raft_consensus.cc:1275] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:10:03.093314 30038 raft_consensus.cc:515] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.089089 30040 raft_consensus.cc:697] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 20 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:10:03.149906 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 98560.9us
I20260709 13:10:03.155205 21561 raft_consensus.cc:3060] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:03.178982 30047 consensus_queue.cc:237] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.185501 21565 raft_consensus.cc:2468] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 28.
I20260709 13:10:03.190589 21388 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 18 to 19, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 19 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:03.202831 21606 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.194087 30076 consensus_queue.cc:237] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.204056 30038 leader_election.cc:290] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:03.208313 30047 consensus_queue.cc:1048] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:10:03.209388 21567 raft_consensus.cc:2468] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 29.
I20260709 13:10:03.216858 21561 raft_consensus.cc:2468] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 17.
I20260709 13:10:03.238230 21566 raft_consensus.cc:2468] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:10:03.255260 30051 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:03.256225 30040 consensus_queue.cc:237] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:03.264132 21532 consensus_peers.cc:597] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.264657 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 103771us
W20260709 13:10:03.265117 21532 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.272850 21642 raft_consensus.cc:1275] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:10:03.273283 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:03.283725 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:03.285125 21608 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:03.286302 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:10:03.288146 21606 leader_election.cc:336] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.286764 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fbb59e66fd74778a9cbae5114efa101" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:10:03.288739 21606 leader_election.cc:336] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.288872 21634 raft_consensus.cc:3060] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:10:03.289343 21606 consensus_peers.cc:597] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.289903 21606 leader_election.cc:336] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.291059 30047 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:10:03.290478 21606 leader_election.cc:336] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.241967 30039 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:03.293066 21606 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.214625 30046 consensus_queue.cc:1048] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 13:10:03.291085 30058 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:03.295797 30076 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:10:03.300014 30044 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.302229 30044 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:03.311677 30053 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.313804 30053 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:03.313930 21634 raft_consensus.cc:2468] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 29.
I20260709 13:10:03.286724 30059 consensus_queue.cc:1048] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:10:03.292999 30051 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:03.316648 29798 consensus_queue.cc:1048] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:03.319604 21608 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:10:03.320679 21532 consensus_peers.cc:597] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.325614 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
W20260709 13:10:03.315485 22210 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.331594 21608 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:03.332696 21608 leader_election.cc:304] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:03.333622 21608 leader_election.cc:304] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:03.334723 21642 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 26: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:10:03.345265 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852aa9ec17544a9eb8f44e067743d0c6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:03.345889 21636 raft_consensus.cc:3060] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:03.346185 21642 raft_consensus.cc:1275] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:10:03.350167 30059 raft_consensus.cc:2804] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:03.349836 30076 raft_consensus.cc:2804] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:10:03.349650 30058 raft_consensus.cc:2804] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:10:03.350327 30044 raft_consensus.cc:2804] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:03.386840 30059 raft_consensus.cc:697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:03.387832 30059 consensus_queue.cc:237] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.388684 21636 raft_consensus.cc:2468] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 24.
I20260709 13:10:03.390897 30076 raft_consensus.cc:697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:03.392163 30076 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.395341 30058 raft_consensus.cc:697] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 28 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:03.421597 21391 catalog_manager.cc:5697] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 27 to 28, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 28 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.425243 21391 catalog_manager.cc:5697] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 24 to 25, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 25 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.428216 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:03.429167 21561 raft_consensus.cc:3060] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:03.432062 21606 leader_election.cc:336] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.434072 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ba3136589046f7ada398d9210f305d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:03.434711 21568 raft_consensus.cc:3060] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:03.443766 21561 raft_consensus.cc:2468] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 25.
I20260709 13:10:03.435943 21391 catalog_manager.cc:5697] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 22 to 23, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 23 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.449844 21391 catalog_manager.cc:5697] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 24 to 25, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 25 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.406183 30044 raft_consensus.cc:697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:03.453352 21561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:03.455811 21561 raft_consensus.cc:2393] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a87bd86b86e74aa8bb61189215b73439 in current term 26: Already voted for candidate 5727b19579474da6a12f79730b924770 in this term.
I20260709 13:10:03.427831 30058 consensus_queue.cc:237] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.452670 21391 catalog_manager.cc:5697] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 19 to 20, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 20 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.467113 21565 raft_consensus.cc:1275] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:10:03.467396 30044 consensus_queue.cc:237] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.484159 21565 raft_consensus.cc:1275] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:10:03.503190 21566 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:03.513922 21636 raft_consensus.cc:1275] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:03.521603 21568 raft_consensus.cc:2468] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:10:03.517745 30064 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:10:03.532313 21608 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:03.560149 21532 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
W20260709 13:10:03.574618 20382 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21515)
I20260709 13:10:03.575284 30038 consensus_queue.cc:1048] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:03.575377 29924 consensus_queue.cc:1048] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:10:03.579358 22210 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:03.579103 21532 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:03.561729 30040 raft_consensus.cc:2804] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:10:03.588800 21376 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 85864.2us
I20260709 13:10:03.573216 29798 raft_consensus.cc:2804] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Leader election won for term 29
W20260709 13:10:03.614018 21606 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111) [suppressed 274 similar messages]
W20260709 13:10:03.620508 21606 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.621122 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:03.573163 30017 consensus_queue.cc:1048] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:10:03.605794 30042 raft_consensus.cc:2804] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:03.639719 21636 raft_consensus.cc:1275] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 13:10:03.638971 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 73866.9us
I20260709 13:10:03.618745 30040 raft_consensus.cc:697] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:10:03.647421 21606 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.643352 29809 consensus_queue.cc:1048] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:10:03.638648 29887 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:10:03.665956 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 76078us
I20260709 13:10:03.671948 30040 consensus_queue.cc:237] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:03.682447 21532 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:03.690112 21532 consensus_peers.cc:597] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:03.691365 21532 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:03.692127 21532 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.692569 30077 consensus_queue.cc:1048] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:10:03.693315 22210 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.692521 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:03.696468 30021 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:10:03.696782 30106 log.cc:927] Time spent T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:10:03.699363 21532 consensus_peers.cc:597] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.702066 21608 leader_election.cc:304] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
W20260709 13:10:03.703163 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6fad88e2e67d44f7adb559c0a8eb0af8: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:03.706877 30081 raft_consensus.cc:2804] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:03.707480 30081 raft_consensus.cc:697] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:03.708451 30081 consensus_queue.cc:237] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.716531 21566 raft_consensus.cc:1275] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:10:03.731312 30042 raft_consensus.cc:697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 24 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
W20260709 13:10:03.749326 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:03.747946 29798 raft_consensus.cc:697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 29 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:10:03.751642 29798 consensus_queue.cc:237] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.778992 30074 consensus_queue.cc:1048] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
W20260709 13:10:03.818096 21532 consensus_peers.cc:597] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.827050 21561 raft_consensus.cc:1275] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:10:03.829237 30074 consensus_queue.cc:1048] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:03.838912 30042 consensus_queue.cc:237] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:03.857697 30017 raft_consensus.cc:1064] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
W20260709 13:10:03.886049 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:03.886696 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:03.909621 21566 raft_consensus.cc:1275] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 13:10:03.941013 30122 log.cc:927] Time spent T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:10:03.941448 21606 consensus_peers.cc:597] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.944254 21606 consensus_peers.cc:597] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.951557 21606 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.952122 21606 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.952579 21606 consensus_peers.cc:597] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.956882 30017 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 14, Current term: 29, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:03.970599 21532 consensus_peers.cc:597] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:03.975708 30081 consensus_queue.cc:1048] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:10:03.988536 22210 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:04.006093 21641 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:10:03.994169 21391 catalog_manager.cc:5697] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 25 to 26, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 26 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.017302 21391 catalog_manager.cc:5697] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 16 to 17, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 17 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.019547 21391 catalog_manager.cc:5697] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 27 to 28, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 28 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.035727 21391 catalog_manager.cc:5697] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 24 to 25, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 25 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.051803 21391 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 28 to 29, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 29 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.053571 21391 catalog_manager.cc:5697] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 24 to 25, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 25 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:04.064209 21606 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.065855 21606 consensus_peers.cc:597] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.066552 29798 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:10:04.066406 21606 consensus_peers.cc:597] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:04.084699 21567 raft_consensus.cc:1275] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:04.096520 21566 raft_consensus.cc:1275] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 13:10:04.133903 21569 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 13:10:04.136205 21569 raft_consensus.cc:1275] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:04.160157 30074 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:04.172267 22241 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
W20260709 13:10:04.227460 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 43618.3us
I20260709 13:10:04.156023 30081 consensus_queue.cc:1048] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:10:04.255993 30083 consensus_queue.cc:1048] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.103s
I20260709 13:10:04.186676 30039 consensus_queue.cc:1048] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
W20260709 13:10:04.302866 30120 log.cc:927] Time spent T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:10:04.308145 30131 log.cc:927] Time spent T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:10:04.242555 30017 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 13:10:04.422837 21634 raft_consensus.cc:1275] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:10:04.424640 21641 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 13:10:04.422735 30017 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.426702 30017 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:04.438925 21606 consensus_peers.cc:597] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.442014 30017 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:04.459203 30144 log.cc:927] Time spent T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: Append to log took a long time: real 0.167s	user 0.004s	sys 0.001s
I20260709 13:10:04.449755 30021 consensus_queue.cc:1048] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:10:04.467746 30114 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.016s
W20260709 13:10:04.472437 30137 log.cc:927] Time spent T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: Append to log took a long time: real 0.173s	user 0.000s	sys 0.002s
W20260709 13:10:04.498224 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 368472us
W20260709 13:10:04.522986 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 69193.7us
I20260709 13:10:04.527794 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:10:04.537690 21606 consensus_peers.cc:597] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.538379 21606 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.555159 21606 consensus_peers.cc:597] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.567590 21641 raft_consensus.cc:1275] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:10:04.575203 20382 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 21515)
I20260709 13:10:04.594056 21391 catalog_manager.cc:5697] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 20 to 21, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 21 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:04.636401 21532 consensus_peers.cc:597] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.651396 30042 consensus_queue.cc:1048] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:04.656329 21389 catalog_manager.cc:5697] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 28 to 29, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 29 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.658340 21389 catalog_manager.cc:5697] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 23 to 24, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 24 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:04.660903 21606 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:04.712491 21567 raft_consensus.cc:1275] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:10:04.715584 21567 raft_consensus.cc:1275] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:10:04.721937 21567 raft_consensus.cc:1275] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:10:04.726539 30040 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.727128 30040 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:04.732118 30040 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:04.737941 21606 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:04.757743 21532 consensus_peers.cc:597] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.758459 21532 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:04.759305 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:04.760187 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:04.761090 21565 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 22.
I20260709 13:10:04.785105 30039 consensus_queue.cc:1048] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:10:04.789254 30145 consensus_queue.cc:1048] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:10:04.788131 30083 consensus_queue.cc:1048] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:10:04.827518 30044 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.828054 30044 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:04.830039 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:04.830246 30044 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:04.831769 30043 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:04.832172 30043 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.832546 30043 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:04.835312 30042 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.835907 30042 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:04.843670 30042 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:04.845685 30043 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:04.854938 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 98277.3us
W20260709 13:10:04.861032 21606 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:04.861845 21606 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:04.862411 30043 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:04.880119 30066 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:04.883181 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:04.883993 22210 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:04.884505 22210 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:04.894413 30066 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.895053 30066 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:04.897567 30066 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:04.918836 30066 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.919397 30066 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:04.923375 30066 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:04.940121 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770" is_pre_election: true
I20260709 13:10:04.940855 21565 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 20.
I20260709 13:10:04.942454 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14a1dff9e774b09a93b9bf00960df20" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:04.943127 21566 raft_consensus.cc:3060] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:04.969530 21566 raft_consensus.cc:2468] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 23.
I20260709 13:10:04.974931 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:04.975961 21634 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 20.
W20260709 13:10:04.984038 21532 consensus_peers.cc:597] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:04.984724 21532 consensus_peers.cc:597] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:04.988770 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:04.989497 21634 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 26.
I20260709 13:10:04.970907 30115 raft_consensus.cc:2955] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 29 LEADER]: Committing config change with OpId 29.17: config changed from index 16 to 17, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:05.004467 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:05.007534 30044 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:05.008035 30044 raft_consensus.cc:493] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.008426 30044 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:05.013907 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:05.030946 21608 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:05.037564 30083 raft_consensus.cc:2804] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:05.037791 21641 raft_consensus.cc:2955] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Committing config change with OpId 29.17: config changed from index 16 to 17, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:05.038923 30083 raft_consensus.cc:697] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 23 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
W20260709 13:10:05.065999 21532 consensus_peers.cc:597] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:05.071905 21532 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:05.087392 30083 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:05.092506 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:05.094085 30112 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:05.094583 30112 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.095045 30112 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:05.104985 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:05.113758 30017 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:10:05.114251 30017 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.114665 30017 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:10:05.146445 21532 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:05.149124 21532 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:05.149861 21532 consensus_peers.cc:597] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:05.155392 22239 raft_consensus.cc:2955] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Committing config change with OpId 29.17: config changed from index 16 to 17, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:05.184602 30044 raft_consensus.cc:515] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:05.186057 21634 raft_consensus.cc:2393] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5727b19579474da6a12f79730b924770 in current term 21: Already voted for candidate a87bd86b86e74aa8bb61189215b73439 in this term.
I20260709 13:10:05.186962 30044 leader_election.cc:290] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:05.213814 30017 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:05.221421 30017 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:05.222427 21391 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 16 to 17, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 29 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } attrs { replace: true } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:10:05.248281 21606 leader_election.cc:336] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:05.253722 21606 consensus_peers.cc:597] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:05.235550 30017 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.255672 30017 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:05.258590 30017 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:05.263491 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:05.268512 21532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 92503.1us
W20260709 13:10:05.272032 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:05.277652 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:05.278560 21637 raft_consensus.cc:3060] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:05.295318 21532 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:05.304177 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:05.305032 21634 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 26.
I20260709 13:10:05.321909 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:05.322978 30116 raft_consensus.cc:3060] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:05.324159 30183 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:10:05.324626 30183 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.324957 30183 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:05.332369 21637 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 27.
I20260709 13:10:05.293376 30112 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:05.335657 30112 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:05.337671 21564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e067febbdfa48d7b1d4f20ec5e2337a" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5727b19579474da6a12f79730b924770"
I20260709 13:10:05.339921 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdde72d59a41308bcdd5d0e303c5cb" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:05.340543 21641 raft_consensus.cc:3060] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:05.341040 21532 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:05.342463 30115 raft_consensus.cc:2804] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:10:05.343264 30115 raft_consensus.cc:697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 27 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:10:05.344247 30115 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:05.349121 21532 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:05.351667 21532 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:05.355144 21641 raft_consensus.cc:2468] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 21.
I20260709 13:10:05.367895 21532 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:05.375231 29798 raft_consensus.cc:2804] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:05.376991 29798 raft_consensus.cc:697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:10:05.378237 29798 consensus_queue.cc:237] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:05.421298 30116 raft_consensus.cc:2749] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:05.428087 21606 consensus_peers.cc:597] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:05.448167 21564 raft_consensus.cc:2468] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 21.
I20260709 13:10:05.453063 30183 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:05.457221 21532 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:05.476557 21606 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:05.490864 30183 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Requested vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:05.491737 21532 consensus_peers.cc:597] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:05.497680 21637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff1ef08407c4bed8b0670f8230f0a40" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:05.498347 21637 raft_consensus.cc:3060] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:05.514262 21637 raft_consensus.cc:2468] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727b19579474da6a12f79730b924770 in term 27.
I20260709 13:10:05.524365 21608 leader_election.cc:304] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:05.525444 30059 raft_consensus.cc:2804] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:05.526183 30059 raft_consensus.cc:697] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:05.527143 30059 consensus_queue.cc:237] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:05.541148 21532 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439; no voters: 
I20260709 13:10:05.542587 30183 raft_consensus.cc:2804] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:10:05.543195 30183 raft_consensus.cc:697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 27 LEADER]: Becoming Leader. State: Replica: 5727b19579474da6a12f79730b924770, State: Running, Role: LEADER
I20260709 13:10:05.544090 30183 consensus_queue.cc:237] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:05.546275 21532 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:05.576031 20382 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 21515)
I20260709 13:10:05.591732 21388 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 21 to 23, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 23 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.618667 21564 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:05.643528 22241 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 13:10:05.648964 21532 consensus_peers.cc:597] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:05.650496 21606 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:05.665036 21637 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:10:05.678169 21389 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 25 to 27, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 27 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:05.678983 30115 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:10:05.680897 21389 catalog_manager.cc:5697] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 25 to 27, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 27 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:05.682992 21389 catalog_manager.cc:5697] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 reported cstate change: term changed from 19 to 21, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to 5727b19579474da6a12f79730b924770 (127.19.231.130). New cstate: current_term: 21 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:05.695569 30115 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:10:05.699729 21564 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:10:05.713961 21388 catalog_manager.cc:5697] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 19 to 21, leader changed from 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 21 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:05.716701 21606 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.735880 30059 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:05.744616 30183 raft_consensus.cc:2955] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 29 LEADER]: Committing config change with OpId 29.18: config changed from index 17 to 18, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:05.748623 22241 raft_consensus.cc:2955] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Committing config change with OpId 29.18: config changed from index 17 to 18, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:05.755057 21637 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:10:05.779246 29798 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:05.797027 21634 raft_consensus.cc:2955] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Committing config change with OpId 29.18: config changed from index 17 to 18, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:05.798085 21635 raft_consensus.cc:1275] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:10:05.797062 22210 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:05.802449 30115 consensus_queue.cc:1048] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:05.808351 21606 consensus_peers.cc:597] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:05.821583 21378 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 470cdc8938f2464c96c100ae314a56b7 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:05.842502 21389 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 17 to 18, VOTER 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129) evicted. New cstate: current_term: 29 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:10:05.897661 21532 consensus_peers.cc:597] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:05.913623 21532 consensus_peers.cc:597] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.958377 21566 raft_consensus.cc:1275] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:10:05.964854 30074 consensus_queue.cc:1048] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:10:05.965945 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 470cdc8938f2464c96c100ae314a56b7: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:05.971130 21532 consensus_peers.cc:597] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:05.983321 22210 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:05.984478 21637 raft_consensus.cc:1275] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:10:05.987483 30183 consensus_queue.cc:1048] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
W20260709 13:10:06.039073 21532 consensus_peers.cc:597] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:06.042953 21606 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.052783 22210 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.072779 21606 consensus_peers.cc:597] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.084090 21606 consensus_peers.cc:597] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.184469 21532 consensus_peers.cc:597] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.264508 21606 consensus_peers.cc:597] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.337155 21606 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.428970 21606 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.449373 21606 consensus_peers.cc:597] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.477401 21606 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.480958 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:06.490866 21606 consensus_peers.cc:597] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.493556 21606 consensus_peers.cc:597] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:06.494266 22210 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.542840 21532 consensus_peers.cc:597] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.551054 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:06.576537 20382 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 21515)
W20260709 13:10:06.628754 21532 consensus_peers.cc:597] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:06.633730 22210 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:06.644670 22210 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:06.684930 21606 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.860162 21606 consensus_peers.cc:597] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.869429 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:06.910043 21606 consensus_peers.cc:597] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:06.967406 21606 consensus_peers.cc:597] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:07.048660 21569 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:10:07.062356 21532 consensus_peers.cc:597] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:07.073132 21641 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:10:07.080087 21532 consensus_peers.cc:597] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 300e225ec8c14d76921637fefe0d57eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.095079 30017 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:07.106451 21532 consensus_peers.cc:597] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:07.146190 21606 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:07.173502 22210 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:07.177037 21532 consensus_peers.cc:597] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:07.177690 21532 consensus_peers.cc:597] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:07.189473 21532 consensus_peers.cc:597] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:07.194506 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 470cdc8938f2464c96c100ae314a56b7: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:07.197340 30017 raft_consensus.cc:2955] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:10:07.202657 21641 raft_consensus.cc:2955] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:10:07.225713 21564 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:07.228240 21389 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 13, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 19 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:10:07.257150 21641 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
W20260709 13:10:07.258486 21532 consensus_peers.cc:597] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ce0a50f2fc84191b1ad3c1fde5847ce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.261480 30207 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:10:07.263396 21532 consensus_peers.cc:597] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.292636 30017 raft_consensus.cc:2955] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 27 LEADER]: Committing config change with OpId 27.16: config changed from index -1 to 16, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:10:07.298346 21637 raft_consensus.cc:2955] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Committing config change with OpId 27.16: config changed from index -1 to 16, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:10:07.401206 21637 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:07.410140 21388 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 16, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 27 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:10:07.526968 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:07.541872 30220 ts_tablet_manager.cc:933] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:07.561578 21564 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:07.573695 30038 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:07.575455 30220 tablet_copy_client.cc:323] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.130:41371
W20260709 13:10:07.577119 20382 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 21515)
I20260709 13:10:07.577706 21579 tablet_copy_service.cc:140] P 5727b19579474da6a12f79730b924770: Received BeginTabletCopySession request for tablet 300e225ec8c14d76921637fefe0d57eb from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36572)
I20260709 13:10:07.578256 21579 tablet_copy_service.cc:161] P 5727b19579474da6a12f79730b924770: Beginning new tablet copy session on tablet 300e225ec8c14d76921637fefe0d57eb from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36572: session id = 549b31ac31b6428994b45938abc223a7-300e225ec8c14d76921637fefe0d57eb
I20260709 13:10:07.591987 21579 tablet_copy_source_session.cc:215] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:07.596742 30220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300e225ec8c14d76921637fefe0d57eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:07.605540 21606 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b14a1dff9e774b09a93b9bf00960df20. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:07.606557 21606 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.624884 30220 tablet_copy_client.cc:806] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:07.637534 30220 tablet_copy_client.cc:670] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:07.642222 30220 tablet_copy_client.cc:538] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:07.656567 30038 raft_consensus.cc:2955] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:10:07.661463 30220 tablet_bootstrap.cc:492] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:10:07.699800 21569 raft_consensus.cc:2955] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:10:07.705766 21641 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
W20260709 13:10:07.709543 21532 consensus_peers.cc:597] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:07.714920 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:07.716468 21389 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 14, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 23 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:07.785557 21606 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.791754 21564 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 13:10:07.799858 30224 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:10:07.837244 30220 tablet_bootstrap.cc:492] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.844439 30220 tablet_bootstrap.cc:492] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:10:07.845707 30220 ts_tablet_manager.cc:1403] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.184s	user 0.037s	sys 0.017s
I20260709 13:10:07.856796 30223 raft_consensus.cc:2955] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Committing config change with OpId 29.17: config changed from index -1 to 17, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
I20260709 13:10:07.865392 30220 raft_consensus.cc:359] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:07.870949 30220 raft_consensus.cc:740] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:10:07.871927 30220 consensus_queue.cc:260] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:07.875420 30228 ts_tablet_manager.cc:933] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:07.874046 21564 raft_consensus.cc:2955] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Committing config change with OpId 29.17: config changed from index -1 to 17, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } } }
W20260709 13:10:07.925305 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 50433.6us
W20260709 13:10:07.951125 21606 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323): Couldn't send request to peer 549b31ac31b6428994b45938abc223a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a85b464a0e924904be2840142de89c0d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.924566 30228 tablet_copy_client.cc:323] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.130:41371
W20260709 13:10:07.978580 21532 consensus_peers.cc:597] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:07.987669 30220 ts_tablet_manager.cc:1434] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.001s
I20260709 13:10:07.993876 21389 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index -1 to 17, NON_VOTER 549b31ac31b6428994b45938abc223a7 (127.19.231.132) added. New cstate: current_term: 29 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:08.012621 21606 consensus_peers.cc:597] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:08.093773 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 162065us
I20260709 13:10:08.099912 21579 tablet_copy_service.cc:140] P 5727b19579474da6a12f79730b924770: Received BeginTabletCopySession request for tablet 6ce0a50f2fc84191b1ad3c1fde5847ce from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36572)
I20260709 13:10:08.100473 21579 tablet_copy_service.cc:161] P 5727b19579474da6a12f79730b924770: Beginning new tablet copy session on tablet 6ce0a50f2fc84191b1ad3c1fde5847ce from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36572: session id = 549b31ac31b6428994b45938abc223a7-6ce0a50f2fc84191b1ad3c1fde5847ce
I20260709 13:10:08.103034 21578 tablet_copy_service.cc:342] P 5727b19579474da6a12f79730b924770: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-300e225ec8c14d76921637fefe0d57eb received from {username='slave'} at 127.0.0.1:36572
I20260709 13:10:08.103489 21578 tablet_copy_service.cc:434] P 5727b19579474da6a12f79730b924770: ending tablet copy session 549b31ac31b6428994b45938abc223a7-300e225ec8c14d76921637fefe0d57eb on tablet 300e225ec8c14d76921637fefe0d57eb with peer 549b31ac31b6428994b45938abc223a7
W20260709 13:10:08.111790 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:08.120793 21579 tablet_copy_source_session.cc:215] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:08.122135 22239 raft_consensus.cc:1217] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
W20260709 13:10:08.175822 21606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:40323, user_credentials={real_user=slave}} blocked reactor thread for 62206.1us
I20260709 13:10:08.211452 30245 ts_tablet_manager.cc:933] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:08.241590 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 52606.7us
W20260709 13:10:08.256682 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 470cdc8938f2464c96c100ae314a56b7: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:08.280004 21608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 45251.6us
W20260709 13:10:08.305691 21606 consensus_peers.cc:597] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:08.303716 30245 tablet_copy_client.cc:323] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.131:41367
W20260709 13:10:08.314949 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 74053.2us
W20260709 13:10:08.318295 21606 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:08.318874 21606 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:08.323961 22210 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:08.344931 21653 tablet_copy_service.cc:140] P a87bd86b86e74aa8bb61189215b73439: Received BeginTabletCopySession request for tablet b14a1dff9e774b09a93b9bf00960df20 from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36050)
I20260709 13:10:08.345604 21653 tablet_copy_service.cc:161] P a87bd86b86e74aa8bb61189215b73439: Beginning new tablet copy session on tablet b14a1dff9e774b09a93b9bf00960df20 from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36050: session id = 549b31ac31b6428994b45938abc223a7-b14a1dff9e774b09a93b9bf00960df20
W20260709 13:10:08.343350 22212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:41371, user_credentials={real_user=slave}} blocked reactor thread for 101044us
W20260709 13:10:08.334105 21532 consensus_peers.cc:597] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:08.357322 30228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce0a50f2fc84191b1ad3c1fde5847ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.357833 21653 tablet_copy_source_session.cc:215] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:08.392447 21532 consensus_peers.cc:597] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:08.398618 21606 consensus_peers.cc:597] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:08.408195 21532 consensus_peers.cc:597] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:08.414741 30220 ts_tablet_manager.cc:933] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: Initiating tablet copy from peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:08.423534 30245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14a1dff9e774b09a93b9bf00960df20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.451849 30228 tablet_copy_client.cc:806] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:08.453805 30228 tablet_copy_client.cc:670] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:08.454671 30220 tablet_copy_client.cc:323] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: tablet copy: Beginning tablet copy session from remote peer at address 127.19.231.131:41367
I20260709 13:10:08.456355 21653 tablet_copy_service.cc:140] P a87bd86b86e74aa8bb61189215b73439: Received BeginTabletCopySession request for tablet a85b464a0e924904be2840142de89c0d from peer 549b31ac31b6428994b45938abc223a7 ({username='slave'} at 127.0.0.1:36050)
I20260709 13:10:08.456929 21653 tablet_copy_service.cc:161] P a87bd86b86e74aa8bb61189215b73439: Beginning new tablet copy session on tablet a85b464a0e924904be2840142de89c0d from peer 549b31ac31b6428994b45938abc223a7 at {username='slave'} at 127.0.0.1:36050: session id = 549b31ac31b6428994b45938abc223a7-a85b464a0e924904be2840142de89c0d
I20260709 13:10:08.470942 21653 tablet_copy_source_session.cc:215] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:08.480981 30228 tablet_copy_client.cc:538] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:08.483029 30220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85b464a0e924904be2840142de89c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.495144 30228 tablet_bootstrap.cc:492] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:10:08.545739 30245 tablet_copy_client.cc:806] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:08.546389 30245 tablet_copy_client.cc:670] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:08.550675 30245 tablet_copy_client.cc:538] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:08.554469 30017 raft_consensus.cc:1064] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:10:08.557009 30017 consensus_queue.cc:237] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:08.560464 30245 tablet_bootstrap.cc:492] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:10:08.564774 30220 tablet_copy_client.cc:806] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 0 data blocks...
W20260709 13:10:08.573812 22210 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:08.577553 20382 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 21515)
I20260709 13:10:08.583209 30220 tablet_copy_client.cc:670] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:08.586923 22239 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:08.589969 30220 tablet_copy_client.cc:538] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:08.600296 30017 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:10:08.605614 21532 consensus_peers.cc:597] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:08.608459 21637 raft_consensus.cc:1275] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:10:08.618278 22210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111) [suppressed 463 similar messages]
I20260709 13:10:08.641508 30235 consensus_queue.cc:1048] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:08.725481 30228 tablet_bootstrap.cc:492] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=19 overwritten=3 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.726512 30228 tablet_bootstrap.cc:492] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:10:08.727347 30228 ts_tablet_manager.cc:1403] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.232s	user 0.057s	sys 0.002s
W20260709 13:10:08.728935 21606 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:08.734707 30220 tablet_bootstrap.cc:492] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: Bootstrap starting.
I20260709 13:10:08.736608 30228 raft_consensus.cc:359] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:08.744168 30228 raft_consensus.cc:740] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:10:08.744872 30228 consensus_queue.cc:260] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:08.778882 21634 raft_consensus.cc:2955] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:08.785040 30042 raft_consensus.cc:2955] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:10:08.790060 21606 consensus_peers.cc:597] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:08.797042 30228 ts_tablet_manager.cc:1434] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.002s
W20260709 13:10:08.822918 21606 consensus_peers.cc:597] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:08.819844 21388 catalog_manager.cc:5697] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 13 to 14, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:08.840369 21579 tablet_copy_service.cc:342] P 5727b19579474da6a12f79730b924770: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-6ce0a50f2fc84191b1ad3c1fde5847ce received from {username='slave'} at 127.0.0.1:36572
I20260709 13:10:08.840890 21579 tablet_copy_service.cc:434] P 5727b19579474da6a12f79730b924770: ending tablet copy session 549b31ac31b6428994b45938abc223a7-6ce0a50f2fc84191b1ad3c1fde5847ce on tablet 6ce0a50f2fc84191b1ad3c1fde5847ce with peer 549b31ac31b6428994b45938abc223a7
W20260709 13:10:08.874500 21532 consensus_peers.cc:597] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:08.881210 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:08.890370 22239 raft_consensus.cc:2955] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:08.898449 30245 tablet_bootstrap.cc:492] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=3 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.899468 30245 tablet_bootstrap.cc:492] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:10:08.904529 22245 raft_consensus.cc:1217] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 LEARNER]: Deduplicated request from leader. Original: 27.15->[27.16-27.16]   Dedup: 27.16->[]
I20260709 13:10:08.909833 30245 ts_tablet_manager.cc:1403] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.350s	user 0.044s	sys 0.015s
I20260709 13:10:08.914220 30245 raft_consensus.cc:359] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:08.915148 30245 raft_consensus.cc:740] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
W20260709 13:10:08.926441 21606 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:08.915829 30245 consensus_queue.cc:260] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:08.934974 30245 ts_tablet_manager.cc:1434] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:10:08.947048 21653 tablet_copy_service.cc:342] P a87bd86b86e74aa8bb61189215b73439: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-b14a1dff9e774b09a93b9bf00960df20 received from {username='slave'} at 127.0.0.1:36050
I20260709 13:10:08.947598 21653 tablet_copy_service.cc:434] P a87bd86b86e74aa8bb61189215b73439: ending tablet copy session 549b31ac31b6428994b45938abc223a7-b14a1dff9e774b09a93b9bf00960df20 on tablet b14a1dff9e774b09a93b9bf00960df20 with peer 549b31ac31b6428994b45938abc223a7
W20260709 13:10:08.969848 22210 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:09.089506 21606 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:09.092744 21606 consensus_peers.cc:597] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:09.141268 21606 consensus_peers.cc:597] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:09.144482 21606 consensus_peers.cc:597] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:09.162549 21532 consensus_peers.cc:597] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:09.175331 30220 tablet_bootstrap.cc:492] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=3 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.176788 30220 tablet_bootstrap.cc:492] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: Bootstrap complete.
I20260709 13:10:09.178310 30220 ts_tablet_manager.cc:1403] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: Time spent bootstrapping tablet: real 0.444s	user 0.063s	sys 0.009s
I20260709 13:10:09.253754 22238 raft_consensus.cc:1217] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.13->[23.14-23.14]   Dedup: 23.14->[]
I20260709 13:10:09.234686 30220 raft_consensus.cc:359] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [term 29 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:09.265726 30220 raft_consensus.cc:740] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [term 29 LEARNER]: Becoming Follower/Learner. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Initialized, Role: LEARNER
I20260709 13:10:09.266573 30220 consensus_queue.cc:260] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: NON_VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: true } }
I20260709 13:10:09.268867 30220 ts_tablet_manager.cc:1434] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.002s
W20260709 13:10:09.300220 21606 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:09.318110 21606 consensus_peers.cc:597] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:09.324888 21532 consensus_peers.cc:597] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:09.325528 22210 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:09.339613 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:09.340201 22210 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:09.342468 21653 tablet_copy_service.cc:342] P a87bd86b86e74aa8bb61189215b73439: Request end of tablet copy session 549b31ac31b6428994b45938abc223a7-a85b464a0e924904be2840142de89c0d received from {username='slave'} at 127.0.0.1:36050
I20260709 13:10:09.343107 21653 tablet_copy_service.cc:434] P a87bd86b86e74aa8bb61189215b73439: ending tablet copy session 549b31ac31b6428994b45938abc223a7-a85b464a0e924904be2840142de89c0d on tablet a85b464a0e924904be2840142de89c0d with peer 549b31ac31b6428994b45938abc223a7
I20260709 13:10:09.362372 22245 raft_consensus.cc:1217] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [term 29 LEARNER]: Deduplicated request from leader. Original: 29.16->[29.17-29.17]   Dedup: 29.17->[]
W20260709 13:10:09.386626 22210 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:09.405350 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:09.434350 21606 consensus_peers.cc:597] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:09.444510 21606 consensus_peers.cc:597] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:09.454067 30042 raft_consensus.cc:1064] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:10:09.458691 30042 consensus_queue.cc:237] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 14, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:09.478946 21606 consensus_peers.cc:597] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:09.493880 22245 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 LEARNER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:10:09.496263 21642 raft_consensus.cc:1275] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Refusing update from remote peer 5727b19579474da6a12f79730b924770: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:10:09.499363 30238 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:10:09.502398 21532 consensus_peers.cc:597] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.507802 30240 consensus_queue.cc:1048] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:10:09.574133 30042 raft_consensus.cc:2955] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 27 LEADER]: Committing config change with OpId 27.17: config changed from index 16 to 17, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:09.576056 22245 raft_consensus.cc:2955] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Committing config change with OpId 27.17: config changed from index 16 to 17, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:10:09.579455 20382 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 21515)
I20260709 13:10:09.605962 21642 raft_consensus.cc:2955] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Committing config change with OpId 27.17: config changed from index 16 to 17, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:09.607981 21389 catalog_manager.cc:5697] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 16 to 17, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 27 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:10:09.625994 21532 consensus_peers.cc:597] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:09.748669 22210 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:09.787540 30223 raft_consensus.cc:1064] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:10:09.798233 30223 consensus_queue.cc:237] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:09.799961 21532 consensus_peers.cc:597] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:09.864445 21606 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:09.854588 21532 consensus_peers.cc:597] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:09.866704 22245 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [term 23 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:10:09.875587 30272 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:10:09.879338 21566 raft_consensus.cc:1275] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:10:09.893513 30274 consensus_queue.cc:1048] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:09.921504 30223 raft_consensus.cc:1064] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: attempting to promote NON_VOTER 549b31ac31b6428994b45938abc223a7 to VOTER
I20260709 13:10:09.924712 30223 consensus_queue.cc:237] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 15, Current term: 29, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:09.941213 21606 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:09.961534 22245 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [term 29 LEARNER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:10:09.964041 30242 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:10:09.976574 21569 raft_consensus.cc:1275] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 13:10:09.977330 21606 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.979630 30242 consensus_queue.cc:1048] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:10:09.982537 21532 consensus_peers.cc:597] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:10.069599 30252 raft_consensus.cc:2955] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:10.076334 21566 raft_consensus.cc:2955] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:10.103524 30223 raft_consensus.cc:2955] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Committing config change with OpId 29.18: config changed from index 17 to 18, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:10.109661 21568 raft_consensus.cc:2955] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Committing config change with OpId 29.18: config changed from index 17 to 18, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:10:10.115273 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:10.181592 22245 raft_consensus.cc:2955] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Committing config change with OpId 29.18: config changed from index 17 to 18, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:10.196025 22238 raft_consensus.cc:2955] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
I20260709 13:10:10.197736 21388 catalog_manager.cc:5697] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 reported cstate change: config changed from index 17 to 18, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 29 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.245500 21389 catalog_manager.cc:5697] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 reported cstate change: config changed from index 14 to 15, 549b31ac31b6428994b45938abc223a7 (127.19.231.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:10:10.370523 21532 consensus_peers.cc:597] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:10.399758 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:10.431809 21606 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:10.468622 21532 consensus_peers.cc:597] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:10.491125 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:10.493616 21376 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 79608.9us
W20260709 13:10:10.500273 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 470cdc8938f2464c96c100ae314a56b7: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:10.514320 21532 consensus_peers.cc:597] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:10.561717 21378 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d46f34ab738d4d38b09f9d1228d68c7d with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 5727b19579474da6a12f79730b924770 (127.19.231.130:41371) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 5727b19579474da6a12f79730b924770 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 24 leader_uuid: "5727b19579474da6a12f79730b924770" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } } }
W20260709 13:10:10.568404 21532 consensus_peers.cc:597] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:10.579972 20382 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 21515)
W20260709 13:10:10.589586 22210 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:10.621447 21606 consensus_peers.cc:597] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:10.731959 21606 consensus_peers.cc:597] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:10.897075 21606 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:10.904400 21532 consensus_peers.cc:597] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:10.909039 21532 consensus_peers.cc:597] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:10.973035 21606 consensus_peers.cc:597] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.026351 22210 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:11.050743 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:11.120010 21606 consensus_peers.cc:597] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.120556 21606 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.282701 21606 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.403975 21606 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.447424 21532 consensus_peers.cc:597] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:11.519129 22210 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:11.530328 21606 consensus_peers.cc:597] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:11.580461 20382 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 21515)
W20260709 13:10:11.583112 22210 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.627163 21606 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.634590 21606 consensus_peers.cc:597] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.638728 22210 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.662007 22210 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:11.682206 21606 consensus_peers.cc:597] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.719331 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:11.802649 21606 consensus_peers.cc:597] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.834020 21532 consensus_peers.cc:597] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:11.854369 21532 consensus_peers.cc:597] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.892485 21606 consensus_peers.cc:597] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:11.960110 21606 consensus_peers.cc:597] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:11.991266 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:12.030376 21606 consensus_peers.cc:597] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:12.090477 21532 consensus_peers.cc:597] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.098202 21606 consensus_peers.cc:597] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:12.148566 21532 consensus_peers.cc:597] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:12.184340 21606 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.316787 21532 consensus_peers.cc:597] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:12.343438 22210 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:12.355275 21606 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:12.390480 21532 consensus_peers.cc:597] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:12.456148 21606 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.555759 21532 consensus_peers.cc:597] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:12.580988 20382 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 21515)
W20260709 13:10:12.720312 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:12.795819 21532 consensus_peers.cc:597] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:12.899396 21606 consensus_peers.cc:597] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:13.053150 21606 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:13.058362 21606 consensus_peers.cc:597] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:13.078572 21532 consensus_peers.cc:597] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:13.089825 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:13.141075 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:13.243046 21532 consensus_peers.cc:597] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:13.250490 21532 consensus_peers.cc:597] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:13.259918 22210 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:13.365036 21532 consensus_peers.cc:597] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:13.403680 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:13.542413 22210 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:13.543635 21532 consensus_peers.cc:597] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:13.638850 22210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111) [suppressed 475 similar messages]
W20260709 13:10:13.660517 21606 consensus_peers.cc:597] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:13.674930 21606 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:13.692210 21606 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:13.787874 21606 consensus_peers.cc:597] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:13.853286 22210 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:13.896230 21606 consensus_peers.cc:597] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:13.998818 21606 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.000450 22210 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.003430 22210 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.009824 21606 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.045651 21532 consensus_peers.cc:597] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:14.059518 21606 consensus_peers.cc:597] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:14.068953 21606 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.111505 21606 consensus_peers.cc:597] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:14.242841 21606 consensus_peers.cc:597] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.260190 22210 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:14.333277 21532 consensus_peers.cc:597] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:14.422456 21532 consensus_peers.cc:597] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.439591 21606 consensus_peers.cc:597] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.454931 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:14.523547 20382 tablet_server.cc:196] TabletServer@127.19.231.129:0 shutdown complete.
W20260709 13:10:14.562085 21606 consensus_peers.cc:597] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.605109 21606 consensus_peers.cc:597] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.611699 21606 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:14.648422 21532 consensus_peers.cc:597] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:14.659005 21381 maintenance_manager.cc:419] P 8a31697310664f6da99c69fbc04b3926: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033395
W20260709 13:10:14.724737 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 470cdc8938f2464c96c100ae314a56b7: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:14.733314 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:14.812431 21606 consensus_peers.cc:597] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:14.811632 21532 consensus_peers.cc:597] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:14.835564 21606 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:14.836091 21606 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:14.874552 21380 maintenance_manager.cc:643] P 8a31697310664f6da99c69fbc04b3926: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.215s	user 0.045s	sys 0.006s Metrics: {"bytes_written":10106,"delete_count":0,"lbm_write_time_us":16367,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":7,"reinsert_count":0,"thread_start_us":8968,"threads_started":1,"update_count":392,"wal-append.queue_time_us":16838}
I20260709 13:10:14.885294 21381 maintenance_manager.cc:419] P 8a31697310664f6da99c69fbc04b3926: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.459800
W20260709 13:10:14.991029 21532 consensus_peers.cc:597] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:15.000795 22210 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:15.039590 20382 tablet_server.cc:179] TabletServer@127.19.231.130:0 shutting down...
W20260709 13:10:15.061177 22212 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.061975 21532 consensus_peers.cc:597] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:15.069788 22212 consensus_peers.cc:597] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.091045 21532 consensus_peers.cc:597] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:15.101682 22212 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.122622 21608 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.125559 22212 consensus_peers.cc:597] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.130216 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:15.136963 21608 consensus_peers.cc:597] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.137722 21608 consensus_peers.cc:597] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.141363 21608 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.167323 22212 consensus_peers.cc:597] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.176605 21608 consensus_peers.cc:597] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.185333 21608 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.206856 22212 consensus_peers.cc:597] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.230186 22212 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.243563 21608 consensus_peers.cc:597] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.285429 21606 consensus_peers.cc:597] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:15.319181 21608 consensus_peers.cc:597] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.321807 21608 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.323764 21608 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.335129 21608 consensus_peers.cc:597] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.336102 21608 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.339172 21532 consensus_peers.cc:597] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:15.358947 21608 consensus_peers.cc:597] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.368698 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:10:15.547053 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:15.549203 22212 consensus_peers.cc:597] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.552177 22212 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.552800 22212 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.553352 22212 consensus_peers.cc:597] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.611131 20382 tablet_replica.cc:333] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.612987 20382 raft_consensus.cc:2243] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:15.614073 20382 raft_consensus.cc:2272] T 2002b234371248e3aaaecd1014e30086 P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:15.620911 22212 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.644730 21532 consensus_peers.cc:597] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:15.652207 21532 consensus_peers.cc:597] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:15.652829 21532 consensus_peers.cc:597] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:15.661015 21532 consensus_peers.cc:597] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:15.691435 20382 tablet_replica.cc:333] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.709347 20382 raft_consensus.cc:2243] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.710204 20382 raft_consensus.cc:2272] T e0950a4a64c4484ba4b753d544c7f1eb P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.713658 20382 tablet_replica.cc:333] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770: stopping tablet replica
W20260709 13:10:15.715482 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:15.718719 20382 raft_consensus.cc:2243] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:15.720801 20382 raft_consensus.cc:2272] T 67538f399a3e491e97d3a4c5585bf44a P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.726989 20382 tablet_replica.cc:333] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.748752 20382 raft_consensus.cc:2243] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.755316 20382 raft_consensus.cc:2272] T 13befc0ae0be496ea458eb0ed6662d3d P 5727b19579474da6a12f79730b924770 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.764379 20382 tablet_replica.cc:333] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.765314 20382 raft_consensus.cc:2243] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.774106 20382 raft_consensus.cc:2272] T 630b1c2cf4484981883df8266fc20ac4 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:15.787076 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:15.792450 20382 tablet_replica.cc:333] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770: stopping tablet replica
W20260709 13:10:15.801118 22212 consensus_peers.cc:597] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.803527 20382 raft_consensus.cc:2243] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:10:15.804807 21608 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.805984 21608 consensus_peers.cc:597] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.806854 21608 consensus_peers.cc:597] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.807753 21608 consensus_peers.cc:597] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.808947 21608 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.804836 20382 raft_consensus.cc:2272] T 1f372659e8e14c5d86dae03fcd58b963 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.818915 20382 tablet_replica.cc:333] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.819828 20382 raft_consensus.cc:2243] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.824453 20382 raft_consensus.cc:2272] T 05ff2c5405fa4d388804a95695e2b592 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.838353 20382 tablet_replica.cc:333] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.846082 20382 raft_consensus.cc:2243] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.847064 20382 raft_consensus.cc:2272] T 12f1cc6194a54e7d8fb8d72776638772 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:15.849802 21608 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.853292 20382 tablet_replica.cc:333] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.861227 20382 raft_consensus.cc:2243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:15.875247 20382 raft_consensus.cc:2272] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.878433 20382 tablet_replica.cc:333] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770: stopping tablet replica
W20260709 13:10:15.857786 21606 consensus_peers.cc:597] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:15.855109 21380 maintenance_manager.cc:643] P 8a31697310664f6da99c69fbc04b3926: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.969s	user 0.139s	sys 0.021s Metrics: {"cfile_cache_miss":11,"cfile_cache_miss_bytes":31639,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":14908,"dirs.run_cpu_time_us":564,"dirs.run_wall_time_us":5291,"lbm_read_time_us":23841,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":25,"lbm_write_time_us":11667,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":12,"peak_mem_usage":609840,"reinsert_count":0,"thread_start_us":46719,"threads_started":2,"update_count":401}
I20260709 13:10:15.880075 21381 maintenance_manager.cc:419] P 8a31697310664f6da99c69fbc04b3926: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:10:15.880849 21380 maintenance_manager.cc:643] P 8a31697310664f6da99c69fbc04b3926: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:10:15.883051 21606 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:15.895931 20382 raft_consensus.cc:2243] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.903781 20382 raft_consensus.cc:2272] T 18a391cd0b80409cb0308239137325f8 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.907419 20382 tablet_replica.cc:333] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.908522 20382 raft_consensus.cc:2243] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.909613 20382 raft_consensus.cc:2272] T b14a1dff9e774b09a93b9bf00960df20 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.929177 20382 tablet_replica.cc:333] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770: stopping tablet replica
W20260709 13:10:15.929275 22210 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:15.931249 20382 raft_consensus.cc:2243] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.932085 20382 raft_consensus.cc:2272] T 5057458c15c04db7a727b0b401a36bdc P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.935635 20382 tablet_replica.cc:333] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.936612 20382 raft_consensus.cc:2243] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.937463 20382 raft_consensus.cc:2272] T 6397e2c83e814a908887a9e44184de0a P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.940747 20382 tablet_replica.cc:333] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.942201 20382 raft_consensus.cc:2243] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.952775 20382 raft_consensus.cc:2272] T 18db3d7d8520484b9eb6da32f2bc86ed P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.955667 20382 tablet_replica.cc:333] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.958866 20382 raft_consensus.cc:2243] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.959982 20382 raft_consensus.cc:2272] T bbb07a26963247f383d1e9c7990b92ac P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.969609 20382 tablet_replica.cc:333] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:15.985743 20382 raft_consensus.cc:2243] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.009858 20382 raft_consensus.cc:2272] T 5b18ad2e6f014e20be78478bc402f892 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.017628 20382 tablet_replica.cc:333] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.018750 20382 raft_consensus.cc:2243] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.019767 20382 raft_consensus.cc:2272] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.022912 20382 tablet_replica.cc:333] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.023954 30304 raft_consensus.cc:493] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:16.024623 30304 raft_consensus.cc:515] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:16.027424 30304 leader_election.cc:290] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:16.029726 21634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32891f0cc92c44afbc3bd39c2c408597" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:10:16.037691 21532 leader_election.cc:336] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:16.044546 21532 leader_election.cc:304] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:16.046336 30308 raft_consensus.cc:2749] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:10:16.050900 20382 raft_consensus.cc:2243] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.052273 20382 raft_consensus.cc:2272] T 4d0597072fba4deebec5c1ddaeff142f P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.055401 20382 tablet_replica.cc:333] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.067649 20382 raft_consensus.cc:2243] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.069279 20382 raft_consensus.cc:2272] T 24789f7f25d44609b76928ec55894739 P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.085078 30308 raft_consensus.cc:493] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:10:16.098341 30308 raft_consensus.cc:515] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:16.100708 30308 leader_election.cc:290] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:16.097630 30304 raft_consensus.cc:493] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:16.101511 30304 raft_consensus.cc:515] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:16.103897 30304 leader_election.cc:290] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:16.104136 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214d67cdc8f4690b393c47800e8e3e6" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:16.106947 20382 tablet_replica.cc:333] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.107870 20382 raft_consensus.cc:2243] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.108547 20382 raft_consensus.cc:2272] T 0cf7884717c9466486b7e5eb6b4626c5 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.140604 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a421c4648b143d58ea851d133ca3863" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:16.143378 20382 tablet_replica.cc:333] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.147070 20382 raft_consensus.cc:2243] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.147931 20382 raft_consensus.cc:2272] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.150864 20382 tablet_replica.cc:333] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770: stopping tablet replica
W20260709 13:10:16.145442 21532 leader_election.cc:336] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:16.164217 21532 leader_election.cc:304] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:10:16.164903 21532 raft_consensus.cc:2686] T e214d67cdc8f4690b393c47800e8e3e6 P 5727b19579474da6a12f79730b924770: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:16.165715 30304 raft_consensus.cc:493] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:10:16.166335 30304 raft_consensus.cc:515] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:16.168849 30304 leader_election.cc:290] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:10:16.172014 21532 leader_election.cc:336] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:16.172485 21532 leader_election.cc:304] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:16.172606 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6859210b204263aedc975d7586330c" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:16.173379 20382 raft_consensus.cc:2243] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:16.174183 21606 consensus_peers.cc:597] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:16.175123 30308 raft_consensus.cc:2749] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:16.175874 20382 raft_consensus.cc:2272] T 7d086ed254594401ae567a7d3681c987 P 5727b19579474da6a12f79730b924770 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:16.179278 21532 leader_election.cc:336] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:16.179463 20382 tablet_replica.cc:333] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.203737 20382 raft_consensus.cc:2243] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:16.195891 21376 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.231.129:46061, user_credentials={real_user=slave}} blocked reactor thread for 79650.1us
I20260709 13:10:16.204872 21532 leader_election.cc:304] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:16.204504 20382 raft_consensus.cc:2272] T 8e067febbdfa48d7b1d4f20ec5e2337a P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.205643 30308 raft_consensus.cc:2749] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:16.206972 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6fad88e2e67d44f7adb559c0a8eb0af8: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:16.210350 20382 tablet_replica.cc:333] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.211309 20382 raft_consensus.cc:2243] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.214327 20382 raft_consensus.cc:2272] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P 5727b19579474da6a12f79730b924770 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.215054 30308 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:16.218241 30308 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:16.220782 30308 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:16.221470 30304 raft_consensus.cc:493] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:16.221992 30304 raft_consensus.cc:515] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:16.224133 30304 leader_election.cc:290] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:16.224548 21606 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:16.231038 30308 raft_consensus.cc:493] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:16.231711 30308 raft_consensus.cc:515] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:16.233808 30308 leader_election.cc:290] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:16.236464 20382 tablet_replica.cc:333] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.237418 20382 raft_consensus.cc:2243] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.240033 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:16.242326 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85b464a0e924904be2840142de89c0d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:10:16.247560 21606 consensus_peers.cc:597] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:16.256036 20382 raft_consensus.cc:2272] T 47fdde72d59a41308bcdd5d0e303c5cb P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:16.264806 22210 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:16.266218 20382 tablet_replica.cc:333] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.266469 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d6d6e481fd941658a227093848691fa" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:16.267163 20382 raft_consensus.cc:2243] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.267841 20382 raft_consensus.cc:2272] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.270553 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c670f1ebdec3444e9e371f0fca10d38d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:16.284318 20382 tablet_replica.cc:333] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.284989 20382 raft_consensus.cc:2243] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.286158 20382 raft_consensus.cc:2272] T 300e225ec8c14d76921637fefe0d57eb P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.290207 20382 tablet_replica.cc:333] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.291531 20382 raft_consensus.cc:2243] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.292380 30304 raft_consensus.cc:493] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:10:16.292860 30304 raft_consensus.cc:515] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:16.293352 20382 raft_consensus.cc:2272] T 4e78f55a98514b6b95c6ea1b508ac13e P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.295049 30304 leader_election.cc:290] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:16.296887 20382 tablet_replica.cc:333] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.299894 21532 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:16.302942 30304 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:10:16.307613 21606 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:16.307909 20382 raft_consensus.cc:2243] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.309331 20382 raft_consensus.cc:2272] T d46f34ab738d4d38b09f9d1228d68c7d P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.313740 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:10:16.320216 21606 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:16.320782 21606 consensus_peers.cc:597] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:16.324409 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401d63d1bf204db2a802876b9ddc8476" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:16.329101 20382 tablet_replica.cc:333] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.336493 20382 raft_consensus.cc:2243] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.344869 30304 raft_consensus.cc:493] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:10:16.345554 30304 raft_consensus.cc:515] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:16.346668 20382 raft_consensus.cc:2272] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.347716 30304 leader_election.cc:290] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:10:16.352674 22210 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:16.352968 20382 tablet_replica.cc:333] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770: stopping tablet replica
W20260709 13:10:16.353601 21532 leader_election.cc:336] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:16.365258 21532 leader_election.cc:336] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:16.353940 20382 raft_consensus.cc:2243] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.366671 20382 raft_consensus.cc:2272] T a85b464a0e924904be2840142de89c0d P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.375165 20382 tablet_replica.cc:333] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770: stopping tablet replica
W20260709 13:10:16.376077 21423 debug-util.cc:398] Leaking SignalData structure 0x7b0800177560 after lost signal to thread 20385
W20260709 13:10:16.377821 21423 debug-util.cc:398] Leaking SignalData structure 0x7b080003cfa0 after lost signal to thread 21426
W20260709 13:10:16.378472 21423 debug-util.cc:398] Leaking SignalData structure 0x7b0800220140 after lost signal to thread 21593
W20260709 13:10:16.379709 21423 debug-util.cc:398] Leaking SignalData structure 0x7b0800264d20 after lost signal to thread 21667
I20260709 13:10:16.379421 20382 raft_consensus.cc:2243] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.380918 20382 raft_consensus.cc:2272] T 377467a782f94dd2b6e76b88920dfb8b P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:16.381309 21423 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfd40 after lost signal to thread 22277
I20260709 13:10:16.386278 20382 tablet_replica.cc:333] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.387298 20382 raft_consensus.cc:2243] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.388115 20382 raft_consensus.cc:2272] T e2ba3136589046f7ada398d9210f305d P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.375551 21532 leader_election.cc:304] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:16.391144 20382 tablet_replica.cc:333] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.391413 30304 raft_consensus.cc:2749] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:10:16.392159 20382 raft_consensus.cc:2243] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.392971 20382 raft_consensus.cc:2272] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:16.393370 21532 leader_election.cc:336] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:16.400236 21532 leader_election.cc:304] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:16.395852 20382 tablet_replica.cc:333] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.401638 20382 raft_consensus.cc:2243] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.403182 20382 raft_consensus.cc:2272] T 545ee5e8315344d387b7e32a6fe5984b P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:16.415776 21532 raft_consensus.cc:2686] T c670f1ebdec3444e9e371f0fca10d38d P 5727b19579474da6a12f79730b924770: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:16.417358 20382 tablet_replica.cc:333] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.424067 30304 raft_consensus.cc:493] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:16.424278 20382 raft_consensus.cc:2243] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.424680 30304 raft_consensus.cc:515] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:16.425361 20382 raft_consensus.cc:2272] T 470cdc8938f2464c96c100ae314a56b7 P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.426950 30304 leader_election.cc:290] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:16.435829 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b5fb42c147456889a1843340b22720" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:16.436995 30304 raft_consensus.cc:493] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:16.437573 30304 raft_consensus.cc:515] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:16.439775 30304 leader_election.cc:290] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:16.439898 21532 leader_election.cc:304] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
W20260709 13:10:16.440598 21532 raft_consensus.cc:2686] T 401d63d1bf204db2a802876b9ddc8476 P 5727b19579474da6a12f79730b924770: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:16.451951 20382 tablet_replica.cc:333] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.452888 20382 raft_consensus.cc:2243] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.453683 20382 raft_consensus.cc:2272] T eae01b9fdd5340dc9416e5834263a4d6 P 5727b19579474da6a12f79730b924770 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.464212 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e37e086e4a48aa8d09172d1b43518d" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:16.465775 30304 raft_consensus.cc:493] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:10:16.471575 30304 raft_consensus.cc:515] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:16.473724 30304 leader_election.cc:290] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:16.465031 20382 tablet_replica.cc:333] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.475032 20382 raft_consensus.cc:2243] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.475754 20382 raft_consensus.cc:2272] T bd6859210b204263aedc975d7586330c P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.477450 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2e35d97e8c4c319144e4d36af40d14" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:16.488726 20382 tablet_replica.cc:333] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.489679 20382 raft_consensus.cc:2243] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.492182 30304 raft_consensus.cc:493] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 549b31ac31b6428994b45938abc223a7)
I20260709 13:10:16.492796 30304 raft_consensus.cc:515] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:16.495757 30304 leader_election.cc:290] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:10:16.497666 21532 leader_election.cc:336] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:16.498206 21532 leader_election.cc:304] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:16.499043 30304 raft_consensus.cc:2749] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:16.503098 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:16.504403 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0b1311ffdd4c1293236cad678687e7" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:16.507085 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:16.509550 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68080652a5d4450691efb2d8b5c1b187" candidate_uuid: "5727b19579474da6a12f79730b924770" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:16.490618 20382 raft_consensus.cc:2272] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.529949 20382 tablet_replica.cc:333] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.532653 20382 raft_consensus.cc:2243] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.537981 20382 raft_consensus.cc:2272] T 1fbb59e66fd74778a9cbae5114efa101 P 5727b19579474da6a12f79730b924770 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.549988 20382 tablet_replica.cc:333] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.550918 20382 raft_consensus.cc:2243] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.551717 20382 raft_consensus.cc:2272] T 1a421c4648b143d58ea851d133ca3863 P 5727b19579474da6a12f79730b924770 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.536343 21532 leader_election.cc:304] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:16.559384 30304 raft_consensus.cc:2749] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:16.560879 21532 leader_election.cc:304] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:16.561718 30304 raft_consensus.cc:2749] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:16.562983 21532 leader_election.cc:336] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:16.563476 21532 leader_election.cc:304] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:10:16.564177 21532 raft_consensus.cc:2686] T 92e37e086e4a48aa8d09172d1b43518d P 5727b19579474da6a12f79730b924770: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:16.567895 20382 tablet_replica.cc:333] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.575527 20382 raft_consensus.cc:2243] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:16.574429 21606 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:16.564846 21532 leader_election.cc:336] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:16.576519 21532 leader_election.cc:304] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5727b19579474da6a12f79730b924770; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:16.577391 30304 raft_consensus.cc:2749] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:16.582906 20382 raft_consensus.cc:2272] T 06b5fb42c147456889a1843340b22720 P 5727b19579474da6a12f79730b924770 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.592389 20382 tablet_replica.cc:333] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.595933 20382 raft_consensus.cc:2243] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:16.598274 22210 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:16.603379 20382 raft_consensus.cc:2272] T 4d6d6e481fd941658a227093848691fa P 5727b19579474da6a12f79730b924770 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.606554 20382 tablet_replica.cc:333] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.614738 20382 raft_consensus.cc:2243] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.615526 20382 raft_consensus.cc:2272] T 68080652a5d4450691efb2d8b5c1b187 P 5727b19579474da6a12f79730b924770 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:16.619740 22210 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:16.621901 20382 tablet_replica.cc:333] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.626067 20382 raft_consensus.cc:2243] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.628819 20382 raft_consensus.cc:2272] T 852aa9ec17544a9eb8f44e067743d0c6 P 5727b19579474da6a12f79730b924770 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.631824 20382 tablet_replica.cc:333] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.632671 20382 raft_consensus.cc:2243] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.633430 20382 raft_consensus.cc:2272] T 32891f0cc92c44afbc3bd39c2c408597 P 5727b19579474da6a12f79730b924770 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.637085 20382 tablet_replica.cc:333] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.637915 20382 raft_consensus.cc:2243] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:10:16.639302 20382 raft_consensus.cc:2272] T 6ff1ef08407c4bed8b0670f8230f0a40 P 5727b19579474da6a12f79730b924770 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.642069 20382 tablet_replica.cc:333] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.642870 20382 raft_consensus.cc:2243] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.643646 20382 raft_consensus.cc:2272] T 3e2e35d97e8c4c319144e4d36af40d14 P 5727b19579474da6a12f79730b924770 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.646500 20382 tablet_replica.cc:333] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770: stopping tablet replica
I20260709 13:10:16.647245 20382 raft_consensus.cc:2243] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.653030 20382 raft_consensus.cc:2272] T ac0b1311ffdd4c1293236cad678687e7 P 5727b19579474da6a12f79730b924770 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:16.743007 21606 consensus_peers.cc:597] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:16.789582 22210 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:16.864470 21606 consensus_peers.cc:597] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:16.895078 21606 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:16.907358 21606 consensus_peers.cc:597] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:16.979140 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:17.051828 21606 consensus_peers.cc:597] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:17.137739 21606 consensus_peers.cc:597] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:17.199348 21606 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:17.244076 21606 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:17.244892 30315 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.245692 30326 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.246596 30326 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.248934 30326 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:17.250917 30315 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.255971 30315 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:17.259581 22210 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.268944 30319 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.269706 30319 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:17.272122 30319 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:17.277194 22210 leader_election.cc:336] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:17.296656 22212 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.298827 22212 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:17.301450 30326 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:17.302170 30326 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.302659 30326 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.305068 30326 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:17.321475 22212 leader_election.cc:336] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.328476 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:10:17.327678 21606 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.339999 30315 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:17.347028 21608 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:17.356176 22210 leader_election.cc:336] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.360963 30319 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.361624 30319 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:17.364166 30319 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:17.358536 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:10:17.365885 22212 leader_election.cc:336] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.374475 22212 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:17.385069 30326 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:17.367640 30319 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:17.388490 30319 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.390458 30319 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:17.382422 21606 consensus_peers.cc:597] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:17.399806 21606 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:17.402138 21608 leader_election.cc:336] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.403328 30319 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:10:17.404663 22212 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:17.424399 21606 leader_election.cc:336] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.437904 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:17.425891 30319 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.441812 30319 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:17.444289 30319 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:17.425055 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:17.453055 30319 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:17.454049 30326 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.454658 30326 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.457130 30326 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:17.460673 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
W20260709 13:10:17.440991 21608 leader_election.cc:336] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:17.468334 22212 leader_election.cc:336] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.471299 30315 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.479133 30315 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.481609 30315 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:17.488510 21606 consensus_peers.cc:597] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:17.496752 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
W20260709 13:10:17.501963 22212 leader_election.cc:336] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:17.508527 21608 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:17.515712 21608 consensus_peers.cc:597] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:17.513167 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:17.518519 30315 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:17.523497 21606 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
I20260709 13:10:17.536475 30319 raft_consensus.cc:2749] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:10:17.540437 21606 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.541725 21606 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:10:17.541206 22210 leader_election.cc:336] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.547394 22210 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:17.548178 30315 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:17.550230 30319 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:17.558772 30319 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.559474 30319 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:17.561932 30319 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:17.567920 30327 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.568578 30327 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.571530 30327 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:17.572178 30327 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.572719 30327 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.575011 30327 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:17.579098 30315 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.579715 30315 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.585587 30315 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:17.587872 21608 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:17.591352 22212 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.597550 30315 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.603698 30315 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.606377 30315 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:17.611722 22212 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.614053 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:17.619035 30327 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.621862 30327 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.627364 30327 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:17.639536 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:17.640244 21642 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 27.
W20260709 13:10:17.640558 22212 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:17.643775 21606 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.644362 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:17.649472 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:17.649664 22245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:17.651033 22238 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 18.
W20260709 13:10:17.650086 22212 consensus_peers.cc:597] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:17.652100 30327 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:17.650346 21608 leader_election.cc:336] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:17.653306 21608 leader_election.cc:336] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:17.671296 22210 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.674618 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:17.679841 30315 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:17.674074 21608 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:17.684984 21608 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:17.695111 21606 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:17.696684 22212 consensus_peers.cc:597] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:17.696792 21606 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:17.703447 30327 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:10:17.705021 21606 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 549b31ac31b6428994b45938abc223a7, 5727b19579474da6a12f79730b924770
W20260709 13:10:17.712989 21608 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:17.715535 21608 consensus_peers.cc:597] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:17.717733 30319 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.721874 30319 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.725000 30319 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:17.717399 30327 raft_consensus.cc:2749] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:17.727924 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:17.728665 22239 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 27.
I20260709 13:10:17.720863 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:10:17.739779 30327 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:17.740358 30327 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.740814 30327 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:17.749377 22210 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.753743 22210 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:17.758919 30315 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:10:17.756472 21608 consensus_peers.cc:597] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:17.778188 21608 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.790009 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:17.786962 30319 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.792534 30319 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.799530 30319 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:10:17.800688 21608 consensus_peers.cc:597] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:17.801791 30327 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.804039 30327 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:10:17.804177 21608 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:17.810477 21608 leader_election.cc:336] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.812748 30315 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.813369 30315 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.815747 30315 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:17.820264 21606 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.820766 21606 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:17.822115 30328 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:17.825066 22212 leader_election.cc:336] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:17.834973 22210 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:17.836915 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:17.837577 21642 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 20.
W20260709 13:10:17.840410 21608 consensus_peers.cc:597] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:17.847733 22212 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:17.849210 30315 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.850802 30315 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.857594 30315 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:17.860292 22212 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.870373 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:10:17.884641 30326 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:17.885124 30326 raft_consensus.cc:493] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.885507 30326 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:17.891685 21608 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:17.897939 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:17.898904 22241 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
I20260709 13:10:17.900702 22241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24789f7f25d44609b76928ec55894739" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7"
I20260709 13:10:17.900871 30326 raft_consensus.cc:515] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.901520 22241 raft_consensus.cc:3060] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:17.909965 22241 raft_consensus.cc:2468] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 19.
I20260709 13:10:17.912206 30326 leader_election.cc:290] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:17.912771 21606 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:17.913249 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:17.914186 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:17.914867 21642 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
I20260709 13:10:17.915393 30327 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:17.919493 21608 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:17.920408 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377467a782f94dd2b6e76b88920dfb8b" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:17.921080 21636 raft_consensus.cc:3060] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:17.924852 22212 leader_election.cc:336] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.926818 30326 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.927403 30326 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:17.929062 21636 raft_consensus.cc:2468] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 21.
I20260709 13:10:17.929482 30326 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:17.940374 21608 consensus_peers.cc:597] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:17.941017 21608 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:17.943894 30327 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:17.944478 30327 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:17.946209 21606 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:10:17.947803 21608 consensus_peers.cc:597] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:17.948434 21608 consensus_peers.cc:597] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:17.943413 22212 leader_election.cc:336] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:17.949312 30328 raft_consensus.cc:2804] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:17.949842 30328 raft_consensus.cc:697] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Becoming Leader. State: Replica: a87bd86b86e74aa8bb61189215b73439, State: Running, Role: LEADER
I20260709 13:10:17.950675 30328 consensus_queue.cc:237] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:17.963195 22212 consensus_peers.cc:597] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:17.946537 30327 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:17.998922 22212 consensus_peers.cc:597] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:17.999197 20382 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21590)
W20260709 13:10:17.999500 22212 consensus_peers.cc:597] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:18.000387 22210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:41367, user_credentials={real_user=slave}} blocked reactor thread for 64075.5us
I20260709 13:10:18.001091 22210 leader_election.cc:304] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:10:18.003150 30336 raft_consensus.cc:2804] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:18.003734 30336 raft_consensus.cc:697] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:10:18.004627 30336 consensus_queue.cc:237] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:18.010973 30327 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:18.011587 30327 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:18.019055 21636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:18.019744 21636 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 29.
I20260709 13:10:18.022598 30327 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:18.022933 21608 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:18.023679 21608 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:18.025226 22210 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:18.025730 22210 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:18.026472 30326 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:18.026589 21608 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:18.031499 22210 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
I20260709 13:10:18.030944 21391 catalog_manager.cc:5697] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 reported cstate change: term changed from 18 to 19, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to a87bd86b86e74aa8bb61189215b73439 (127.19.231.131). New cstate: current_term: 19 leader_uuid: "a87bd86b86e74aa8bb61189215b73439" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.032382 30326 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:10:18.032816 30326 raft_consensus.cc:493] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:18.033593 30326 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:10:18.034667 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:18.036844 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:18.049696 21388 catalog_manager.cc:5697] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 20 to 21, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 21 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:18.051506 22212 consensus_peers.cc:597] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:18.053025 21606 consensus_peers.cc:597] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:18.053308 30327 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:10:18.055286 22212 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:18.053857 30327 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:18.057683 30327 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:18.061391 21606 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:18.061894 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
W20260709 13:10:18.063541 22212 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:18.065187 21608 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:18.065469 30326 raft_consensus.cc:515] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:18.067001 30328 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:10:18.068696 30326 leader_election.cc:290] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 election: Requested vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:18.070348 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470cdc8938f2464c96c100ae314a56b7" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439"
I20260709 13:10:18.070996 21642 raft_consensus.cc:3060] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:10:18.071714 21606 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:18.072168 21606 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:18.072818 30328 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:10:18.073818 21606 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:18.074220 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:18.074903 30328 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:18.081146 22212 leader_election.cc:336] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:18.085460 21642 raft_consensus.cc:2468] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 30.
I20260709 13:10:18.088537 22210 leader_election.cc:304] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770
W20260709 13:10:18.090107 21608 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:18.090620 21608 consensus_peers.cc:597] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:18.091334 30336 raft_consensus.cc:2804] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:10:18.092046 30336 raft_consensus.cc:697] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 30 LEADER]: Becoming Leader. State: Replica: 549b31ac31b6428994b45938abc223a7, State: Running, Role: LEADER
I20260709 13:10:18.093250 30336 consensus_queue.cc:237] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:18.105306 22212 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:18.134244 21608 consensus_peers.cc:597] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:18.149812 21388 catalog_manager.cc:5697] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 reported cstate change: term changed from 29 to 30, leader changed from 5727b19579474da6a12f79730b924770 (127.19.231.130) to 549b31ac31b6428994b45938abc223a7 (127.19.231.132). New cstate: current_term: 30 leader_uuid: "549b31ac31b6428994b45938abc223a7" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:18.232729 21608 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:18.236018 21606 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:18.249136 22212 consensus_peers.cc:597] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:18.346053 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:18.350868 21608 consensus_peers.cc:597] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:18.421404 22239 raft_consensus.cc:1275] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Refusing update from remote peer a87bd86b86e74aa8bb61189215b73439: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:18.423602 30328 consensus_queue.cc:1048] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
W20260709 13:10:18.527282 21606 consensus_peers.cc:597] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:18.527810 22212 consensus_peers.cc:597] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:18.534675 21608 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:18.547561 22210 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:18.548092 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:18.585865 21606 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:18.614534 21642 raft_consensus.cc:1275] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:10:18.616820 30326 consensus_queue.cc:1048] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:10:18.641116 21608 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111) [suppressed 688 similar messages]
W20260709 13:10:18.681222 22212 consensus_peers.cc:597] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:18.723582 21642 raft_consensus.cc:1275] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 30 FOLLOWER]: Refusing update from remote peer 549b31ac31b6428994b45938abc223a7: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 13:10:18.725561 30333 consensus_queue.cc:1048] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:10:18.725899 21606 consensus_peers.cc:597] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:18.731889 21606 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:18.790578 21606 consensus_peers.cc:597] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:18.853602 21606 consensus_peers.cc:597] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:18.873051 21606 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:18.897919 22210 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:18.926559 22210 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:18.975383 22210 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:18.999706 20382 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21590)
W20260709 13:10:19.010281 21606 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:19.019361 30326 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.019999 30326 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:19.022184 30326 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:19.032509 22212 leader_election.cc:336] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:19.034200 22210 leader_election.cc:336] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:19.034621 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.035356 30326 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:10:19.060531 22210 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:19.210692 30315 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.222512 30315 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:19.226016 30315 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:19.231462 22210 leader_election.cc:336] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:19.235857 30328 raft_consensus.cc:493] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.236706 30328 raft_consensus.cc:515] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:19.240958 30328 leader_election.cc:290] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:19.244119 22212 leader_election.cc:336] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:19.244767 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.247041 30315 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:19.251585 21606 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:19.267246 21608 leader_election.cc:336] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:19.284950 30328 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.295249 30328 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:19.298658 30328 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
I20260709 13:10:19.303232 21608 leader_election.cc:304] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.307608 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce0a50f2fc84191b1ad3c1fde5847ce" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:19.308888 30328 raft_consensus.cc:2749] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:19.308848 22239 raft_consensus.cc:2468] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 27.
W20260709 13:10:19.313992 21606 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:19.334694 21608 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:19.339078 21608 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.339883 30328 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:10:19.372596 22210 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:19.405057 30352 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.406044 30352 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:19.413571 30328 raft_consensus.cc:493] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.414275 30328 raft_consensus.cc:515] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:19.416453 30328 leader_election.cc:290] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:19.416574 22212 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:19.425473 21608 leader_election.cc:336] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:19.430146 30350 raft_consensus.cc:493] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.431222 30350 raft_consensus.cc:515] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:19.434234 30350 leader_election.cc:290] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
I20260709 13:10:19.445358 30352 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:19.449476 21606 consensus_peers.cc:597] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:19.456166 21608 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:19.463171 21606 leader_election.cc:336] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:19.464352 21606 leader_election.cc:304] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.471462 30350 raft_consensus.cc:2749] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:19.471356 30333 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
W20260709 13:10:19.472796 21606 leader_election.cc:336] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:19.472503 30333 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:19.473245 21606 leader_election.cc:304] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.473935 30350 raft_consensus.cc:2749] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:19.477995 30333 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:19.487015 22212 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:19.478915 21606 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:19.498549 21606 consensus_peers.cc:597] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:19.505704 30328 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.506590 30328 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:19.514906 21608 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:19.515676 22210 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:19.516237 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.517310 30333 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:19.516230 30328 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), 549b31ac31b6428994b45938abc223a7 (127.19.231.132:40323)
W20260709 13:10:19.522415 21606 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:19.522892 21606 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.523875 30328 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:19.523809 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:19.524879 21642 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 24.
W20260709 13:10:19.534385 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:19.549681 22239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46f34ab738d4d38b09f9d1228d68c7d" candidate_uuid: "a87bd86b86e74aa8bb61189215b73439" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "549b31ac31b6428994b45938abc223a7" is_pre_election: true
I20260709 13:10:19.550343 22239 raft_consensus.cc:2468] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a87bd86b86e74aa8bb61189215b73439 in term 24.
W20260709 13:10:19.551481 22210 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:19.553584 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7, a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.557760 30333 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:19.591003 30350 raft_consensus.cc:493] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.591820 30350 raft_consensus.cc:515] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:19.603252 21606 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:19.604286 30350 leader_election.cc:290] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:19.627249 21606 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:19.640920 21608 leader_election.cc:336] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:19.643808 21608 leader_election.cc:304] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.647225 30350 raft_consensus.cc:2749] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:19.643028 21606 consensus_peers.cc:597] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:19.732110 30354 raft_consensus.cc:493] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.732793 30354 raft_consensus.cc:515] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
W20260709 13:10:19.736593 21606 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:19.737705 30354 leader_election.cc:290] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:19.745975 21608 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:19.747177 30333 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.749320 30333 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:19.755636 30333 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:19.767817 22210 leader_election.cc:336] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:19.777251 21606 leader_election.cc:336] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:19.777799 21606 leader_election.cc:304] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.778610 30354 raft_consensus.cc:2749] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:19.788265 22212 leader_election.cc:336] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:19.788796 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.789641 30333 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:19.812098 21606 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:19.884328 21606 consensus_peers.cc:597] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:19.893798 21606 consensus_peers.cc:597] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:19.905979 21606 consensus_peers.cc:597] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:19.917886 30327 raft_consensus.cc:493] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.918741 30327 raft_consensus.cc:515] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:19.923002 30327 leader_election.cc:290] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:19.928583 21606 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:19.931777 21608 leader_election.cc:336] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:19.932279 21608 leader_election.cc:304] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:19.933689 30327 raft_consensus.cc:2749] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:10:19.955174 21606 consensus_peers.cc:597] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:19.960844 22212 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:19.984261 30327 raft_consensus.cc:493] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:19.985003 30327 raft_consensus.cc:515] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } }
I20260709 13:10:19.991799 30327 leader_election.cc:290] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:19.997078 21608 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:20.019151 21606 leader_election.cc:336] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:20.019814 21606 leader_election.cc:304] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87bd86b86e74aa8bb61189215b73439; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:20.020766 30327 raft_consensus.cc:2749] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:10:20.108850 21608 consensus_peers.cc:597] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.110661 22212 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.116355 22212 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.123194 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:20.126842 21608 consensus_peers.cc:597] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.170488 22212 consensus_peers.cc:597] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.182350 22212 consensus_peers.cc:597] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.188059 22212 consensus_peers.cc:597] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.190477 21608 consensus_peers.cc:597] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:20.237422 30352 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:20.238250 30352 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:20.245899 22210 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:20.247666 21608 consensus_peers.cc:597] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.251031 21606 consensus_peers.cc:597] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:20.251601 22212 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:20.252113 22212 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:20.252948 30315 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:20.255139 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300e225ec8c14d76921637fefe0d57eb" candidate_uuid: "549b31ac31b6428994b45938abc223a7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a87bd86b86e74aa8bb61189215b73439" is_pre_election: true
I20260709 13:10:20.255932 21642 raft_consensus.cc:2468] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549b31ac31b6428994b45938abc223a7 in term 19.
W20260709 13:10:20.256644 21608 consensus_peers.cc:597] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:20.258088 30352 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:20.261212 21608 consensus_peers.cc:597] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.301396 22210 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:20.305617 21608 consensus_peers.cc:597] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.313817 22212 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.314513 22212 consensus_peers.cc:597] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.361514 21608 consensus_peers.cc:597] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.391781 22212 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.397071 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:20.429402 21608 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:20.435969 20382 tablet_server.cc:196] TabletServer@127.19.231.130:0 shutdown complete.
W20260709 13:10:20.455883 21608 consensus_peers.cc:597] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.465561 21608 consensus_peers.cc:597] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.468705 21608 consensus_peers.cc:597] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.495931 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:20.508086 21608 consensus_peers.cc:597] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.520785 22212 consensus_peers.cc:597] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.600369 21608 consensus_peers.cc:597] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.604228 21608 consensus_peers.cc:597] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.608990 22212 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.627053 21608 consensus_peers.cc:597] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:20.642589 20382 tablet_server.cc:179] TabletServer@127.19.231.131:0 shutting down...
W20260709 13:10:20.683737 22212 consensus_peers.cc:597] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.733225 22210 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:20.735127 21608 consensus_peers.cc:597] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:20.736739 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:20.741333 20382 tablet_replica.cc:333] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
W20260709 13:10:20.747781 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:20.751304 22210 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.752305 20382 raft_consensus.cc:2243] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.753638 20382 raft_consensus.cc:2272] T 2002b234371248e3aaaecd1014e30086 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.757302 20382 tablet_replica.cc:333] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
W20260709 13:10:20.767817 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.768795 20382 raft_consensus.cc:2243] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.770958 20382 raft_consensus.cc:2272] T e0950a4a64c4484ba4b753d544c7f1eb P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.781186 30333 raft_consensus.cc:493] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:20.781929 30333 raft_consensus.cc:515] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:20.783051 20382 tablet_replica.cc:333] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.784137 30333 leader_election.cc:290] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:20.792333 22212 leader_election.cc:336] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:20.798449 22210 leader_election.cc:336] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:20.798916 22210 leader_election.cc:304] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:20.799638 30333 raft_consensus.cc:2749] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:10:20.800175 22210 consensus_peers.cc:597] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.801034 20382 raft_consensus.cc:2243] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.807629 20382 raft_consensus.cc:2272] T cc9f5258ae3f4790a9bc1813d73ec987 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.810941 20382 tablet_replica.cc:333] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.811915 20382 raft_consensus.cc:2243] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.813620 20382 raft_consensus.cc:2272] T 13befc0ae0be496ea458eb0ed6662d3d P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:20.820947 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:20.822907 20382 tablet_replica.cc:333] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.823861 20382 raft_consensus.cc:2243] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.825197 20382 raft_consensus.cc:2272] T 630b1c2cf4484981883df8266fc20ac4 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.828119 20382 tablet_replica.cc:333] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.829414 20382 raft_consensus.cc:2243] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.830822 20382 raft_consensus.cc:2272] T ac0b1311ffdd4c1293236cad678687e7 P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.833899 20382 tablet_replica.cc:333] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.834914 20382 raft_consensus.cc:2243] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.842677 20382 raft_consensus.cc:2272] T 3e2e35d97e8c4c319144e4d36af40d14 P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.845703 20382 tablet_replica.cc:333] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.846745 20382 raft_consensus.cc:2243] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.848553 20382 raft_consensus.cc:2272] T 470cdc8938f2464c96c100ae314a56b7 P a87bd86b86e74aa8bb61189215b73439 [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:20.851155 21608 consensus_peers.cc:597] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:20.851620 20382 tablet_replica.cc:333] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.852547 20382 raft_consensus.cc:2243] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.853227 20382 raft_consensus.cc:2272] T 545ee5e8315344d387b7e32a6fe5984b P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.856355 20382 tablet_replica.cc:333] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.857968 20382 raft_consensus.cc:2243] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 28 LEADER]: Raft consensus shutting down.
W20260709 13:10:20.859735 22212 consensus_peers.cc:597] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:20.862128 22210 consensus_peers.cc:597] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.863299 20382 raft_consensus.cc:2272] T 05ff2c5405fa4d388804a95695e2b592 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.869613 20382 tablet_replica.cc:333] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
W20260709 13:10:20.874305 22210 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:20.877339 21608 consensus_peers.cc:597] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:20.879382 22210 consensus_peers.cc:597] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.870452 20382 raft_consensus.cc:2243] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.886034 20382 raft_consensus.cc:2272] T 18a391cd0b80409cb0308239137325f8 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:20.890931 22210 consensus_peers.cc:597] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:20.892637 21608 consensus_peers.cc:597] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:20.892993 20382 tablet_replica.cc:333] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.893926 20382 raft_consensus.cc:2243] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.894994 20382 raft_consensus.cc:2272] T 6397e2c83e814a908887a9e44184de0a P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.898360 20382 tablet_replica.cc:333] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.902577 20382 raft_consensus.cc:2243] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.903913 20382 raft_consensus.cc:2272] T cae2bb9c133344078cc4f963e7188776 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:20.905551 22212 consensus_peers.cc:597] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:20.909536 20382 tablet_replica.cc:333] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.910778 20382 raft_consensus.cc:2243] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.912544 20382 raft_consensus.cc:2272] T 3d0b012cfcad4a71a65a1e83d453cfca P a87bd86b86e74aa8bb61189215b73439 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.916939 20382 tablet_replica.cc:333] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.917822 20382 raft_consensus.cc:2243] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.919598 20382 raft_consensus.cc:2272] T 5057458c15c04db7a727b0b401a36bdc P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.922732 20382 tablet_replica.cc:333] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.923956 20382 raft_consensus.cc:2243] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.926136 20382 raft_consensus.cc:2272] T b14a1dff9e774b09a93b9bf00960df20 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.929441 20382 tablet_replica.cc:333] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.931969 20382 raft_consensus.cc:2243] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.932715 20382 raft_consensus.cc:2272] T 35e6cfe6efc04bc98ae2183731b5ae40 P a87bd86b86e74aa8bb61189215b73439 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.936120 20382 tablet_replica.cc:333] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.936939 20382 raft_consensus.cc:2243] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.937974 20382 raft_consensus.cc:2272] T 18db3d7d8520484b9eb6da32f2bc86ed P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.940974 20382 tablet_replica.cc:333] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.941831 20382 raft_consensus.cc:2243] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.948256 20382 raft_consensus.cc:2272] T 24789f7f25d44609b76928ec55894739 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.951103 20382 tablet_replica.cc:333] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.952005 20382 raft_consensus.cc:2243] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.954770 20382 raft_consensus.cc:2272] T 6fad88e2e67d44f7adb559c0a8eb0af8 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.957901 20382 tablet_replica.cc:333] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.958755 20382 raft_consensus.cc:2243] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.960904 20382 raft_consensus.cc:2272] T 4d0597072fba4deebec5c1ddaeff142f P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.963886 20382 tablet_replica.cc:333] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.964807 20382 raft_consensus.cc:2243] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.966110 20382 raft_consensus.cc:2272] T c7bfc9f63b5d484f83f58360423d19e3 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.969075 20382 tablet_replica.cc:333] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.969941 20382 raft_consensus.cc:2243] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.971581 20382 raft_consensus.cc:2272] T 6ce0a50f2fc84191b1ad3c1fde5847ce P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.974654 20382 tablet_replica.cc:333] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.975564 20382 raft_consensus.cc:2243] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.977896 20382 raft_consensus.cc:2272] T a85b464a0e924904be2840142de89c0d P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.980906 20382 tablet_replica.cc:333] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.981963 20382 raft_consensus.cc:2243] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.982594 20382 raft_consensus.cc:2272] T 377467a782f94dd2b6e76b88920dfb8b P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.985947 20382 tablet_replica.cc:333] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.986704 20382 raft_consensus.cc:2243] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.988361 20382 raft_consensus.cc:2272] T b4a9406eef59405b975ed9c99811d69a P a87bd86b86e74aa8bb61189215b73439 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:20.991828 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:10:20.995622 20382 tablet_replica.cc:333] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:20.996608 20382 raft_consensus.cc:2243] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.998446 20382 raft_consensus.cc:2272] T 8e067febbdfa48d7b1d4f20ec5e2337a P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.001706 20382 tablet_replica.cc:333] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
W20260709 13:10:21.005573 22210 consensus_peers.cc:597] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.006719 20382 raft_consensus.cc:2243] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.008340 20382 raft_consensus.cc:2272] T d6080cb4ff0f4e5aae18e38fa86b1fa1 P a87bd86b86e74aa8bb61189215b73439 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.011508 20382 tablet_replica.cc:333] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.012266 20382 raft_consensus.cc:2243] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.013253 20382 raft_consensus.cc:2272] T 47fdde72d59a41308bcdd5d0e303c5cb P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:21.019021 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.023350 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.023928 30333 raft_consensus.cc:493] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:21.024549 30333 raft_consensus.cc:515] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:21.026407 22210 consensus_peers.cc:597] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.027007 30333 leader_election.cc:290] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:21.033221 22212 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:21.046734 22210 leader_election.cc:336] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:21.047298 22210 leader_election.cc:304] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:21.048121 30352 raft_consensus.cc:2749] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:21.049021 20382 tablet_replica.cc:333] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.050021 20382 raft_consensus.cc:2243] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:10:21.055967 21606 consensus_peers.cc:597] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:10:21.062769 20382 raft_consensus.cc:2272] T c670f1ebdec3444e9e371f0fca10d38d P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.071807 20382 tablet_replica.cc:333] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.072777 20382 raft_consensus.cc:2243] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:10:21.076577 22210 consensus_peers.cc:597] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.077411 22210 consensus_peers.cc:597] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.079890 20382 raft_consensus.cc:2272] T 0cf7884717c9466486b7e5eb6b4626c5 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.085826 20382 tablet_replica.cc:333] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.086814 20382 raft_consensus.cc:2243] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.088182 20382 raft_consensus.cc:2272] T 7d086ed254594401ae567a7d3681c987 P a87bd86b86e74aa8bb61189215b73439 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.091360 20382 tablet_replica.cc:333] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.092160 20382 raft_consensus.cc:2243] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.092872 20382 raft_consensus.cc:2272] T 1fbb59e66fd74778a9cbae5114efa101 P a87bd86b86e74aa8bb61189215b73439 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.095818 20382 tablet_replica.cc:333] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.096607 20382 raft_consensus.cc:2243] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.097819 20382 raft_consensus.cc:2272] T 92e37e086e4a48aa8d09172d1b43518d P a87bd86b86e74aa8bb61189215b73439 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.100911 20382 tablet_replica.cc:333] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.107692 20382 raft_consensus.cc:2243] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.109521 20382 raft_consensus.cc:2272] T e2ba3136589046f7ada398d9210f305d P a87bd86b86e74aa8bb61189215b73439 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.118331 20382 tablet_replica.cc:333] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.119503 20382 raft_consensus.cc:2243] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.120532 20382 raft_consensus.cc:2272] T 401d63d1bf204db2a802876b9ddc8476 P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.123934 20382 tablet_replica.cc:333] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.124805 20382 raft_consensus.cc:2243] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.125466 20382 raft_consensus.cc:2272] T 05a0423f397042e3aed0ddbf0c111bd4 P a87bd86b86e74aa8bb61189215b73439 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.130686 20382 tablet_replica.cc:333] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.131515 20382 raft_consensus.cc:2243] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.133097 20382 raft_consensus.cc:2272] T 300e225ec8c14d76921637fefe0d57eb P a87bd86b86e74aa8bb61189215b73439 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.139735 20382 tablet_replica.cc:333] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.140563 20382 raft_consensus.cc:2243] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.141342 20382 raft_consensus.cc:2272] T 4e78f55a98514b6b95c6ea1b508ac13e P a87bd86b86e74aa8bb61189215b73439 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.144275 20382 tablet_replica.cc:333] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.146242 20382 raft_consensus.cc:2243] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.147886 20382 raft_consensus.cc:2272] T d46f34ab738d4d38b09f9d1228d68c7d P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.150749 20382 tablet_replica.cc:333] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.151600 20382 raft_consensus.cc:2243] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.153117 20382 raft_consensus.cc:2272] T 4d6d6e481fd941658a227093848691fa P a87bd86b86e74aa8bb61189215b73439 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.156637 20382 tablet_replica.cc:333] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.157789 20382 raft_consensus.cc:2243] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.159181 20382 raft_consensus.cc:2272] T 1a421c4648b143d58ea851d133ca3863 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.162642 20382 tablet_replica.cc:333] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.163398 20382 raft_consensus.cc:2243] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.163990 20382 raft_consensus.cc:2272] T 68080652a5d4450691efb2d8b5c1b187 P a87bd86b86e74aa8bb61189215b73439 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.168895 20382 tablet_replica.cc:333] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.169709 20382 raft_consensus.cc:2243] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.171357 20382 raft_consensus.cc:2272] T eae01b9fdd5340dc9416e5834263a4d6 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.174216 20382 tablet_replica.cc:333] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.175022 20382 raft_consensus.cc:2243] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.175792 20382 raft_consensus.cc:2272] T 22b45f3e8b8e428ea4709e7e9ee43868 P a87bd86b86e74aa8bb61189215b73439 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.179041 20382 tablet_replica.cc:333] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.179807 20382 raft_consensus.cc:2243] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.180435 20382 raft_consensus.cc:2272] T 852aa9ec17544a9eb8f44e067743d0c6 P a87bd86b86e74aa8bb61189215b73439 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:21.192308 22212 consensus_peers.cc:597] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:21.209892 20382 tablet_replica.cc:333] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.210814 20382 raft_consensus.cc:2243] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.211577 20382 raft_consensus.cc:2272] T b773b0d389ce4ab991f6892abb4882e7 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:21.217957 22210 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:21.228121 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.214613 20382 tablet_replica.cc:333] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.230958 20382 raft_consensus.cc:2243] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.232199 20382 raft_consensus.cc:2272] T 6ff1ef08407c4bed8b0670f8230f0a40 P a87bd86b86e74aa8bb61189215b73439 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:21.239701 22210 consensus_peers.cc:597] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.241482 20382 tablet_replica.cc:333] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.242236 20382 raft_consensus.cc:2243] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.253185 20382 raft_consensus.cc:2272] T 32891f0cc92c44afbc3bd39c2c408597 P a87bd86b86e74aa8bb61189215b73439 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.256009 20382 tablet_replica.cc:333] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439: stopping tablet replica
I20260709 13:10:21.256673 20382 raft_consensus.cc:2243] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.257799 20382 raft_consensus.cc:2272] T 7f7e8b71ee674ed4b42ef0ba024cf600 P a87bd86b86e74aa8bb61189215b73439 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.331924 30352 raft_consensus.cc:493] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:21.332711 30352 raft_consensus.cc:515] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:21.364614 30352 leader_election.cc:290] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:21.406054 22210 leader_election.cc:336] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:21.509078 22212 leader_election.cc:336] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:21.509702 22212 leader_election.cc:304] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:21.514252 30362 raft_consensus.cc:2749] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:21.516044 22210 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:21.549719 22210 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:21.747174 22210 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:21.747776 22210 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:21.909078 22210 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:22.028513 30352 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:22.029114 30352 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:22.031406 30352 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:22.036767 22210 leader_election.cc:336] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
W20260709 13:10:22.037624 22210 leader_election.cc:336] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:22.038097 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:22.038873 30352 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:10:22.050377 30352 raft_consensus.cc:493] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:22.050946 30352 raft_consensus.cc:515] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:22.053234 30352 leader_election.cc:290] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:22.059684 22212 leader_election.cc:336] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:22.061522 22210 leader_election.cc:336] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
I20260709 13:10:22.061949 22210 leader_election.cc:304] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:22.063330 30352 raft_consensus.cc:2749] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:22.069378 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:10:22.196007 30362 raft_consensus.cc:493] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:22.196556 30362 raft_consensus.cc:515] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:22.198987 30362 leader_election.cc:290] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:22.204608 22210 leader_election.cc:336] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:22.205251 22210 leader_election.cc:336] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
I20260709 13:10:22.205622 22210 leader_election.cc:304] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:22.206360 30362 raft_consensus.cc:2749] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:10:22.260162 30362 raft_consensus.cc:493] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:22.260844 30362 raft_consensus.cc:515] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:22.263659 30362 leader_election.cc:290] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:22.270249 22212 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:22.272915 22210 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
I20260709 13:10:22.273393 22210 leader_election.cc:304] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:22.274143 30362 raft_consensus.cc:2749] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:10:22.276237 22210 leader_election.cc:336] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:22.316538 30333 raft_consensus.cc:493] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:22.317122 30333 raft_consensus.cc:515] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:22.319769 30333 leader_election.cc:290] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:22.325188 22212 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:22.328725 22210 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:22.330197 22210 leader_election.cc:304] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:22.330971 30333 raft_consensus.cc:2749] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:22.331692 22210 leader_election.cc:336] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
I20260709 13:10:22.377167 30333 raft_consensus.cc:493] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:22.377763 30333 raft_consensus.cc:515] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:22.380667 30333 leader_election.cc:290] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
I20260709 13:10:22.384287 30333 raft_consensus.cc:493] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:22.384877 30333 raft_consensus.cc:515] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } attrs { replace: true } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:22.387741 30333 leader_election.cc:290] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:22.392271 22210 leader_election.cc:336] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:22.393354 22210 leader_election.cc:336] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
I20260709 13:10:22.393813 22210 leader_election.cc:304] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:22.394557 30333 raft_consensus.cc:2749] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:10:22.398855 22210 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:22.399559 22210 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
W20260709 13:10:22.399901 22212 leader_election.cc:336] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:22.399986 22210 leader_election.cc:304] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:22.400673 30333 raft_consensus.cc:493] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:22.400962 30362 raft_consensus.cc:2749] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:22.401193 30333 raft_consensus.cc:515] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:22.403950 30333 leader_election.cc:290] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:22.405440 22212 leader_election.cc:336] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:22.409905 22210 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:22.412839 22210 leader_election.cc:336] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
I20260709 13:10:22.413285 22210 leader_election.cc:304] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:22.414027 30333 raft_consensus.cc:2749] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:10:22.437144 22212 consensus_peers.cc:597] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:22.522578 22212 consensus_peers.cc:597] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:22.580629 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:10:22.583001 30362 raft_consensus.cc:493] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:22.583585 30362 raft_consensus.cc:515] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:22.585742 30362 leader_election.cc:290] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:22.590364 22212 leader_election.cc:336] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:22.592275 22210 leader_election.cc:336] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
I20260709 13:10:22.593736 22210 leader_election.cc:304] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, a87bd86b86e74aa8bb61189215b73439
I20260709 13:10:22.595096 30333 raft_consensus.cc:2749] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:22.611886 21664 debug-util.cc:398] Leaking SignalData structure 0x7b08003950e0 after lost signal to thread 20385
W20260709 13:10:22.613070 21664 debug-util.cc:398] Leaking SignalData structure 0x7b0800305fc0 after lost signal to thread 21426
W20260709 13:10:22.613660 21664 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7340 after lost signal to thread 21667
W20260709 13:10:22.614886 21664 debug-util.cc:398] Leaking SignalData structure 0x7b08002f41e0 after lost signal to thread 22277
W20260709 13:10:22.666554 22212 consensus_peers.cc:597] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:22.680884 22210 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:22.698669 22212 consensus_peers.cc:597] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:22.745435 22212 consensus_peers.cc:597] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:22.748585 22212 consensus_peers.cc:597] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:22.760490 20382 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21664)
W20260709 13:10:22.773011 22212 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:22.906404 30364 raft_consensus.cc:493] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:22.907374 30364 raft_consensus.cc:515] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
W20260709 13:10:22.916539 22212 consensus_peers.cc:597] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:22.917596 30364 leader_election.cc:290] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371)
W20260709 13:10:22.920164 22210 leader_election.cc:336] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:22.927363 22212 leader_election.cc:336] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
I20260709 13:10:22.927975 22212 leader_election.cc:304] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:22.931809 30365 raft_consensus.cc:2749] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:22.940696 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:22.948570 22212 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:22.974361 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 470cdc8938f2464c96c100ae314a56b7: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:23.123562 30364 raft_consensus.cc:493] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5727b19579474da6a12f79730b924770)
I20260709 13:10:23.124119 30364 raft_consensus.cc:515] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "5727b19579474da6a12f79730b924770" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41371 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } attrs { replace: true } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:23.127674 30364 leader_election.cc:290] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), 5727b19579474da6a12f79730b924770 (127.19.231.130:41371), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:23.131903 22212 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:23.135900 22210 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:23.136292 22210 leader_election.cc:304] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5727b19579474da6a12f79730b924770, 5a34fd3290de493eb6bbe828dd742772
I20260709 13:10:23.136905 30364 raft_consensus.cc:2749] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:23.136999 22210 leader_election.cc:336] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
W20260709 13:10:23.149441 22210 consensus_peers.cc:597] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.210505 22210 consensus_peers.cc:597] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:23.230104 22210 consensus_peers.cc:597] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.261382 22210 consensus_peers.cc:597] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.358053 22210 consensus_peers.cc:597] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.358192 22212 consensus_peers.cc:597] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:23.388738 22210 consensus_peers.cc:597] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.402640 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.420226 22210 consensus_peers.cc:597] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:23.420588 22212 consensus_peers.cc:597] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:23.443078 22212 consensus_peers.cc:597] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:23.463976 22210 consensus_peers.cc:597] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.473064 22210 consensus_peers.cc:597] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.476475 22210 consensus_peers.cc:597] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.498720 22210 consensus_peers.cc:597] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.502156 22212 consensus_peers.cc:597] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:23.516748 22210 consensus_peers.cc:597] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 -> Peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Couldn't send request to peer 5a34fd3290de493eb6bbe828dd742772. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:10:23.519675 22210 consensus_peers.cc:597] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.532496 22210 consensus_peers.cc:597] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:23.537241 20382 tablet_server.cc:196] TabletServer@127.19.231.131:0 shutdown complete.
W20260709 13:10:23.585635 22210 consensus_peers.cc:597] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.603642 22210 consensus_peers.cc:597] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:23.620796 30365 raft_consensus.cc:493] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader a87bd86b86e74aa8bb61189215b73439)
I20260709 13:10:23.621451 30365 raft_consensus.cc:515] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a34fd3290de493eb6bbe828dd742772" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 46061 } } peers { permanent_uuid: "a87bd86b86e74aa8bb61189215b73439" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 41367 } } peers { permanent_uuid: "549b31ac31b6428994b45938abc223a7" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 40323 } attrs { promote: false } }
I20260709 13:10:23.624128 30365 leader_election.cc:290] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061), a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367)
W20260709 13:10:23.638873 22210 leader_election.cc:336] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:23.639779 22210 leader_election.cc:336] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111)
I20260709 13:10:23.640323 22210 leader_election.cc:304] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549b31ac31b6428994b45938abc223a7; no voters: 5a34fd3290de493eb6bbe828dd742772, a87bd86b86e74aa8bb61189215b73439
W20260709 13:10:23.641080 22212 consensus_peers.cc:597] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 -> Peer 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): Couldn't send request to peer 5727b19579474da6a12f79730b924770. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:23.641371 30364 raft_consensus.cc:2749] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:10:23.644541 22210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111) [suppressed 633 similar messages]
W20260709 13:10:23.647679 22210 consensus_peers.cc:597] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:23.652496 20382 tablet_server.cc:179] TabletServer@127.19.231.132:0 shutting down...
W20260709 13:10:23.677057 22210 consensus_peers.cc:597] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 -> Peer a87bd86b86e74aa8bb61189215b73439 (127.19.231.131:41367): Couldn't send request to peer a87bd86b86e74aa8bb61189215b73439. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:41367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:23.702101 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:23.703104 20382 tablet_replica.cc:333] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.704106 20382 raft_consensus.cc:2243] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.705224 20382 raft_consensus.cc:2272] T 300e225ec8c14d76921637fefe0d57eb P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.708498 20382 tablet_replica.cc:333] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.709285 20382 raft_consensus.cc:2243] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.710405 20382 raft_consensus.cc:2272] T 22b45f3e8b8e428ea4709e7e9ee43868 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.713064 20382 tablet_replica.cc:333] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.713959 20382 raft_consensus.cc:2243] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.714758 20382 raft_consensus.cc:2272] T a85b464a0e924904be2840142de89c0d P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.717557 20382 tablet_replica.cc:333] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.718443 20382 raft_consensus.cc:2243] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.719101 20382 raft_consensus.cc:2272] T 6ce0a50f2fc84191b1ad3c1fde5847ce P 549b31ac31b6428994b45938abc223a7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.722105 20382 tablet_replica.cc:333] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.722875 20382 raft_consensus.cc:2243] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.723992 20382 raft_consensus.cc:2272] T 377467a782f94dd2b6e76b88920dfb8b P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.726504 20382 tablet_replica.cc:333] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.727344 20382 raft_consensus.cc:2243] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.727929 20382 raft_consensus.cc:2272] T d46f34ab738d4d38b09f9d1228d68c7d P 549b31ac31b6428994b45938abc223a7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.730967 20382 tablet_replica.cc:333] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.731740 20382 raft_consensus.cc:2243] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.732801 20382 raft_consensus.cc:2272] T 4e78f55a98514b6b95c6ea1b508ac13e P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.735412 20382 tablet_replica.cc:333] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.736145 20382 raft_consensus.cc:2243] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.737396 20382 raft_consensus.cc:2272] T 470cdc8938f2464c96c100ae314a56b7 P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.740254 20382 tablet_replica.cc:333] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.741014 20382 raft_consensus.cc:2243] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.742414 20382 raft_consensus.cc:2272] T eae01b9fdd5340dc9416e5834263a4d6 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.745283 20382 tablet_replica.cc:333] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.746145 20382 raft_consensus.cc:2243] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.747321 20382 raft_consensus.cc:2272] T b4a9406eef59405b975ed9c99811d69a P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.750128 20382 tablet_replica.cc:333] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.750932 20382 raft_consensus.cc:2243] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.752022 20382 raft_consensus.cc:2272] T 05a0423f397042e3aed0ddbf0c111bd4 P 549b31ac31b6428994b45938abc223a7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.754673 20382 tablet_replica.cc:333] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.755443 20382 raft_consensus.cc:2243] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.756536 20382 raft_consensus.cc:2272] T 401d63d1bf204db2a802876b9ddc8476 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.759361 20382 tablet_replica.cc:333] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.760121 20382 raft_consensus.cc:2243] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.761286 20382 raft_consensus.cc:2272] T 35e6cfe6efc04bc98ae2183731b5ae40 P 549b31ac31b6428994b45938abc223a7 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.763937 20382 tablet_replica.cc:333] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.764746 20382 raft_consensus.cc:2243] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.765904 20382 raft_consensus.cc:2272] T 12f1cc6194a54e7d8fb8d72776638772 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.768682 20382 tablet_replica.cc:333] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.769390 20382 raft_consensus.cc:2243] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.769981 20382 raft_consensus.cc:2272] T ca05d89c0a6b4f8ca791df1da0bad1f1 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.772658 20382 tablet_replica.cc:333] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.773368 20382 raft_consensus.cc:2243] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.774421 20382 raft_consensus.cc:2272] T bbb07a26963247f383d1e9c7990b92ac P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.777056 20382 tablet_replica.cc:333] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.777778 20382 raft_consensus.cc:2243] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.778905 20382 raft_consensus.cc:2272] T 6397e2c83e814a908887a9e44184de0a P 549b31ac31b6428994b45938abc223a7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.781450 20382 tablet_replica.cc:333] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.782213 20382 raft_consensus.cc:2243] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.783353 20382 raft_consensus.cc:2272] T cc9f5258ae3f4790a9bc1813d73ec987 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.786332 20382 tablet_replica.cc:333] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.787129 20382 raft_consensus.cc:2243] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.787869 20382 raft_consensus.cc:2272] T c7bfc9f63b5d484f83f58360423d19e3 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.790427 20382 tablet_replica.cc:333] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.791213 20382 raft_consensus.cc:2243] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.792306 20382 raft_consensus.cc:2272] T 68080652a5d4450691efb2d8b5c1b187 P 549b31ac31b6428994b45938abc223a7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.794850 20382 tablet_replica.cc:333] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.795564 20382 raft_consensus.cc:2243] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.796173 20382 raft_consensus.cc:2272] T 67538f399a3e491e97d3a4c5585bf44a P 549b31ac31b6428994b45938abc223a7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.798710 20382 tablet_replica.cc:333] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.799458 20382 raft_consensus.cc:2243] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.800197 20382 raft_consensus.cc:2272] T cae2bb9c133344078cc4f963e7188776 P 549b31ac31b6428994b45938abc223a7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.802719 20382 tablet_replica.cc:333] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.803474 20382 raft_consensus.cc:2243] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.804562 20382 raft_consensus.cc:2272] T e214d67cdc8f4690b393c47800e8e3e6 P 549b31ac31b6428994b45938abc223a7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.807126 20382 tablet_replica.cc:333] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.807863 20382 raft_consensus.cc:2243] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.808450 20382 raft_consensus.cc:2272] T 7d086ed254594401ae567a7d3681c987 P 549b31ac31b6428994b45938abc223a7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.811033 20382 tablet_replica.cc:333] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.811765 20382 raft_consensus.cc:2243] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.812511 20382 raft_consensus.cc:2272] T 5b18ad2e6f014e20be78478bc402f892 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.815270 20382 tablet_replica.cc:333] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.815968 20382 raft_consensus.cc:2243] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.816468 20382 raft_consensus.cc:2272] T 24789f7f25d44609b76928ec55894739 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.819067 20382 tablet_replica.cc:333] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.819782 20382 raft_consensus.cc:2243] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.820899 20382 raft_consensus.cc:2272] T 18db3d7d8520484b9eb6da32f2bc86ed P 549b31ac31b6428994b45938abc223a7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.823496 20382 tablet_replica.cc:333] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.824237 20382 raft_consensus.cc:2243] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.825335 20382 raft_consensus.cc:2272] T 7f7e8b71ee674ed4b42ef0ba024cf600 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.828044 20382 tablet_replica.cc:333] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.828763 20382 raft_consensus.cc:2243] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.829396 20382 raft_consensus.cc:2272] T b14a1dff9e774b09a93b9bf00960df20 P 549b31ac31b6428994b45938abc223a7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.832231 20382 tablet_replica.cc:333] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.832914 20382 raft_consensus.cc:2243] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.833560 20382 raft_consensus.cc:2272] T 3d0b012cfcad4a71a65a1e83d453cfca P 549b31ac31b6428994b45938abc223a7 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.836128 20382 tablet_replica.cc:333] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.836782 20382 raft_consensus.cc:2243] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.837491 20382 raft_consensus.cc:2272] T 1f372659e8e14c5d86dae03fcd58b963 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.839913 20382 tablet_replica.cc:333] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.840536 20382 raft_consensus.cc:2243] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.841503 20382 raft_consensus.cc:2272] T ac0b1311ffdd4c1293236cad678687e7 P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.844043 20382 tablet_replica.cc:333] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.844709 20382 raft_consensus.cc:2243] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.845788 20382 raft_consensus.cc:2272] T bd6859210b204263aedc975d7586330c P 549b31ac31b6428994b45938abc223a7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.848337 20382 tablet_replica.cc:333] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.848994 20382 raft_consensus.cc:2243] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.850026 20382 raft_consensus.cc:2272] T 6fad88e2e67d44f7adb559c0a8eb0af8 P 549b31ac31b6428994b45938abc223a7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.853120 20382 tablet_replica.cc:333] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.853796 20382 raft_consensus.cc:2243] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.854983 20382 raft_consensus.cc:2272] T 06b5fb42c147456889a1843340b22720 P 549b31ac31b6428994b45938abc223a7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.857769 20382 tablet_replica.cc:333] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7: stopping tablet replica
I20260709 13:10:23.858392 20382 raft_consensus.cc:2243] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.859495 20382 raft_consensus.cc:2272] T b773b0d389ce4ab991f6892abb4882e7 P 549b31ac31b6428994b45938abc223a7 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:23.882333 22274 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3d20 after lost signal to thread 20385
W20260709 13:10:23.883322 22274 debug-util.cc:398] Leaking SignalData structure 0x7b08003804c0 after lost signal to thread 21426
W20260709 13:10:23.884531 22274 debug-util.cc:398] Leaking SignalData structure 0x7b0800364d40 after lost signal to thread 22277
I20260709 13:10:24.766251 20382 tablet_server.cc:196] TabletServer@127.19.231.132:0 shutdown complete.
I20260709 13:10:24.835510 20382 master.cc:562] Master@127.19.231.190:34603 shutting down...
W20260709 13:10:24.877404 21440 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:10:24.877718 21440 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:10:24.877944 21440 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:10:26.959859 21378 catalog_manager.cc:4755] TS 5727b19579474da6a12f79730b924770 (127.19.231.130:41371): ChangeConfig:REMOVE_PEER RPC failed for tablet d46f34ab738d4d38b09f9d1228d68c7d: Network error: Client connection negotiation failed: client connection to 127.19.231.130:41371: connect: Connection refused (error 111)
W20260709 13:10:32.644845 21376 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260709 13:10:32.648573 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6fad88e2e67d44f7adb559c0a8eb0af8: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:39.408875 21376 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
W20260709 13:10:39.412499 21376 catalog_manager.cc:4755] TS 5a34fd3290de493eb6bbe828dd742772 (127.19.231.129:46061): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 470cdc8938f2464c96c100ae314a56b7: Network error: Client connection negotiation failed: client connection to 127.19.231.129:46061: connect: Connection refused (error 111)
I20260709 13:10:41.888446 20382 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:41.889559 20382 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:41.889977 20382 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8a31697310664f6da99c69fbc04b3926: stopping tablet replica
I20260709 13:10:42.136757 20382 master.cc:584] Master@127.19.231.190:34603 shutdown complete.
I20260709 13:10:42.186691 20382 test_util.cc:182] -----------------------------------------------
I20260709 13:10:42.186990 20382 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337466250-20382-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (281287 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:10:42.190448 20382 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.231.190:46409
I20260709 13:10:42.191594 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:42.197448 30380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.197517 30379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.198832 30382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.200075 20382 server_base.cc:1061] running on GCE node
I20260709 13:10:42.203245 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:42.203488 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:42.203662 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602642203641 us; error 0 us; skew 500 ppm
I20260709 13:10:42.204200 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:42.206720 20382 webserver.cc:533] Webserver started at http://127.19.231.190:42949/ using document root <none> and password file <none>
I20260709 13:10:42.207300 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:42.207515 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:42.207803 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:42.209107 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/master-0-root/instance:
uuid: "9dab7df47a0245579717f453d37de123"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:10:42.213804 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:42.217285 30387 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.218004 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:42.218326 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/master-0-root
uuid: "9dab7df47a0245579717f453d37de123"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:10:42.218608 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:42.234530 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:42.235801 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:42.276094 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.190:46409
I20260709 13:10:42.276219 30438 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.190:46409 every 8 connection(s)
I20260709 13:10:42.280471 30439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:42.292254 30439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123: Bootstrap starting.
I20260709 13:10:42.297309 30439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.301716 30439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123: No bootstrap required, opened a new log
I20260709 13:10:42.303992 30439 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dab7df47a0245579717f453d37de123" member_type: VOTER }
I20260709 13:10:42.304426 30439 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.304603 30439 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dab7df47a0245579717f453d37de123, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.305202 30439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dab7df47a0245579717f453d37de123" member_type: VOTER }
I20260709 13:10:42.305655 30439 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:42.305866 30439 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:42.306083 30439 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.310598 30439 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dab7df47a0245579717f453d37de123" member_type: VOTER }
I20260709 13:10:42.311106 30439 leader_election.cc:304] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9dab7df47a0245579717f453d37de123; no voters: 
I20260709 13:10:42.312220 30439 leader_election.cc:290] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:42.312649 30442 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.314005 30442 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 1 LEADER]: Becoming Leader. State: Replica: 9dab7df47a0245579717f453d37de123, State: Running, Role: LEADER
I20260709 13:10:42.314723 30442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dab7df47a0245579717f453d37de123" member_type: VOTER }
I20260709 13:10:42.315318 30439 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:42.322011 30444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9dab7df47a0245579717f453d37de123. Latest consensus state: current_term: 1 leader_uuid: "9dab7df47a0245579717f453d37de123" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dab7df47a0245579717f453d37de123" member_type: VOTER } }
I20260709 13:10:42.322053 30443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9dab7df47a0245579717f453d37de123" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dab7df47a0245579717f453d37de123" member_type: VOTER } }
I20260709 13:10:42.322836 30444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:42.322971 30443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:42.325204 30452 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:42.333184 30452 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:42.334187 20382 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:42.343019 30452 catalog_manager.cc:1383] Generated new cluster ID: 7d0dc91ffe724b218a88e32030db9b39
I20260709 13:10:42.343329 30452 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:42.386562 30452 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:42.388015 30452 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:42.402073 30452 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123: Generated new TSK 0
I20260709 13:10:42.402740 30452 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:42.465286 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:42.472075 30460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.473490 30461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.480919 30463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.481370 20382 server_base.cc:1061] running on GCE node
I20260709 13:10:42.483865 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:42.484128 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:42.484288 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602642484274 us; error 0 us; skew 500 ppm
I20260709 13:10:42.484918 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:42.487453 20382 webserver.cc:533] Webserver started at http://127.19.231.129:35737/ using document root <none> and password file <none>
I20260709 13:10:42.487947 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:42.488114 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:42.488435 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:42.489672 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/instance:
uuid: "5eebf0fa5aba46afa04623642d7795e6"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:10:42.494488 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:42.498062 30468 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.498904 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:42.499562 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-0-root
uuid: "5eebf0fa5aba46afa04623642d7795e6"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:10:42.499830 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:42.512502 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:42.513775 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:42.515375 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:42.517906 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:42.518139 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.518410 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:42.518613 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.560813 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.129:44027
I20260709 13:10:42.560913 30530 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.129:44027 every 8 connection(s)
I20260709 13:10:42.566485 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:42.574086 30535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.576031 30536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.577390 30538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.578511 20382 server_base.cc:1061] running on GCE node
I20260709 13:10:42.580941 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:42.581141 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:42.581333 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602642581309 us; error 0 us; skew 500 ppm
I20260709 13:10:42.582119 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:42.585294 20382 webserver.cc:533] Webserver started at http://127.19.231.130:46877/ using document root <none> and password file <none>
I20260709 13:10:42.585837 30531 heartbeater.cc:344] Connected to a master server at 127.19.231.190:46409
I20260709 13:10:42.585868 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:42.586344 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:42.586352 30531 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:42.586699 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:42.587381 30531 heartbeater.cc:507] Master 127.19.231.190:46409 requested a full tablet report, sending...
I20260709 13:10:42.588198 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/instance:
uuid: "fe9b995b077d4cb795f08934ed7d9088"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:10:42.589605 30404 ts_manager.cc:194] Registered new tserver with Master: 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:42.591552 30404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42132
I20260709 13:10:42.593412 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:10:42.597123 30543 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.597911 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:42.598237 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-1-root
uuid: "fe9b995b077d4cb795f08934ed7d9088"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:10:42.598541 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:42.617400 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:42.618691 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:42.620262 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:42.622630 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:42.622888 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:10:42.623128 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:42.623314 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.665046 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.130:37481
I20260709 13:10:42.665169 30605 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.130:37481 every 8 connection(s)
I20260709 13:10:42.670240 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:42.677376 30609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.678711 30610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.680169 20382 server_base.cc:1061] running on GCE node
W20260709 13:10:42.679852 30612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.681471 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:42.681704 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:42.681910 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602642681891 us; error 0 us; skew 500 ppm
I20260709 13:10:42.682642 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:42.684192 30606 heartbeater.cc:344] Connected to a master server at 127.19.231.190:46409
I20260709 13:10:42.684576 30606 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:42.685452 20382 webserver.cc:533] Webserver started at http://127.19.231.131:37519/ using document root <none> and password file <none>
I20260709 13:10:42.685496 30606 heartbeater.cc:507] Master 127.19.231.190:46409 requested a full tablet report, sending...
I20260709 13:10:42.686129 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:42.686365 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:42.686658 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:42.687861 30404 ts_manager.cc:194] Registered new tserver with Master: fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:42.687948 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/instance:
uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:10:42.689412 30404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42146
I20260709 13:10:42.692989 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:42.696738 30617 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.697577 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:42.697909 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-2-root
uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:10:42.698230 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:42.723021 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:42.724334 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:42.725736 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:42.728008 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:42.728240 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.728493 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:42.728669 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.772184 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.131:34377
I20260709 13:10:42.772301 30679 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.131:34377 every 8 connection(s)
I20260709 13:10:42.777580 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:42.785665 30683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.787377 30684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.789347 30687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.789772 20382 server_base.cc:1061] running on GCE node
I20260709 13:10:42.790357 30680 heartbeater.cc:344] Connected to a master server at 127.19.231.190:46409
I20260709 13:10:42.790827 30680 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:42.790921 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:42.791261 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:42.791446 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602642791430 us; error 0 us; skew 500 ppm
I20260709 13:10:42.791759 30680 heartbeater.cc:507] Master 127.19.231.190:46409 requested a full tablet report, sending...
I20260709 13:10:42.792121 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:42.794350 30404 ts_manager.cc:194] Registered new tserver with Master: e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:42.795004 20382 webserver.cc:533] Webserver started at http://127.19.231.132:33545/ using document root <none> and password file <none>
I20260709 13:10:42.795550 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:42.795763 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:42.796034 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:42.796034 30404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42156
I20260709 13:10:42.797777 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-3-root/instance:
uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:10:42.802933 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:10:42.806335 30691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.807273 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:42.807605 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-3-root
uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:10:42.807870 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:42.870728 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:42.871982 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:42.873270 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:42.875483 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:42.875730 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.876014 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:42.876179 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.918427 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.132:38089
I20260709 13:10:42.918522 30753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.132:38089 every 8 connection(s)
I20260709 13:10:42.932860 30754 heartbeater.cc:344] Connected to a master server at 127.19.231.190:46409
I20260709 13:10:42.933296 30754 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:42.934113 30754 heartbeater.cc:507] Master 127.19.231.190:46409 requested a full tablet report, sending...
I20260709 13:10:42.936161 30404 ts_manager.cc:194] Registered new tserver with Master: ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:42.936606 20382 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014765084s
I20260709 13:10:42.937585 30404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42172
I20260709 13:10:42.965453 30404 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42188:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:10:43.207237 30496 tablet_service.cc:1511] Processing CreateTablet for tablet ec3860c6607e4192b0fa932efa48a730 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:43.208848 30496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3860c6607e4192b0fa932efa48a730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.210562 30495 tablet_service.cc:1511] Processing CreateTablet for tablet 8a3a53f4eac747b2b57fe6b5c5516cee (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:43.210980 30718 tablet_service.cc:1511] Processing CreateTablet for tablet df38dc922fb445c48c8c877918cea7db (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:43.212159 30495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3a53f4eac747b2b57fe6b5c5516cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.212520 30718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df38dc922fb445c48c8c877918cea7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.212271 30719 tablet_service.cc:1511] Processing CreateTablet for tablet ec3860c6607e4192b0fa932efa48a730 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:43.213660 30719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3860c6607e4192b0fa932efa48a730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.214825 30716 tablet_service.cc:1511] Processing CreateTablet for tablet ba73d0b006bc437393ba09c76a909614 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:43.216336 30716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba73d0b006bc437393ba09c76a909614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.216004 30494 tablet_service.cc:1511] Processing CreateTablet for tablet df38dc922fb445c48c8c877918cea7db (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:43.217455 30494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df38dc922fb445c48c8c877918cea7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.210974 30717 tablet_service.cc:1511] Processing CreateTablet for tablet fac028c5a7bd40c28ecec9a4bd1e83f0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:43.218868 30717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac028c5a7bd40c28ecec9a4bd1e83f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.221230 30493 tablet_service.cc:1511] Processing CreateTablet for tablet 31877ad6fd384cf68ca3b0a20380b50f (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:43.224043 30492 tablet_service.cc:1511] Processing CreateTablet for tablet ba73d0b006bc437393ba09c76a909614 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:43.224539 30715 tablet_service.cc:1511] Processing CreateTablet for tablet 87fb671441fb4addaa5108aea6093d4f (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:43.226123 30715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fb671441fb4addaa5108aea6093d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.227108 30491 tablet_service.cc:1511] Processing CreateTablet for tablet 87fb671441fb4addaa5108aea6093d4f (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:43.222720 30493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31877ad6fd384cf68ca3b0a20380b50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.230240 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba73d0b006bc437393ba09c76a909614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.234488 30714 tablet_service.cc:1511] Processing CreateTablet for tablet fe5c236d415d4a2ba5cab92446b2cc9e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:43.235275 30491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fb671441fb4addaa5108aea6093d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.236183 30714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5c236d415d4a2ba5cab92446b2cc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.240651 30490 tablet_service.cc:1511] Processing CreateTablet for tablet c8653cfe6a71495f8708ab4726905d40 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:43.241603 30713 tablet_service.cc:1511] Processing CreateTablet for tablet 73ee8459c7f745eb8bb1fb0d6ea88f2a (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:43.242190 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8653cfe6a71495f8708ab4726905d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.243094 30713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ee8459c7f745eb8bb1fb0d6ea88f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.245271 30489 tablet_service.cc:1511] Processing CreateTablet for tablet 73ee8459c7f745eb8bb1fb0d6ea88f2a (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:43.246672 30489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ee8459c7f745eb8bb1fb0d6ea88f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.248044 30712 tablet_service.cc:1511] Processing CreateTablet for tablet 23f015cc36aa4db08cb18e49721204ad (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:43.249500 30712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f015cc36aa4db08cb18e49721204ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.255637 30711 tablet_service.cc:1511] Processing CreateTablet for tablet e0c896f7c3954b098ac0769a5ce664a1 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:43.257293 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c896f7c3954b098ac0769a5ce664a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.257537 30488 tablet_service.cc:1511] Processing CreateTablet for tablet 23f015cc36aa4db08cb18e49721204ad (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:43.259217 30488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f015cc36aa4db08cb18e49721204ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.274401 30487 tablet_service.cc:1511] Processing CreateTablet for tablet 497e9f19c992474c92f71cf517d1adfb (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:43.276104 30487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497e9f19c992474c92f71cf517d1adfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.279073 30710 tablet_service.cc:1511] Processing CreateTablet for tablet 17ca8d69123d49ada168ec5581c199d4 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:43.280671 30710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ca8d69123d49ada168ec5581c199d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:43.328330 30451 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:43.335283 30773 tablet_bootstrap.cc:492] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:43.334827 30488 tablet_service.cc:1511] Processing CreateTablet for tablet 17ca8d69123d49ada168ec5581c199d4 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:43.342885 30565 tablet_service.cc:1511] Processing CreateTablet for tablet c8653cfe6a71495f8708ab4726905d40 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:43.355635 30488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ca8d69123d49ada168ec5581c199d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.356201 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8653cfe6a71495f8708ab4726905d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.342857 30569 tablet_service.cc:1511] Processing CreateTablet for tablet fac028c5a7bd40c28ecec9a4bd1e83f0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:43.344133 30570 tablet_service.cc:1511] Processing CreateTablet for tablet df38dc922fb445c48c8c877918cea7db (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:43.344551 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 73ee8459c7f745eb8bb1fb0d6ea88f2a (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:43.344756 30568 tablet_service.cc:1511] Processing CreateTablet for tablet 31877ad6fd384cf68ca3b0a20380b50f (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:43.346576 30567 tablet_service.cc:1511] Processing CreateTablet for tablet ba73d0b006bc437393ba09c76a909614 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:43.348420 30563 tablet_service.cc:1511] Processing CreateTablet for tablet e0c896f7c3954b098ac0769a5ce664a1 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:43.350441 30562 tablet_service.cc:1511] Processing CreateTablet for tablet 497e9f19c992474c92f71cf517d1adfb (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:43.353468 30566 tablet_service.cc:1511] Processing CreateTablet for tablet fe5c236d415d4a2ba5cab92446b2cc9e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:43.342878 30571 tablet_service.cc:1511] Processing CreateTablet for tablet 8a3a53f4eac747b2b57fe6b5c5516cee (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:43.366451 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac028c5a7bd40c28ecec9a4bd1e83f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.367158 30571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3a53f4eac747b2b57fe6b5c5516cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.367846 30566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5c236d415d4a2ba5cab92446b2cc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.368520 30568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31877ad6fd384cf68ca3b0a20380b50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.370103 30562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497e9f19c992474c92f71cf517d1adfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.371169 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ee8459c7f745eb8bb1fb0d6ea88f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.373528 30567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba73d0b006bc437393ba09c76a909614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.375250 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df38dc922fb445c48c8c877918cea7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.375946 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c896f7c3954b098ac0769a5ce664a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.379768 30774 tablet_bootstrap.cc:492] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:43.408634 30563 tablet_service.cc:1511] Processing CreateTablet for tablet 17ca8d69123d49ada168ec5581c199d4 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:43.419390 30492 tablet_service.cc:1511] Processing CreateTablet for tablet a1acee1ab5494c3a87ba7e6a84ef73cf (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:43.420953 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1acee1ab5494c3a87ba7e6a84ef73cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.423231 30773 tablet_bootstrap.cc:654] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.433759 30644 tablet_service.cc:1511] Processing CreateTablet for tablet 8a3a53f4eac747b2b57fe6b5c5516cee (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:43.435285 30711 tablet_service.cc:1511] Processing CreateTablet for tablet a1acee1ab5494c3a87ba7e6a84ef73cf (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:43.436105 30643 tablet_service.cc:1511] Processing CreateTablet for tablet fac028c5a7bd40c28ecec9a4bd1e83f0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:43.438290 30645 tablet_service.cc:1511] Processing CreateTablet for tablet ec3860c6607e4192b0fa932efa48a730 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:43.447463 30642 tablet_service.cc:1511] Processing CreateTablet for tablet 31877ad6fd384cf68ca3b0a20380b50f (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:43.448308 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ca8d69123d49ada168ec5581c199d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.449165 30718 tablet_service.cc:1511] Processing CreateTablet for tablet 4a479c021bcf40f087e21cf6099daeb0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:43.450227 30641 tablet_service.cc:1511] Processing CreateTablet for tablet 87fb671441fb4addaa5108aea6093d4f (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:43.452984 30774 tablet_bootstrap.cc:654] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.453061 30640 tablet_service.cc:1511] Processing CreateTablet for tablet fe5c236d415d4a2ba5cab92446b2cc9e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:43.454085 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1acee1ab5494c3a87ba7e6a84ef73cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.459791 30639 tablet_service.cc:1511] Processing CreateTablet for tablet c8653cfe6a71495f8708ab4726905d40 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:43.465144 30638 tablet_service.cc:1511] Processing CreateTablet for tablet 23f015cc36aa4db08cb18e49721204ad (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:43.471680 30641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fb671441fb4addaa5108aea6093d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.472785 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5c236d415d4a2ba5cab92446b2cc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.475306 30638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f015cc36aa4db08cb18e49721204ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.480585 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8653cfe6a71495f8708ab4726905d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.481668 30718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a479c021bcf40f087e21cf6099daeb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.483033 30643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac028c5a7bd40c28ecec9a4bd1e83f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.486449 30637 tablet_service.cc:1511] Processing CreateTablet for tablet e0c896f7c3954b098ac0769a5ce664a1 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:43.488570 30636 tablet_service.cc:1511] Processing CreateTablet for tablet 497e9f19c992474c92f71cf517d1adfb (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:43.486493 30644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3a53f4eac747b2b57fe6b5c5516cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.491127 30645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3860c6607e4192b0fa932efa48a730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.494714 30637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c896f7c3954b098ac0769a5ce664a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.495519 30642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31877ad6fd384cf68ca3b0a20380b50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.499256 30636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497e9f19c992474c92f71cf517d1adfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.512181 30496 tablet_service.cc:1511] Processing CreateTablet for tablet 04593214c5bf43b6b52bc5d7b4d27ee1 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:43.514230 30496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04593214c5bf43b6b52bc5d7b4d27ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.535905 30567 tablet_service.cc:1511] Processing CreateTablet for tablet 04593214c5bf43b6b52bc5d7b4d27ee1 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:43.536777 30719 tablet_service.cc:1511] Processing CreateTablet for tablet efe10cb5a2eb471f86bec2723e5dbe97 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:43.538939 30719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe10cb5a2eb471f86bec2723e5dbe97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.537485 30567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04593214c5bf43b6b52bc5d7b4d27ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.554068 30494 tablet_service.cc:1511] Processing CreateTablet for tablet efe10cb5a2eb471f86bec2723e5dbe97 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:43.555567 30494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe10cb5a2eb471f86bec2723e5dbe97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.562801 30563 tablet_service.cc:1511] Processing CreateTablet for tablet efe10cb5a2eb471f86bec2723e5dbe97 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:43.571167 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe10cb5a2eb471f86bec2723e5dbe97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.509152 30566 tablet_service.cc:1511] Processing CreateTablet for tablet 4a479c021bcf40f087e21cf6099daeb0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:43.578238 30710 tablet_service.cc:1511] Processing CreateTablet for tablet 018c73c344ee48698633b2153ac2bce0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:43.579599 30566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a479c021bcf40f087e21cf6099daeb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.580160 30710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018c73c344ee48698633b2153ac2bce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.579986 30490 tablet_service.cc:1511] Processing CreateTablet for tablet 018c73c344ee48698633b2153ac2bce0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:43.581293 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018c73c344ee48698633b2153ac2bce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.583437 30775 tablet_bootstrap.cc:492] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:43.589582 30773 tablet_bootstrap.cc:492] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:43.591218 30773 ts_tablet_manager.cc:1403] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.256s	user 0.037s	sys 0.029s
I20260709 13:10:43.594492 30531 heartbeater.cc:499] Master 127.19.231.190:46409 was elected leader, sending a full tablet report...
I20260709 13:10:43.594306 30773 raft_consensus.cc:359] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:43.595120 30773 raft_consensus.cc:385] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.595448 30773 raft_consensus.cc:740] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.596374 30773 consensus_queue.cc:260] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:43.604887 30562 tablet_service.cc:1511] Processing CreateTablet for tablet 65bf3caefe70453bbed914700540bef7 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:43.609513 30712 tablet_service.cc:1511] Processing CreateTablet for tablet 65bf3caefe70453bbed914700540bef7 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:43.612766 30712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bf3caefe70453bbed914700540bef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.613057 30774 tablet_bootstrap.cc:492] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:43.613571 30774 ts_tablet_manager.cc:1403] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.234s	user 0.028s	sys 0.060s
I20260709 13:10:43.623345 30562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bf3caefe70453bbed914700540bef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.636976 30775 tablet_bootstrap.cc:654] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.641942 30640 tablet_service.cc:1511] Processing CreateTablet for tablet 4a479c021bcf40f087e21cf6099daeb0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:43.620016 30643 tablet_service.cc:1511] Processing CreateTablet for tablet a1acee1ab5494c3a87ba7e6a84ef73cf (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:43.656260 30774 raft_consensus.cc:359] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:43.657168 30774 raft_consensus.cc:385] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.658941 30643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1acee1ab5494c3a87ba7e6a84ef73cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.666960 30641 tablet_service.cc:1511] Processing CreateTablet for tablet 04593214c5bf43b6b52bc5d7b4d27ee1 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:43.668046 30636 tablet_service.cc:1511] Processing CreateTablet for tablet 018c73c344ee48698633b2153ac2bce0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:43.678022 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a479c021bcf40f087e21cf6099daeb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.683889 30778 tablet_bootstrap.cc:492] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:43.663219 30774 raft_consensus.cc:740] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.692230 30606 heartbeater.cc:499] Master 127.19.231.190:46409 was elected leader, sending a full tablet report...
I20260709 13:10:43.696633 30773 ts_tablet_manager.cc:1434] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.105s	user 0.020s	sys 0.022s
I20260709 13:10:43.699712 30773 tablet_bootstrap.cc:492] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:43.705085 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 84da8a48a44e4cbcb497791695726487 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:43.705703 30637 tablet_service.cc:1511] Processing CreateTablet for tablet 65bf3caefe70453bbed914700540bef7 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:43.706602 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84da8a48a44e4cbcb497791695726487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.706933 30773 tablet_bootstrap.cc:654] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.707654 30488 tablet_service.cc:1511] Processing CreateTablet for tablet 84da8a48a44e4cbcb497791695726487 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:43.711252 30775 tablet_bootstrap.cc:492] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:43.711529 30488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84da8a48a44e4cbcb497791695726487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.711824 30775 ts_tablet_manager.cc:1403] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.129s	user 0.012s	sys 0.017s
I20260709 13:10:43.715552 30774 consensus_queue.cc:260] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:43.733798 30645 tablet_service.cc:1511] Processing CreateTablet for tablet 84da8a48a44e4cbcb497791695726487 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:43.737502 30778 tablet_bootstrap.cc:654] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.735893 30775 raft_consensus.cc:359] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:43.748133 30718 tablet_service.cc:1511] Processing CreateTablet for tablet 155c2eeaa7cc439c8c8e42ec57accfd3 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:43.751983 30775 raft_consensus.cc:385] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.753225 30775 raft_consensus.cc:740] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.752712 30718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155c2eeaa7cc439c8c8e42ec57accfd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.740165 30641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04593214c5bf43b6b52bc5d7b4d27ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.757232 30636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018c73c344ee48698633b2153ac2bce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.758065 30645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84da8a48a44e4cbcb497791695726487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.757956 30496 tablet_service.cc:1511] Processing CreateTablet for tablet 155c2eeaa7cc439c8c8e42ec57accfd3 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:43.759414 30496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155c2eeaa7cc439c8c8e42ec57accfd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.768018 30775 consensus_queue.cc:260] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:43.772820 30774 ts_tablet_manager.cc:1434] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.159s	user 0.015s	sys 0.002s
I20260709 13:10:43.783919 30754 heartbeater.cc:499] Master 127.19.231.190:46409 was elected leader, sending a full tablet report...
I20260709 13:10:43.782549 30567 tablet_service.cc:1511] Processing CreateTablet for tablet 155c2eeaa7cc439c8c8e42ec57accfd3 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:43.787434 30567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155c2eeaa7cc439c8c8e42ec57accfd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.787886 30639 tablet_service.cc:1511] Processing CreateTablet for tablet 684ac54b92e440b48092a7e38bd73e59 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:43.789778 30710 tablet_service.cc:1511] Processing CreateTablet for tablet 684ac54b92e440b48092a7e38bd73e59 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:43.791185 30710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684ac54b92e440b48092a7e38bd73e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.796749 30774 tablet_bootstrap.cc:492] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:43.799043 30680 heartbeater.cc:499] Master 127.19.231.190:46409 was elected leader, sending a full tablet report...
I20260709 13:10:43.799427 30565 tablet_service.cc:1511] Processing CreateTablet for tablet d758ec9801614080a6a30dd820a62459 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:43.800016 30490 tablet_service.cc:1511] Processing CreateTablet for tablet 684ac54b92e440b48092a7e38bd73e59 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:43.800827 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d758ec9801614080a6a30dd820a62459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.801352 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684ac54b92e440b48092a7e38bd73e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.805480 30773 tablet_bootstrap.cc:492] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:43.806209 30773 ts_tablet_manager.cc:1403] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.107s	user 0.033s	sys 0.024s
I20260709 13:10:43.794708 30637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bf3caefe70453bbed914700540bef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.811270 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684ac54b92e440b48092a7e38bd73e59. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:43.816134 30532 tablet.cc:2406] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:43.816723 30778 tablet_bootstrap.cc:492] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:43.817396 30778 ts_tablet_manager.cc:1403] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.000s
I20260709 13:10:43.819403 30773 raft_consensus.cc:359] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:43.820609 30773 raft_consensus.cc:385] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.820945 30773 raft_consensus.cc:740] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.837703 30775 ts_tablet_manager.cc:1434] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.125s	user 0.011s	sys 0.003s
I20260709 13:10:43.838871 30775 tablet_bootstrap.cc:492] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:43.842396 30773 consensus_queue.cc:260] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:43.845052 30640 tablet_service.cc:1511] Processing CreateTablet for tablet d758ec9801614080a6a30dd820a62459 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:43.846460 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d758ec9801614080a6a30dd820a62459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.852826 30773 ts_tablet_manager.cc:1434] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:10:43.858191 30775 tablet_bootstrap.cc:654] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.865315 30774 tablet_bootstrap.cc:654] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.866281 30496 tablet_service.cc:1511] Processing CreateTablet for tablet a90a5be13c8840bd8045433a356f8210 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:43.867973 30496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90a5be13c8840bd8045433a356f8210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.834900 30778 raft_consensus.cc:359] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:43.870200 30778 raft_consensus.cc:385] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.870935 30778 raft_consensus.cc:740] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.871016 30782 raft_consensus.cc:493] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.879323 30782 raft_consensus.cc:515] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:43.880784 30564 tablet_service.cc:1511] Processing CreateTablet for tablet a90a5be13c8840bd8045433a356f8210 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:43.879545 30778 consensus_queue.cc:260] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:43.876088 30718 tablet_service.cc:1511] Processing CreateTablet for tablet d758ec9801614080a6a30dd820a62459 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:43.882365 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90a5be13c8840bd8045433a356f8210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.896659 30718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d758ec9801614080a6a30dd820a62459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.883683 30779 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.884562 30782 leader_election.cc:290] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:43.900067 30779 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:43.901142 30778 ts_tablet_manager.cc:1434] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.083s	user 0.004s	sys 0.010s
I20260709 13:10:43.902832 30778 tablet_bootstrap.cc:492] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:43.907452 30490 tablet_service.cc:1511] Processing CreateTablet for tablet eacc589c8fd4465d9a8549c531711c32 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:43.908145 30719 tablet_service.cc:1511] Processing CreateTablet for tablet eacc589c8fd4465d9a8549c531711c32 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:43.909770 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eacc589c8fd4465d9a8549c531711c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.909904 30719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eacc589c8fd4465d9a8549c531711c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.919082 30779 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:43.929054 30639 tablet_service.cc:1511] Processing CreateTablet for tablet a90a5be13c8840bd8045433a356f8210 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:43.871712 30773 tablet_bootstrap.cc:492] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:43.930701 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90a5be13c8840bd8045433a356f8210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.934686 30778 tablet_bootstrap.cc:654] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.957181 30565 tablet_service.cc:1511] Processing CreateTablet for tablet eacc589c8fd4465d9a8549c531711c32 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:43.958698 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eacc589c8fd4465d9a8549c531711c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.967473 30779 raft_consensus.cc:493] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.967878 30645 tablet_service.cc:1511] Processing CreateTablet for tablet ecb61d7cc4374a2ba332ae4af88d0f63 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:43.968116 30779 raft_consensus.cc:515] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:43.969298 30645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb61d7cc4374a2ba332ae4af88d0f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.971422 30779 leader_election.cc:290] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:43.980715 30778 tablet_bootstrap.cc:492] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:43.981410 30778 ts_tablet_manager.cc:1403] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.004s
I20260709 13:10:43.985224 30778 raft_consensus.cc:359] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:43.986369 30778 raft_consensus.cc:385] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.994933 30778 raft_consensus.cc:740] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.996611 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:43.997025 30789 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.003599 30778 consensus_queue.cc:260] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.004948 30789 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.005402 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:44.006554 30472 leader_election.cc:343] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.010355 30719 tablet_service.cc:1511] Processing CreateTablet for tablet ecb61d7cc4374a2ba332ae4af88d0f63 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:44.017257 30719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb61d7cc4374a2ba332ae4af88d0f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.018421 30789 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:10:44.020411 30472 leader_election.cc:343] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.034447 30490 tablet_service.cc:1511] Processing CreateTablet for tablet ecb61d7cc4374a2ba332ae4af88d0f63 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:44.036562 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb61d7cc4374a2ba332ae4af88d0f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.053970 30774 tablet_bootstrap.cc:492] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:44.054713 30774 ts_tablet_manager.cc:1403] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.258s	user 0.019s	sys 0.002s
I20260709 13:10:44.058367 30774 raft_consensus.cc:359] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:44.059249 30774 raft_consensus.cc:385] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.059664 30774 raft_consensus.cc:740] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.060495 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:44.069509 30567 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca31368027748349419b6fe09ea1375 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:44.072374 30567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca31368027748349419b6fe09ea1375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.081900 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:44.086297 30655 raft_consensus.cc:2468] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:44.060720 30774 consensus_queue.cc:260] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
W20260709 13:10:44.074863 30471 leader_election.cc:343] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.091711 30471 leader_election.cc:304] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:44.092983 30779 raft_consensus.cc:2749] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.093711 30471 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:44.094161 30774 ts_tablet_manager.cc:1434] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.004s
I20260709 13:10:44.094898 30779 raft_consensus.cc:2804] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.095386 30779 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.095732 30779 raft_consensus.cc:3060] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.096443 30710 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca31368027748349419b6fe09ea1375 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:44.097123 30640 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca31368027748349419b6fe09ea1375 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:44.097925 30710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca31368027748349419b6fe09ea1375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.099169 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca31368027748349419b6fe09ea1375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.103039 30782 raft_consensus.cc:493] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.103601 30782 raft_consensus.cc:515] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:44.104760 30779 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.106149 30782 leader_election.cc:290] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:44.107039 30779 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:44.108294 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:44.098155 30773 tablet_bootstrap.cc:654] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:44.109850 30472 leader_election.cc:343] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.117360 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:44.118038 30655 raft_consensus.cc:3060] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.121047 30565 tablet_service.cc:1511] Processing CreateTablet for tablet ed4a06fb8568471d8db2b93426f9d678 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:44.125100 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:44.127177 30621 leader_election.cc:343] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.127065 30645 tablet_service.cc:1511] Processing CreateTablet for tablet ed4a06fb8568471d8db2b93426f9d678 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:44.127228 30775 tablet_bootstrap.cc:492] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:44.128577 30645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4a06fb8568471d8db2b93426f9d678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.128919 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4a06fb8568471d8db2b93426f9d678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.128611 30775 ts_tablet_manager.cc:1403] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.290s	user 0.060s	sys 0.089s
I20260709 13:10:44.137899 30718 tablet_service.cc:1511] Processing CreateTablet for tablet 55d1b96e1d27444ebfb159aae9bbe85b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:44.142616 30784 raft_consensus.cc:493] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.147186 30784 raft_consensus.cc:515] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.150071 30784 leader_election.cc:290] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:44.144460 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c896f7c3954b098ac0769a5ce664a1" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:44.144984 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c896f7c3954b098ac0769a5ce664a1" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:44.145318 30775 raft_consensus.cc:359] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.146112 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:44.155339 30778 ts_tablet_manager.cc:1434] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.174s	user 0.022s	sys 0.022s
W20260709 13:10:44.157302 30694 leader_election.cc:343] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:44.159178 30694 leader_election.cc:343] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.159256 30778 tablet_bootstrap.cc:492] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:44.160059 30789 raft_consensus.cc:493] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.164340 30789 raft_consensus.cc:515] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.166436 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 55d1b96e1d27444ebfb159aae9bbe85b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:44.147702 30718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55d1b96e1d27444ebfb159aae9bbe85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.153069 30775 raft_consensus.cc:385] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.161751 30655 raft_consensus.cc:2468] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:44.168359 30774 tablet_bootstrap.cc:492] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:44.168408 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55d1b96e1d27444ebfb159aae9bbe85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.171042 30775 raft_consensus.cc:740] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.172284 30789 leader_election.cc:290] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:44.172677 30471 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:44.173466 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:44.179771 30779 raft_consensus.cc:2804] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:44.182652 30621 leader_election.cc:343] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.188887 30711 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9f8c7ed7744cb9b06471b91d2bec4a (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:44.190326 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9f8c7ed7744cb9b06471b91d2bec4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.189985 30563 tablet_service.cc:1511] Processing CreateTablet for tablet 27a322c98a8d493ab4377fe92a1c01db (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:44.193840 30774 tablet_bootstrap.cc:654] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.199144 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a322c98a8d493ab4377fe92a1c01db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.217872 30640 tablet_service.cc:1511] Processing CreateTablet for tablet c7e3aaad672f42e5838c628da427a0b7 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:44.201946 30641 tablet_service.cc:1511] Processing CreateTablet for tablet 27a322c98a8d493ab4377fe92a1c01db (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:44.204448 30496 tablet_service.cc:1511] Processing CreateTablet for tablet ed4a06fb8568471d8db2b93426f9d678 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:44.204834 30488 tablet_service.cc:1511] Processing CreateTablet for tablet 55d1b96e1d27444ebfb159aae9bbe85b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:44.220791 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e3aaad672f42e5838c628da427a0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.221014 30496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4a06fb8568471d8db2b93426f9d678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.221544 30641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a322c98a8d493ab4377fe92a1c01db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.223173 30488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55d1b96e1d27444ebfb159aae9bbe85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.178444 30639 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9f8c7ed7744cb9b06471b91d2bec4a (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:44.208035 30494 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9f8c7ed7744cb9b06471b91d2bec4a (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:44.229470 30494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9f8c7ed7744cb9b06471b91d2bec4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.206477 30712 tablet_service.cc:1511] Processing CreateTablet for tablet 27a322c98a8d493ab4377fe92a1c01db (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:44.231626 30712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a322c98a8d493ab4377fe92a1c01db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.236783 30719 tablet_service.cc:1511] Processing CreateTablet for tablet 71865a4b38b04d879e4188a8eebba7e7 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:44.238219 30719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71865a4b38b04d879e4188a8eebba7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.239446 30492 tablet_service.cc:1511] Processing CreateTablet for tablet 71865a4b38b04d879e4188a8eebba7e7 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:44.239811 30562 tablet_service.cc:1511] Processing CreateTablet for tablet 71865a4b38b04d879e4188a8eebba7e7 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:44.240875 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71865a4b38b04d879e4188a8eebba7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.241258 30562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71865a4b38b04d879e4188a8eebba7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.247586 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:44.228559 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9f8c7ed7744cb9b06471b91d2bec4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.259862 30643 tablet_service.cc:1511] Processing CreateTablet for tablet 059a9c51005141eb9c585ad91a67d779 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:44.260849 30773 tablet_bootstrap.cc:492] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:44.261386 30773 ts_tablet_manager.cc:1403] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.408s	user 0.011s	sys 0.015s
I20260709 13:10:44.266176 30715 tablet_service.cc:1511] Processing CreateTablet for tablet 059a9c51005141eb9c585ad91a67d779 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:44.267645 30715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059a9c51005141eb9c585ad91a67d779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.269860 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:44.270889 30779 raft_consensus.cc:697] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:44.271946 30779 consensus_queue.cc:237] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.272238 30570 tablet_service.cc:1511] Processing CreateTablet for tablet f8d68b0f1c1e48609d42244622ea1d7c (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:44.273583 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d68b0f1c1e48609d42244622ea1d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.198662 30775 consensus_queue.cc:260] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.212886 30566 tablet_service.cc:1511] Processing CreateTablet for tablet c7e3aaad672f42e5838c628da427a0b7 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:44.279313 30637 tablet_service.cc:1511] Processing CreateTablet for tablet f8d68b0f1c1e48609d42244622ea1d7c (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:10:44.280694 30693 leader_election.cc:343] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.281236 30693 leader_election.cc:304] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:44.282060 30782 raft_consensus.cc:2749] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.283351 30493 tablet_service.cc:1511] Processing CreateTablet for tablet 059a9c51005141eb9c585ad91a67d779 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:44.284734 30493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059a9c51005141eb9c585ad91a67d779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.286480 30714 tablet_service.cc:1511] Processing CreateTablet for tablet f8d68b0f1c1e48609d42244622ea1d7c (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:44.287889 30714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d68b0f1c1e48609d42244622ea1d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.293804 30773 raft_consensus.cc:359] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:44.297887 30566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e3aaad672f42e5838c628da427a0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.298420 30489 tablet_service.cc:1511] Processing CreateTablet for tablet 03df1e0d5cf741c0b915e09e00ebc9d3 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:44.261308 30643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059a9c51005141eb9c585ad91a67d779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.299836 30489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03df1e0d5cf741c0b915e09e00ebc9d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.302330 30637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d68b0f1c1e48609d42244622ea1d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.302253 30581 raft_consensus.cc:2468] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:44.303701 30775 ts_tablet_manager.cc:1434] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.172s	user 0.004s	sys 0.004s
I20260709 13:10:44.213712 30778 tablet_bootstrap.cc:654] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.213478 30490 tablet_service.cc:1511] Processing CreateTablet for tablet c7e3aaad672f42e5838c628da427a0b7 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:44.307775 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:44.308427 30580 raft_consensus.cc:2468] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:44.309964 30620 leader_election.cc:304] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:44.311357 30789 raft_consensus.cc:2804] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.311743 30789 raft_consensus.cc:493] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.312127 30789 raft_consensus.cc:3060] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.294622 30773 raft_consensus.cc:385] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.315105 30694 leader_election.cc:304] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:44.319752 30782 raft_consensus.cc:2804] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.308430 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e3aaad672f42e5838c628da427a0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.320135 30782 raft_consensus.cc:493] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.320595 30782 raft_consensus.cc:3060] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:44.330987 30451 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:44.333181 30782 raft_consensus.cc:515] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.334846 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:44.336365 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c896f7c3954b098ac0769a5ce664a1" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:44.337105 30580 raft_consensus.cc:3060] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:44.336440 30547 leader_election.cc:343] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.345474 30580 raft_consensus.cc:2468] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:44.346946 30694 leader_election.cc:304] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:44.347306 30775 tablet_bootstrap.cc:492] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:44.316727 30773 raft_consensus.cc:740] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.351112 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:44.351783 30773 consensus_queue.cc:260] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:44.357074 30789 raft_consensus.cc:515] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.358508 30655 raft_consensus.cc:2393] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 1: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:44.360589 30773 ts_tablet_manager.cc:1434] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.000s
I20260709 13:10:44.360833 30546 leader_election.cc:304] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:44.361794 30773 tablet_bootstrap.cc:492] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:44.361876 30784 raft_consensus.cc:3060] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.366444 30775 tablet_bootstrap.cc:654] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.366851 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:44.370769 30782 leader_election.cc:290] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:44.382650 30641 tablet_service.cc:1511] Processing CreateTablet for tablet 03df1e0d5cf741c0b915e09e00ebc9d3 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:44.384183 30641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03df1e0d5cf741c0b915e09e00ebc9d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.384965 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
W20260709 13:10:44.386631 30621 leader_election.cc:343] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.387868 30492 tablet_service.cc:1511] Processing CreateTablet for tablet 26ec91d866c84f30813b1d51ebf9a214 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:44.388666 30789 leader_election.cc:290] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:44.389261 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ec91d866c84f30813b1d51ebf9a214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.389963 30784 raft_consensus.cc:2749] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.390923 30567 tablet_service.cc:1511] Processing CreateTablet for tablet 03df1e0d5cf741c0b915e09e00ebc9d3 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:44.392285 30567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03df1e0d5cf741c0b915e09e00ebc9d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.396968 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 26ec91d866c84f30813b1d51ebf9a214 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:44.400854 30404 catalog_manager.cc:5697] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.403405 30619 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:44.398330 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ec91d866c84f30813b1d51ebf9a214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.414286 30789 raft_consensus.cc:2749] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.418659 30774 tablet_bootstrap.cc:492] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:44.418476 30640 tablet_service.cc:1511] Processing CreateTablet for tablet a8fb5e8eecef48b5831eb8cf4003e561 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:44.419395 30774 ts_tablet_manager.cc:1403] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.252s	user 0.014s	sys 0.003s
I20260709 13:10:44.420033 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fb5e8eecef48b5831eb8cf4003e561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.394578 30782 raft_consensus.cc:2804] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.431948 30711 tablet_service.cc:1511] Processing CreateTablet for tablet a8fb5e8eecef48b5831eb8cf4003e561 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:44.434396 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fb5e8eecef48b5831eb8cf4003e561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.436700 30712 tablet_service.cc:1511] Processing CreateTablet for tablet 26ec91d866c84f30813b1d51ebf9a214 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:44.439546 30493 tablet_service.cc:1511] Processing CreateTablet for tablet a8fb5e8eecef48b5831eb8cf4003e561 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:44.440749 30712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ec91d866c84f30813b1d51ebf9a214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.440876 30493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fb5e8eecef48b5831eb8cf4003e561. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:44.412963 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 47598.1us
I20260709 13:10:44.444801 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c896f7c3954b098ac0769a5ce664a1" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
W20260709 13:10:44.447664 30694 leader_election.cc:343] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.459642 30773 tablet_bootstrap.cc:654] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.462093 30565 tablet_service.cc:1511] Processing CreateTablet for tablet 9b693fc5a9c3477a87a09ce7d3c57859 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:44.463670 30774 raft_consensus.cc:359] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.464475 30774 raft_consensus.cc:385] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.464805 30774 raft_consensus.cc:740] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.465355 30637 tablet_service.cc:1511] Processing CreateTablet for tablet 9b693fc5a9c3477a87a09ce7d3c57859 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:44.465605 30774 consensus_queue.cc:260] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.423710 30782 raft_consensus.cc:697] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:44.464143 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b693fc5a9c3477a87a09ce7d3c57859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.470149 30580 raft_consensus.cc:2468] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:44.466774 30637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b693fc5a9c3477a87a09ce7d3c57859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.478704 30782 consensus_queue.cc:237] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.479182 30492 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9a111191e34c528c226549c74a4453 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:44.481509 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9a111191e34c528c226549c74a4453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.488859 30563 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9a111191e34c528c226549c74a4453 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:44.490326 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9a111191e34c528c226549c74a4453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.490643 30620 leader_election.cc:304] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:44.491609 30789 raft_consensus.cc:2804] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.492152 30789 raft_consensus.cc:697] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:44.492511 30778 tablet_bootstrap.cc:492] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:44.493038 30778 ts_tablet_manager.cc:1403] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.334s	user 0.008s	sys 0.006s
I20260709 13:10:44.492983 30789 consensus_queue.cc:237] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.508970 30643 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9a111191e34c528c226549c74a4453 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:44.510731 30643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9a111191e34c528c226549c74a4453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.512353 30719 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1b94fe3ebf42e090e8c6ef27e1c4df (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:44.513051 30775 tablet_bootstrap.cc:492] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:44.513602 30775 ts_tablet_manager.cc:1403] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.000s
I20260709 13:10:44.513751 30719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1b94fe3ebf42e090e8c6ef27e1c4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.516816 30775 raft_consensus.cc:359] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:44.517627 30775 raft_consensus.cc:385] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.527098 30775 raft_consensus.cc:740] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.532933 30711 tablet_service.cc:1511] Processing CreateTablet for tablet 9b693fc5a9c3477a87a09ce7d3c57859 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:44.533574 30775 consensus_queue.cc:260] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:44.534422 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b693fc5a9c3477a87a09ce7d3c57859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.539798 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1b94fe3ebf42e090e8c6ef27e1c4df (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:44.541280 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1b94fe3ebf42e090e8c6ef27e1c4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.514691 30778 raft_consensus.cc:359] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.543596 30778 raft_consensus.cc:385] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.543923 30778 raft_consensus.cc:740] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.544854 30778 consensus_queue.cc:260] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.545336 30490 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1b94fe3ebf42e090e8c6ef27e1c4df (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:44.546754 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1b94fe3ebf42e090e8c6ef27e1c4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.547698 30778 ts_tablet_manager.cc:1434] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:10:44.548894 30778 tablet_bootstrap.cc:492] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:44.552158 30775 ts_tablet_manager.cc:1434] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260709 13:10:44.568987 30715 tablet_service.cc:1511] Processing CreateTablet for tablet 723f558d9f1b4b448a1d027e5e116bf2 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:44.570463 30715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 723f558d9f1b4b448a1d027e5e116bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.570119 30494 tablet_service.cc:1511] Processing CreateTablet for tablet 723f558d9f1b4b448a1d027e5e116bf2 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:44.571524 30494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 723f558d9f1b4b448a1d027e5e116bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.580166 30710 tablet_service.cc:1511] Processing CreateTablet for tablet 52a2ea7040e149929599d0d145c8264e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:44.585294 30775 tablet_bootstrap.cc:492] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:44.591184 30641 tablet_service.cc:1511] Processing CreateTablet for tablet 52a2ea7040e149929599d0d145c8264e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:44.592621 30641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a2ea7040e149929599d0d145c8264e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.583791 30566 tablet_service.cc:1511] Processing CreateTablet for tablet f4a0db3fa3f64190af9ad01781659e3b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:44.594429 30566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a0db3fa3f64190af9ad01781659e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.594339 30714 tablet_service.cc:1511] Processing CreateTablet for tablet c60650c912f44bac84d7e81cf49ad99d (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:44.599126 30403 catalog_manager.cc:5697] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.602596 30492 tablet_service.cc:1511] Processing CreateTablet for tablet f4a0db3fa3f64190af9ad01781659e3b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:44.602735 30639 tablet_service.cc:1511] Processing CreateTablet for tablet f4a0db3fa3f64190af9ad01781659e3b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:44.599918 30565 tablet_service.cc:1511] Processing CreateTablet for tablet 52a2ea7040e149929599d0d145c8264e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:44.604058 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a0db3fa3f64190af9ad01781659e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.608292 30774 ts_tablet_manager.cc:1434] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.188s	user 0.004s	sys 0.007s
I20260709 13:10:44.608072 30493 tablet_service.cc:1511] Processing CreateTablet for tablet c60650c912f44bac84d7e81cf49ad99d (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:44.588459 30710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a2ea7040e149929599d0d145c8264e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.604065 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a0db3fa3f64190af9ad01781659e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.610495 30567 tablet_service.cc:1511] Processing CreateTablet for tablet c60650c912f44bac84d7e81cf49ad99d (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:44.612082 30567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c60650c912f44bac84d7e81cf49ad99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.613890 30778 tablet_bootstrap.cc:654] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.609440 30774 tablet_bootstrap.cc:492] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:44.619153 30493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c60650c912f44bac84d7e81cf49ad99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.623147 30714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c60650c912f44bac84d7e81cf49ad99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.624677 30645 tablet_service.cc:1511] Processing CreateTablet for tablet 40c44012ec644ddbbe5ec4685054ed5b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:44.626070 30645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c44012ec644ddbbe5ec4685054ed5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.627131 30401 catalog_manager.cc:5697] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 1 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.605661 30773 tablet_bootstrap.cc:492] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:44.631208 30773 ts_tablet_manager.cc:1403] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.270s	user 0.017s	sys 0.015s
I20260709 13:10:44.631407 30718 tablet_service.cc:1511] Processing CreateTablet for tablet 40c44012ec644ddbbe5ec4685054ed5b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:44.632794 30718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c44012ec644ddbbe5ec4685054ed5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.639530 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a2ea7040e149929599d0d145c8264e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.650550 30774 tablet_bootstrap.cc:654] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.659612 30643 tablet_service.cc:1511] Processing CreateTablet for tablet 723f558d9f1b4b448a1d027e5e116bf2 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:44.673802 30643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 723f558d9f1b4b448a1d027e5e116bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.664619 30496 tablet_service.cc:1511] Processing CreateTablet for tablet 40c44012ec644ddbbe5ec4685054ed5b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:44.668071 30563 tablet_service.cc:1511] Processing CreateTablet for tablet b2ffcc3dff924a86a1403a064784dba0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:44.669809 30645 tablet_service.cc:1511] Processing CreateTablet for tablet b2ffcc3dff924a86a1403a064784dba0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:44.672444 30712 tablet_service.cc:1511] Processing CreateTablet for tablet b2ffcc3dff924a86a1403a064784dba0 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:44.634402 30773 raft_consensus.cc:359] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.675623 30496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c44012ec644ddbbe5ec4685054ed5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.676614 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ffcc3dff924a86a1403a064784dba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.682884 30773 raft_consensus.cc:385] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.683598 30773 raft_consensus.cc:740] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.684888 30773 consensus_queue.cc:260] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.687224 30645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ffcc3dff924a86a1403a064784dba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.688342 30712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ffcc3dff924a86a1403a064784dba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.696934 30779 raft_consensus.cc:493] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.697513 30779 raft_consensus.cc:515] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.700649 30779 leader_election.cc:290] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:44.702149 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:44.702481 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:44.703119 30728 raft_consensus.cc:2468] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
W20260709 13:10:44.704133 30471 leader_election.cc:343] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.704772 30472 leader_election.cc:304] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:44.705757 30779 raft_consensus.cc:2804] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.706144 30779 raft_consensus.cc:493] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.706490 30779 raft_consensus.cc:3060] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.706590 30494 tablet_service.cc:1511] Processing CreateTablet for tablet 056efc360d6c4950a5e033e7a145395e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:44.708096 30494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056efc360d6c4950a5e033e7a145395e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.708740 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 056efc360d6c4950a5e033e7a145395e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:44.711159 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056efc360d6c4950a5e033e7a145395e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.720815 30645 tablet_service.cc:1511] Processing CreateTablet for tablet 056efc360d6c4950a5e033e7a145395e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:44.722282 30645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056efc360d6c4950a5e033e7a145395e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.710651 30775 tablet_bootstrap.cc:654] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.736205 30773 ts_tablet_manager.cc:1434] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.001s
I20260709 13:10:44.737854 30773 tablet_bootstrap.cc:492] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:44.756021 30493 tablet_service.cc:1511] Processing CreateTablet for tablet ff5f081bede942ccbbb7ab42a42bf354 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:44.757243 30718 tablet_service.cc:1511] Processing CreateTablet for tablet ff5f081bede942ccbbb7ab42a42bf354 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:44.757220 30779 raft_consensus.cc:515] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.758996 30718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5f081bede942ccbbb7ab42a42bf354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.761771 30778 tablet_bootstrap.cc:492] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:44.762475 30778 ts_tablet_manager.cc:1403] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.214s	user 0.023s	sys 0.004s
I20260709 13:10:44.765563 30778 raft_consensus.cc:359] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.766305 30778 raft_consensus.cc:385] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.766580 30778 raft_consensus.cc:740] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.767572 30778 consensus_queue.cc:260] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.768225 30789 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.768819 30789 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.771147 30789 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:44.771940 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
W20260709 13:10:44.774289 30620 leader_election.cc:343] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.776597 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:44.778327 30621 leader_election.cc:343] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.778808 30621 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:44.780104 30789 raft_consensus.cc:2749] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.770439 30778 ts_tablet_manager.cc:1434] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:44.781981 30778 tablet_bootstrap.cc:492] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:44.788399 30773 tablet_bootstrap.cc:654] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.793879 30803 raft_consensus.cc:493] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.795176 30778 tablet_bootstrap.cc:654] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.794658 30803 raft_consensus.cc:515] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:44.798681 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497e9f19c992474c92f71cf517d1adfb" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:44.800762 30779 leader_election.cc:290] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
W20260709 13:10:44.800907 30471 leader_election.cc:343] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.803707 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:44.804375 30655 raft_consensus.cc:3060] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.802325 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:44.809629 30493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5f081bede942ccbbb7ab42a42bf354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.810578 30728 raft_consensus.cc:3060] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.815724 30803 leader_election.cc:290] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:44.819404 30566 tablet_service.cc:1511] Processing CreateTablet for tablet ff5f081bede942ccbbb7ab42a42bf354 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:44.821204 30566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5f081bede942ccbbb7ab42a42bf354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.819475 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497e9f19c992474c92f71cf517d1adfb" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:44.825520 30471 leader_election.cc:343] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.825997 30471 leader_election.cc:304] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:44.827899 30492 tablet_service.cc:1511] Processing CreateTablet for tablet 2b210bd1ede94a3abb6560f301be6a7b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:44.829495 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b210bd1ede94a3abb6560f301be6a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.834375 30803 raft_consensus.cc:2749] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.833184 30563 tablet_service.cc:1511] Processing CreateTablet for tablet 9687bd5f80bd4d869a68cbbecda69806 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:44.840171 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9687bd5f80bd4d869a68cbbecda69806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.845424 30639 tablet_service.cc:1511] Processing CreateTablet for tablet 9687bd5f80bd4d869a68cbbecda69806 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:44.848718 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9687bd5f80bd4d869a68cbbecda69806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.850287 30803 consensus_queue.cc:1048] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:44.860620 30655 raft_consensus.cc:2468] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:44.860888 30714 tablet_service.cc:1511] Processing CreateTablet for tablet 9687bd5f80bd4d869a68cbbecda69806 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:44.862334 30714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9687bd5f80bd4d869a68cbbecda69806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.864811 30728 raft_consensus.cc:2468] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:44.866179 30472 leader_election.cc:304] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:44.867515 30803 raft_consensus.cc:2804] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.868074 30803 raft_consensus.cc:697] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:44.860795 30641 tablet_service.cc:1511] Processing CreateTablet for tablet 2b210bd1ede94a3abb6560f301be6a7b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:44.869148 30803 consensus_queue.cc:237] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:44.869800 30641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b210bd1ede94a3abb6560f301be6a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.867848 30494 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec7a3e0f271468aa4e4809f9707f7a3 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:44.882699 30494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec7a3e0f271468aa4e4809f9707f7a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.860795 30774 tablet_bootstrap.cc:492] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:44.867848 30711 tablet_service.cc:1511] Processing CreateTablet for tablet 2b210bd1ede94a3abb6560f301be6a7b (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:44.885795 30774 ts_tablet_manager.cc:1403] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.277s	user 0.025s	sys 0.022s
I20260709 13:10:44.886698 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b210bd1ede94a3abb6560f301be6a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.877526 30775 tablet_bootstrap.cc:492] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:44.889103 30775 ts_tablet_manager.cc:1403] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.324s	user 0.018s	sys 0.018s
I20260709 13:10:44.895998 30814 consensus_queue.cc:1048] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:44.903174 30472 consensus_peers.cc:597] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 -> Peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Couldn't send request to peer ce7bd1ecd6e44f32879851d7b3174acb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.918031 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec7a3e0f271468aa4e4809f9707f7a3 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:44.920534 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec7a3e0f271468aa4e4809f9707f7a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.920934 30778 tablet_bootstrap.cc:492] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:44.921444 30778 ts_tablet_manager.cc:1403] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.140s	user 0.018s	sys 0.001s
I20260709 13:10:44.922446 30710 tablet_service.cc:1511] Processing CreateTablet for tablet fafe994543a04390ab335d1abeaa6f4e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:44.920275 30643 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec7a3e0f271468aa4e4809f9707f7a3 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:44.924082 30643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec7a3e0f271468aa4e4809f9707f7a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.925961 30775 raft_consensus.cc:359] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.926705 30775 raft_consensus.cc:385] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.927047 30775 raft_consensus.cc:740] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.924546 30778 raft_consensus.cc:359] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.928483 30778 raft_consensus.cc:385] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.928810 30778 raft_consensus.cc:740] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.929795 30778 consensus_queue.cc:260] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.931067 30775 consensus_queue.cc:260] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.933447 30775 ts_tablet_manager.cc:1434] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.004s
I20260709 13:10:44.933853 30778 ts_tablet_manager.cc:1434] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:10:44.934545 30775 tablet_bootstrap.cc:492] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:44.934201 30774 raft_consensus.cc:359] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.934986 30778 tablet_bootstrap.cc:492] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:44.935164 30774 raft_consensus.cc:385] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.935817 30774 raft_consensus.cc:740] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.936923 30784 raft_consensus.cc:493] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.951900 30784 raft_consensus.cc:515] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:44.954418 30784 leader_election.cc:290] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:44.945443 30710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fafe994543a04390ab335d1abeaa6f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.949688 30773 tablet_bootstrap.cc:492] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:44.962296 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:44.964161 30546 leader_election.cc:343] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.962523 30773 ts_tablet_manager.cc:1403] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.225s	user 0.020s	sys 0.010s
I20260709 13:10:44.968178 30645 tablet_service.cc:1511] Processing CreateTablet for tablet aedcef0a31d14c3e90d15d1bbbf329c2 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:44.969604 30645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedcef0a31d14c3e90d15d1bbbf329c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.970181 30773 raft_consensus.cc:359] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:44.971113 30773 raft_consensus.cc:385] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.955456 30775 tablet_bootstrap.cc:654] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.957528 30565 tablet_service.cc:1511] Processing CreateTablet for tablet fafe994543a04390ab335d1abeaa6f4e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:44.959447 30789 consensus_queue.cc:1048] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.971505 30773 raft_consensus.cc:740] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.973681 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fafe994543a04390ab335d1abeaa6f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.973565 30774 consensus_queue.cc:260] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:44.973744 30773 consensus_queue.cc:260] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:44.979333 30496 tablet_service.cc:1511] Processing CreateTablet for tablet fafe994543a04390ab335d1abeaa6f4e (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:44.980880 30496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fafe994543a04390ab335d1abeaa6f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.941392 30778 tablet_bootstrap.cc:654] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.977334 30773 ts_tablet_manager.cc:1434] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:45.010872 30640 tablet_service.cc:1511] Processing CreateTablet for tablet 17a1eefeef3847b8ad88b05ca970c43f (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:45.012934 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 17a1eefeef3847b8ad88b05ca970c43f (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:45.014559 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a1eefeef3847b8ad88b05ca970c43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.015237 30711 tablet_service.cc:1511] Processing CreateTablet for tablet 17a1eefeef3847b8ad88b05ca970c43f (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:45.017638 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a1eefeef3847b8ad88b05ca970c43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.018317 30492 tablet_service.cc:1511] Processing CreateTablet for tablet e4221f91ccf44480aa2e341f14c10588 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:45.019613 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4221f91ccf44480aa2e341f14c10588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.019748 30774 ts_tablet_manager.cc:1434] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.134s	user 0.006s	sys 0.002s
I20260709 13:10:45.020866 30774 tablet_bootstrap.cc:492] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:45.032323 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a1eefeef3847b8ad88b05ca970c43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.043129 30773 tablet_bootstrap.cc:492] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:45.047753 30563 tablet_service.cc:1511] Processing CreateTablet for tablet e4221f91ccf44480aa2e341f14c10588 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:45.049204 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4221f91ccf44480aa2e341f14c10588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.012240 30493 tablet_service.cc:1511] Processing CreateTablet for tablet aedcef0a31d14c3e90d15d1bbbf329c2 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:45.051290 30655 raft_consensus.cc:3060] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.052371 30493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedcef0a31d14c3e90d15d1bbbf329c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.069005 30639 tablet_service.cc:1511] Processing CreateTablet for tablet e4221f91ccf44480aa2e341f14c10588 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:45.069974 30714 tablet_service.cc:1511] Processing CreateTablet for tablet 7904d28f33ba4b9298735fe0bbaf6855 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:45.070480 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4221f91ccf44480aa2e341f14c10588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.076472 30714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7904d28f33ba4b9298735fe0bbaf6855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.057165 30712 tablet_service.cc:1511] Processing CreateTablet for tablet aedcef0a31d14c3e90d15d1bbbf329c2 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:45.095486 30490 tablet_service.cc:1511] Processing CreateTablet for tablet 7904d28f33ba4b9298735fe0bbaf6855 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:45.096946 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7904d28f33ba4b9298735fe0bbaf6855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.070986 30403 catalog_manager.cc:5697] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:45.110399 30806 consensus_queue.cc:1048] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:10:45.122375 30712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedcef0a31d14c3e90d15d1bbbf329c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:45.128494 30621 consensus_peers.cc:597] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Couldn't send request to peer ce7bd1ecd6e44f32879851d7b3174acb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.155864 30784 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.156395 30784 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:45.158597 30784 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:45.159507 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:45.160269 30653 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:45.162515 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:45.168234 30728 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:45.169682 30547 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:45.171669 30784 raft_consensus.cc:2804] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:45.172055 30784 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.172391 30784 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.173445 30778 tablet_bootstrap.cc:492] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:45.174034 30778 ts_tablet_manager.cc:1403] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.239s	user 0.015s	sys 0.019s
I20260709 13:10:45.174350 30775 tablet_bootstrap.cc:492] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:45.174906 30775 ts_tablet_manager.cc:1403] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.241s	user 0.013s	sys 0.007s
I20260709 13:10:45.177585 30778 raft_consensus.cc:359] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.178614 30778 raft_consensus.cc:385] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.183007 30778 raft_consensus.cc:740] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.183791 30565 tablet_service.cc:1511] Processing CreateTablet for tablet 7904d28f33ba4b9298735fe0bbaf6855 (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:45.183949 30778 consensus_queue.cc:260] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.185222 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7904d28f33ba4b9298735fe0bbaf6855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.187332 30774 tablet_bootstrap.cc:654] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.186543 30778 ts_tablet_manager.cc:1434] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:45.207940 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:45.210140 30490 tablet_service.cc:1511] Processing CreateTablet for tablet 3253c47b0c1749e39622495eb339195c (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:45.212713 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3253c47b0c1749e39622495eb339195c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.213078 30778 tablet_bootstrap.cc:492] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:45.208907 30506 raft_consensus.cc:2468] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:45.214318 30773 tablet_bootstrap.cc:654] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.214411 30545 leader_election.cc:304] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:45.218865 30784 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:45.218955 30775 raft_consensus.cc:359] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.220121 30775 raft_consensus.cc:385] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.221772 30784 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:45.222388 30784 raft_consensus.cc:2804] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:45.222723 30784 raft_consensus.cc:493] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.223080 30784 raft_consensus.cc:3060] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.223359 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:45.223948 30653 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.227774 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:45.228650 30728 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.234412 30778 tablet_bootstrap.cc:654] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.235246 30784 raft_consensus.cc:515] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.239341 30640 tablet_service.cc:1511] Processing CreateTablet for tablet 3253c47b0c1749e39622495eb339195c (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:45.237710 30784 leader_election.cc:290] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:45.220479 30775 raft_consensus.cc:740] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.252772 30728 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:45.255874 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3253c47b0c1749e39622495eb339195c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.254990 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:45.254024 30711 tablet_service.cc:1511] Processing CreateTablet for tablet 3253c47b0c1749e39622495eb339195c (DEFAULT_TABLE table=test-workload [id=767d63f5549e429d91997ab2c72f5ee2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:10:45.266471 30546 leader_election.cc:343] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.270709 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3253c47b0c1749e39622495eb339195c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.271240 30775 consensus_queue.cc:260] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.273710 30775 ts_tablet_manager.cc:1434] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.001s
I20260709 13:10:45.275833 30547 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:45.278054 30775 tablet_bootstrap.cc:492] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:45.288482 30784 raft_consensus.cc:2804] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.289261 30784 raft_consensus.cc:697] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:45.282246 30653 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:45.290414 30784 consensus_queue.cc:237] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:45.307768 30774 tablet_bootstrap.cc:492] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:45.317588 30774 ts_tablet_manager.cc:1403] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.297s	user 0.020s	sys 0.015s
W20260709 13:10:45.306692 30545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 92508us
I20260709 13:10:45.323086 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:45.323701 30506 raft_consensus.cc:3060] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.323989 30775 tablet_bootstrap.cc:654] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.326766 30778 tablet_bootstrap.cc:492] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:45.330868 30778 ts_tablet_manager.cc:1403] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.006s
W20260709 13:10:45.333576 30451 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:45.334028 30778 raft_consensus.cc:359] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.334813 30778 raft_consensus.cc:385] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.335112 30778 raft_consensus.cc:740] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.326603 30774 raft_consensus.cc:359] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.336500 30774 raft_consensus.cc:385] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.336927 30774 raft_consensus.cc:740] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.338366 30506 raft_consensus.cc:2468] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:45.337962 30774 consensus_queue.cc:260] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.342267 30545 leader_election.cc:304] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:45.343739 30838 raft_consensus.cc:2804] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.344082 30773 tablet_bootstrap.cc:492] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:45.344678 30773 ts_tablet_manager.cc:1403] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.316s	user 0.019s	sys 0.014s
I20260709 13:10:45.348510 30838 raft_consensus.cc:697] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:45.350024 30838 consensus_queue.cc:237] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.357352 30774 ts_tablet_manager.cc:1434] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.002s
I20260709 13:10:45.358284 30803 consensus_queue.cc:1048] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:45.359181 30774 tablet_bootstrap.cc:492] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:45.358979 30401 catalog_manager.cc:5697] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.340903 30778 consensus_queue.cc:260] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.382679 30773 raft_consensus.cc:359] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.383594 30773 raft_consensus.cc:385] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.383917 30773 raft_consensus.cc:740] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.385986 30779 consensus_queue.cc:1048] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:45.391351 30774 tablet_bootstrap.cc:654] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.384941 30773 consensus_queue.cc:260] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.395429 30779 raft_consensus.cc:493] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.396085 30779 raft_consensus.cc:515] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.376271 30778 ts_tablet_manager.cc:1434] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:10:45.400291 30844 raft_consensus.cc:493] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.400826 30844 raft_consensus.cc:515] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.402139 30778 tablet_bootstrap.cc:492] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:45.402438 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:45.403009 30844 leader_election.cc:290] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:45.412434 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:45.405155 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:45.417618 30546 leader_election.cc:343] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:45.419291 30545 leader_election.cc:343] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.419989 30545 leader_election.cc:304] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:45.421151 30844 raft_consensus.cc:2749] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:45.423527 30471 leader_election.cc:343] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.424654 30779 leader_election.cc:290] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:45.426219 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:45.429682 30471 leader_election.cc:343] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.430150 30471 leader_election.cc:304] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:45.441062 30778 tablet_bootstrap.cc:654] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.452046 30779 raft_consensus.cc:2749] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:45.456312 30773 ts_tablet_manager.cc:1434] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.111s	user 0.009s	sys 0.000s
I20260709 13:10:45.457620 30773 tablet_bootstrap.cc:492] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:45.462972 30404 catalog_manager.cc:5697] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.464618 30773 tablet_bootstrap.cc:654] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.473317 30775 tablet_bootstrap.cc:492] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:45.473474 30774 tablet_bootstrap.cc:492] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:45.473989 30775 ts_tablet_manager.cc:1403] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.196s	user 0.031s	sys 0.043s
I20260709 13:10:45.474145 30774 ts_tablet_manager.cc:1403] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.000s
I20260709 13:10:45.475790 30842 raft_consensus.cc:493] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.476343 30842 raft_consensus.cc:515] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.477432 30775 raft_consensus.cc:359] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.478274 30775 raft_consensus.cc:385] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.478598 30775 raft_consensus.cc:740] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.478973 30774 raft_consensus.cc:359] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:45.480172 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497e9f19c992474c92f71cf517d1adfb" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:45.481952 30842 leader_election.cc:290] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:45.482338 30506 raft_consensus.cc:2468] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:45.483395 30774 raft_consensus.cc:385] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.483805 30774 raft_consensus.cc:740] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.483916 30619 leader_election.cc:304] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:45.484861 30774 consensus_queue.cc:260] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:45.481316 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497e9f19c992474c92f71cf517d1adfb" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:45.480629 30775 consensus_queue.cc:260] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.487067 30773 tablet_bootstrap.cc:492] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
W20260709 13:10:45.487104 30620 leader_election.cc:343] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.488119 30773 ts_tablet_manager.cc:1403] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:10:45.490347 30775 ts_tablet_manager.cc:1434] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:45.493889 30775 tablet_bootstrap.cc:492] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:45.491382 30773 raft_consensus.cc:359] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.492419 30774 ts_tablet_manager.cc:1434] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:10:45.497786 30773 raft_consensus.cc:385] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.498164 30773 raft_consensus.cc:740] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.498987 30774 tablet_bootstrap.cc:492] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:45.507189 30842 raft_consensus.cc:2804] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:45.507838 30842 raft_consensus.cc:493] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.508176 30842 raft_consensus.cc:3060] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.511710 30773 consensus_queue.cc:260] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.521953 30774 tablet_bootstrap.cc:654] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.522768 30773 ts_tablet_manager.cc:1434] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.010s
I20260709 13:10:45.523922 30775 tablet_bootstrap.cc:654] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.524518 30789 raft_consensus.cc:493] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.525251 30789 raft_consensus.cc:515] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.529476 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:45.532485 30773 tablet_bootstrap.cc:492] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:45.533488 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:45.534699 30506 raft_consensus.cc:2393] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4b8e689773b4a9d8e6de6d82d225c0d in current term 1: Already voted for candidate fe9b995b077d4cb795f08934ed7d9088 in this term.
I20260709 13:10:45.537606 30620 leader_election.cc:304] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:45.539247 30798 raft_consensus.cc:3060] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.544646 30775 tablet_bootstrap.cc:492] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:45.545011 30773 tablet_bootstrap.cc:654] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.545228 30775 ts_tablet_manager.cc:1403] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.004s
I20260709 13:10:45.548237 30798 raft_consensus.cc:2749] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:45.548547 30775 raft_consensus.cc:359] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.572487 30775 raft_consensus.cc:385] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.572873 30775 raft_consensus.cc:740] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.573632 30775 consensus_queue.cc:260] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.576105 30775 ts_tablet_manager.cc:1434] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:10:45.577200 30775 tablet_bootstrap.cc:492] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:45.555361 30789 leader_election.cc:290] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:45.581316 30842 raft_consensus.cc:515] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.584185 30775 tablet_bootstrap.cc:654] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.596925 30778 tablet_bootstrap.cc:492] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:45.597532 30778 ts_tablet_manager.cc:1403] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.196s	user 0.052s	sys 0.054s
I20260709 13:10:45.601274 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497e9f19c992474c92f71cf517d1adfb" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:45.601282 30778 raft_consensus.cc:359] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.602015 30506 raft_consensus.cc:3060] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.602092 30778 raft_consensus.cc:385] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.602491 30778 raft_consensus.cc:740] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.603339 30775 tablet_bootstrap.cc:492] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:45.603242 30778 consensus_queue.cc:260] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.603895 30775 ts_tablet_manager.cc:1403] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.005s
I20260709 13:10:45.605361 30778 ts_tablet_manager.cc:1434] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:45.606591 30778 tablet_bootstrap.cc:492] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:45.607254 30775 raft_consensus.cc:359] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.608027 30775 raft_consensus.cc:385] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.608372 30775 raft_consensus.cc:740] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.609380 30775 consensus_queue.cc:260] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.613232 30838 raft_consensus.cc:493] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.613902 30838 raft_consensus.cc:515] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.617945 30778 tablet_bootstrap.cc:654] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.618110 30838 leader_election.cc:290] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:45.619191 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:45.620544 30775 ts_tablet_manager.cc:1434] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:45.621924 30775 tablet_bootstrap.cc:492] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:45.627627 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
W20260709 13:10:45.628021 30547 leader_election.cc:343] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.628576 30505 raft_consensus.cc:2468] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:45.630649 30545 leader_election.cc:304] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:45.632382 30838 raft_consensus.cc:2804] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:45.632887 30838 raft_consensus.cc:493] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.633281 30838 raft_consensus.cc:3060] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.635664 30775 tablet_bootstrap.cc:654] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.642807 30838 raft_consensus.cc:515] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.646888 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:45.647269 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:45.648080 30505 raft_consensus.cc:3060] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:45.649068 30547 leader_election.cc:343] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.656847 30789 raft_consensus.cc:493] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.657666 30789 raft_consensus.cc:515] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.660472 30838 leader_election.cc:290] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:45.660755 30789 leader_election.cc:290] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:45.663111 30505 raft_consensus.cc:2468] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:45.663565 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
W20260709 13:10:45.666021 30619 leader_election.cc:343] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.666955 30545 leader_election.cc:304] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:45.668150 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:45.668789 30838 raft_consensus.cc:2804] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.669544 30838 raft_consensus.cc:697] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
W20260709 13:10:45.670603 30621 leader_election.cc:343] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.671458 30621 leader_election.cc:304] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:45.673950 30789 raft_consensus.cc:2749] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:45.676008 30775 tablet_bootstrap.cc:492] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:45.676724 30775 ts_tablet_manager.cc:1403] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.010s
I20260709 13:10:45.677768 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497e9f19c992474c92f71cf517d1adfb" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:45.679174 30506 raft_consensus.cc:2468] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
W20260709 13:10:45.679986 30620 leader_election.cc:343] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.680613 30619 leader_election.cc:304] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:45.681740 30789 raft_consensus.cc:2804] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.682400 30789 raft_consensus.cc:697] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:45.682911 30775 raft_consensus.cc:359] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.683301 30789 consensus_queue.cc:237] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.684068 30775 raft_consensus.cc:385] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.684717 30775 raft_consensus.cc:740] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.685738 30775 consensus_queue.cc:260] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.687788 30775 ts_tablet_manager.cc:1434] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:10:45.688985 30775 tablet_bootstrap.cc:492] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:45.688099 30842 leader_election.cc:290] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:45.695596 30773 tablet_bootstrap.cc:492] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:45.696199 30773 ts_tablet_manager.cc:1403] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.164s	user 0.023s	sys 0.078s
I20260709 13:10:45.697009 30775 tablet_bootstrap.cc:654] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.670635 30838 consensus_queue.cc:237] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.699420 30773 raft_consensus.cc:359] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.703414 30806 raft_consensus.cc:493] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.703987 30773 raft_consensus.cc:385] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.703613 30774 tablet_bootstrap.cc:492] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:45.704247 30806 raft_consensus.cc:515] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:45.705197 30774 ts_tablet_manager.cc:1403] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.207s	user 0.055s	sys 0.075s
I20260709 13:10:45.709781 30774 raft_consensus.cc:359] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.710882 30773 raft_consensus.cc:740] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.712044 30773 consensus_queue.cc:260] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.713485 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:45.718935 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:45.721627 30694 leader_election.cc:304] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:45.722244 30773 ts_tablet_manager.cc:1434] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:10:45.722908 30806 leader_election.cc:290] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:45.723683 30773 tablet_bootstrap.cc:492] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:45.724720 30806 raft_consensus.cc:2749] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:45.730296 30775 tablet_bootstrap.cc:492] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:45.731704 30775 ts_tablet_manager.cc:1403] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.017s
I20260709 13:10:45.734985 30728 raft_consensus.cc:3060] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.734526 30775 raft_consensus.cc:359] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.737380 30775 raft_consensus.cc:385] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.737718 30775 raft_consensus.cc:740] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.738616 30775 consensus_queue.cc:260] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.741041 30773 tablet_bootstrap.cc:654] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.728796 30844 consensus_queue.cc:1048] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:10:45.745115 30864 raft_consensus.cc:493] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.745901 30864 raft_consensus.cc:515] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.726871 30774 raft_consensus.cc:385] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.754739 30774 raft_consensus.cc:740] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.756462 30864 leader_election.cc:290] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:45.755872 30774 consensus_queue.cc:260] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.757675 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:45.762894 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:45.764945 30545 leader_election.cc:343] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:45.771446 30547 leader_election.cc:343] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.773722 30547 leader_election.cc:304] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:45.776536 30844 raft_consensus.cc:2749] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:45.776391 30403 catalog_manager.cc:5697] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:45.777288 30844 consensus_queue.cc:1048] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:45.790355 30774 ts_tablet_manager.cc:1434] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.085s	user 0.011s	sys 0.000s
I20260709 13:10:45.790946 30773 tablet_bootstrap.cc:492] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:45.792011 30773 ts_tablet_manager.cc:1403] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.000s
I20260709 13:10:45.790916 30775 ts_tablet_manager.cc:1434] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.059s	user 0.018s	sys 0.022s
I20260709 13:10:45.788589 30864 consensus_queue.cc:1048] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:10:45.793677 30775 tablet_bootstrap.cc:492] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:45.795531 30773 raft_consensus.cc:359] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.796883 30773 raft_consensus.cc:385] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.797243 30773 raft_consensus.cc:740] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.801350 30774 tablet_bootstrap.cc:492] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:45.800230 30773 consensus_queue.cc:260] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.806746 30863 raft_consensus.cc:493] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.807485 30863 raft_consensus.cc:515] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.810600 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:45.811329 30506 raft_consensus.cc:2468] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:45.812826 30693 leader_election.cc:304] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:45.813838 30862 raft_consensus.cc:2804] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:45.814254 30862 raft_consensus.cc:493] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.814575 30862 raft_consensus.cc:3060] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.818936 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
W20260709 13:10:45.820585 30694 leader_election.cc:343] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.821241 30863 leader_election.cc:290] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:45.823011 30806 raft_consensus.cc:493] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.823745 30806 raft_consensus.cc:515] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.833546 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:45.834234 30778 tablet_bootstrap.cc:492] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:45.834502 30581 raft_consensus.cc:2468] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:45.834770 30778 ts_tablet_manager.cc:1403] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.228s	user 0.050s	sys 0.083s
I20260709 13:10:45.835939 30694 leader_election.cc:304] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:45.836053 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:45.836869 30863 raft_consensus.cc:2804] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:45.836956 30506 raft_consensus.cc:2468] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:45.837320 30863 raft_consensus.cc:493] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.837819 30863 raft_consensus.cc:3060] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.837769 30778 raft_consensus.cc:359] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.838608 30778 raft_consensus.cc:385] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.838940 30778 raft_consensus.cc:740] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.839663 30778 consensus_queue.cc:260] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.826898 30806 leader_election.cc:290] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:45.834472 30774 tablet_bootstrap.cc:654] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.843698 30773 ts_tablet_manager.cc:1434] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:10:45.844808 30773 tablet_bootstrap.cc:492] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:45.828549 30862 raft_consensus.cc:515] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.848416 30778 ts_tablet_manager.cc:1434] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:45.851048 30778 tablet_bootstrap.cc:492] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:45.851584 30775 tablet_bootstrap.cc:654] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.855307 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:45.855955 30506 raft_consensus.cc:3060] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.864127 30779 raft_consensus.cc:493] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.865180 30779 raft_consensus.cc:515] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.866991 30838 raft_consensus.cc:493] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.867509 30838 raft_consensus.cc:515] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.869526 30779 leader_election.cc:290] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:45.869776 30838 leader_election.cc:290] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:45.871160 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:45.872260 30655 raft_consensus.cc:2468] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:45.872576 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497e9f19c992474c92f71cf517d1adfb" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:45.873625 30471 leader_election.cc:304] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:45.871174 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497e9f19c992474c92f71cf517d1adfb" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:45.874873 30505 raft_consensus.cc:2393] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 1: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:45.876153 30545 leader_election.cc:304] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:45.877923 30864 raft_consensus.cc:3060] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.883096 30838 consensus_queue.cc:1048] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:45.886233 30803 raft_consensus.cc:2804] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:45.886840 30803 raft_consensus.cc:493] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.887307 30803 raft_consensus.cc:3060] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.887593 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:45.890723 30472 leader_election.cc:343] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.869314 30403 catalog_manager.cc:5697] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.871181 30863 raft_consensus.cc:515] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.903400 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:45.904323 30504 raft_consensus.cc:3060] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.919894 30863 leader_election.cc:290] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:45.919121 30862 leader_election.cc:290] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:45.923949 30504 raft_consensus.cc:2468] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:45.925501 30778 tablet_bootstrap.cc:654] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.925168 30506 raft_consensus.cc:2468] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:45.928927 30693 leader_election.cc:304] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:45.930218 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:45.930902 30693 leader_election.cc:304] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:45.931808 30863 raft_consensus.cc:2804] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.927382 30864 raft_consensus.cc:2749] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:45.936476 30863 raft_consensus.cc:697] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:45.931941 30862 raft_consensus.cc:2804] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.933342 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
W20260709 13:10:45.932981 30694 leader_election.cc:343] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.937884 30862 raft_consensus.cc:697] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:45.937929 30581 raft_consensus.cc:3060] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.939545 30862 consensus_queue.cc:237] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.944962 30775 tablet_bootstrap.cc:492] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:45.945667 30775 ts_tablet_manager.cc:1403] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.063s
I20260709 13:10:45.949609 30775 raft_consensus.cc:359] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.950603 30775 raft_consensus.cc:385] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.950986 30775 raft_consensus.cc:740] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.952039 30775 consensus_queue.cc:260] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.955377 30775 ts_tablet_manager.cc:1434] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 13:10:45.955786 30773 tablet_bootstrap.cc:654] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.956972 30775 tablet_bootstrap.cc:492] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:45.933235 30803 raft_consensus.cc:515] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.961457 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:45.962092 30653 raft_consensus.cc:3060] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.966866 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
W20260709 13:10:45.969241 30472 leader_election.cc:343] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.966845 30775 tablet_bootstrap.cc:654] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.971871 30803 leader_election.cc:290] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:45.975768 30774 tablet_bootstrap.cc:492] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:45.975355 30863 consensus_queue.cc:237] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:45.976279 30774 ts_tablet_manager.cc:1403] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.175s	user 0.021s	sys 0.003s
I20260709 13:10:45.973760 30653 raft_consensus.cc:2468] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:45.977744 30471 leader_election.cc:304] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:45.978485 30803 raft_consensus.cc:2804] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.979298 30803 raft_consensus.cc:697] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:45.980201 30774 raft_consensus.cc:359] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.981199 30774 raft_consensus.cc:385] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.980454 30803 consensus_queue.cc:237] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:45.981600 30774 raft_consensus.cc:740] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.982770 30774 consensus_queue.cc:260] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:45.986495 30774 ts_tablet_manager.cc:1434] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:45.987758 30774 tablet_bootstrap.cc:492] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:45.991034 30581 raft_consensus.cc:2468] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:45.997607 30773 tablet_bootstrap.cc:492] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:45.998414 30773 ts_tablet_manager.cc:1403] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.154s	user 0.010s	sys 0.002s
I20260709 13:10:46.003443 30774 tablet_bootstrap.cc:654] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.002943 30773 raft_consensus.cc:359] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.010926 30773 raft_consensus.cc:385] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.011380 30773 raft_consensus.cc:740] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.012439 30773 consensus_queue.cc:260] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.015983 30773 ts_tablet_manager.cc:1434] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:10:46.017292 30773 tablet_bootstrap.cc:492] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:46.019253 30778 tablet_bootstrap.cc:492] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:46.019685 30775 tablet_bootstrap.cc:492] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:46.019843 30778 ts_tablet_manager.cc:1403] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.169s	user 0.017s	sys 0.047s
I20260709 13:10:46.020193 30775 ts_tablet_manager.cc:1403] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.010s
I20260709 13:10:46.023242 30775 raft_consensus.cc:359] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.024092 30775 raft_consensus.cc:385] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.024410 30775 raft_consensus.cc:740] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.025143 30775 consensus_queue.cc:260] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.027827 30778 raft_consensus.cc:359] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.028566 30778 raft_consensus.cc:385] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.028846 30778 raft_consensus.cc:740] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.029733 30773 tablet_bootstrap.cc:654] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.029539 30778 consensus_queue.cc:260] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.031643 30775 ts_tablet_manager.cc:1434] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:46.033043 30775 tablet_bootstrap.cc:492] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:46.037045 30778 ts_tablet_manager.cc:1434] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:10:46.036604 30403 catalog_manager.cc:5697] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.038302 30778 tablet_bootstrap.cc:492] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:46.038517 30401 catalog_manager.cc:5697] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 1 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.041618 30862 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.042183 30862 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.046833 30775 tablet_bootstrap.cc:654] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.053189 30774 tablet_bootstrap.cc:492] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:46.052934 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:46.054360 30774 ts_tablet_manager.cc:1403] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.001s
I20260709 13:10:46.056291 30778 tablet_bootstrap.cc:654] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.059289 30774 raft_consensus.cc:359] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.060173 30774 raft_consensus.cc:385] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.060446 30774 raft_consensus.cc:740] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.061208 30774 consensus_queue.cc:260] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.062889 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:46.065037 30693 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:46.065965 30862 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:46.067265 30862 raft_consensus.cc:2749] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.077417 30775 tablet_bootstrap.cc:492] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:46.077965 30775 ts_tablet_manager.cc:1403] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.010s
I20260709 13:10:46.078366 30773 tablet_bootstrap.cc:492] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:46.079286 30773 ts_tablet_manager.cc:1403] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.021s
I20260709 13:10:46.063724 30774 ts_tablet_manager.cc:1434] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:10:46.080873 30775 raft_consensus.cc:359] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.081614 30775 raft_consensus.cc:385] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.081895 30775 raft_consensus.cc:740] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.081912 30773 raft_consensus.cc:359] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.082010 30774 tablet_bootstrap.cc:492] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:46.082939 30773 raft_consensus.cc:385] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.083501 30773 raft_consensus.cc:740] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.084237 30773 consensus_queue.cc:260] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.085049 30778 tablet_bootstrap.cc:492] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:46.085549 30778 ts_tablet_manager.cc:1403] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.000s
I20260709 13:10:46.087646 30403 catalog_manager.cc:5697] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 1 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.088373 30778 raft_consensus.cc:359] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.089120 30778 raft_consensus.cc:385] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.089201 30773 ts_tablet_manager.cc:1434] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 13:10:46.089437 30778 raft_consensus.cc:740] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.090204 30773 tablet_bootstrap.cc:492] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:46.090153 30778 consensus_queue.cc:260] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.082688 30775 consensus_queue.cc:260] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.093089 30775 ts_tablet_manager.cc:1434] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:10:46.091351 30774 tablet_bootstrap.cc:654] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.097185 30773 tablet_bootstrap.cc:654] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.097445 30775 tablet_bootstrap.cc:492] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:46.103219 30778 ts_tablet_manager.cc:1434] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:10:46.104338 30778 tablet_bootstrap.cc:492] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:46.106174 30842 consensus_queue.cc:1048] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.107270 30773 tablet_bootstrap.cc:492] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:46.107790 30773 ts_tablet_manager.cc:1403] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:10:46.109810 30775 tablet_bootstrap.cc:654] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.113538 30778 tablet_bootstrap.cc:654] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.116675 30773 raft_consensus.cc:359] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.117511 30773 raft_consensus.cc:385] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.117782 30773 raft_consensus.cc:740] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.118139 30774 tablet_bootstrap.cc:492] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:46.118611 30773 consensus_queue.cc:260] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.118654 30774 ts_tablet_manager.cc:1403] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.007s
I20260709 13:10:46.121542 30773 ts_tablet_manager.cc:1434] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:10:46.122514 30773 tablet_bootstrap.cc:492] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:46.127348 30774 raft_consensus.cc:359] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.128182 30774 raft_consensus.cc:385] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.128464 30774 raft_consensus.cc:740] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.129221 30774 consensus_queue.cc:260] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.135743 30778 tablet_bootstrap.cc:492] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:46.136337 30778 ts_tablet_manager.cc:1403] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.008s
I20260709 13:10:46.139213 30778 raft_consensus.cc:359] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.139896 30778 raft_consensus.cc:385] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.140172 30778 raft_consensus.cc:740] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.141732 30773 tablet_bootstrap.cc:654] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.142994 30798 consensus_queue.cc:1048] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.140827 30778 consensus_queue.cc:260] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.146740 30778 ts_tablet_manager.cc:1434] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:46.150661 30778 tablet_bootstrap.cc:492] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:46.156618 30774 ts_tablet_manager.cc:1434] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:10:46.157430 30778 tablet_bootstrap.cc:654] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.158592 30864 raft_consensus.cc:493] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.158933 30775 tablet_bootstrap.cc:492] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:46.159629 30775 ts_tablet_manager.cc:1403] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.018s
I20260709 13:10:46.159364 30864 raft_consensus.cc:515] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.162680 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:46.162712 30775 raft_consensus.cc:359] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.163515 30504 raft_consensus.cc:2468] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:46.163625 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:46.163688 30775 raft_consensus.cc:385] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.164425 30775 raft_consensus.cc:740] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.164691 30545 leader_election.cc:304] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:46.164386 30653 raft_consensus.cc:2468] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:46.165679 30784 raft_consensus.cc:2804] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.165447 30775 consensus_queue.cc:260] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.166079 30784 raft_consensus.cc:493] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.166464 30784 raft_consensus.cc:3060] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.165256 30798 raft_consensus.cc:493] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.168002 30775 ts_tablet_manager.cc:1434] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:46.167793 30798 raft_consensus.cc:515] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.170681 30775 tablet_bootstrap.cc:492] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:46.170974 30864 leader_election.cc:290] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:46.172372 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:46.173040 30505 raft_consensus.cc:2468] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:46.174139 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:46.174397 30619 leader_election.cc:304] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:46.175134 30580 raft_consensus.cc:2468] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:46.176214 30789 raft_consensus.cc:2804] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.176728 30789 raft_consensus.cc:493] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.177130 30789 raft_consensus.cc:3060] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.177307 30775 tablet_bootstrap.cc:654] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.181289 30784 raft_consensus.cc:515] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.183324 30798 leader_election.cc:290] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:46.188829 30729 raft_consensus.cc:3060] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.193163 30775 tablet_bootstrap.cc:492] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:46.193722 30775 ts_tablet_manager.cc:1403] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 13:10:46.195324 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:46.195945 30504 raft_consensus.cc:3060] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.196558 30775 raft_consensus.cc:359] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.197250 30775 raft_consensus.cc:385] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.197512 30775 raft_consensus.cc:740] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.198170 30775 consensus_queue.cc:260] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.202622 30784 leader_election.cc:290] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:46.204109 30775 ts_tablet_manager.cc:1434] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:10:46.204278 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:46.205147 30775 tablet_bootstrap.cc:492] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:46.206245 30504 raft_consensus.cc:2468] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:46.207532 30545 leader_election.cc:304] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:46.208971 30784 raft_consensus.cc:2804] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.209510 30784 raft_consensus.cc:697] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:46.205129 30653 raft_consensus.cc:3060] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.210623 30784 consensus_queue.cc:237] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.216367 30775 tablet_bootstrap.cc:654] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.224251 30773 tablet_bootstrap.cc:492] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:46.224754 30773 ts_tablet_manager.cc:1403] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.025s
I20260709 13:10:46.202018 30798 raft_consensus.cc:493] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.229825 30798 raft_consensus.cc:515] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.233919 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a479c021bcf40f087e21cf6099daeb0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:46.234907 30580 raft_consensus.cc:2468] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:46.236788 30620 leader_election.cc:304] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:46.238086 30842 raft_consensus.cc:2804] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.238620 30842 raft_consensus.cc:493] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.239110 30842 raft_consensus.cc:3060] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.255458 30798 leader_election.cc:290] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:46.228834 30773 raft_consensus.cc:359] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.256592 30773 raft_consensus.cc:385] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.256911 30773 raft_consensus.cc:740] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.257220 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a479c021bcf40f087e21cf6099daeb0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:46.257730 30773 consensus_queue.cc:260] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:10:46.259337 30621 leader_election.cc:343] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.260860 30865 consensus_queue.cc:1048] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:46.262034 30774 tablet_bootstrap.cc:492] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:46.248847 30864 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.268437 30864 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.272079 30864 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:46.271989 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:46.264771 30773 ts_tablet_manager.cc:1434] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
W20260709 13:10:46.274333 30545 leader_election.cc:343] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.274832 30773 tablet_bootstrap.cc:492] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:46.271989 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:46.257222 30789 raft_consensus.cc:515] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:46.277235 30547 leader_election.cc:343] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.277743 30547 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:46.279002 30865 consensus_queue.cc:1048] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.279361 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:46.279976 30504 raft_consensus.cc:3060] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.280479 30865 raft_consensus.cc:2749] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.284567 30778 tablet_bootstrap.cc:492] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:46.284745 30842 raft_consensus.cc:515] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.285398 30778 ts_tablet_manager.cc:1403] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.135s	user 0.036s	sys 0.039s
I20260709 13:10:46.289172 30789 leader_election.cc:290] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:46.289554 30775 tablet_bootstrap.cc:492] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:46.290122 30775 ts_tablet_manager.cc:1403] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.085s	user 0.031s	sys 0.036s
I20260709 13:10:46.288931 30778 raft_consensus.cc:359] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.290982 30778 raft_consensus.cc:385] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.291286 30778 raft_consensus.cc:740] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.292819 30775 raft_consensus.cc:359] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.293676 30774 tablet_bootstrap.cc:654] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.296898 30778 consensus_queue.cc:260] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.297706 30773 tablet_bootstrap.cc:654] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.293542 30775 raft_consensus.cc:385] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.298998 30775 raft_consensus.cc:740] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.301599 30775 consensus_queue.cc:260] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.304764 30775 ts_tablet_manager.cc:1434] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:10:46.306165 30775 tablet_bootstrap.cc:492] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:46.309103 30905 raft_consensus.cc:493] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.313625 30778 ts_tablet_manager.cc:1434] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.005s
W20260709 13:10:46.314741 30620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 59115.2us
I20260709 13:10:46.331367 30778 tablet_bootstrap.cc:492] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:46.331693 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a479c021bcf40f087e21cf6099daeb0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:46.332418 30581 raft_consensus.cc:3060] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.316686 30774 tablet_bootstrap.cc:492] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:46.335516 30774 ts_tablet_manager.cc:1403] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.006s
I20260709 13:10:46.316439 30404 catalog_manager.cc:5697] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.318225 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a479c021bcf40f087e21cf6099daeb0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:46.338714 30798 raft_consensus.cc:493] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.342358 30798 raft_consensus.cc:515] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.319744 30864 raft_consensus.cc:493] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.344813 30864 raft_consensus.cc:515] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.347178 30864 leader_election.cc:290] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:46.349902 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:46.319798 30842 leader_election.cc:290] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:46.325029 30803 raft_consensus.cc:493] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.352895 30798 leader_election.cc:290] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:46.327144 30863 consensus_queue.cc:1048] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:46.355494 30451 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:46.340898 30905 raft_consensus.cc:515] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.359581 30905 leader_election.cc:290] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:46.340624 30778 tablet_bootstrap.cc:654] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.338534 30774 raft_consensus.cc:359] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.364249 30774 raft_consensus.cc:385] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.364332 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf3caefe70453bbed914700540bef7" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:46.364611 30774 raft_consensus.cc:740] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.365083 30579 raft_consensus.cc:2468] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:46.367616 30774 consensus_queue.cc:260] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.371467 30581 raft_consensus.cc:2468] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:46.352931 30803 raft_consensus.cc:515] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.374603 30774 ts_tablet_manager.cc:1434] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:10:46.376590 30774 tablet_bootstrap.cc:492] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:46.377064 30803 leader_election.cc:290] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:46.378657 30504 raft_consensus.cc:2468] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:46.380350 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:46.342847 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:46.381058 30580 raft_consensus.cc:3060] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.382107 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf3caefe70453bbed914700540bef7" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:46.386523 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:46.387204 30729 raft_consensus.cc:2468] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:46.387315 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:46.388517 30619 leader_election.cc:304] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:46.389041 30472 leader_election.cc:304] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:46.389406 30905 raft_consensus.cc:2804] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.389931 30905 raft_consensus.cc:697] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:46.390843 30905 consensus_queue.cc:237] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.394599 30803 raft_consensus.cc:2804] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.395110 30803 raft_consensus.cc:493] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:46.395205 30621 leader_election.cc:343] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.395514 30803 raft_consensus.cc:3060] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:46.395936 30621 leader_election.cc:343] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.267071 30653 raft_consensus.cc:2468] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:46.350216 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:46.380532 30728 raft_consensus.cc:3060] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.409822 30580 raft_consensus.cc:2468] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:46.413844 30728 raft_consensus.cc:2468] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:46.414288 30620 leader_election.cc:304] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:46.415176 30798 raft_consensus.cc:2804] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.415560 30798 raft_consensus.cc:493] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.415915 30798 raft_consensus.cc:3060] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.423575 30621 leader_election.cc:304] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:46.424610 30842 raft_consensus.cc:2804] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.425308 30842 raft_consensus.cc:697] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:46.426527 30842 consensus_queue.cc:237] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.329731 30775 tablet_bootstrap.cc:654] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.448935 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:46.449914 30504 raft_consensus.cc:2468] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:46.456166 30773 tablet_bootstrap.cc:492] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:46.457055 30773 ts_tablet_manager.cc:1403] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.183s	user 0.067s	sys 0.067s
I20260709 13:10:46.443280 30581 raft_consensus.cc:2468] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:46.461896 30773 raft_consensus.cc:359] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.463035 30773 raft_consensus.cc:385] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.463469 30773 raft_consensus.cc:740] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.464529 30773 consensus_queue.cc:260] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.466202 30581 raft_consensus.cc:3060] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.466768 30864 raft_consensus.cc:493] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.467332 30864 raft_consensus.cc:515] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.468986 30773 ts_tablet_manager.cc:1434] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:46.470448 30864 leader_election.cc:290] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:46.471680 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:46.473327 30546 leader_election.cc:343] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.470407 30773 tablet_bootstrap.cc:492] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:46.481292 30798 raft_consensus.cc:515] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.489341 30864 raft_consensus.cc:493] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.489912 30864 raft_consensus.cc:515] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.499389 30774 tablet_bootstrap.cc:654] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.502395 30773 tablet_bootstrap.cc:654] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.503544 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:46.505475 30546 leader_election.cc:343] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.502697 30864 leader_election.cc:290] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
W20260709 13:10:46.509783 30472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 120820us
I20260709 13:10:46.511518 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf3caefe70453bbed914700540bef7" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:46.512208 30580 raft_consensus.cc:3060] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.511574 30545 leader_election.cc:304] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:46.514500 30773 tablet_bootstrap.cc:492] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:46.514645 30619 leader_election.cc:304] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:46.515033 30773 ts_tablet_manager.cc:1403] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.005s
I20260709 13:10:46.515370 30728 raft_consensus.cc:3060] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.515856 30842 raft_consensus.cc:2804] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.516234 30842 raft_consensus.cc:493] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.516553 30842 raft_consensus.cc:3060] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.522995 30862 raft_consensus.cc:493] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.523716 30862 raft_consensus.cc:515] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.524304 30798 leader_election.cc:290] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:46.525885 30862 leader_election.cc:290] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:46.526391 30911 raft_consensus.cc:493] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.526774 30580 raft_consensus.cc:2468] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:46.526935 30911 raft_consensus.cc:515] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.528095 30620 leader_election.cc:304] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:46.478180 30803 raft_consensus.cc:515] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.528995 30798 raft_consensus.cc:2804] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.529513 30798 raft_consensus.cc:697] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:46.529939 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1acee1ab5494c3a87ba7e6a84ef73cf" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:46.530365 30798 consensus_queue.cc:237] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.531216 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:46.531489 30471 leader_election.cc:343] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.532284 30653 raft_consensus.cc:2393] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate 5eebf0fa5aba46afa04623642d7795e6 in this term.
I20260709 13:10:46.532322 30773 raft_consensus.cc:359] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.533157 30773 raft_consensus.cc:385] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.533252 30803 leader_election.cc:290] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:46.533478 30773 raft_consensus.cc:740] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.534101 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf3caefe70453bbed914700540bef7" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:46.534256 30773 consensus_queue.cc:260] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.534878 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:46.535462 30579 raft_consensus.cc:3060] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:46.536303 30621 leader_election.cc:343] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.536669 30773 ts_tablet_manager.cc:1434] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:10:46.537721 30773 tablet_bootstrap.cc:492] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:46.540201 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:46.540637 30911 leader_election.cc:290] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:46.546808 30693 leader_election.cc:304] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:46.549365 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:46.550092 30504 raft_consensus.cc:2468] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:46.552238 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:46.554162 30545 leader_election.cc:304] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:46.555338 30784 raft_consensus.cc:2804] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.555758 30784 raft_consensus.cc:493] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.556087 30784 raft_consensus.cc:3060] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.557125 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1acee1ab5494c3a87ba7e6a84ef73cf" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:46.558318 30863 raft_consensus.cc:3060] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.562444 30579 raft_consensus.cc:2468] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:46.563297 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:46.563953 30471 leader_election.cc:304] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:46.564918 30803 raft_consensus.cc:2804] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.565626 30803 raft_consensus.cc:697] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
W20260709 13:10:46.566092 30472 leader_election.cc:343] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.566468 30803 consensus_queue.cc:237] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.566805 30472 leader_election.cc:304] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:46.563962 30726 raft_consensus.cc:3060] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.567847 30911 raft_consensus.cc:2749] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:46.568583 30545 leader_election.cc:343] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.569245 30545 leader_election.cc:304] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:46.570254 30838 raft_consensus.cc:2749] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.575948 30862 consensus_queue.cc:1048] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:46.580634 30863 raft_consensus.cc:2749] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.583709 30774 tablet_bootstrap.cc:492] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:46.584589 30774 ts_tablet_manager.cc:1403] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.208s	user 0.009s	sys 0.008s
I20260709 13:10:46.588336 30775 tablet_bootstrap.cc:492] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:46.588888 30775 ts_tablet_manager.cc:1403] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.283s	user 0.022s	sys 0.000s
I20260709 13:10:46.589605 30773 tablet_bootstrap.cc:654] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.563934 30784 raft_consensus.cc:515] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.592280 30863 consensus_queue.cc:1048] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:46.600355 30775 raft_consensus.cc:359] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.603067 30775 raft_consensus.cc:385] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.603310 30775 raft_consensus.cc:740] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.603969 30775 consensus_queue.cc:260] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.605891 30775 ts_tablet_manager.cc:1434] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:10:46.607010 30864 raft_consensus.cc:2749] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.609611 30784 leader_election.cc:290] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:46.614382 30775 tablet_bootstrap.cc:492] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:46.613531 30911 consensus_queue.cc:1048] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:10:46.633059 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:46.633723 30506 raft_consensus.cc:3060] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.633385 30402 catalog_manager.cc:5697] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.611200 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:46.636873 30402 catalog_manager.cc:5697] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.631992 30774 raft_consensus.cc:359] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.641881 30911 consensus_queue.cc:1048] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.646751 30726 raft_consensus.cc:2468] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:46.638131 30862 consensus_queue.cc:1048] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.646034 30778 tablet_bootstrap.cc:492] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
W20260709 13:10:46.642813 30546 leader_election.cc:343] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.655300 30774 raft_consensus.cc:385] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.657343 30778 ts_tablet_manager.cc:1403] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.326s	user 0.080s	sys 0.093s
I20260709 13:10:46.658244 30774 raft_consensus.cc:740] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.662897 30773 tablet_bootstrap.cc:492] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:46.663338 30775 tablet_bootstrap.cc:654] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.663465 30773 ts_tablet_manager.cc:1403] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.126s	user 0.002s	sys 0.013s
I20260709 13:10:46.664915 30842 raft_consensus.cc:515] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.667683 30774 consensus_queue.cc:260] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.671615 30774 ts_tablet_manager.cc:1434] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.003s
I20260709 13:10:46.679354 30506 raft_consensus.cc:2468] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:46.680868 30545 leader_election.cc:304] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:46.686184 30784 raft_consensus.cc:2804] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.686939 30784 raft_consensus.cc:697] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:46.688092 30784 consensus_queue.cc:237] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.693975 30403 catalog_manager.cc:5697] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.699955 30774 tablet_bootstrap.cc:492] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:46.703215 30778 raft_consensus.cc:359] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.703966 30778 raft_consensus.cc:385] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.704248 30778 raft_consensus.cc:740] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.705181 30778 consensus_queue.cc:260] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.707356 30842 leader_election.cc:290] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:46.707813 30773 raft_consensus.cc:359] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.714365 30773 raft_consensus.cc:385] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.714742 30773 raft_consensus.cc:740] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.715713 30773 consensus_queue.cc:260] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.709321 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:46.735512 30506 raft_consensus.cc:3060] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.736485 30773 ts_tablet_manager.cc:1434] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:10:46.737579 30773 tablet_bootstrap.cc:492] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:46.711061 30778 ts_tablet_manager.cc:1434] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:10:46.712801 30774 tablet_bootstrap.cc:654] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.708331 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
W20260709 13:10:46.747247 30621 leader_election.cc:343] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.734020 30775 tablet_bootstrap.cc:492] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:46.744699 30778 tablet_bootstrap.cc:492] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:46.748492 30775 ts_tablet_manager.cc:1403] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.137s	user 0.025s	sys 0.027s
I20260709 13:10:46.751384 30775 raft_consensus.cc:359] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.752135 30775 raft_consensus.cc:385] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.752398 30775 raft_consensus.cc:740] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.753118 30775 consensus_queue.cc:260] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.756496 30773 tablet_bootstrap.cc:654] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.756901 30404 catalog_manager.cc:5697] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.759850 30779 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.760622 30779 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.764916 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:46.765303 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:46.765887 30580 raft_consensus.cc:2468] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
W20260709 13:10:46.767688 30472 leader_election.cc:343] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.776536 30506 raft_consensus.cc:2468] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:46.754617 30778 tablet_bootstrap.cc:654] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.768220 30779 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:46.764946 30775 ts_tablet_manager.cc:1434] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:46.779409 30775 tablet_bootstrap.cc:492] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:46.779245 30619 leader_election.cc:304] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:46.785347 30774 tablet_bootstrap.cc:492] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:46.785919 30774 ts_tablet_manager.cc:1403] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.004s
I20260709 13:10:46.787374 30471 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:46.789227 30774 raft_consensus.cc:359] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.788499 30842 raft_consensus.cc:2804] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.790831 30775 tablet_bootstrap.cc:654] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.790302 30774 raft_consensus.cc:385] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.794112 30842 raft_consensus.cc:697] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:46.795238 30842 consensus_queue.cc:237] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.790869 30779 raft_consensus.cc:2804] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.796002 30784 consensus_queue.cc:1048] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.796550 30779 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.796947 30779 raft_consensus.cc:3060] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.807655 30773 tablet_bootstrap.cc:492] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:46.808442 30773 ts_tablet_manager.cc:1403] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.012s
I20260709 13:10:46.818132 30905 consensus_queue.cc:1048] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:46.797693 30774 raft_consensus.cc:740] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.824649 30402 catalog_manager.cc:5697] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.842727 30778 tablet_bootstrap.cc:492] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:46.843391 30778 ts_tablet_manager.cc:1403] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.004s
I20260709 13:10:46.845455 30905 consensus_queue.cc:1048] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:46.846493 30778 raft_consensus.cc:359] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.849627 30778 raft_consensus.cc:385] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.849896 30778 raft_consensus.cc:740] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.850600 30778 consensus_queue.cc:260] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.850968 30907 raft_consensus.cc:493] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.851857 30907 raft_consensus.cc:515] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.855274 30907 leader_election.cc:290] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:46.859736 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1acee1ab5494c3a87ba7e6a84ef73cf" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:46.863272 30778 ts_tablet_manager.cc:1434] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:10:46.863739 30775 tablet_bootstrap.cc:492] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:46.864354 30775 ts_tablet_manager.cc:1403] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.085s	user 0.030s	sys 0.030s
I20260709 13:10:46.864598 30778 tablet_bootstrap.cc:492] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:46.826521 30774 consensus_queue.cc:260] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.832320 30779 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.867552 30728 raft_consensus.cc:2468] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:46.868865 30779 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:46.869453 30621 leader_election.cc:304] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:46.871006 30773 raft_consensus.cc:359] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.874389 30773 raft_consensus.cc:385] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.874742 30773 raft_consensus.cc:740] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.875391 30773 consensus_queue.cc:260] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.876093 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1acee1ab5494c3a87ba7e6a84ef73cf" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:46.876775 30505 raft_consensus.cc:2468] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:46.880719 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:46.881383 30580 raft_consensus.cc:3060] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.872228 30403 catalog_manager.cc:5697] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.873502 30907 raft_consensus.cc:2804] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.883694 30907 raft_consensus.cc:493] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.884091 30907 raft_consensus.cc:3060] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.885468 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:46.886958 30784 consensus_queue.cc:1048] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.889700 30798 consensus_queue.cc:1048] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:46.893456 30775 raft_consensus.cc:359] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.894277 30775 raft_consensus.cc:385] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.872262 30774 ts_tablet_manager.cc:1434] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:10:46.895489 30774 tablet_bootstrap.cc:492] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:46.894593 30775 raft_consensus.cc:740] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.899200 30775 consensus_queue.cc:260] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.902504 30778 tablet_bootstrap.cc:654] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.904767 30775 ts_tablet_manager.cc:1434] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:10:46.905843 30775 tablet_bootstrap.cc:492] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:46.906090 30842 consensus_queue.cc:1048] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:46.908176 30472 leader_election.cc:343] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.915377 30907 raft_consensus.cc:515] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:46.928588 30907 leader_election.cc:290] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:46.922194 30774 tablet_bootstrap.cc:654] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.929324 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1acee1ab5494c3a87ba7e6a84ef73cf" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:46.929704 30778 tablet_bootstrap.cc:492] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:46.930030 30729 raft_consensus.cc:3060] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.930253 30778 ts_tablet_manager.cc:1403] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.005s
I20260709 13:10:46.924110 30580 raft_consensus.cc:2468] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:46.924898 30775 tablet_bootstrap.cc:654] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.932934 30773 ts_tablet_manager.cc:1434] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.004s
I20260709 13:10:46.933526 30778 raft_consensus.cc:359] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.934266 30778 raft_consensus.cc:385] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.934549 30778 raft_consensus.cc:740] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.935415 30471 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:46.935415 30778 consensus_queue.cc:260] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:46.937148 30940 raft_consensus.cc:2804] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.937666 30940 raft_consensus.cc:697] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:46.937958 30778 ts_tablet_manager.cc:1434] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:46.938971 30778 tablet_bootstrap.cc:492] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:46.938566 30940 consensus_queue.cc:237] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.933970 30773 tablet_bootstrap.cc:492] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:46.953896 30775 tablet_bootstrap.cc:492] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:46.954478 30775 ts_tablet_manager.cc:1403] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.005s
I20260709 13:10:46.957271 30775 raft_consensus.cc:359] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.957973 30775 raft_consensus.cc:385] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.958253 30775 raft_consensus.cc:740] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.958621 30778 tablet_bootstrap.cc:654] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.958971 30775 consensus_queue.cc:260] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:46.961201 30775 ts_tablet_manager.cc:1434] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:46.962090 30773 tablet_bootstrap.cc:654] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.962210 30775 tablet_bootstrap.cc:492] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:46.971782 30919 raft_consensus.cc:493] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.972393 30919 raft_consensus.cc:515] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:46.975633 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf3caefe70453bbed914700540bef7" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:46.976505 30580 raft_consensus.cc:2393] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:46.979234 30729 raft_consensus.cc:2468] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:46.979400 30773 tablet_bootstrap.cc:492] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:46.979503 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf3caefe70453bbed914700540bef7" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:47.003302 30773 ts_tablet_manager.cc:1403] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.005s
I20260709 13:10:46.980132 30919 leader_election.cc:290] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:47.004052 30621 leader_election.cc:304] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:47.004614 30694 leader_election.cc:304] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:47.005040 30798 raft_consensus.cc:2804] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.985072 30778 tablet_bootstrap.cc:492] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:47.005427 30919 raft_consensus.cc:3060] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.005878 30798 raft_consensus.cc:697] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:47.006031 30778 ts_tablet_manager.cc:1403] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.005s
I20260709 13:10:47.009258 30778 raft_consensus.cc:359] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.009984 30778 raft_consensus.cc:385] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.010285 30779 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.010848 30779 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.011283 30798 consensus_queue.cc:237] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.012492 30774 tablet_bootstrap.cc:492] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:47.013003 30779 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.014187 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:46.992734 30803 raft_consensus.cc:493] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.012995 30774 ts_tablet_manager.cc:1403] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.118s	user 0.035s	sys 0.017s
I20260709 13:10:47.015033 30803 raft_consensus.cc:515] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:47.015781 30472 leader_election.cc:343] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.017186 30803 leader_election.cc:290] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:46.994020 30907 consensus_queue.cc:1048] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:46.999217 30619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 110314us
I20260709 13:10:47.000583 30784 raft_consensus.cc:493] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.017930 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.018100 30784 raft_consensus.cc:515] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.018743 30581 raft_consensus.cc:2468] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:47.014097 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.019789 30580 raft_consensus.cc:2468] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:47.020398 30784 leader_election.cc:290] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:46.991501 30940 consensus_queue.cc:1048] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.021984 30471 leader_election.cc:304] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:47.022414 30773 raft_consensus.cc:359] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.022876 30940 raft_consensus.cc:2804] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.023195 30773 raft_consensus.cc:385] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.023011 30471 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:47.023339 30940 raft_consensus.cc:493] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.023458 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d758ec9801614080a6a30dd820a62459" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:47.023864 30940 raft_consensus.cc:3060] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.024230 30803 raft_consensus.cc:2804] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.985956 30775 tablet_bootstrap.cc:654] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.010281 30778 raft_consensus.cc:740] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.023633 30773 raft_consensus.cc:740] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.026944 30803 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.027760 30803 raft_consensus.cc:3060] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.029157 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:47.029855 30654 raft_consensus.cc:2468] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
W20260709 13:10:47.025662 30546 leader_election.cc:343] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.026347 30778 consensus_queue.cc:260] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.026347 30773 consensus_queue.cc:260] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.017793 30774 raft_consensus.cc:359] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.033560 30774 raft_consensus.cc:385] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.033897 30774 raft_consensus.cc:740] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.032155 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1acee1ab5494c3a87ba7e6a84ef73cf" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:47.035158 30774 consensus_queue.cc:260] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.035702 30503 raft_consensus.cc:3060] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.037686 30940 raft_consensus.cc:515] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.032016 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d758ec9801614080a6a30dd820a62459" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:47.043643 30940 leader_election.cc:290] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:47.044101 30778 ts_tablet_manager.cc:1434] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.004s
I20260709 13:10:47.045125 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:47.046512 30580 raft_consensus.cc:3060] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.046774 30778 tablet_bootstrap.cc:492] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:47.046880 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:47.047708 30654 raft_consensus.cc:3060] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.045053 30773 ts_tablet_manager.cc:1434] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
W20260709 13:10:47.052443 30547 leader_election.cc:343] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.052996 30547 leader_election.cc:304] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:47.053272 30773 tablet_bootstrap.cc:492] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:47.053861 30838 raft_consensus.cc:2749] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.054947 30774 ts_tablet_manager.cc:1434] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.003s
I20260709 13:10:47.056041 30774 tablet_bootstrap.cc:492] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:47.062072 30580 raft_consensus.cc:2468] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:47.032619 30919 raft_consensus.cc:2749] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.063691 30471 leader_election.cc:304] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:47.064558 30940 raft_consensus.cc:2804] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.065223 30940 raft_consensus.cc:697] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:47.068537 30503 raft_consensus.cc:2468] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:47.066092 30940 consensus_queue.cc:237] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.081360 30778 tablet_bootstrap.cc:654] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.083186 30774 tablet_bootstrap.cc:654] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.083410 30838 raft_consensus.cc:493] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.083967 30838 raft_consensus.cc:515] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.082702 30400 catalog_manager.cc:5697] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.101433 30911 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.101974 30911 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.105186 30911 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:47.096014 30803 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.106173 30654 raft_consensus.cc:2468] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:47.107666 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:47.108243 30838 leader_election.cc:290] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:47.108366 30653 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:47.109573 30773 tablet_bootstrap.cc:654] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.114596 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:47.115026 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.116398 30471 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:47.125743 30775 tablet_bootstrap.cc:492] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
W20260709 13:10:47.122607 30545 leader_election.cc:343] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.126528 30775 ts_tablet_manager.cc:1403] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.165s	user 0.013s	sys 0.006s
I20260709 13:10:47.119095 30940 raft_consensus.cc:2804] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.127090 30940 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.127573 30940 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.119061 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:47.133267 30547 leader_election.cc:343] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.125598 30803 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.133859 30547 leader_election.cc:304] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:47.120919 30798 consensus_queue.cc:1048] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:10:47.133306 30654 raft_consensus.cc:3060] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.136246 30838 raft_consensus.cc:2749] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.138684 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:47.145133 30773 tablet_bootstrap.cc:492] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:47.146484 30773 ts_tablet_manager.cc:1403] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.008s
I20260709 13:10:47.146768 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:47.149816 30773 raft_consensus.cc:359] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.150905 30773 raft_consensus.cc:385] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.151252 30773 raft_consensus.cc:740] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.152006 30773 consensus_queue.cc:260] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.146066 30579 raft_consensus.cc:3060] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.157971 30773 ts_tablet_manager.cc:1434] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:47.152762 30803 consensus_queue.cc:1048] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:10:47.152477 30472 leader_election.cc:343] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.162431 30773 tablet_bootstrap.cc:492] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:47.165262 30775 raft_consensus.cc:359] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.166432 30775 raft_consensus.cc:385] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.166673 30775 raft_consensus.cc:740] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.167654 30403 catalog_manager.cc:5697] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.169039 30775 consensus_queue.cc:260] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
W20260709 13:10:47.171115 30472 leader_election.cc:343] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.172453 30940 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.175796 30775 ts_tablet_manager.cc:1434] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:10:47.177211 30775 tablet_bootstrap.cc:492] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:47.180435 30798 raft_consensus.cc:493] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.180995 30798 raft_consensus.cc:515] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.185576 30798 leader_election.cc:290] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.185711 30778 tablet_bootstrap.cc:492] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:47.186362 30778 ts_tablet_manager.cc:1403] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.140s	user 0.019s	sys 0.024s
I20260709 13:10:47.189484 30778 raft_consensus.cc:359] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.190692 30778 raft_consensus.cc:385] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.192436 30778 raft_consensus.cc:740] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.192755 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.195005 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:47.196713 30653 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.200225 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:47.193902 30940 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:47.203563 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.204238 30505 raft_consensus.cc:2468] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:47.196077 30778 consensus_queue.cc:260] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.207468 30784 consensus_queue.cc:1048] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.207815 30774 tablet_bootstrap.cc:492] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:47.208356 30774 ts_tablet_manager.cc:1403] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.153s	user 0.023s	sys 0.017s
I20260709 13:10:47.208873 30784 consensus_queue.cc:1048] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.211303 30774 raft_consensus.cc:359] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.212073 30774 raft_consensus.cc:385] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.213747 30778 ts_tablet_manager.cc:1434] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:10:47.214550 30778 tablet_bootstrap.cc:492] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:47.216005 30619 leader_election.cc:304] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:47.218741 30838 raft_consensus.cc:493] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.216233 30472 leader_election.cc:343] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.219301 30838 raft_consensus.cc:515] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.220045 30579 raft_consensus.cc:2468] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:47.221568 30838 leader_election.cc:290] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:47.233901 30471 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:47.224516 30775 tablet_bootstrap.cc:654] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.224586 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:47.235237 30803 raft_consensus.cc:2804] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.235741 30803 raft_consensus.cc:697] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
W20260709 13:10:47.236071 30546 leader_election.cc:343] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.212098 30653 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:47.230072 30773 tablet_bootstrap.cc:654] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.236410 30803 consensus_queue.cc:237] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.212384 30774 raft_consensus.cc:740] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.242637 30774 consensus_queue.cc:260] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.231527 30778 tablet_bootstrap.cc:654] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.231694 30907 raft_consensus.cc:2804] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.245313 30774 ts_tablet_manager.cc:1434] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:10:47.253542 30774 tablet_bootstrap.cc:492] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:47.253973 30907 raft_consensus.cc:493] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:10:47.254498 30907 raft_consensus.cc:3060] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.259940 30774 tablet_bootstrap.cc:654] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.262130 30471 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:47.273859 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.265287 30911 raft_consensus.cc:2804] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.281198 30911 raft_consensus.cc:697] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:47.282116 30911 consensus_queue.cc:237] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.289199 30778 tablet_bootstrap.cc:492] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:47.289945 30778 ts_tablet_manager.cc:1403] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.008s
I20260709 13:10:47.294487 30907 raft_consensus.cc:515] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.298990 30654 raft_consensus.cc:1240] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:47.302222 30907 leader_election.cc:290] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.310743 30862 raft_consensus.cc:493] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.312222 30545 leader_election.cc:343] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.315721 30545 leader_election.cc:304] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:47.317076 30774 tablet_bootstrap.cc:492] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:47.317251 30784 raft_consensus.cc:2749] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.317602 30774 ts_tablet_manager.cc:1403] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.025s
I20260709 13:10:47.318089 30773 tablet_bootstrap.cc:492] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:47.318598 30773 ts_tablet_manager.cc:1403] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.030s
I20260709 13:10:47.320060 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:47.320806 30774 raft_consensus.cc:359] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.321558 30774 raft_consensus.cc:385] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.321357 30773 raft_consensus.cc:359] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.321910 30774 raft_consensus.cc:740] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.322151 30773 raft_consensus.cc:385] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.322494 30773 raft_consensus.cc:740] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.322749 30774 consensus_queue.cc:260] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.323151 30773 consensus_queue.cc:260] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.312214 30862 raft_consensus.cc:515] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.327574 30404 catalog_manager.cc:5697] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.329062 30775 tablet_bootstrap.cc:492] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:47.329557 30775 ts_tablet_manager.cc:1403] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.153s	user 0.023s	sys 0.010s
I20260709 13:10:47.331902 30774 ts_tablet_manager.cc:1434] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:10:47.333371 30774 tablet_bootstrap.cc:492] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:47.334496 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.335562 30505 raft_consensus.cc:2393] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:47.338215 30844 consensus_queue.cc:1059] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.338696 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:47.339323 30844 raft_consensus.cc:3055] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.339758 30844 raft_consensus.cc:740] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:47.341248 30774 tablet_bootstrap.cc:654] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.342650 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:47.344527 30694 leader_election.cc:304] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:47.345566 30863 raft_consensus.cc:3060] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.346837 30619 leader_election.cc:304] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:47.333725 30862 leader_election.cc:290] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:47.357734 30778 raft_consensus.cc:359] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.358495 30778 raft_consensus.cc:385] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.358771 30778 raft_consensus.cc:740] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.354905 30907 raft_consensus.cc:2749] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.359791 30775 raft_consensus.cc:359] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.362718 30775 raft_consensus.cc:385] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.363037 30775 raft_consensus.cc:740] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.364229 30773 ts_tablet_manager.cc:1434] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:10:47.361958 30778 consensus_queue.cc:260] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.371254 30863 raft_consensus.cc:2749] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.378702 30778 ts_tablet_manager.cc:1434] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.004s
I20260709 13:10:47.378561 30942 consensus_queue.cc:1048] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.380019 30778 tablet_bootstrap.cc:492] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:47.383224 30773 tablet_bootstrap.cc:492] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:47.365875 30775 consensus_queue.cc:260] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.386229 30775 ts_tablet_manager.cc:1434] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:10:47.390641 30844 consensus_queue.cc:260] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.391104 30907 consensus_queue.cc:1048] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.395345 30844 raft_consensus.cc:3060] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.384835 30911 raft_consensus.cc:493] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.396423 30911 raft_consensus.cc:515] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.399446 30775 tablet_bootstrap.cc:492] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:47.400418 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:47.400609 30865 raft_consensus.cc:493] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.401738 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.401700 30865 raft_consensus.cc:515] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.402462 30579 raft_consensus.cc:2468] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:47.403743 30471 leader_election.cc:304] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:47.404094 30865 leader_election.cc:290] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:47.404647 30803 raft_consensus.cc:2804] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.405055 30803 raft_consensus.cc:493] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.405393 30803 raft_consensus.cc:3060] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.405678 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca31368027748349419b6fe09ea1375" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:47.406689 30775 tablet_bootstrap.cc:654] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:47.409286 30546 leader_election.cc:343] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.405373 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca31368027748349419b6fe09ea1375" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:47.411850 30773 tablet_bootstrap.cc:654] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:47.412360 30547 leader_election.cc:343] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.403919 30774 tablet_bootstrap.cc:492] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:47.413811 30774 ts_tablet_manager.cc:1403] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.081s	user 0.036s	sys 0.015s
W20260709 13:10:47.414286 30472 leader_election.cc:343] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.416832 30774 raft_consensus.cc:359] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.412855 30911 leader_election.cc:290] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.419133 30774 raft_consensus.cc:385] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.413168 30547 leader_election.cc:304] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:47.421414 30778 tablet_bootstrap.cc:654] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.422104 30404 catalog_manager.cc:5697] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.424113 30774 raft_consensus.cc:740] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.425539 30404 catalog_manager.cc:5697] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.427973 30774 consensus_queue.cc:260] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.433724 30844 raft_consensus.cc:2749] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.438730 30774 ts_tablet_manager.cc:1434] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:10:47.439886 30774 tablet_bootstrap.cc:492] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
W20260709 13:10:47.441118 30451 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:47.447446 30774 tablet_bootstrap.cc:654] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.449796 30779 consensus_queue.cc:1048] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.450805 30942 raft_consensus.cc:493] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.451360 30942 raft_consensus.cc:515] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.456223 30907 raft_consensus.cc:493] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.456822 30907 raft_consensus.cc:515] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.457623 30803 raft_consensus.cc:515] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.459928 30803 leader_election.cc:290] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.461583 30775 tablet_bootstrap.cc:492] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:47.461422 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:47.462113 30775 ts_tablet_manager.cc:1403] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.000s
I20260709 13:10:47.462160 30580 raft_consensus.cc:3060] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.465197 30775 raft_consensus.cc:359] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.465926 30775 raft_consensus.cc:385] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.466213 30775 raft_consensus.cc:740] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.466701 30842 consensus_queue.cc:1048] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.467453 30775 consensus_queue.cc:260] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.468325 30942 leader_election.cc:290] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:47.468760 30773 tablet_bootstrap.cc:492] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:47.469285 30773 ts_tablet_manager.cc:1403] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.018s
I20260709 13:10:47.469645 30775 ts_tablet_manager.cc:1434] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:47.470376 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:47.470656 30775 tablet_bootstrap.cc:492] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:47.472816 30907 leader_election.cc:290] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:47.474592 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d758ec9801614080a6a30dd820a62459" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.475536 30581 raft_consensus.cc:2468] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:47.476833 30620 leader_election.cc:304] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:47.477002 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:47.477377 30775 tablet_bootstrap.cc:654] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.478274 30907 raft_consensus.cc:2804] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.478729 30907 raft_consensus.cc:493] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.479084 30907 raft_consensus.cc:3060] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.480237 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d758ec9801614080a6a30dd820a62459" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:47.481429 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
W20260709 13:10:47.486274 30621 leader_election.cc:343] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:47.486898 30619 leader_election.cc:343] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:47.487133 30621 leader_election.cc:343] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.487370 30619 leader_election.cc:304] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:47.493784 30778 tablet_bootstrap.cc:492] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
W20260709 13:10:47.489012 30472 leader_election.cc:343] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.495165 30778 ts_tablet_manager.cc:1403] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.000s
I20260709 13:10:47.498096 30778 raft_consensus.cc:359] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.488263 30942 raft_consensus.cc:2749] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.491680 30773 raft_consensus.cc:359] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.503473 30773 raft_consensus.cc:385] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.503793 30773 raft_consensus.cc:740] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.504974 30773 consensus_queue.cc:260] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.508199 30773 ts_tablet_manager.cc:1434] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:10:47.505999 30778 raft_consensus.cc:385] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.502121 30580 raft_consensus.cc:2468] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:47.515591 30773 tablet_bootstrap.cc:492] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:47.515196 30471 leader_election.cc:304] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:47.527333 30842 consensus_queue.cc:1048] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:10:47.540155 30803 raft_consensus.cc:2804] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.540686 30803 raft_consensus.cc:697] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:47.541666 30803 consensus_queue.cc:237] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.542237 30862 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.513831 30778 raft_consensus.cc:740] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.542768 30862 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.547583 30862 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.513370 30774 tablet_bootstrap.cc:492] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:47.548405 30774 ts_tablet_manager.cc:1403] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.002s
I20260709 13:10:47.548305 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.545539 30773 tablet_bootstrap.cc:654] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.512142 30863 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.544811 30778 consensus_queue.cc:260] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.551748 30863 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.554016 30863 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.554174 30778 ts_tablet_manager.cc:1434] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:10:47.555819 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.556180 30778 tablet_bootstrap.cc:492] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:47.558436 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.559139 30726 raft_consensus.cc:3060] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.559798 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.560071 30694 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:47.560873 30579 raft_consensus.cc:2393] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate 5eebf0fa5aba46afa04623642d7795e6 in this term.
I20260709 13:10:47.562495 30694 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:47.563890 30774 raft_consensus.cc:359] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.564848 30774 raft_consensus.cc:385] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.565181 30774 raft_consensus.cc:740] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.577953 30862 raft_consensus.cc:3060] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.587258 30774 consensus_queue.cc:260] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.598003 30774 ts_tablet_manager.cc:1434] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:10:47.511942 30907 raft_consensus.cc:515] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.614548 30774 tablet_bootstrap.cc:492] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:47.624722 30778 tablet_bootstrap.cc:654] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.604308 30907 leader_election.cc:290] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:47.655761 30863 raft_consensus.cc:2749] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.661295 30775 tablet_bootstrap.cc:492] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:47.662011 30775 ts_tablet_manager.cc:1403] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.192s	user 0.052s	sys 0.046s
I20260709 13:10:47.662940 30844 raft_consensus.cc:493] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.663515 30844 raft_consensus.cc:515] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.664345 30862 raft_consensus.cc:2749] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:47.644304 30621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 72005.7us
I20260709 13:10:47.666426 30404 catalog_manager.cc:5697] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.668466 30775 raft_consensus.cc:359] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.670288 30775 raft_consensus.cc:385] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.670594 30775 raft_consensus.cc:740] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.671289 30775 consensus_queue.cc:260] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.672019 30773 tablet_bootstrap.cc:492] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:47.672583 30773 ts_tablet_manager.cc:1403] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.157s	user 0.049s	sys 0.037s
I20260709 13:10:47.673750 30775 ts_tablet_manager.cc:1434] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:10:47.677410 30844 leader_election.cc:290] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:10:47.678889 30981 log.cc:927] Time spent T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:47.680332 30774 tablet_bootstrap.cc:654] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.680436 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.681300 30773 raft_consensus.cc:359] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.681949 30773 raft_consensus.cc:385] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.682205 30773 raft_consensus.cc:740] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.682896 30773 consensus_queue.cc:260] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
W20260709 13:10:47.683983 30545 leader_election.cc:343] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.685048 30773 ts_tablet_manager.cc:1434] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:47.686030 30773 tablet_bootstrap.cc:492] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
W20260709 13:10:47.665256 30620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 103763us
I20260709 13:10:47.689875 30984 raft_consensus.cc:493] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.690460 30984 raft_consensus.cc:515] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.691365 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d758ec9801614080a6a30dd820a62459" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:47.692181 30773 tablet_bootstrap.cc:654] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.692260 30579 raft_consensus.cc:3060] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.693846 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.694537 30580 raft_consensus.cc:2468] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:47.694715 30778 tablet_bootstrap.cc:492] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:47.695428 30778 ts_tablet_manager.cc:1403] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.000s
I20260709 13:10:47.695905 30620 leader_election.cc:304] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:47.696059 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.696790 30503 raft_consensus.cc:2468] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:47.698859 30983 raft_consensus.cc:2804] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.684340 30775 tablet_bootstrap.cc:492] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:47.701005 30803 consensus_queue.cc:1048] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.699419 30983 raft_consensus.cc:493] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.704131 30983 raft_consensus.cc:3060] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.714972 30778 raft_consensus.cc:359] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.715576 30778 raft_consensus.cc:385] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.715858 30778 raft_consensus.cc:740] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.716526 30778 consensus_queue.cc:260] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.717180 30773 tablet_bootstrap.cc:492] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:47.717682 30773 ts_tablet_manager.cc:1403] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.012s
I20260709 13:10:47.718700 30778 ts_tablet_manager.cc:1434] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:10:47.719676 30778 tablet_bootstrap.cc:492] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:47.720604 30773 raft_consensus.cc:359] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.721305 30773 raft_consensus.cc:385] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.721560 30773 raft_consensus.cc:740] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.722231 30773 consensus_queue.cc:260] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.722680 30779 consensus_queue.cc:1048] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.724751 30773 ts_tablet_manager.cc:1434] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:47.725765 30773 tablet_bootstrap.cc:492] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:47.726408 30778 tablet_bootstrap.cc:654] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.733349 30773 tablet_bootstrap.cc:654] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.736213 30844 raft_consensus.cc:493] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.736964 30844 raft_consensus.cc:515] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.743191 30778 tablet_bootstrap.cc:492] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:47.743763 30778 ts_tablet_manager.cc:1403] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.015s
I20260709 13:10:47.744242 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:47.744830 30844 leader_election.cc:290] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
W20260709 13:10:47.745940 30546 leader_election.cc:343] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.746690 30778 raft_consensus.cc:359] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.749091 30778 raft_consensus.cc:385] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.749369 30778 raft_consensus.cc:740] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.749984 30773 tablet_bootstrap.cc:492] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:47.750538 30773 ts_tablet_manager.cc:1403] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.015s
I20260709 13:10:47.753417 30773 raft_consensus.cc:359] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.754051 30775 tablet_bootstrap.cc:654] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.754082 30773 raft_consensus.cc:385] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.754734 30773 raft_consensus.cc:740] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.711946 30803 consensus_queue.cc:1048] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.755465 30773 consensus_queue.cc:260] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.757699 30773 ts_tablet_manager.cc:1434] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:47.758641 30773 tablet_bootstrap.cc:492] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:47.750037 30778 consensus_queue.cc:260] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.712880 30984 leader_election.cc:290] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.767472 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:47.768885 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d758ec9801614080a6a30dd820a62459" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:47.769629 30803 raft_consensus.cc:493] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.770179 30803 raft_consensus.cc:515] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:10:47.771741 30547 leader_election.cc:343] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.772269 30547 leader_election.cc:304] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:47.762568 30579 raft_consensus.cc:2468] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:47.778079 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.778898 30503 raft_consensus.cc:2468] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:47.779296 30779 raft_consensus.cc:493] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.779820 30779 raft_consensus.cc:515] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.781898 30779 leader_election.cc:290] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.781840 30940 consensus_queue.cc:1048] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.784191 30620 leader_election.cc:304] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:47.785147 30778 ts_tablet_manager.cc:1434] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:10:47.787663 30778 tablet_bootstrap.cc:492] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:47.774941 30865 raft_consensus.cc:2749] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.786808 30803 leader_election.cc:290] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
W20260709 13:10:47.796841 30621 leader_election.cc:343] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.815088 30980 raft_consensus.cc:2804] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.817325 30980 raft_consensus.cc:697] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:47.819319 30774 tablet_bootstrap.cc:492] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:47.819851 30774 ts_tablet_manager.cc:1403] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.206s	user 0.050s	sys 0.033s
I20260709 13:10:47.822633 30774 raft_consensus.cc:359] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.826957 30774 raft_consensus.cc:385] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.827378 30774 raft_consensus.cc:740] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.828325 30774 consensus_queue.cc:260] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.794407 30983 raft_consensus.cc:515] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.818326 30980 consensus_queue.cc:237] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:47.835494 30862 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.836091 30862 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:47.841401 30774 ts_tablet_manager.cc:1434] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:10:47.841974 30862 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:47.831177 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:47.831411 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.842118 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.842576 30774 tablet_bootstrap.cc:492] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:47.842864 30775 tablet_bootstrap.cc:492] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
W20260709 13:10:47.826071 30472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 48032.7us
I20260709 13:10:47.845795 30773 tablet_bootstrap.cc:654] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.847486 30545 leader_election.cc:304] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:47.846200 30775 ts_tablet_manager.cc:1403] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.162s	user 0.026s	sys 0.017s
I20260709 13:10:47.850975 30865 raft_consensus.cc:2804] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.851397 30865 raft_consensus.cc:493] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.851747 30865 raft_consensus.cc:3060] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.852072 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:47.852732 30503 raft_consensus.cc:3060] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.853219 30775 raft_consensus.cc:359] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.853948 30775 raft_consensus.cc:385] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.854218 30775 raft_consensus.cc:740] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.855436 30775 consensus_queue.cc:260] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.858959 30862 raft_consensus.cc:493] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.864673 30862 raft_consensus.cc:515] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.866024 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:47.868436 30983 leader_election.cc:290] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.855732 30580 raft_consensus.cc:2468] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:47.845456 30654 raft_consensus.cc:2468] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:47.860833 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:47.873032 30694 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:47.875684 30987 raft_consensus.cc:2749] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.876837 30983 raft_consensus.cc:493] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.878019 30471 leader_election.cc:304] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:47.885424 30775 ts_tablet_manager.cc:1434] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:10:47.891006 30775 tablet_bootstrap.cc:492] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:47.883523 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.880836 30911 consensus_queue.cc:1048] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 13:10:47.888185 30472 leader_election.cc:343] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.887624 30983 raft_consensus.cc:515] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.895273 30995 raft_consensus.cc:2804] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.903438 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:47.892140 30862 leader_election.cc:290] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.900921 30778 tablet_bootstrap.cc:654] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.903566 30995 raft_consensus.cc:493] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.894492 30864 raft_consensus.cc:493] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.900604 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.906184 30983 leader_election.cc:290] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:47.907763 30865 raft_consensus.cc:515] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.910356 30995 raft_consensus.cc:3060] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.911147 30864 raft_consensus.cc:515] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:47.916723 30579 raft_consensus.cc:2393] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate 5eebf0fa5aba46afa04623642d7795e6 in this term.
I20260709 13:10:47.918088 30694 leader_election.cc:304] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:47.918320 30864 leader_election.cc:290] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:47.919891 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e3aaad672f42e5838c628da427a0b7" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:47.920347 30471 leader_election.cc:304] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:47.921188 30911 raft_consensus.cc:2804] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.921571 30911 raft_consensus.cc:493] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.921928 30911 raft_consensus.cc:3060] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.921855 30940 consensus_queue.cc:1048] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.922971 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:47.923525 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:47.924134 30581 raft_consensus.cc:3060] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.924754 30862 raft_consensus.cc:3060] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:47.925576 30547 leader_election.cc:343] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:47.928012 30620 leader_election.cc:343] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.933772 30865 leader_election.cc:290] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:47.942251 30774 tablet_bootstrap.cc:654] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:47.943008 30472 leader_election.cc:343] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.945470 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.946220 30506 raft_consensus.cc:2468] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:47.947520 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
W20260709 13:10:47.950006 30546 leader_election.cc:343] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.956254 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e3aaad672f42e5838c628da427a0b7" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:47.965430 30773 tablet_bootstrap.cc:492] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:47.965273 30581 raft_consensus.cc:2468] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:47.966003 30773 ts_tablet_manager.cc:1403] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.208s	user 0.013s	sys 0.004s
I20260709 13:10:47.967149 30545 leader_election.cc:304] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:47.968320 30865 raft_consensus.cc:2804] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.968876 30865 raft_consensus.cc:493] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.969250 30865 raft_consensus.cc:3060] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.971220 30726 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.973786 30775 tablet_bootstrap.cc:654] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.973848 30773 raft_consensus.cc:359] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.974653 30773 raft_consensus.cc:385] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.974974 30773 raft_consensus.cc:740] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.975693 30773 consensus_queue.cc:260] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:47.977614 30862 raft_consensus.cc:2749] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.980531 30620 leader_election.cc:304] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
W20260709 13:10:47.996668 30619 leader_election.cc:343] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.998611 30619 leader_election.cc:304] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:48.001056 30773 ts_tablet_manager.cc:1434] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:10:47.950313 30503 raft_consensus.cc:2468] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:48.002980 30773 tablet_bootstrap.cc:492] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:47.983096 30980 raft_consensus.cc:2804] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.009565 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:48.010504 30505 raft_consensus.cc:3060] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.012424 30986 raft_consensus.cc:2749] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:48.017148 30403 catalog_manager.cc:5697] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.019723 30844 raft_consensus.cc:493] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.020309 30844 raft_consensus.cc:515] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.022468 30844 leader_election.cc:290] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:48.024789 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a322c98a8d493ab4377fe92a1c01db" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:48.026221 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a322c98a8d493ab4377fe92a1c01db" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:48.027833 30546 leader_election.cc:343] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.029580 30774 tablet_bootstrap.cc:492] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:48.030119 30774 ts_tablet_manager.cc:1403] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.188s	user 0.018s	sys 0.000s
I20260709 13:10:48.032871 30774 raft_consensus.cc:359] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.033538 30774 raft_consensus.cc:385] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.033793 30774 raft_consensus.cc:740] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
W20260709 13:10:48.034986 30547 leader_election.cc:343] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.035482 30547 leader_election.cc:304] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:48.036365 30844 raft_consensus.cc:2749] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:48.037047 30778 tablet_bootstrap.cc:492] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:48.037688 30778 ts_tablet_manager.cc:1403] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.252s	user 0.017s	sys 0.005s
I20260709 13:10:48.036917 30995 raft_consensus.cc:515] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.044876 30865 raft_consensus.cc:515] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.046169 30773 tablet_bootstrap.cc:654] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.046918 30911 raft_consensus.cc:515] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.040581 30778 raft_consensus.cc:359] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.048525 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:48.055753 30778 raft_consensus.cc:385] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.057348 30778 raft_consensus.cc:740] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.059805 30995 leader_election.cc:290] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:48.059854 30778 consensus_queue.cc:260] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
W20260709 13:10:48.063099 30547 leader_election.cc:343] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.067938 30911 leader_election.cc:290] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:48.056388 30980 raft_consensus.cc:697] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:48.075030 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:48.075553 30980 consensus_queue.cc:237] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.076776 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:48.074445 30505 raft_consensus.cc:2468] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:48.080986 30778 ts_tablet_manager.cc:1434] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 13:10:48.082926 30865 leader_election.cc:290] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:10:48.084811 30472 leader_election.cc:343] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.084945 30803 consensus_queue.cc:1048] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:48.086938 30911 consensus_queue.cc:1048] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:48.057255 30471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 109573us
I20260709 13:10:48.091770 30545 leader_election.cc:304] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:48.093962 30775 tablet_bootstrap.cc:492] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:48.034446 30774 consensus_queue.cc:260] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.098079 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:48.099026 30775 ts_tablet_manager.cc:1403] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.208s	user 0.011s	sys 0.026s
I20260709 13:10:48.099107 30655 raft_consensus.cc:3060] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.100879 30778 tablet_bootstrap.cc:492] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:48.102183 30775 raft_consensus.cc:359] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.102882 30775 raft_consensus.cc:385] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.103137 30775 raft_consensus.cc:740] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.100021 30774 ts_tablet_manager.cc:1434] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:10:48.105365 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:48.105321 30775 consensus_queue.cc:260] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.106303 30579 raft_consensus.cc:3060] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.106688 30774 tablet_bootstrap.cc:492] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:48.106506 30844 raft_consensus.cc:2804] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.113042 30844 raft_consensus.cc:697] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:48.114014 30844 consensus_queue.cc:237] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.118480 30726 raft_consensus.cc:3060] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.120009 30987 raft_consensus.cc:493] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.120455 30773 tablet_bootstrap.cc:492] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:48.120517 30987 raft_consensus.cc:515] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.123165 30987 leader_election.cc:290] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:48.123649 30774 tablet_bootstrap.cc:654] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.126191 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d758ec9801614080a6a30dd820a62459" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:48.127044 30581 raft_consensus.cc:2393] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:48.127538 30775 ts_tablet_manager.cc:1434] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:10:48.121255 30773 ts_tablet_manager.cc:1403] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.119s	user 0.008s	sys 0.004s
I20260709 13:10:48.128837 30775 tablet_bootstrap.cc:492] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:48.133980 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d758ec9801614080a6a30dd820a62459" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:48.135807 30694 leader_election.cc:304] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:48.140877 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:48.141644 30505 raft_consensus.cc:3060] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.142272 30862 raft_consensus.cc:3060] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.178360 30579 raft_consensus.cc:2468] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:48.179874 30471 leader_election.cc:304] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:48.181392 30911 raft_consensus.cc:2804] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.181967 30911 raft_consensus.cc:697] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:48.145313 30773 raft_consensus.cc:359] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.183346 30773 raft_consensus.cc:385] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.183668 30773 raft_consensus.cc:740] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.183878 30911 consensus_queue.cc:237] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.184420 30773 consensus_queue.cc:260] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.184772 30505 raft_consensus.cc:2468] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:48.186056 30545 leader_election.cc:304] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:48.148545 30402 catalog_manager.cc:5697] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.186911 30726 raft_consensus.cc:2468] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:48.187264 30865 raft_consensus.cc:2804] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.188001 30865 raft_consensus.cc:697] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:48.186681 30773 ts_tablet_manager.cc:1434] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.002s
I20260709 13:10:48.163645 30774 tablet_bootstrap.cc:492] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:48.190340 30774 ts_tablet_manager.cc:1403] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.017s
I20260709 13:10:48.190716 30773 tablet_bootstrap.cc:492] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:48.172322 30984 raft_consensus.cc:493] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.192022 30984 raft_consensus.cc:515] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.189065 30865 consensus_queue.cc:237] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.194137 30984 leader_election.cc:290] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:48.195236 30472 leader_election.cc:304] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:48.158020 30775 tablet_bootstrap.cc:654] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.201874 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca31368027748349419b6fe09ea1375" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:48.202695 30579 raft_consensus.cc:2468] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:48.118531 30778 tablet_bootstrap.cc:654] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.140720 30995 consensus_queue.cc:1048] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:48.196762 30940 raft_consensus.cc:2804] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.204192 30940 raft_consensus.cc:697] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:48.204757 30620 leader_election.cc:304] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:48.205327 30940 consensus_queue.cc:237] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.207324 30773 tablet_bootstrap.cc:654] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.200205 30862 raft_consensus.cc:2749] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:48.182430 30655 raft_consensus.cc:2468] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:48.213860 30774 raft_consensus.cc:359] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.214911 30774 raft_consensus.cc:385] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.215253 30774 raft_consensus.cc:740] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.216349 30774 consensus_queue.cc:260] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.219159 30774 ts_tablet_manager.cc:1434] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 13:10:48.220242 30774 tablet_bootstrap.cc:492] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:48.212415 30984 raft_consensus.cc:2804] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:48.221424 30984 raft_consensus.cc:493] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.221899 30984 raft_consensus.cc:3060] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.230202 30774 tablet_bootstrap.cc:654] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.235720 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca31368027748349419b6fe09ea1375" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:48.240724 30402 catalog_manager.cc:5697] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.246426 30403 catalog_manager.cc:5697] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:48.247855 30621 leader_election.cc:343] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.256994 30984 raft_consensus.cc:515] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.282843 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca31368027748349419b6fe09ea1375" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:48.285084 30581 raft_consensus.cc:3060] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.284089 30984 leader_election.cc:290] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:48.286881 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca31368027748349419b6fe09ea1375" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
W20260709 13:10:48.288570 30621 leader_election.cc:343] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.290887 30775 tablet_bootstrap.cc:492] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:48.291420 30775 ts_tablet_manager.cc:1403] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.163s	user 0.014s	sys 0.004s
I20260709 13:10:48.296571 30775 raft_consensus.cc:359] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.297309 30775 raft_consensus.cc:385] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.297598 30775 raft_consensus.cc:740] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.301733 30581 raft_consensus.cc:2468] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:48.304688 30620 leader_election.cc:304] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:48.304816 30404 catalog_manager.cc:5697] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:48.306354 30983 raft_consensus.cc:2804] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.310760 30983 raft_consensus.cc:697] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:48.311872 30983 consensus_queue.cc:237] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.306571 30778 tablet_bootstrap.cc:492] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:48.319129 30778 ts_tablet_manager.cc:1403] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.237s	user 0.008s	sys 0.012s
I20260709 13:10:48.302517 30775 consensus_queue.cc:260] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.307507 30773 tablet_bootstrap.cc:492] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:48.299804 30980 consensus_queue.cc:1048] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:10:48.322348 30773 ts_tablet_manager.cc:1403] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.132s	user 0.014s	sys 0.004s
I20260709 13:10:48.323545 30775 ts_tablet_manager.cc:1434] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:10:48.324580 30775 tablet_bootstrap.cc:492] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:48.325314 30773 raft_consensus.cc:359] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.326004 30774 tablet_bootstrap.cc:492] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:48.326241 30773 raft_consensus.cc:385] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.326568 30774 ts_tablet_manager.cc:1403] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.003s
I20260709 13:10:48.326700 30773 raft_consensus.cc:740] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.327620 30778 raft_consensus.cc:359] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.327898 30773 consensus_queue.cc:260] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.332180 30778 raft_consensus.cc:385] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.332711 30775 tablet_bootstrap.cc:654] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.333374 30980 raft_consensus.cc:493] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.334128 30773 ts_tablet_manager.cc:1434] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:10:48.333912 30980 raft_consensus.cc:515] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.335373 30773 tablet_bootstrap.cc:492] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:48.337415 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a322c98a8d493ab4377fe92a1c01db" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:48.338392 30581 raft_consensus.cc:2468] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:48.331264 30403 catalog_manager.cc:5697] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:48.340607 30620 leader_election.cc:304] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:48.329660 30774 raft_consensus.cc:359] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.341871 30774 raft_consensus.cc:385] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.342200 30774 raft_consensus.cc:740] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.343456 30980 leader_election.cc:290] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:48.332685 30778 raft_consensus.cc:740] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.344676 30778 consensus_queue.cc:260] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.346740 30773 tablet_bootstrap.cc:654] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.346647 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a322c98a8d493ab4377fe92a1c01db" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:48.347988 30778 ts_tablet_manager.cc:1434] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 13:10:48.348059 30402 catalog_manager.cc:5697] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.349138 30778 tablet_bootstrap.cc:492] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:48.349650 30774 consensus_queue.cc:260] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:10:48.351797 30621 leader_election.cc:343] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.341663 30984 raft_consensus.cc:2804] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:48.353423 30984 raft_consensus.cc:493] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.353812 30984 raft_consensus.cc:3060] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.354140 30774 ts_tablet_manager.cc:1434] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:10:48.355170 30774 tablet_bootstrap.cc:492] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:48.360378 30986 consensus_queue.cc:1048] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:48.361002 30774 tablet_bootstrap.cc:654] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.367803 30778 tablet_bootstrap.cc:654] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.385319 30984 raft_consensus.cc:515] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.399192 30940 raft_consensus.cc:493] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.399972 30940 raft_consensus.cc:515] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.404268 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a9c51005141eb9c585ad91a67d779" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:48.406540 30471 leader_election.cc:343] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.409454 30940 leader_election.cc:290] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:48.409713 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a9c51005141eb9c585ad91a67d779" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:48.411815 30472 leader_election.cc:343] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.412488 30472 leader_election.cc:304] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:48.423002 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a322c98a8d493ab4377fe92a1c01db" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:48.423704 30579 raft_consensus.cc:3060] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.424106 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a322c98a8d493ab4377fe92a1c01db" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:48.424918 30775 tablet_bootstrap.cc:492] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:48.425407 30775 ts_tablet_manager.cc:1403] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.006s
W20260709 13:10:48.425884 30621 leader_election.cc:343] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.427214 30940 raft_consensus.cc:2749] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:48.429486 30775 raft_consensus.cc:359] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.431608 30579 raft_consensus.cc:2468] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:48.433027 30620 leader_election.cc:304] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:48.433924 30986 raft_consensus.cc:2804] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.434443 30986 raft_consensus.cc:697] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:48.435385 30984 leader_election.cc:290] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:48.436097 30987 raft_consensus.cc:493] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.435977 30986 consensus_queue.cc:237] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.436820 30987 raft_consensus.cc:515] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.440495 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:48.441336 30505 raft_consensus.cc:2393] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate fe9b995b077d4cb795f08934ed7d9088 in this term.
I20260709 13:10:48.441272 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:48.440523 30987 leader_election.cc:290] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:48.443686 30774 tablet_bootstrap.cc:492] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:48.443747 30693 leader_election.cc:304] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:48.444274 30774 ts_tablet_manager.cc:1403] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.026s
I20260709 13:10:48.445072 30987 raft_consensus.cc:3060] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.447170 30774 raft_consensus.cc:359] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.447949 30774 raft_consensus.cc:385] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.430519 30775 raft_consensus.cc:385] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.448298 30774 raft_consensus.cc:740] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.448797 30775 raft_consensus.cc:740] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.449580 30774 consensus_queue.cc:260] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.451814 30773 tablet_bootstrap.cc:492] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:48.452340 30773 ts_tablet_manager.cc:1403] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.117s	user 0.034s	sys 0.027s
I20260709 13:10:48.452979 30774 ts_tablet_manager.cc:1434] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:48.453383 30775 consensus_queue.cc:260] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.455911 30774 tablet_bootstrap.cc:492] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:48.456893 30775 ts_tablet_manager.cc:1434] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 13:10:48.457908 30775 tablet_bootstrap.cc:492] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:48.454720 30778 tablet_bootstrap.cc:492] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:48.458478 30778 ts_tablet_manager.cc:1403] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.110s	user 0.016s	sys 0.018s
I20260709 13:10:48.458940 30773 raft_consensus.cc:359] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.459602 30773 raft_consensus.cc:385] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.459872 30773 raft_consensus.cc:740] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.460848 30773 consensus_queue.cc:260] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.461759 30995 raft_consensus.cc:493] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.462212 30995 raft_consensus.cc:515] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.464475 30995 leader_election.cc:290] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:48.465184 30778 raft_consensus.cc:359] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.465960 30778 raft_consensus.cc:385] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.466287 30778 raft_consensus.cc:740] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.467329 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:48.468760 30773 ts_tablet_manager.cc:1434] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:10:48.468613 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:48.469280 30778 consensus_queue.cc:260] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.469702 30864 raft_consensus.cc:493] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:48.469961 30471 leader_election.cc:343] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.470326 30864 raft_consensus.cc:515] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
W20260709 13:10:48.470714 30471 leader_election.cc:343] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.471160 30774 tablet_bootstrap.cc:654] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.471390 30775 tablet_bootstrap.cc:654] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.471272 30471 leader_election.cc:304] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:48.472884 30995 raft_consensus.cc:2749] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:48.471267 30773 tablet_bootstrap.cc:492] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:48.473857 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:48.474340 30653 raft_consensus.cc:2468] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:48.475692 30864 leader_election.cc:290] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:48.475932 30546 leader_election.cc:304] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:48.477094 30865 raft_consensus.cc:2804] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:48.477298 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:48.477582 30865 raft_consensus.cc:493] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.478078 30865 raft_consensus.cc:3060] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:48.478926 30547 leader_election.cc:343] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.480083 30402 catalog_manager.cc:5697] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.485464 30778 ts_tablet_manager.cc:1434] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:10:48.486976 30773 tablet_bootstrap.cc:654] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.490316 30987 raft_consensus.cc:2749] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:48.494702 30778 tablet_bootstrap.cc:492] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:48.495427 30986 consensus_queue.cc:1048] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:48.500176 30987 raft_consensus.cc:493] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.501164 30987 raft_consensus.cc:515] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.504325 30987 leader_election.cc:290] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:48.504725 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a322c98a8d493ab4377fe92a1c01db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:48.505605 30579 raft_consensus.cc:2393] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:48.506505 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a322c98a8d493ab4377fe92a1c01db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:48.507231 30778 tablet_bootstrap.cc:654] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.514333 30980 consensus_queue.cc:1048] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:48.517313 30694 leader_election.cc:304] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:48.516939 30865 raft_consensus.cc:515] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.519971 30987 raft_consensus.cc:3060] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.521314 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:48.521947 30653 raft_consensus.cc:3060] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.527920 30862 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.528522 30862 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.529557 30865 leader_election.cc:290] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:48.530715 30862 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:48.541710 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:48.542189 30774 tablet_bootstrap.cc:492] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:48.536280 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:48.544353 30774 ts_tablet_manager.cc:1403] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.001s
W20260709 13:10:48.545025 30694 leader_election.cc:343] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.537851 30987 raft_consensus.cc:2749] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:48.539091 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:48.547886 30844 consensus_queue.cc:1048] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:48.548625 30774 raft_consensus.cc:359] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.558822 30864 raft_consensus.cc:493] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.575811 30774 raft_consensus.cc:385] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.576195 30774 raft_consensus.cc:740] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.575953 30864 raft_consensus.cc:515] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.576926 30774 consensus_queue.cc:260] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.577787 30505 raft_consensus.cc:2468] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:48.578460 30773 tablet_bootstrap.cc:492] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:48.580368 30773 ts_tablet_manager.cc:1403] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.109s	user 0.022s	sys 0.016s
I20260709 13:10:48.580787 30693 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:48.578497 30864 leader_election.cc:290] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:10:48.578540 30547 leader_election.cc:343] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.585827 30862 raft_consensus.cc:2804] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:48.586349 30862 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.586632 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ec91d866c84f30813b1d51ebf9a214" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:48.586753 30862 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.590401 30773 raft_consensus.cc:359] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.591272 30773 raft_consensus.cc:385] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.591599 30773 raft_consensus.cc:740] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.594146 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ec91d866c84f30813b1d51ebf9a214" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:48.595031 30506 raft_consensus.cc:2468] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:48.601754 30773 consensus_queue.cc:260] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.603592 30545 leader_election.cc:304] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:48.606722 30864 raft_consensus.cc:2804] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:48.607311 30864 raft_consensus.cc:493] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.607707 30864 raft_consensus.cc:3060] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.607412 30862 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.611513 30773 ts_tablet_manager.cc:1434] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:10:48.612087 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:48.613677 30503 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.613759 30773 tablet_bootstrap.cc:492] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
W20260709 13:10:48.614496 30547 leader_election.cc:343] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.612171 30862 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:48.623240 30774 ts_tablet_manager.cc:1434] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.011s
I20260709 13:10:48.624877 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:48.626466 30774 tablet_bootstrap.cc:492] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:48.639125 30995 consensus_queue.cc:1048] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:48.645135 30864 raft_consensus.cc:515] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
W20260709 13:10:48.647692 30694 leader_election.cc:343] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.648494 30503 raft_consensus.cc:2468] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:48.650490 30693 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:48.653715 31035 raft_consensus.cc:2804] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.654273 31035 raft_consensus.cc:697] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:48.655117 31035 consensus_queue.cc:237] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.656998 30775 tablet_bootstrap.cc:492] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:48.657575 30775 ts_tablet_manager.cc:1403] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.200s	user 0.018s	sys 0.013s
I20260709 13:10:48.660807 30773 tablet_bootstrap.cc:654] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:48.663791 30547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 59566.7us
I20260709 13:10:48.664132 30864 leader_election.cc:290] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:10:48.660880 30472 consensus_peers.cc:597] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 -> Peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Couldn't send request to peer ce7bd1ecd6e44f32879851d7b3174acb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.690487 30774 tablet_bootstrap.cc:654] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.697710 30778 tablet_bootstrap.cc:492] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:48.698379 30778 ts_tablet_manager.cc:1403] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.204s	user 0.015s	sys 0.029s
I20260709 13:10:48.699787 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ec91d866c84f30813b1d51ebf9a214" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
W20260709 13:10:48.696441 30451 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:48.701807 30778 raft_consensus.cc:359] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.704674 30778 raft_consensus.cc:385] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.705111 30778 raft_consensus.cc:740] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.707064 30775 raft_consensus.cc:359] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.708297 30775 raft_consensus.cc:385] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.708709 30775 raft_consensus.cc:740] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.715013 30775 consensus_queue.cc:260] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.717223 30778 consensus_queue.cc:260] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.723495 30778 ts_tablet_manager.cc:1434] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:10:48.703084 30653 raft_consensus.cc:2468] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:48.735831 30864 raft_consensus.cc:493] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.739217 30774 tablet_bootstrap.cc:492] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:48.744683 30774 ts_tablet_manager.cc:1403] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.011s
I20260709 13:10:48.758844 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ec91d866c84f30813b1d51ebf9a214" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:48.759595 30505 raft_consensus.cc:3060] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.760339 30778 tablet_bootstrap.cc:492] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:48.750684 30864 raft_consensus.cc:515] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.763023 30864 leader_election.cc:290] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:48.764946 30404 catalog_manager.cc:5697] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 1 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.769124 30983 raft_consensus.cc:493] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:48.778697 30547 leader_election.cc:343] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.769690 30983 raft_consensus.cc:515] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.784994 30983 leader_election.cc:290] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
W20260709 13:10:48.792482 31032 log.cc:927] Time spent T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:48.796324 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:48.801574 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:48.804968 31041 consensus_queue.cc:1048] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:48.817342 30773 tablet_bootstrap.cc:492] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:48.817977 30773 ts_tablet_manager.cc:1403] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.204s	user 0.025s	sys 0.033s
I20260709 13:10:48.819514 30505 raft_consensus.cc:2468] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:48.822242 30940 consensus_queue.cc:1048] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:48.821938 30773 raft_consensus.cc:359] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.825445 30773 raft_consensus.cc:385] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.825961 30773 raft_consensus.cc:740] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
W20260709 13:10:48.826689 30621 consensus_peers.cc:597] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Couldn't send request to peer ce7bd1ecd6e44f32879851d7b3174acb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.826979 30773 consensus_queue.cc:260] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.830394 30773 ts_tablet_manager.cc:1434] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:10:48.809221 30774 raft_consensus.cc:359] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.832571 30774 raft_consensus.cc:385] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.833050 30774 raft_consensus.cc:740] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.837873 30773 tablet_bootstrap.cc:492] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:48.845011 30778 tablet_bootstrap.cc:654] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.822016 30619 leader_election.cc:304] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:48.852581 30774 consensus_queue.cc:260] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.864334 30775 ts_tablet_manager.cc:1434] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.206s	user 0.053s	sys 0.046s
I20260709 13:10:48.864334 30774 ts_tablet_manager.cc:1434] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.004s
I20260709 13:10:48.865737 30775 tablet_bootstrap.cc:492] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:48.859854 30983 raft_consensus.cc:2749] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:48.867738 30773 tablet_bootstrap.cc:654] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.867991 30774 tablet_bootstrap.cc:492] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:48.871042 30546 leader_election.cc:304] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:48.879309 31046 raft_consensus.cc:2804] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.883937 30655 raft_consensus.cc:3060] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.885332 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e3aaad672f42e5838c628da427a0b7" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:48.892791 30654 raft_consensus.cc:2468] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:48.894590 30545 leader_election.cc:304] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:48.895792 31043 raft_consensus.cc:2804] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.896365 31043 raft_consensus.cc:697] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:48.900542 30546 leader_election.cc:304] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:48.901162 30940 consensus_queue.cc:1048] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:48.886288 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e3aaad672f42e5838c628da427a0b7" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:48.906912 31046 raft_consensus.cc:697] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:48.907451 30505 raft_consensus.cc:2468] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:48.885593 30775 tablet_bootstrap.cc:654] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.908144 31046 consensus_queue.cc:237] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.911330 30865 raft_consensus.cc:2804] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:48.911827 30865 raft_consensus.cc:493] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.911650 31044 consensus_queue.cc:1048] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:48.912273 30865 raft_consensus.cc:3060] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.902694 31045 raft_consensus.cc:493] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:10:48.915186 31045 raft_consensus.cc:515] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.923918 30980 consensus_queue.cc:1048] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:48.928733 30773 tablet_bootstrap.cc:492] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:48.931825 30773 ts_tablet_manager.cc:1403] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.002s
I20260709 13:10:48.935096 30773 raft_consensus.cc:359] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.930087 30865 raft_consensus.cc:515] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.901948 31043 consensus_queue.cc:237] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:48.938196 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:48.939100 30579 raft_consensus.cc:2468] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:10:48.939574 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e3aaad672f42e5838c628da427a0b7" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:48.940312 30655 raft_consensus.cc:3060] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.940567 31047 consensus_queue.cc:1048] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:48.946846 30980 raft_consensus.cc:493] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.947371 30865 leader_election.cc:290] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:48.947418 30980 raft_consensus.cc:515] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.949340 30773 raft_consensus.cc:385] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.949463 31045 leader_election.cc:290] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:48.949755 30773 raft_consensus.cc:740] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.951399 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:48.951728 30655 raft_consensus.cc:2468] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:48.951844 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e3aaad672f42e5838c628da427a0b7" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:48.952165 30505 raft_consensus.cc:2468] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:48.952666 30503 raft_consensus.cc:3060] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.952700 30773 consensus_queue.cc:260] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.954605 30773 ts_tablet_manager.cc:1434] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:10:48.955224 30778 tablet_bootstrap.cc:492] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:48.955873 30546 leader_election.cc:304] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:48.956434 30980 leader_election.cc:290] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:48.956970 30865 raft_consensus.cc:2804] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.957612 30865 raft_consensus.cc:697] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:48.958660 30865 consensus_queue.cc:237] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.959440 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:48.960259 30579 raft_consensus.cc:2468] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 2.
I20260709 13:10:48.960511 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:48.961472 30653 raft_consensus.cc:2393] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 in current term 2: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:48.961603 30620 leader_election.cc:304] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:48.955888 30778 ts_tablet_manager.cc:1403] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.196s	user 0.011s	sys 0.006s
I20260709 13:10:48.962903 30980 raft_consensus.cc:2804] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:48.963392 30980 raft_consensus.cc:493] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.963809 30980 raft_consensus.cc:3060] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.967530 31035 raft_consensus.cc:493] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.968252 31035 raft_consensus.cc:515] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.969735 30778 raft_consensus.cc:359] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.970687 30503 raft_consensus.cc:2468] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:48.990952 30778 raft_consensus.cc:385] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.977792 30471 leader_election.cc:304] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:48.991671 30778 raft_consensus.cc:740] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.973515 30911 raft_consensus.cc:493] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.992769 30778 consensus_queue.cc:260] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:48.992835 31045 raft_consensus.cc:2804] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:48.973811 30862 raft_consensus.cc:493] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.993991 31045 raft_consensus.cc:493] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:10:48.974442 30773 tablet_bootstrap.cc:492] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:48.994731 31045 raft_consensus.cc:3060] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.994518 30862 raft_consensus.cc:515] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:48.990573 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a9c51005141eb9c585ad91a67d779" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:48.996304 30506 raft_consensus.cc:2468] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:48.982492 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a9c51005141eb9c585ad91a67d779" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:48.997328 30652 raft_consensus.cc:2468] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:48.997494 30693 leader_election.cc:304] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:48.997572 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:48.998534 30987 raft_consensus.cc:2804] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:48.998960 30987 raft_consensus.cc:493] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.992805 30911 raft_consensus.cc:515] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:48.999303 30987 raft_consensus.cc:3060] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.999995 30862 leader_election.cc:290] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:48.985960 31035 leader_election.cc:290] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:49.001559 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:49.002774 30652 raft_consensus.cc:2393] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate fe9b995b077d4cb795f08934ed7d9088 in this term.
I20260709 13:10:49.005678 30773 tablet_bootstrap.cc:654] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.008432 30694 leader_election.cc:304] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:49.013001 30865 raft_consensus.cc:493] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.013574 30865 raft_consensus.cc:515] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:49.006613 30911 leader_election.cc:290] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:49.015765 30865 leader_election.cc:290] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:48.994481 30778 ts_tablet_manager.cc:1434] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.008s
I20260709 13:10:49.017861 30778 tablet_bootstrap.cc:492] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:49.017805 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b693fc5a9c3477a87a09ce7d3c57859" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:49.019438 30546 leader_election.cc:343] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.020299 30986 consensus_queue.cc:1048] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:49.021874 31035 raft_consensus.cc:3060] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.025673 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:49.028331 30778 tablet_bootstrap.cc:654] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:49.028752 30471 leader_election.cc:343] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.034070 31045 raft_consensus.cc:515] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.037571 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:49.038043 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:49.038923 31045 leader_election.cc:290] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:49.042169 30778 tablet_bootstrap.cc:492] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:49.042678 30778 ts_tablet_manager.cc:1403] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.008s
I20260709 13:10:49.046193 30577 raft_consensus.cc:2468] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:10:49.052748 30774 tablet_bootstrap.cc:654] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.061168 30980 raft_consensus.cc:515] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.062628 30652 raft_consensus.cc:2368] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 for earlier term 2. Current term is 3.
I20260709 13:10:49.010331 30987 raft_consensus.cc:515] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:49.053495 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b693fc5a9c3477a87a09ce7d3c57859" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:49.065943 30471 leader_election.cc:400] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Vote denied by peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377) with higher term. Message: Invalid argument: T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 for earlier term 2. Current term is 3.
I20260709 13:10:49.066293 30471 leader_election.cc:403] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:49.060338 31035 raft_consensus.cc:2749] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.066838 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a9c51005141eb9c585ad91a67d779" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:49.067414 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a9c51005141eb9c585ad91a67d779" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:49.067314 30778 raft_consensus.cc:359] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.067569 30652 raft_consensus.cc:3060] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.068567 30987 leader_election.cc:290] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:49.068917 30980 leader_election.cc:290] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:49.069245 30803 raft_consensus.cc:3060] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.050917 30984 consensus_queue.cc:1048] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.068120 30503 raft_consensus.cc:3060] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.068135 30778 raft_consensus.cc:385] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.072664 30778 raft_consensus.cc:740] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.074393 30778 consensus_queue.cc:260] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:49.076396 30547 leader_election.cc:343] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.077025 30547 leader_election.cc:304] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:49.078024 31046 raft_consensus.cc:2749] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.079371 30404 catalog_manager.cc:5697] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.080785 30503 raft_consensus.cc:2468] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:49.082652 30778 ts_tablet_manager.cc:1434] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:10:49.083987 30693 leader_election.cc:304] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:49.085276 30778 tablet_bootstrap.cc:492] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:49.054921 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:49.089395 30987 raft_consensus.cc:2804] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.090229 30987 raft_consensus.cc:697] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:49.091338 30987 consensus_queue.cc:237] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:49.093619 30775 tablet_bootstrap.cc:492] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:49.105585 30775 ts_tablet_manager.cc:1403] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.240s	user 0.016s	sys 0.002s
I20260709 13:10:49.101760 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:49.096957 30778 tablet_bootstrap.cc:654] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.099287 30803 raft_consensus.cc:2749] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377) with higher term. Message: Invalid argument: T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 for earlier term 2. Current term is 3.
W20260709 13:10:49.117784 30471 leader_election.cc:343] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.118412 30471 leader_election.cc:304] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:49.115329 30652 raft_consensus.cc:2468] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:49.119632 30775 raft_consensus.cc:359] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.120365 30775 raft_consensus.cc:385] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.120627 30775 raft_consensus.cc:740] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.117712 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:49.129941 30578 raft_consensus.cc:3060] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.144322 30652 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.161343 30505 raft_consensus.cc:2468] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 3.
I20260709 13:10:49.188398 30578 raft_consensus.cc:2468] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 3.
I20260709 13:10:49.189680 30620 leader_election.cc:304] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:49.193048 30986 raft_consensus.cc:2804] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:49.193738 30986 raft_consensus.cc:697] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:49.194867 30986 consensus_queue.cc:237] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.123157 30775 consensus_queue.cc:260] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.203203 30402 catalog_manager.cc:5697] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.205107 30775 ts_tablet_manager.cc:1434] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.001s
I20260709 13:10:49.206051 30775 tablet_bootstrap.cc:492] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:49.206224 30402 catalog_manager.cc:5697] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.201845 30803 raft_consensus.cc:2749] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.229043 30774 tablet_bootstrap.cc:492] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:49.229661 30774 ts_tablet_manager.cc:1403] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.362s	user 0.011s	sys 0.003s
I20260709 13:10:49.231971 30773 tablet_bootstrap.cc:492] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:49.232573 30773 ts_tablet_manager.cc:1403] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.258s	user 0.067s	sys 0.037s
I20260709 13:10:49.232482 30774 raft_consensus.cc:359] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:49.232992 30984 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.233532 30984 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:49.237025 30987 consensus_queue.cc:1048] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:49.238471 30774 raft_consensus.cc:385] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.238919 30774 raft_consensus.cc:740] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.239666 30774 consensus_queue.cc:260] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:49.245297 30984 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:49.246714 30773 raft_consensus.cc:359] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:49.247392 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:49.247779 30773 raft_consensus.cc:385] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.248172 30773 raft_consensus.cc:740] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.247188 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:49.249296 30506 raft_consensus.cc:2468] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:49.248971 30773 consensus_queue.cc:260] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:49.250645 30619 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:49.251983 30984 raft_consensus.cc:2804] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:49.252430 30984 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.252807 30984 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.258885 30775 tablet_bootstrap.cc:654] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.261240 30987 raft_consensus.cc:493] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.261850 30987 raft_consensus.cc:515] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:49.265137 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca31368027748349419b6fe09ea1375" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:49.263861 30778 tablet_bootstrap.cc:492] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:49.277168 30778 ts_tablet_manager.cc:1403] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.192s	user 0.048s	sys 0.039s
I20260709 13:10:49.278635 31035 consensus_queue.cc:1048] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.271968 30773 ts_tablet_manager.cc:1434] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 13:10:49.279096 30984 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:49.280248 30773 tablet_bootstrap.cc:492] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:49.280755 30652 raft_consensus.cc:1240] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Rejecting Update request from peer ce7bd1ecd6e44f32879851d7b3174acb for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:49.284940 31035 consensus_queue.cc:1059] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.285755 30862 raft_consensus.cc:3055] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.286119 30862 raft_consensus.cc:740] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:49.286970 30862 consensus_queue.cc:260] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:49.288136 30862 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.289881 30774 ts_tablet_manager.cc:1434] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 13:10:49.288846 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:49.290973 30774 tablet_bootstrap.cc:492] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:49.295521 30984 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:49.299479 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:49.304821 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca31368027748349419b6fe09ea1375" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:49.303077 30987 leader_election.cc:290] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:49.306830 30694 leader_election.cc:304] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:49.308640 30987 raft_consensus.cc:2749] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.311728 30728 raft_consensus.cc:2410] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e4b8e689773b4a9d8e6de6d82d225c0d for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:10:49.311836 30774 tablet_bootstrap.cc:654] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.314036 30621 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:49.315542 30778 raft_consensus.cc:359] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.316073 30984 raft_consensus.cc:2749] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.316680 30778 raft_consensus.cc:385] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.317080 30778 raft_consensus.cc:740] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.317927 30778 consensus_queue.cc:260] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.326474 30728 raft_consensus.cc:3060] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.341984 30778 ts_tablet_manager.cc:1434] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 13:10:49.343489 30778 tablet_bootstrap.cc:492] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:49.344902 30773 tablet_bootstrap.cc:654] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.350453 30775 tablet_bootstrap.cc:492] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:49.351071 30775 ts_tablet_manager.cc:1403] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.145s	user 0.021s	sys 0.006s
I20260709 13:10:49.353852 30775 raft_consensus.cc:359] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:49.354530 30775 raft_consensus.cc:385] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.354839 30775 raft_consensus.cc:740] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.355508 30775 consensus_queue.cc:260] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:49.357810 30983 raft_consensus.cc:493] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.358541 30774 tablet_bootstrap.cc:492] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:49.358376 30983 raft_consensus.cc:515] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.359077 30774 ts_tablet_manager.cc:1403] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.010s
I20260709 13:10:49.361387 30983 leader_election.cc:290] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:49.362928 30778 tablet_bootstrap.cc:654] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.362768 30774 raft_consensus.cc:359] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:49.363538 30774 raft_consensus.cc:385] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.363883 30774 raft_consensus.cc:740] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.364636 30774 consensus_queue.cc:260] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:49.366816 30774 ts_tablet_manager.cc:1434] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:10:49.367765 30774 tablet_bootstrap.cc:492] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:49.368994 30775 ts_tablet_manager.cc:1434] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:49.369355 30778 tablet_bootstrap.cc:492] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:49.369839 30778 ts_tablet_manager.cc:1403] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.004s
I20260709 13:10:49.370076 30775 tablet_bootstrap.cc:492] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:49.412297 30402 catalog_manager.cc:5697] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 1 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.420228 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:49.421770 30506 raft_consensus.cc:2468] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:49.431785 30619 leader_election.cc:304] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:49.446000 30773 tablet_bootstrap.cc:492] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:49.450107 30844 raft_consensus.cc:493] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.451287 30844 raft_consensus.cc:515] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.447961 30773 ts_tablet_manager.cc:1403] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.168s	user 0.021s	sys 0.003s
I20260709 13:10:49.462961 31072 raft_consensus.cc:2804] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.463610 31072 raft_consensus.cc:493] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.464025 31072 raft_consensus.cc:3060] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.467015 30980 raft_consensus.cc:493] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.468098 30980 raft_consensus.cc:515] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.476059 30911 raft_consensus.cc:493] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.477059 30911 raft_consensus.cc:515] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:49.480175 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:49.481067 30578 raft_consensus.cc:2468] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:49.493470 30911 leader_election.cc:290] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:49.493848 30865 consensus_queue.cc:1048] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:49.495393 30980 leader_election.cc:290] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:49.497936 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb5e8eecef48b5831eb8cf4003e561" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:49.501058 30471 leader_election.cc:343] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.501432 30864 raft_consensus.cc:493] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.502147 30864 raft_consensus.cc:515] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:49.504914 30864 leader_election.cc:290] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:49.511245 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:49.514559 30503 raft_consensus.cc:2468] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:49.515072 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1b94fe3ebf42e090e8c6ef27e1c4df" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:49.516197 30505 raft_consensus.cc:2468] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:49.521891 30619 leader_election.cc:304] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:49.526458 30545 leader_election.cc:304] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:49.527170 30986 raft_consensus.cc:2804] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.527961 31046 raft_consensus.cc:2804] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.529217 31046 raft_consensus.cc:493] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.530151 31046 raft_consensus.cc:3060] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.533988 30862 consensus_queue.cc:1048] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:10:49.535941 30864 consensus_queue.cc:1048] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:49.537135 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb5e8eecef48b5831eb8cf4003e561" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:49.537088 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1b94fe3ebf42e090e8c6ef27e1c4df" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:49.546633 30472 leader_election.cc:343] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.547338 30472 leader_election.cc:304] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:49.550387 30803 raft_consensus.cc:2749] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.553424 30844 leader_election.cc:290] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:49.554141 30844 consensus_queue.cc:1048] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.554845 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:49.528663 30986 raft_consensus.cc:493] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.557418 30986 raft_consensus.cc:3060] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.558337 30773 raft_consensus.cc:359] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:49.559244 30773 raft_consensus.cc:385] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.559564 30773 raft_consensus.cc:740] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.574321 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:49.581130 30864 consensus_queue.cc:1048] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:49.583416 30778 raft_consensus.cc:359] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:49.583267 30400 catalog_manager.cc:5697] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 1 to 3, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 3 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.584275 30778 raft_consensus.cc:385] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.586680 30778 raft_consensus.cc:740] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.587729 30778 consensus_queue.cc:260] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
W20260709 13:10:49.592914 30620 leader_election.cc:343] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:49.595274 30547 leader_election.cc:343] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.605571 30775 tablet_bootstrap.cc:654] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.607223 30862 consensus_queue.cc:1048] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.609131 30773 consensus_queue.cc:260] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:49.610608 30502 raft_consensus.cc:1275] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:49.612972 30773 ts_tablet_manager.cc:1434] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.002s
I20260709 13:10:49.621855 30778 ts_tablet_manager.cc:1434] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.252s	user 0.010s	sys 0.000s
I20260709 13:10:49.635273 30502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:49.636415 30502 raft_consensus.cc:2468] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:49.635655 30986 raft_consensus.cc:515] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.638216 31046 raft_consensus.cc:515] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:49.642239 31046 leader_election.cc:290] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:49.621764 30983 consensus_queue.cc:1048] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:10:49.643181 30986 leader_election.cc:290] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:49.652905 30578 raft_consensus.cc:1275] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:49.654904 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
W20260709 13:10:49.657667 30620 leader_election.cc:343] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.658003 30773 tablet_bootstrap.cc:492] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:49.659776 30983 consensus_queue.cc:1048] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:49.674487 30726 raft_consensus.cc:3060] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.678617 30502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:49.691576 30502 raft_consensus.cc:3060] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.692585 31072 raft_consensus.cc:515] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.694275 30653 raft_consensus.cc:2393] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 1: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:49.703435 30778 tablet_bootstrap.cc:492] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:49.726377 30775 tablet_bootstrap.cc:492] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:49.727151 30775 ts_tablet_manager.cc:1403] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.357s	user 0.009s	sys 0.016s
I20260709 13:10:49.731997 30545 leader_election.cc:304] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:49.737018 30773 tablet_bootstrap.cc:654] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.747783 30844 raft_consensus.cc:2804] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.748109 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1b94fe3ebf42e090e8c6ef27e1c4df" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:49.748337 30844 raft_consensus.cc:493] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.748765 30844 raft_consensus.cc:3060] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.755198 30774 tablet_bootstrap.cc:654] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.742250 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:49.777438 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1b94fe3ebf42e090e8c6ef27e1c4df" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:49.778340 30501 raft_consensus.cc:3060] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:49.803606 30547 leader_election.cc:343] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:49.804628 30547 consensus_peers.cc:597] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 -> Peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Couldn't send request to peer ce7bd1ecd6e44f32879851d7b3174acb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.812060 30778 tablet_bootstrap.cc:654] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.815878 30502 raft_consensus.cc:2468] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:49.817999 30864 consensus_queue.cc:1048] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.820397 30503 raft_consensus.cc:3060] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.802647 30844 raft_consensus.cc:515] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.828572 31072 leader_election.cc:290] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:49.842229 30501 raft_consensus.cc:2468] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:49.845949 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:49.850137 31080 raft_consensus.cc:493] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.857820 30775 raft_consensus.cc:359] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.867820 30775 raft_consensus.cc:385] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.868265 30775 raft_consensus.cc:740] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.880069 30619 leader_election.cc:304] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:49.878763 30775 consensus_queue.cc:260] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.886972 30984 raft_consensus.cc:493] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.887549 30984 raft_consensus.cc:515] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:49.886770 30545 leader_election.cc:304] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:49.886062 30986 raft_consensus.cc:2804] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.893826 30986 raft_consensus.cc:697] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:49.893555 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b693fc5a9c3477a87a09ce7d3c57859" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:49.877452 31080 raft_consensus.cc:515] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:10:49.896481 30621 leader_election.cc:343] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.906330 30775 ts_tablet_manager.cc:1434] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.179s	user 0.009s	sys 0.000s
I20260709 13:10:49.914113 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b693fc5a9c3477a87a09ce7d3c57859" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:49.908433 30578 raft_consensus.cc:2393] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4b8e689773b4a9d8e6de6d82d225c0d in current term 1: Already voted for candidate fe9b995b077d4cb795f08934ed7d9088 in this term.
I20260709 13:10:49.904434 30984 leader_election.cc:290] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:49.924100 31040 raft_consensus.cc:2804] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.924758 31040 raft_consensus.cc:697] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:49.924903 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:49.904224 31080 leader_election.cc:290] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:49.925845 31040 consensus_queue.cc:237] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:49.928020 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:49.936986 30775 tablet_bootstrap.cc:492] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
W20260709 13:10:49.940927 30472 leader_election.cc:343] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.922999 30577 raft_consensus.cc:2468] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
W20260709 13:10:49.966679 30471 leader_election.cc:343] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.967351 30471 leader_election.cc:304] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:49.969202 31048 raft_consensus.cc:2749] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.977679 30774 tablet_bootstrap.cc:492] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:49.978376 30774 ts_tablet_manager.cc:1403] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.611s	user 0.017s	sys 0.001s
I20260709 13:10:49.916280 30986 consensus_queue.cc:237] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:49.997901 30773 tablet_bootstrap.cc:492] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:49.998808 30773 ts_tablet_manager.cc:1403] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.341s	user 0.024s	sys 0.063s
I20260709 13:10:50.000195 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:50.008473 30844 leader_election.cc:290] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:50.012260 30774 raft_consensus.cc:359] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.013440 30774 raft_consensus.cc:385] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.016785 30774 raft_consensus.cc:740] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
W20260709 13:10:50.019382 31088 log.cc:927] Time spent T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:10:50.023779 30773 raft_consensus.cc:359] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.024796 30773 raft_consensus.cc:385] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.025136 30773 raft_consensus.cc:740] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.017974 30774 consensus_queue.cc:260] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.027537 30773 consensus_queue.cc:260] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.031085 30773 ts_tablet_manager.cc:1434] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:10:50.032604 30773 tablet_bootstrap.cc:492] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:50.069087 30503 raft_consensus.cc:2468] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:50.080693 30775 tablet_bootstrap.cc:654] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.092162 30619 leader_election.cc:304] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:50.093393 30986 raft_consensus.cc:2804] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.094718 30986 raft_consensus.cc:697] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:50.095795 30986 consensus_queue.cc:237] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:50.101713 30693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 112173us
I20260709 13:10:50.104326 30774 ts_tablet_manager.cc:1434] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.126s	user 0.011s	sys 0.009s
I20260709 13:10:50.105700 30774 tablet_bootstrap.cc:492] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:50.110680 30773 tablet_bootstrap.cc:654] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.119549 30775 tablet_bootstrap.cc:492] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:50.121795 30775 ts_tablet_manager.cc:1403] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.191s	user 0.015s	sys 0.000s
I20260709 13:10:50.128858 30774 tablet_bootstrap.cc:654] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.131083 30620 leader_election.cc:304] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:50.132589 31072 raft_consensus.cc:2804] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.132977 31072 raft_consensus.cc:493] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.133327 31072 raft_consensus.cc:3060] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.146948 31046 raft_consensus.cc:493] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.147521 31046 raft_consensus.cc:515] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.152520 31046 leader_election.cc:290] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:50.154211 30775 raft_consensus.cc:359] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.154992 30775 raft_consensus.cc:385] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.155275 30775 raft_consensus.cc:740] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.157599 30987 raft_consensus.cc:493] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.158116 30987 raft_consensus.cc:515] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.146653 31072 raft_consensus.cc:515] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:50.160771 31072 leader_election.cc:290] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:50.162534 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb5e8eecef48b5831eb8cf4003e561" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:50.162369 30775 consensus_queue.cc:260] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.168165 30773 tablet_bootstrap.cc:492] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:50.168720 30773 ts_tablet_manager.cc:1403] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.137s	user 0.011s	sys 0.000s
I20260709 13:10:50.170531 30778 tablet_bootstrap.cc:492] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:50.171075 30778 ts_tablet_manager.cc:1403] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.468s	user 0.017s	sys 0.004s
I20260709 13:10:50.173167 30773 raft_consensus.cc:359] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.173947 30773 raft_consensus.cc:385] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.174259 30773 raft_consensus.cc:740] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.174976 30773 consensus_queue.cc:260] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.176131 30775 ts_tablet_manager.cc:1434] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:10:50.177493 30775 tablet_bootstrap.cc:492] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:50.177598 30500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:50.178512 30500 raft_consensus.cc:2393] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 1: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:50.188084 30773 ts_tablet_manager.cc:1434] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:10:50.188380 30775 tablet_bootstrap.cc:654] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.189261 30774 tablet_bootstrap.cc:492] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:50.189421 30773 tablet_bootstrap.cc:492] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:50.189908 30774 ts_tablet_manager.cc:1403] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.001s
I20260709 13:10:50.191809 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
W20260709 13:10:50.195185 30694 leader_election.cc:343] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.196144 30773 tablet_bootstrap.cc:654] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.196985 30774 raft_consensus.cc:359] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.197821 30774 raft_consensus.cc:385] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:50.199337 30451 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:50.200278 30774 raft_consensus.cc:740] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.201035 30774 consensus_queue.cc:260] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.203202 30774 ts_tablet_manager.cc:1434] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:10:50.204201 30774 tablet_bootstrap.cc:492] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:50.199884 30775 tablet_bootstrap.cc:492] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:50.209750 30775 ts_tablet_manager.cc:1403] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.003s
I20260709 13:10:50.211361 30773 tablet_bootstrap.cc:492] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:50.211900 30773 ts_tablet_manager.cc:1403] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260709 13:10:50.212838 30775 raft_consensus.cc:359] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:50.213657 30775 raft_consensus.cc:385] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.213936 30775 raft_consensus.cc:740] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.214679 30773 raft_consensus.cc:359] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.214646 30775 consensus_queue.cc:260] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:50.216481 30774 tablet_bootstrap.cc:654] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.217967 30775 ts_tablet_manager.cc:1434] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:10:50.219218 30775 tablet_bootstrap.cc:492] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:50.226152 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b693fc5a9c3477a87a09ce7d3c57859" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:50.226898 30579 raft_consensus.cc:3060] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.227365 30775 tablet_bootstrap.cc:654] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.228302 30774 tablet_bootstrap.cc:492] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:50.228826 30774 ts_tablet_manager.cc:1403] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.009s
I20260709 13:10:50.230116 30773 raft_consensus.cc:385] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.230432 30773 raft_consensus.cc:740] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.231151 30773 consensus_queue.cc:260] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.231870 30774 raft_consensus.cc:359] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.232582 30774 raft_consensus.cc:385] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.232873 30774 raft_consensus.cc:740] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.233582 30774 consensus_queue.cc:260] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.234849 30773 ts_tablet_manager.cc:1434] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:10:50.236013 30773 tablet_bootstrap.cc:492] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:50.236186 30774 ts_tablet_manager.cc:1434] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:50.237432 30774 tablet_bootstrap.cc:492] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:50.241511 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:50.243534 30773 tablet_bootstrap.cc:654] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.244828 30775 tablet_bootstrap.cc:492] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:50.245355 30775 ts_tablet_manager.cc:1403] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.026s	user 0.003s	sys 0.006s
I20260709 13:10:50.245245 30546 leader_election.cc:304] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:50.246901 30864 raft_consensus.cc:2749] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.248512 30775 raft_consensus.cc:359] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.249302 30775 raft_consensus.cc:385] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.249583 30775 raft_consensus.cc:740] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.250308 30775 consensus_queue.cc:260] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.251997 30546 leader_election.cc:304] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:50.252748 30774 tablet_bootstrap.cc:654] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.255110 30773 tablet_bootstrap.cc:492] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:50.255630 30773 ts_tablet_manager.cc:1403] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:10:50.258554 30773 raft_consensus.cc:359] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.259251 30773 raft_consensus.cc:385] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.259517 30773 raft_consensus.cc:740] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.260396 30773 consensus_queue.cc:260] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.262924 30773 ts_tablet_manager.cc:1434] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:50.263484 30728 raft_consensus.cc:3060] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.264705 30775 ts_tablet_manager.cc:1434] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:10:50.266326 30775 tablet_bootstrap.cc:492] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:50.264477 30864 raft_consensus.cc:3060] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.272025 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b693fc5a9c3477a87a09ce7d3c57859" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:50.160470 30987 leader_election.cc:290] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:50.278517 30775 tablet_bootstrap.cc:654] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.281081 30864 raft_consensus.cc:2749] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.287300 30773 tablet_bootstrap.cc:492] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:50.291494 31080 raft_consensus.cc:493] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.292105 31080 raft_consensus.cc:515] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.294390 31080 leader_election.cc:290] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:50.297782 30774 tablet_bootstrap.cc:492] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:50.298374 30774 ts_tablet_manager.cc:1403] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.061s	user 0.023s	sys 0.027s
I20260709 13:10:50.298522 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:50.299472 30581 raft_consensus.cc:2468] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:50.301045 30471 leader_election.cc:304] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:50.307000 31080 raft_consensus.cc:2804] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.307545 31080 raft_consensus.cc:493] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.307979 31080 raft_consensus.cc:3060] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.310411 30773 tablet_bootstrap.cc:654] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.314637 30778 raft_consensus.cc:359] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.315542 30778 raft_consensus.cc:385] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.315932 30778 raft_consensus.cc:740] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.316250 30500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb5e8eecef48b5831eb8cf4003e561" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:50.316299 30774 raft_consensus.cc:359] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.316671 30778 consensus_queue.cc:260] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.317293 30774 raft_consensus.cc:385] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.317639 30774 raft_consensus.cc:740] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.318482 30774 consensus_queue.cc:260] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:10:50.319476 30621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 61998.8us
I20260709 13:10:50.320168 30774 ts_tablet_manager.cc:1434] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:10:50.321350 30774 tablet_bootstrap.cc:492] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:50.317134 30500 raft_consensus.cc:2468] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:50.322964 30400 catalog_manager.cc:5697] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:50.340600 30775 tablet_bootstrap.cc:492] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:50.344959 30775 ts_tablet_manager.cc:1403] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.015s
I20260709 13:10:50.347901 30775 raft_consensus.cc:359] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:50.348606 30775 raft_consensus.cc:385] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.348882 30775 raft_consensus.cc:740] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.350010 30774 tablet_bootstrap.cc:654] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.342006 30778 ts_tablet_manager.cc:1434] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.171s	user 0.006s	sys 0.000s
I20260709 13:10:50.351617 30778 tablet_bootstrap.cc:492] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:50.349642 30775 consensus_queue.cc:260] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:50.326475 30693 leader_election.cc:304] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:50.357191 31048 raft_consensus.cc:493] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.362463 31048 raft_consensus.cc:515] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.364711 31048 leader_election.cc:290] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:50.366189 30987 raft_consensus.cc:2804] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.366629 30987 raft_consensus.cc:493] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.366994 30987 raft_consensus.cc:3060] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.367272 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:50.368010 30578 raft_consensus.cc:2468] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:50.348891 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:50.344316 30621 leader_election.cc:343] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.359464 30579 raft_consensus.cc:2468] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:50.368484 30775 ts_tablet_manager.cc:1434] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:10:50.338735 31080 raft_consensus.cc:515] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.375385 30775 tablet_bootstrap.cc:492] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:50.379743 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
W20260709 13:10:50.381439 30471 leader_election.cc:343] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.382892 31080 leader_election.cc:290] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:50.382633 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:50.384267 30775 tablet_bootstrap.cc:654] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.384536 30471 leader_election.cc:304] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:50.385504 31048 raft_consensus.cc:2804] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.385900 31048 raft_consensus.cc:493] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.386205 31048 raft_consensus.cc:3060] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.388217 30987 raft_consensus.cc:515] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.384063 30579 raft_consensus.cc:3060] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.392796 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb5e8eecef48b5831eb8cf4003e561" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:50.394037 30655 raft_consensus.cc:3060] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:50.399044 30471 leader_election.cc:343] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.401609 30778 tablet_bootstrap.cc:654] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.403636 30862 raft_consensus.cc:493] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.404186 30862 raft_consensus.cc:515] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.406399 30862 leader_election.cc:290] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:50.411967 30987 leader_election.cc:290] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:10:50.392050 30621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 47777.6us
I20260709 13:10:50.413218 30500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:50.416635 30500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb5e8eecef48b5831eb8cf4003e561" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:50.417213 30500 raft_consensus.cc:3060] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:50.419991 30693 leader_election.cc:343] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.420475 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:50.424284 30620 leader_election.cc:304] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
W20260709 13:10:50.425350 30620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 50190.4us
I20260709 13:10:50.426432 30986 raft_consensus.cc:2804] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.428042 30986 raft_consensus.cc:697] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
W20260709 13:10:50.428807 30694 leader_election.cc:343] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.428910 30986 consensus_queue.cc:237] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:50.429400 30694 leader_election.cc:304] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:50.432811 30987 raft_consensus.cc:2749] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.446347 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:50.447959 30472 leader_election.cc:343] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.456405 30655 raft_consensus.cc:2468] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:50.406473 31048 raft_consensus.cc:515] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.475826 30911 raft_consensus.cc:493] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.480873 30911 raft_consensus.cc:515] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.483073 30694 leader_election.cc:304] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:50.484025 30862 raft_consensus.cc:2804] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.485248 30862 raft_consensus.cc:697] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:50.486328 30862 consensus_queue.cc:237] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.489010 30911 leader_election.cc:290] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:50.490584 30864 consensus_queue.cc:1048] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.498057 31048 leader_election.cc:290] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:50.494400 30579 raft_consensus.cc:2468] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:50.502681 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:50.503351 30581 raft_consensus.cc:3060] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.505139 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:50.506762 30471 leader_election.cc:304] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:50.508078 31078 raft_consensus.cc:2804] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.508524 31078 raft_consensus.cc:697] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:50.509310 31078 consensus_queue.cc:237] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:50.514349 30472 leader_election.cc:343] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.515707 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
W20260709 13:10:50.519122 30472 leader_election.cc:343] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.521252 31072 consensus_queue.cc:1048] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:50.522023 31098 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.522573 31098 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.524850 31098 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:50.526392 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:50.527143 30653 raft_consensus.cc:2468] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:10:50.528479 30694 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:50.528719 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:50.529592 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:50.530233 31098 raft_consensus.cc:2804] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:50.530642 31098 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.531011 31098 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:50.531195 30471 leader_election.cc:343] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.531777 30471 leader_election.cc:304] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:50.533774 31048 raft_consensus.cc:2749] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.535825 30500 raft_consensus.cc:2468] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:50.521457 30581 raft_consensus.cc:2468] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:50.550702 30774 tablet_bootstrap.cc:492] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:50.551303 30774 ts_tablet_manager.cc:1403] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.230s	user 0.027s	sys 0.038s
I20260709 13:10:50.552713 30773 tablet_bootstrap.cc:492] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:50.553390 30773 ts_tablet_manager.cc:1403] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.266s	user 0.023s	sys 0.023s
I20260709 13:10:50.560786 30726 raft_consensus.cc:3060] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.564126 30773 raft_consensus.cc:359] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.564934 30773 raft_consensus.cc:385] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.565220 30773 raft_consensus.cc:740] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.565909 31069 consensus_queue.cc:1048] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:50.566006 30773 consensus_queue.cc:260] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.559330 30774 raft_consensus.cc:359] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.567430 30774 raft_consensus.cc:385] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.567729 30774 raft_consensus.cc:740] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.567787 30471 leader_election.cc:304] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:50.570489 30774 consensus_queue.cc:260] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.576382 30778 tablet_bootstrap.cc:492] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:50.576979 30778 ts_tablet_manager.cc:1403] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.226s	user 0.014s	sys 0.027s
I20260709 13:10:50.580859 31069 consensus_queue.cc:1048] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:50.571863 31098 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.585687 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:50.586305 30655 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.586165 30778 raft_consensus.cc:359] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.590749 30778 raft_consensus.cc:385] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.591152 30778 raft_consensus.cc:740] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.593784 31080 raft_consensus.cc:493] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.594308 31080 raft_consensus.cc:515] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.595506 30778 consensus_queue.cc:260] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.597970 30775 tablet_bootstrap.cc:492] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:50.598730 30775 ts_tablet_manager.cc:1403] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.224s	user 0.068s	sys 0.074s
I20260709 13:10:50.601449 30773 ts_tablet_manager.cc:1434] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:10:50.603008 30773 tablet_bootstrap.cc:492] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:50.603210 30775 raft_consensus.cc:359] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.603935 30775 raft_consensus.cc:385] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.604803 30775 raft_consensus.cc:740] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.598641 31046 raft_consensus.cc:493] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.605615 31046 raft_consensus.cc:515] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:50.608047 31046 leader_election.cc:290] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:50.610977 30773 tablet_bootstrap.cc:654] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.605597 30775 consensus_queue.cc:260] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.613260 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:50.620636 30775 ts_tablet_manager.cc:1434] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:10:50.621970 30775 tablet_bootstrap.cc:492] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:50.622411 31069 raft_consensus.cc:493] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.622962 31069 raft_consensus.cc:515] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.626843 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:50.625178 31069 leader_election.cc:290] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:50.599591 31048 raft_consensus.cc:2804] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.630724 30774 ts_tablet_manager.cc:1434] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.002s
I20260709 13:10:50.636196 30775 tablet_bootstrap.cc:654] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:50.637029 30619 leader_election.cc:343] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:50.616406 30471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 48745.3us
W20260709 13:10:50.638875 30546 leader_election.cc:343] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.658385 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:50.658931 30987 raft_consensus.cc:493] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.659507 30987 raft_consensus.cc:515] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.639413 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:50.661913 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:50.663092 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:50.664215 31080 leader_election.cc:290] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
W20260709 13:10:50.665320 30547 leader_election.cc:343] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.666041 30547 leader_election.cc:304] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:50.666953 30774 tablet_bootstrap.cc:492] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:50.667550 30778 ts_tablet_manager.cc:1434] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.003s
I20260709 13:10:50.638082 31048 raft_consensus.cc:697] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:50.638213 31098 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:50.672637 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:50.665350 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:50.674165 30579 raft_consensus.cc:2393] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate 5eebf0fa5aba46afa04623642d7795e6 in this term.
I20260709 13:10:50.659512 30729 raft_consensus.cc:2468] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
W20260709 13:10:50.674504 30472 leader_election.cc:343] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.677809 30864 raft_consensus.cc:493] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.678370 30864 raft_consensus.cc:515] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:50.679060 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:50.680586 30864 leader_election.cc:290] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:50.683542 31046 raft_consensus.cc:2749] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:50.684815 30471 leader_election.cc:343] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.685360 30471 leader_election.cc:304] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:50.671101 30987 leader_election.cc:290] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:50.693907 31080 raft_consensus.cc:2749] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.686721 31048 consensus_queue.cc:237] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.708958 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:50.703480 30983 consensus_queue.cc:1048] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:50.720283 31080 raft_consensus.cc:493] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.723176 31080 raft_consensus.cc:515] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.726050 31080 leader_election.cc:290] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:50.728101 30655 raft_consensus.cc:2468] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 3.
W20260709 13:10:50.729094 30547 leader_election.cc:343] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.739193 30778 tablet_bootstrap.cc:492] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:50.743436 30987 raft_consensus.cc:493] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.744021 30987 raft_consensus.cc:515] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:50.744295 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:50.744678 30773 tablet_bootstrap.cc:492] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:50.744937 30579 raft_consensus.cc:2468] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:50.745199 30773 ts_tablet_manager.cc:1403] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.142s	user 0.008s	sys 0.018s
I20260709 13:10:50.756024 30471 leader_election.cc:304] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:50.804373 31080 raft_consensus.cc:2804] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.764720 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:50.818703 30773 raft_consensus.cc:359] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.820853 30773 raft_consensus.cc:385] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.821193 30773 raft_consensus.cc:740] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.772964 30864 consensus_queue.cc:1048] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:10:50.834919 30773 consensus_queue.cc:260] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.812803 30911 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:10:50.818377 31080 raft_consensus.cc:493] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.848543 30773 ts_tablet_manager.cc:1434] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.001s
I20260709 13:10:50.850915 30778 tablet_bootstrap.cc:654] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.842191 30911 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.847666 31080 raft_consensus.cc:3060] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.862255 30774 tablet_bootstrap.cc:654] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.867408 30987 leader_election.cc:290] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:50.909699 30911 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:50.910585 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:50.912247 30773 tablet_bootstrap.cc:492] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
W20260709 13:10:50.915060 31128 log.cc:927] Time spent T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:10:50.927282 31136 log.cc:927] Time spent T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:50.901238 30694 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6
W20260709 13:10:50.930709 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 55502.6us
I20260709 13:10:50.932935 31098 raft_consensus.cc:2804] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:50.934266 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1b94fe3ebf42e090e8c6ef27e1c4df" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:50.936204 30621 leader_election.cc:304] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:10:50.937641 31129 raft_consensus.cc:2804] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.938040 31129 raft_consensus.cc:493] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.938401 31129 raft_consensus.cc:3060] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:50.941790 30546 leader_election.cc:343] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.942386 30546 leader_election.cc:304] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:50.943408 31046 raft_consensus.cc:2749] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.944232 30693 leader_election.cc:304] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:50.945462 30987 raft_consensus.cc:3060] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.948348 30773 tablet_bootstrap.cc:654] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.926206 31080 raft_consensus.cc:515] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:50.961335 31098 raft_consensus.cc:697] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 3 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:50.962364 31098 consensus_queue.cc:237] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.963515 30778 tablet_bootstrap.cc:492] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:50.964262 30778 ts_tablet_manager.cc:1403] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.243s	user 0.012s	sys 0.006s
I20260709 13:10:50.968310 30778 raft_consensus.cc:359] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:50.969022 30778 raft_consensus.cc:385] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.969317 30778 raft_consensus.cc:740] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.978391 30778 consensus_queue.cc:260] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:50.984637 30778 ts_tablet_manager.cc:1434] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:10:50.985813 30778 tablet_bootstrap.cc:492] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
W20260709 13:10:50.995839 30621 consensus_peers.cc:597] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Couldn't send request to peer ce7bd1ecd6e44f32879851d7b3174acb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:50.976187 31129 raft_consensus.cc:515] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:50.997833 30775 tablet_bootstrap.cc:492] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:50.998459 30775 ts_tablet_manager.cc:1403] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.377s	user 0.016s	sys 0.015s
I20260709 13:10:50.999302 30774 tablet_bootstrap.cc:492] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:50.998576 31080 leader_election.cc:290] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:50.999783 31129 leader_election.cc:290] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:51.000376 30774 ts_tablet_manager.cc:1403] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.347s	user 0.018s	sys 0.030s
I20260709 13:10:51.002466 30987 raft_consensus.cc:2749] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:51.007207 31137 log.cc:927] Time spent T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088: Append to log took a long time: real 0.103s	user 0.004s	sys 0.000s
I20260709 13:10:51.011626 30774 raft_consensus.cc:359] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:51.012444 30774 raft_consensus.cc:385] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.012710 30774 raft_consensus.cc:740] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.014477 30775 raft_consensus.cc:359] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.015014 30778 tablet_bootstrap.cc:654] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.015231 30775 raft_consensus.cc:385] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.015532 30775 raft_consensus.cc:740] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.016116 30773 tablet_bootstrap.cc:492] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:51.015929 30774 consensus_queue.cc:260] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:51.016383 30775 consensus_queue.cc:260] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.017572 30774 ts_tablet_manager.cc:1434] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:10:51.018952 30775 ts_tablet_manager.cc:1434] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:10:51.020179 30775 tablet_bootstrap.cc:492] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:51.021586 31098 consensus_queue.cc:1048] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:51.029044 30775 tablet_bootstrap.cc:654] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:51.029368 31135 log.cc:927] Time spent T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088: Append to log took a long time: real 0.200s	user 0.001s	sys 0.002s
I20260709 13:10:51.016755 30773 ts_tablet_manager.cc:1403] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.002s
I20260709 13:10:51.048035 30773 raft_consensus.cc:359] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.048641 30773 raft_consensus.cc:385] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.048882 30773 raft_consensus.cc:740] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.049525 30773 consensus_queue.cc:260] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.051643 30773 ts_tablet_manager.cc:1434] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:10:51.052672 30773 tablet_bootstrap.cc:492] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:51.090689 31134 consensus_queue.cc:1048] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:51.105185 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1b94fe3ebf42e090e8c6ef27e1c4df" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
W20260709 13:10:51.113933 30471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 285248us
I20260709 13:10:51.115427 30775 tablet_bootstrap.cc:492] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:51.116144 30775 ts_tablet_manager.cc:1403] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.096s	user 0.035s	sys 0.026s
I20260709 13:10:51.120204 30775 raft_consensus.cc:359] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.121161 30775 raft_consensus.cc:385] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.121506 30775 raft_consensus.cc:740] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.123077 30773 tablet_bootstrap.cc:654] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.122373 30775 consensus_queue.cc:260] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.132006 30775 ts_tablet_manager.cc:1434] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:10:51.133142 30775 tablet_bootstrap.cc:492] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
W20260709 13:10:51.136457 30471 leader_election.cc:343] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.113960 30693 leader_election.cc:304] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:51.142259 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:51.143110 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:51.148965 30778 tablet_bootstrap.cc:492] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:51.149593 30655 raft_consensus.cc:2368] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 for earlier term 2. Current term is 3.
I20260709 13:10:51.148315 31144 raft_consensus.cc:2749] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:51.142269 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:51.149544 30778 ts_tablet_manager.cc:1403] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.164s	user 0.030s	sys 0.045s
I20260709 13:10:51.151089 30577 raft_consensus.cc:3060] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.157980 30775 tablet_bootstrap.cc:654] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:51.159600 30471 consensus_peers.cc:597] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:51.160893 30471 leader_election.cc:343] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.163146 30471 leader_election.cc:400] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377) with higher term. Message: Invalid argument: T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 for earlier term 2. Current term is 3.
I20260709 13:10:51.163450 30471 leader_election.cc:403] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:51.163766 30778 raft_consensus.cc:359] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.164820 30778 raft_consensus.cc:385] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.165055 30778 raft_consensus.cc:740] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.168530 30778 consensus_queue.cc:260] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.173743 31048 raft_consensus.cc:493] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.174329 31048 raft_consensus.cc:515] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:51.176620 31048 leader_election.cc:290] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:51.180174 30778 ts_tablet_manager.cc:1434] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.002s
I20260709 13:10:51.181481 30778 tablet_bootstrap.cc:492] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:51.167268 31078 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.188973 30778 tablet_bootstrap.cc:654] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.271889 31144 raft_consensus.cc:493] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.272769 31144 raft_consensus.cc:515] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:51.275998 31144 leader_election.cc:290] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:51.328087 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:51.328825 30506 raft_consensus.cc:3060] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.337920 30506 raft_consensus.cc:2468] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
W20260709 13:10:51.349182 30451 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:51.381173 31157 consensus_queue.cc:1048] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:51.385983 31156 raft_consensus.cc:493] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.386650 31156 raft_consensus.cc:515] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.389906 31156 leader_election.cc:290] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:51.406278 30725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:51.416158 31134 raft_consensus.cc:493] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.416781 31134 raft_consensus.cc:515] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.418262 30775 tablet_bootstrap.cc:492] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:51.418891 30775 ts_tablet_manager.cc:1403] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.286s	user 0.031s	sys 0.008s
I20260709 13:10:51.425837 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:51.426673 30580 raft_consensus.cc:2468] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:51.428009 30620 leader_election.cc:304] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:51.422179 30775 raft_consensus.cc:359] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.428758 30775 raft_consensus.cc:385] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.408309 31156 raft_consensus.cc:493] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.430943 30775 raft_consensus.cc:740] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.431082 31156 raft_consensus.cc:515] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.432209 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:51.432876 30503 raft_consensus.cc:2468] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:51.433475 31156 leader_election.cc:290] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:51.434298 30693 leader_election.cc:304] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:51.433135 30775 consensus_queue.cc:260] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.429867 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9687bd5f80bd4d869a68cbbecda69806" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:51.430368 30577 raft_consensus.cc:2468] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:10:51.429025 31134 leader_election.cc:290] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:51.429400 31069 raft_consensus.cc:2804] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:51.414448 30862 consensus_queue.cc:1048] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:10:51.456210 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:51.457005 30721 raft_consensus.cc:2468] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 0.
I20260709 13:10:51.464303 30778 tablet_bootstrap.cc:492] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:51.464974 30778 ts_tablet_manager.cc:1403] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.284s	user 0.014s	sys 0.001s
I20260709 13:10:51.468798 30619 leader_election.cc:304] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:51.471246 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:51.471841 30547 leader_election.cc:343] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.473791 30472 leader_election.cc:304] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:51.475627 31161 raft_consensus.cc:2804] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:51.441254 31069 raft_consensus.cc:493] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.476500 31069 raft_consensus.cc:3060] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.476485 31161 raft_consensus.cc:697] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:51.441491 31144 raft_consensus.cc:2804] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:51.477655 31144 raft_consensus.cc:493] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.478091 31144 raft_consensus.cc:3060] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.477900 31161 consensus_queue.cc:237] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:51.485811 31069 raft_consensus.cc:515] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.441761 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec7a3e0f271468aa4e4809f9707f7a3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:51.442943 30471 leader_election.cc:304] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:51.486994 30503 raft_consensus.cc:2468] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
W20260709 13:10:51.487308 30471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 44453.5us
I20260709 13:10:51.491322 31078 raft_consensus.cc:2749] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377) with higher term. Message: Invalid argument: T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 for earlier term 2. Current term is 3.
I20260709 13:10:51.494453 31156 raft_consensus.cc:493] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.495097 31156 raft_consensus.cc:515] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.498077 31156 leader_election.cc:290] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:51.444430 30775 ts_tablet_manager.cc:1434] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:10:51.475755 30911 raft_consensus.cc:2764] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:10:51.503504 30911 raft_consensus.cc:2804] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:51.504037 30911 raft_consensus.cc:697] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:10:51.504861 30911 consensus_queue.cc:237] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.505565 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9687bd5f80bd4d869a68cbbecda69806" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:51.505908 30775 tablet_bootstrap.cc:492] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:51.507347 30545 leader_election.cc:304] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:51.508661 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec7a3e0f271468aa4e4809f9707f7a3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:51.508863 31046 raft_consensus.cc:2804] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:51.509370 31046 raft_consensus.cc:493] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.509794 31046 raft_consensus.cc:3060] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:51.515811 30546 leader_election.cc:343] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.516402 30546 leader_election.cc:304] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:51.517967 30844 raft_consensus.cc:2749] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:51.518033 30546 leader_election.cc:343] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.525092 30774 tablet_bootstrap.cc:492] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:51.516383 31069 leader_election.cc:290] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:51.532022 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:51.534688 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:51.535403 30727 raft_consensus.cc:3060] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.543999 30773 tablet_bootstrap.cc:492] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:51.544836 30773 ts_tablet_manager.cc:1403] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.492s	user 0.027s	sys 0.012s
I20260709 13:10:51.545248 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a1eefeef3847b8ad88b05ca970c43f" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:51.547890 30773 raft_consensus.cc:359] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.548645 30773 raft_consensus.cc:385] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.548934 30773 raft_consensus.cc:740] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.549556 30773 consensus_queue.cc:260] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:51.550848 30546 leader_election.cc:343] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.552701 30773 ts_tablet_manager.cc:1434] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:10:51.553867 30773 tablet_bootstrap.cc:492] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:51.544787 30775 tablet_bootstrap.cc:654] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.555728 30778 raft_consensus.cc:359] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.556737 30778 raft_consensus.cc:385] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.557086 30778 raft_consensus.cc:740] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
W20260709 13:10:51.560225 30619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 90290.9us
I20260709 13:10:51.569666 30774 tablet_bootstrap.cc:654] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.569865 30773 tablet_bootstrap.cc:654] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.575280 30775 tablet_bootstrap.cc:492] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:51.587550 30775 ts_tablet_manager.cc:1403] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.006s
I20260709 13:10:51.577003 30655 raft_consensus.cc:1275] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:51.578215 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a1eefeef3847b8ad88b05ca970c43f" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:51.579279 30694 leader_election.cc:343] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.593688 30727 raft_consensus.cc:2468] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:51.580906 31144 raft_consensus.cc:515] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:51.593928 30775 raft_consensus.cc:359] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:51.594863 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:51.605173 30578 raft_consensus.cc:3060] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.606247 31144 leader_election.cc:290] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:51.596622 31098 consensus_queue.cc:1048] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:51.605252 30774 tablet_bootstrap.cc:492] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:51.608850 30774 ts_tablet_manager.cc:1403] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.004s
I20260709 13:10:51.611817 30774 raft_consensus.cc:359] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:51.612552 30774 raft_consensus.cc:385] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.612818 30774 raft_consensus.cc:740] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.613490 30774 consensus_queue.cc:260] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:51.614595 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:51.615649 30774 ts_tablet_manager.cc:1434] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:10:51.616776 30774 tablet_bootstrap.cc:492] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:51.617894 31080 raft_consensus.cc:493] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.618410 31080 raft_consensus.cc:515] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:51.618993 30621 leader_election.cc:343] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.621701 31080 leader_election.cc:290] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:51.623474 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:51.624617 30774 tablet_bootstrap.cc:654] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.624739 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
W20260709 13:10:51.626181 30471 leader_election.cc:343] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:51.626850 30694 leader_election.cc:343] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:51.603560 30547 leader_election.cc:343] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.628300 30547 leader_election.cc:304] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:51.628872 30503 raft_consensus.cc:1275] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:51.630266 30865 raft_consensus.cc:2749] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:51.632946 30578 raft_consensus.cc:2468] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:51.637426 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:51.641256 30774 tablet_bootstrap.cc:492] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:51.641793 30774 ts_tablet_manager.cc:1403] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 13:10:51.644546 30774 raft_consensus.cc:359] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.645221 30774 raft_consensus.cc:385] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.645464 30774 raft_consensus.cc:740] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.646103 30774 consensus_queue.cc:260] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.614900 30775 raft_consensus.cc:385] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.652456 30775 raft_consensus.cc:740] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.406673 31158 consensus_queue.cc:1048] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:51.558001 30778 consensus_queue.cc:260] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.654415 30402 catalog_manager.cc:5697] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.657833 30774 ts_tablet_manager.cc:1434] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:10:51.661375 30774 tablet_bootstrap.cc:492] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:51.653093 30404 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42172 (request call id 57) took 1307 ms. Trace:
I20260709 13:10:51.663144 31048 consensus_queue.cc:1048] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:51.664003 30402 catalog_manager.cc:5697] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.667184 30402 catalog_manager.cc:5697] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.666962 30775 consensus_queue.cc:260] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:51.675195 30778 ts_tablet_manager.cc:1434] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.210s	user 0.010s	sys 0.000s
I20260709 13:10:51.670475 30620 leader_election.cc:304] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
W20260709 13:10:51.676271 30621 leader_election.cc:343] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.678155 30778 tablet_bootstrap.cc:492] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:51.678030 30506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:51.678894 30506 raft_consensus.cc:3060] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.679021 31134 raft_consensus.cc:2804] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:51.679664 31134 raft_consensus.cc:697] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:51.680619 31134 consensus_queue.cc:237] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.684813 30774 tablet_bootstrap.cc:654] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.685030 30778 tablet_bootstrap.cc:654] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.703485 30862 consensus_queue.cc:1048] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:51.662098 30404 rpcz_store.cc:276] 0709 13:10:50.342887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.343032 (+   145us) service_pool.cc:224] Handling call
0709 13:10:51.650593 (+1307561us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":6}
I20260709 13:10:51.706290 30651 raft_consensus.cc:3060] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.708698 31046 raft_consensus.cc:515] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.710011 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:51.723958 30471 leader_election.cc:343] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.724443 30471 leader_election.cc:304] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:51.726660 30775 ts_tablet_manager.cc:1434] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.139s	user 0.006s	sys 0.001s
I20260709 13:10:51.748471 31080 raft_consensus.cc:2749] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:51.749111 30506 raft_consensus.cc:2468] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:51.759248 30693 leader_election.cc:304] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:51.760491 31098 raft_consensus.cc:2804] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:51.761273 31098 raft_consensus.cc:697] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:51.763928 30773 tablet_bootstrap.cc:492] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:51.764519 30773 ts_tablet_manager.cc:1403] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.211s	user 0.022s	sys 0.059s
I20260709 13:10:51.769292 31134 raft_consensus.cc:493] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.769919 31134 raft_consensus.cc:515] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.772749 31134 leader_election.cc:290] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:51.785655 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:51.787295 30775 tablet_bootstrap.cc:492] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:51.787313 30401 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42132 (request call id 55) took 1477 ms. Trace:
I20260709 13:10:51.790019 30401 rpcz_store.cc:276] 0709 13:10:50.211328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.257639 (+ 46311us) service_pool.cc:224] Handling call
0709 13:10:51.688597 (+1430958us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":6}
I20260709 13:10:51.762447 31098 consensus_queue.cc:237] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:51.799800 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:51.800856 30576 raft_consensus.cc:2468] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:51.802544 30620 leader_election.cc:304] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
W20260709 13:10:51.805409 30621 leader_election.cc:343] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.813141 31134 raft_consensus.cc:2804] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:51.820355 31134 raft_consensus.cc:493] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.820744 31134 raft_consensus.cc:3060] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.832796 30773 raft_consensus.cc:359] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:51.836587 30773 raft_consensus.cc:385] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.836896 30773 raft_consensus.cc:740] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.838726 30773 consensus_queue.cc:260] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:51.853204 30778 tablet_bootstrap.cc:492] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:51.853972 30778 ts_tablet_manager.cc:1403] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.176s	user 0.025s	sys 0.021s
I20260709 13:10:51.845757 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec7a3e0f271468aa4e4809f9707f7a3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:51.855994 30503 raft_consensus.cc:3060] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.864784 31046 leader_election.cc:290] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:51.860144 30778 raft_consensus.cc:359] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:51.865926 30778 raft_consensus.cc:385] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.866320 30778 raft_consensus.cc:740] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.866623 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec7a3e0f271468aa4e4809f9707f7a3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:51.871690 30778 consensus_queue.cc:260] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:51.872810 30774 tablet_bootstrap.cc:492] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:51.877457 30774 ts_tablet_manager.cc:1403] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.216s	user 0.016s	sys 0.006s
W20260709 13:10:51.878329 30546 leader_election.cc:343] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.879892 30778 ts_tablet_manager.cc:1434] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 13:10:51.881358 30778 tablet_bootstrap.cc:492] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:51.886335 30775 tablet_bootstrap.cc:654] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.882560 30774 raft_consensus.cc:359] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.891986 30774 raft_consensus.cc:385] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.892293 30774 raft_consensus.cc:740] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.895174 30774 consensus_queue.cc:260] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.897476 30773 ts_tablet_manager.cc:1434] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.133s	user 0.009s	sys 0.000s
I20260709 13:10:51.899051 30773 tablet_bootstrap.cc:492] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:51.894297 31158 raft_consensus.cc:493] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.901196 31158 raft_consensus.cc:515] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:51.904703 31158 leader_election.cc:290] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:51.874197 31134 raft_consensus.cc:515] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:51.913053 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:51.915458 31134 leader_election.cc:290] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:51.920861 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:51.921559 30578 raft_consensus.cc:3060] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.922757 30503 raft_consensus.cc:2468] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
W20260709 13:10:51.929242 30472 leader_election.cc:343] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.908939 30774 ts_tablet_manager.cc:1434] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:10:51.911068 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:51.931816 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:51.931941 30545 leader_election.cc:304] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:51.934561 30864 raft_consensus.cc:2804] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:51.935185 30864 raft_consensus.cc:697] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:51.936017 30864 consensus_queue.cc:237] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.934441 31132 raft_consensus.cc:493] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:51.939282 31132 raft_consensus.cc:515] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:51.939973 30778 tablet_bootstrap.cc:654] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.943197 30774 tablet_bootstrap.cc:492] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:51.945781 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
W20260709 13:10:51.950222 30471 leader_election.cc:343] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:51.950973 30471 leader_election.cc:304] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:51.958370 30773 tablet_bootstrap.cc:654] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.951818 30727 raft_consensus.cc:3060] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:51.956668 31048 raft_consensus.cc:2749] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:51.947185 30578 raft_consensus.cc:2468] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:51.963929 30620 leader_election.cc:304] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:51.965685 31161 raft_consensus.cc:2804] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.005285 31132 leader_election.cc:290] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:52.014976 31164 consensus_queue.cc:1048] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:52.017307 31161 raft_consensus.cc:697] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:52.018338 31161 consensus_queue.cc:237] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.019613 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:52.022151 30620 leader_election.cc:304] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:52.023411 30774 tablet_bootstrap.cc:654] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.030926 30727 raft_consensus.cc:2468] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:52.022439 30775 tablet_bootstrap.cc:492] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:52.031507 31134 raft_consensus.cc:2749] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:52.037858 30775 ts_tablet_manager.cc:1403] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.251s	user 0.016s	sys 0.011s
I20260709 13:10:52.058207 30778 tablet_bootstrap.cc:492] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:52.058744 30778 ts_tablet_manager.cc:1403] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.178s	user 0.019s	sys 0.011s
I20260709 13:10:52.061707 30778 raft_consensus.cc:359] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:52.062284 30773 tablet_bootstrap.cc:492] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:52.062476 30778 raft_consensus.cc:385] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.063055 30773 ts_tablet_manager.cc:1403] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.164s	user 0.017s	sys 0.004s
I20260709 13:10:52.063568 30778 raft_consensus.cc:740] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.065523 31144 raft_consensus.cc:493] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.065428 30778 consensus_queue.cc:260] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:52.066111 31144 raft_consensus.cc:515] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.071137 30778 ts_tablet_manager.cc:1434] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:52.064191 31098 raft_consensus.cc:493] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.075915 31046 raft_consensus.cc:493] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.079159 31046 raft_consensus.cc:515] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.077303 31098 raft_consensus.cc:515] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.081408 31046 leader_election.cc:290] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:52.086472 30778 tablet_bootstrap.cc:492] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:52.091346 30775 raft_consensus.cc:359] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.092918 30775 raft_consensus.cc:385] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.093251 30775 raft_consensus.cc:740] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.094417 30775 consensus_queue.cc:260] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.099032 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b693fc5a9c3477a87a09ce7d3c57859" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:52.098021 30401 catalog_manager.cc:5697] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 1 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.091874 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:52.100428 30504 raft_consensus.cc:2468] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:52.100535 30401 catalog_manager.cc:5697] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } }
I20260709 13:10:52.104732 31144 leader_election.cc:290] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:52.105010 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:52.102609 30545 leader_election.cc:304] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:52.105715 30504 raft_consensus.cc:2468] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:52.107163 30693 leader_election.cc:304] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:10:52.107367 30865 raft_consensus.cc:2804] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.107921 30865 raft_consensus.cc:493] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.108249 30865 raft_consensus.cc:3060] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.111892 31144 raft_consensus.cc:2804] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.112313 31144 raft_consensus.cc:493] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.112659 31144 raft_consensus.cc:3060] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.113315 30778 tablet_bootstrap.cc:654] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.102846 30775 ts_tablet_manager.cc:1434] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.001s
I20260709 13:10:52.116973 30775 tablet_bootstrap.cc:492] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:52.123035 31098 leader_election.cc:290] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:52.104612 30401 catalog_manager.cc:5697] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.126868 31144 raft_consensus.cc:515] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.110634 30773 raft_consensus.cc:359] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.128896 30773 raft_consensus.cc:385] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.129177 30773 raft_consensus.cc:740] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.132082 30773 consensus_queue.cc:260] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.136701 30773 ts_tablet_manager.cc:1434] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260709 13:10:52.137883 30773 tablet_bootstrap.cc:492] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
W20260709 13:10:52.139632 30621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 104739us
I20260709 13:10:52.144152 30721 raft_consensus.cc:3060] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.158537 30402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42156 (request call id 52) took 1618 ms. Trace:
I20260709 13:10:52.170240 30651 raft_consensus.cc:3060] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.160820 31155 raft_consensus.cc:493] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.173441 31191 consensus_queue.cc:1048] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:52.173534 31155 raft_consensus.cc:515] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.159134 30402 rpcz_store.cc:276] 0709 13:10:50.540031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.540188 (+   157us) service_pool.cc:224] Handling call
0709 13:10:52.158472 (+1618284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:51.840807 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:51.841423 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:51.841460 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:10:51.841478 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:51.842019 (+   541us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:51.842102 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:51.842129 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:51.842474 (+   345us) tablet.cc:701] Row locks acquired
0709 13:10:51.842496 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:10:51.842635 (+   139us) write_op.cc:270] Start()
0709 13:10:51.842742 (+   107us) write_op.cc:276] Timestamp: P: 1783602651842587 usec, L: 0
0709 13:10:51.842764 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:51.843475 (+   711us) log.cc:844] Serialized 1325 byte log entry
0709 13:10:51.953080 (+109605us) op_driver.cc:464] REPLICATION: finished
0709 13:10:52.044581 (+ 91501us) write_op.cc:301] APPLY: starting
0709 13:10:52.044661 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:52.044803 (+   142us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:52.044923 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:52.045352 (+   429us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:52.045526 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:10:52.045569 (+    43us) write_op.cc:312] APPLY: finished
0709 13:10:52.045755 (+   186us) log.cc:844] Serialized 34 byte log entry
0709 13:10:52.045960 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:52.046056 (+    96us) write_op.cc:454] Released schema lock
0709 13:10:52.046095 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:52.050085 (+  3990us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:52.050125 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2988,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":91258,"apply.run_cpu_time_us":1849,"apply.run_wall_time_us":1849,"num_ops":3,"prepare.queue_time_us":144834,"prepare.run_cpu_time_us":2961,"prepare.run_wall_time_us":7738,"replication_time_us":110175,"thread_start_us":225832,"threads_started":2}]]}
I20260709 13:10:52.176819 31155 leader_election.cc:290] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:52.176919 30865 raft_consensus.cc:515] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.178893 30775 tablet_bootstrap.cc:654] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.183393 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafe994543a04390ab335d1abeaa6f4e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:52.184180 30503 raft_consensus.cc:2468] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
W20260709 13:10:52.160087 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 71759us
I20260709 13:10:52.195923 30773 tablet_bootstrap.cc:654] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.197018 31078 consensus_queue.cc:1048] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:52.192827 30545 leader_election.cc:304] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:52.200606 31155 raft_consensus.cc:2804] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.200994 31155 raft_consensus.cc:493] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.201431 31155 raft_consensus.cc:3060] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.221628 31144 leader_election.cc:290] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:52.221884 31155 raft_consensus.cc:515] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.223333 30865 leader_election.cc:290] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:52.221912 30778 tablet_bootstrap.cc:492] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:52.224642 30778 ts_tablet_manager.cc:1403] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.006s
I20260709 13:10:52.231045 31129 consensus_queue.cc:1048] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:52.230604 30778 raft_consensus.cc:359] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.232985 30778 raft_consensus.cc:385] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.233273 30778 raft_consensus.cc:740] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.232472 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:52.234145 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:52.234391 30727 raft_consensus.cc:2393] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 1: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:10:52.234509 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafe994543a04390ab335d1abeaa6f4e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:52.235234 30503 raft_consensus.cc:3060] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.236537 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:52.237264 30728 raft_consensus.cc:2393] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 1: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:10:52.241124 30404 catalog_manager.cc:5697] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } }
I20260709 13:10:52.242746 30500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:52.242369 30778 consensus_queue.cc:260] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.245085 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b693fc5a9c3477a87a09ce7d3c57859" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:52.245972 31161 consensus_queue.cc:1048] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:52.256381 30778 ts_tablet_manager.cc:1434] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 13:10:52.263676 30778 tablet_bootstrap.cc:492] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:52.263449 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:52.264472 30576 raft_consensus.cc:2393] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate fe9b995b077d4cb795f08934ed7d9088 in this term.
I20260709 13:10:52.249791 31134 raft_consensus.cc:493] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.266147 30500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafe994543a04390ab335d1abeaa6f4e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:52.266556 31134 raft_consensus.cc:515] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.267325 30500 raft_consensus.cc:3060] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.268846 31134 leader_election.cc:290] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:52.270439 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:52.271301 30774 tablet_bootstrap.cc:492] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:52.271831 30774 ts_tablet_manager.cc:1403] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.329s	user 0.023s	sys 0.048s
I20260709 13:10:52.289193 30778 tablet_bootstrap.cc:654] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.293114 30503 raft_consensus.cc:2468] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:52.299055 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:52.299957 30576 raft_consensus.cc:2393] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate fe9b995b077d4cb795f08934ed7d9088 in this term.
I20260709 13:10:52.300602 30774 raft_consensus.cc:359] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.300845 30693 leader_election.cc:304] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
W20260709 13:10:52.300976 30621 consensus_peers.cc:597] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Couldn't send request to peer ce7bd1ecd6e44f32879851d7b3174acb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.301362 30774 raft_consensus.cc:385] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.301698 30774 raft_consensus.cc:740] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.301797 31144 raft_consensus.cc:2804] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.302343 31144 raft_consensus.cc:697] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:52.303237 31144 consensus_queue.cc:237] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
W20260709 13:10:52.303769 30547 leader_election.cc:343] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.304767 30547 leader_election.cc:304] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:52.305259 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:52.306073 30504 raft_consensus.cc:2393] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4b8e689773b4a9d8e6de6d82d225c0d in current term 1: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:10:52.302420 30774 consensus_queue.cc:260] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.257639 31155 leader_election.cc:290] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:52.306221 31046 raft_consensus.cc:2749] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:10:52.309732 30527 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7b20 after lost signal to thread 20385
W20260709 13:10:52.311843 30527 debug-util.cc:398] Leaking SignalData structure 0x7b08003678e0 after lost signal to thread 30438
W20260709 13:10:52.313715 30527 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2180 after lost signal to thread 30530
I20260709 13:10:52.311874 30773 tablet_bootstrap.cc:492] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
I20260709 13:10:52.318579 30773 ts_tablet_manager.cc:1403] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.004s
I20260709 13:10:52.326510 30619 leader_election.cc:304] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:52.335078 30774 ts_tablet_manager.cc:1434] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:10:52.350672 30774 tablet_bootstrap.cc:492] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:52.336936 30983 raft_consensus.cc:3060] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:52.348302 30527 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2f40 after lost signal to thread 30605
I20260709 13:10:52.371989 30773 raft_consensus.cc:359] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.372763 30773 raft_consensus.cc:385] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.373051 30773 raft_consensus.cc:740] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.384985 30983 raft_consensus.cc:2749] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.386701 30400 catalog_manager.cc:5697] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.377764 30911 raft_consensus.cc:493] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.394047 30911 raft_consensus.cc:515] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.396643 30911 leader_election.cc:290] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:52.397090 31191 raft_consensus.cc:493] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:52.400029 30527 debug-util.cc:398] Leaking SignalData structure 0x7b080030d240 after lost signal to thread 30679
I20260709 13:10:52.400242 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:52.401322 30527 debug-util.cc:398] Leaking SignalData structure 0x7b08001513a0 after lost signal to thread 30753
I20260709 13:10:52.397655 31191 raft_consensus.cc:515] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.404184 31191 leader_election.cc:290] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:52.404819 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9687bd5f80bd4d869a68cbbecda69806" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:52.405504 30578 raft_consensus.cc:2468] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
W20260709 13:10:52.407697 30471 leader_election.cc:343] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.411422 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9687bd5f80bd4d869a68cbbecda69806" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:52.373765 30773 consensus_queue.cc:260] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.410768 30620 leader_election.cc:304] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:52.416077 31161 raft_consensus.cc:2804] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.416426 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:52.414867 30778 tablet_bootstrap.cc:492] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:52.417402 30778 ts_tablet_manager.cc:1403] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.154s	user 0.014s	sys 0.024s
I20260709 13:10:52.412279 30728 raft_consensus.cc:2468] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:52.416462 31161 raft_consensus.cc:493] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.421770 31161 raft_consensus.cc:3060] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.426622 30694 leader_election.cc:304] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:52.430008 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafe994543a04390ab335d1abeaa6f4e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:52.430312 31144 raft_consensus.cc:2749] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:52.427532 30472 leader_election.cc:343] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.431119 30472 leader_election.cc:304] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:52.430888 30773 ts_tablet_manager.cc:1434] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 13:10:52.432521 30773 tablet_bootstrap.cc:492] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:10:52.432776 31158 raft_consensus.cc:2749] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.432837 30500 raft_consensus.cc:2468] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:52.435036 30778 raft_consensus.cc:359] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.435848 30778 raft_consensus.cc:385] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.436105 30778 raft_consensus.cc:740] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.436766 30778 consensus_queue.cc:260] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.440635 30778 ts_tablet_manager.cc:1434] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.000s
I20260709 13:10:52.439003 30545 leader_election.cc:304] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
W20260709 13:10:52.441668 30547 leader_election.cc:343] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.444118 30774 tablet_bootstrap.cc:654] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.443794 31155 raft_consensus.cc:2804] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.447243 31155 raft_consensus.cc:697] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:52.448107 31155 consensus_queue.cc:237] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.452119 30862 consensus_queue.cc:1048] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:52.455516 30401 catalog_manager.cc:5697] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 1 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.460554 30864 consensus_queue.cc:1048] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:52.460870 31161 raft_consensus.cc:515] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.477757 30775 tablet_bootstrap.cc:492] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:52.479009 30775 ts_tablet_manager.cc:1403] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.362s	user 0.025s	sys 0.015s
I20260709 13:10:52.482677 30778 tablet_bootstrap.cc:492] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:52.481864 31193 consensus_queue.cc:1048] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:10:52.492229 30404 catalog_manager.cc:5697] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } }
I20260709 13:10:52.499171 30983 consensus_queue.cc:1048] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:52.501025 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9687bd5f80bd4d869a68cbbecda69806" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:52.501945 30576 raft_consensus.cc:3060] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:52.515952 30451 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:52.509379 30404 catalog_manager.cc:5697] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:52.522897 30546 consensus_peers.cc:597] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.523295 31161 leader_election.cc:290] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:52.524820 30773 tablet_bootstrap.cc:654] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.531450 30774 tablet_bootstrap.cc:492] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:52.532022 30774 ts_tablet_manager.cc:1403] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.182s	user 0.014s	sys 0.002s
I20260709 13:10:52.534755 30774 raft_consensus.cc:359] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.535446 30774 raft_consensus.cc:385] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.541427 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9687bd5f80bd4d869a68cbbecda69806" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:52.543354 30726 raft_consensus.cc:3060] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.536891 30774 raft_consensus.cc:740] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.556239 30774 consensus_queue.cc:260] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.560115 30778 tablet_bootstrap.cc:654] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.555224 30401 catalog_manager.cc:5697] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 1 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.581326 31161 consensus_queue.cc:1048] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:52.583101 30726 raft_consensus.cc:2468] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:52.585152 30621 leader_election.cc:304] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:52.562664 30401 catalog_manager.cc:5697] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } }
I20260709 13:10:52.591993 30775 raft_consensus.cc:359] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:52.595736 30775 raft_consensus.cc:385] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.596011 30775 raft_consensus.cc:740] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.596525 30774 ts_tablet_manager.cc:1434] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.064s	user 0.003s	sys 0.005s
I20260709 13:10:52.586982 31161 raft_consensus.cc:2804] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.600306 30774 tablet_bootstrap.cc:492] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:52.600617 31161 raft_consensus.cc:697] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:52.599786 30911 raft_consensus.cc:493] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.602066 30911 raft_consensus.cc:515] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.601531 31161 consensus_queue.cc:237] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.615007 30775 consensus_queue.cc:260] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:52.620317 30911 leader_election.cc:290] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:52.620352 30576 raft_consensus.cc:2468] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:52.622113 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:52.624171 30471 leader_election.cc:343] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.624862 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:52.633288 30773 tablet_bootstrap.cc:492] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: No bootstrap required, opened a new log
W20260709 13:10:52.637537 30472 leader_election.cc:343] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.639797 30472 leader_election.cc:304] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:52.639822 30773 ts_tablet_manager.cc:1403] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.208s	user 0.011s	sys 0.003s
I20260709 13:10:52.637274 30404 catalog_manager.cc:5697] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.643976 30404 catalog_manager.cc:5697] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } }
I20260709 13:10:52.645810 30911 raft_consensus.cc:2749] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.650092 30773 raft_consensus.cc:359] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.651353 30773 raft_consensus.cc:385] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.651734 30773 raft_consensus.cc:740] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.653034 30775 ts_tablet_manager.cc:1434] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.174s	user 0.008s	sys 0.000s
I20260709 13:10:52.654122 30775 tablet_bootstrap.cc:492] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088: Bootstrap starting.
I20260709 13:10:52.662819 30773 consensus_queue.cc:260] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.666953 30774 tablet_bootstrap.cc:654] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.667039 30773 ts_tablet_manager.cc:1434] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:10:52.673882 30775 tablet_bootstrap.cc:654] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.679769 30778 tablet_bootstrap.cc:492] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:52.680465 30778 ts_tablet_manager.cc:1403] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.204s	user 0.011s	sys 0.003s
I20260709 13:10:52.683465 30778 raft_consensus.cc:359] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:52.684413 30778 raft_consensus.cc:385] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.684764 30778 raft_consensus.cc:740] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.686445 30778 consensus_queue.cc:260] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:52.689268 30778 ts_tablet_manager.cc:1434] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:52.702454 30778 tablet_bootstrap.cc:492] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:52.717353 30775 tablet_bootstrap.cc:492] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088: No bootstrap required, opened a new log
I20260709 13:10:52.717943 30775 ts_tablet_manager.cc:1403] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.015s
I20260709 13:10:52.720954 30775 raft_consensus.cc:359] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.721767 30775 raft_consensus.cc:385] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.722055 30775 raft_consensus.cc:740] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.730479 30774 tablet_bootstrap.cc:492] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:52.731117 30774 ts_tablet_manager.cc:1403] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.131s	user 0.027s	sys 0.009s
I20260709 13:10:52.733726 30778 tablet_bootstrap.cc:654] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.737438 30774 raft_consensus.cc:359] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.738157 30774 raft_consensus.cc:385] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.738435 30774 raft_consensus.cc:740] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.736872 30775 consensus_queue.cc:260] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.739197 30774 consensus_queue.cc:260] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.741291 30775 ts_tablet_manager.cc:1434] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:10:52.741307 30774 ts_tablet_manager.cc:1434] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:52.743064 30774 tablet_bootstrap.cc:492] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:52.749151 30774 tablet_bootstrap.cc:654] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.751691 30778 tablet_bootstrap.cc:492] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:52.752393 30778 ts_tablet_manager.cc:1403] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.000s
I20260709 13:10:52.759557 30983 raft_consensus.cc:493] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.760092 30983 raft_consensus.cc:515] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.772732 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:52.773524 30727 raft_consensus.cc:2468] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:52.784174 30774 tablet_bootstrap.cc:492] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:52.784834 30774 ts_tablet_manager.cc:1403] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.042s	user 0.005s	sys 0.007s
I20260709 13:10:52.788010 30774 raft_consensus.cc:359] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.788549 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:52.775043 30778 raft_consensus.cc:359] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.789354 30504 raft_consensus.cc:2468] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:52.789549 30778 raft_consensus.cc:385] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.789958 30778 raft_consensus.cc:740] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.790910 30778 consensus_queue.cc:260] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.792810 30402 catalog_manager.cc:5697] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.795682 30778 ts_tablet_manager.cc:1434] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:10:52.797055 30778 tablet_bootstrap.cc:492] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:52.801574 30724 raft_consensus.cc:3060] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.805704 30778 tablet_bootstrap.cc:654] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.811229 31193 consensus_queue.cc:1048] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:52.812139 30619 leader_election.cc:304] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:52.812867 31191 raft_consensus.cc:2804] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.813279 31191 raft_consensus.cc:493] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.813602 31191 raft_consensus.cc:3060] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.824156 30864 raft_consensus.cc:493] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.824697 30864 raft_consensus.cc:515] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.828487 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:52.826617 30864 leader_election.cc:290] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:52.829191 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:52.829864 30501 raft_consensus.cc:2468] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
W20260709 13:10:52.830391 30547 leader_election.cc:343] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.831274 31193 consensus_queue.cc:1048] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:52.837085 30545 leader_election.cc:304] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:52.838652 30844 raft_consensus.cc:2804] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.762468 30983 leader_election.cc:290] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:52.839072 30844 raft_consensus.cc:493] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.839535 30844 raft_consensus.cc:3060] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.852010 31191 raft_consensus.cc:515] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.788820 30774 raft_consensus.cc:385] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.855340 31191 leader_election.cc:290] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:52.855202 30774 raft_consensus.cc:740] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.857707 30774 consensus_queue.cc:260] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.859692 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:52.860342 30501 raft_consensus.cc:3060] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.862960 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:52.863596 30727 raft_consensus.cc:3060] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.863680 31048 raft_consensus.cc:493] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.864363 31048 raft_consensus.cc:515] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.867153 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:52.868649 30471 leader_election.cc:343] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.871694 31048 leader_election.cc:290] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:52.873934 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:52.875721 30472 leader_election.cc:343] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.876360 30472 leader_election.cc:304] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:52.870453 30844 raft_consensus.cc:515] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.878880 30726 raft_consensus.cc:3060] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.879725 30774 ts_tablet_manager.cc:1434] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:10:52.880789 30774 tablet_bootstrap.cc:492] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:52.875640 30501 raft_consensus.cc:2468] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:52.887342 30844 leader_election.cc:290] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:52.888006 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:52.888609 30774 tablet_bootstrap.cc:654] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.916515 30983 raft_consensus.cc:493] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.917240 30983 raft_consensus.cc:515] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.917781 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:52.918414 30504 raft_consensus.cc:3060] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.919400 30983 leader_election.cc:290] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:52.921536 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:52.889370 30727 raft_consensus.cc:2468] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:52.906250 30911 raft_consensus.cc:2749] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:52.922886 30621 leader_election.cc:343] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:52.924961 30547 leader_election.cc:343] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.932085 30774 tablet_bootstrap.cc:492] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:52.911542 30619 leader_election.cc:304] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:52.932750 30774 ts_tablet_manager.cc:1403] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.003s
I20260709 13:10:52.935602 31129 raft_consensus.cc:2804] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.935843 30774 raft_consensus.cc:359] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.936609 30774 raft_consensus.cc:385] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.936818 30651 raft_consensus.cc:3060] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.937803 31129 raft_consensus.cc:697] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:52.938762 31129 consensus_queue.cc:237] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:52.940433 30778 tablet_bootstrap.cc:492] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:52.941468 30778 ts_tablet_manager.cc:1403] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.145s	user 0.010s	sys 0.008s
I20260709 13:10:52.936883 30774 raft_consensus.cc:740] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.949625 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:52.950380 30501 raft_consensus.cc:2468] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:52.946444 30778 raft_consensus.cc:359] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.952216 30778 raft_consensus.cc:385] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.952508 30504 raft_consensus.cc:2468] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:52.952711 30844 consensus_queue.cc:1048] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:52.953537 30774 consensus_queue.cc:260] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.952564 30778 raft_consensus.cc:740] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.955021 30778 consensus_queue.cc:260] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:52.955451 30545 leader_election.cc:304] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:52.955739 30774 ts_tablet_manager.cc:1434] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:10:52.956822 30774 tablet_bootstrap.cc:492] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:52.957192 30844 raft_consensus.cc:2804] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.957788 30844 raft_consensus.cc:697] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:52.955444 30619 leader_election.cc:304] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:52.959524 30844 consensus_queue.cc:237] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:52.960811 31191 raft_consensus.cc:2804] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.961221 31191 raft_consensus.cc:493] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.961791 31191 raft_consensus.cc:3060] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.963160 30778 ts_tablet_manager.cc:1434] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:10:52.965965 30778 tablet_bootstrap.cc:492] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:52.983995 30778 tablet_bootstrap.cc:654] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.991710 30404 catalog_manager.cc:5697] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.987797 31191 raft_consensus.cc:515] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.004904 30774 tablet_bootstrap.cc:654] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:53.010040 30864 consensus_queue.cc:1048] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.018432 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:53.019098 30504 raft_consensus.cc:3060] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.020709 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:53.025841 30778 tablet_bootstrap.cc:492] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:53.026466 30778 ts_tablet_manager.cc:1403] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.014s
W20260709 13:10:53.026569 30621 leader_election.cc:343] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:53.030189 30504 raft_consensus.cc:2468] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:53.034077 31191 leader_election.cc:290] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:53.036042 30864 raft_consensus.cc:493] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.041023 30864 raft_consensus.cc:515] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:53.043030 30864 leader_election.cc:290] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:53.043741 30619 leader_election.cc:304] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:53.045359 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:53.046479 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:53.043080 30778 raft_consensus.cc:359] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:53.047180 30501 raft_consensus.cc:2468] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:53.051378 31191 raft_consensus.cc:2804] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:53.052168 31191 raft_consensus.cc:697] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:53.052175 30778 raft_consensus.cc:385] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:53.053020 30778 raft_consensus.cc:740] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:53.053169 31191 consensus_queue.cc:237] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.054986 30778 consensus_queue.cc:260] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:53.055984 30651 raft_consensus.cc:2468] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 0.
I20260709 13:10:53.059180 30546 leader_election.cc:304] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:53.060537 30865 raft_consensus.cc:2804] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:53.060976 30865 raft_consensus.cc:493] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.061342 30865 raft_consensus.cc:3060] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.068602 31193 raft_consensus.cc:493] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.069429 31193 raft_consensus.cc:515] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:53.073814 30865 raft_consensus.cc:515] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:53.076964 31193 leader_election.cc:290] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:53.079721 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a1eefeef3847b8ad88b05ca970c43f" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:53.080893 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a1eefeef3847b8ad88b05ca970c43f" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:53.081990 30578 raft_consensus.cc:2468] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:53.084692 30694 leader_election.cc:304] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:53.092540 31193 raft_consensus.cc:2804] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:53.092974 31193 raft_consensus.cc:493] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.080577 30651 raft_consensus.cc:2468] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 0.
I20260709 13:10:53.076968 30778 ts_tablet_manager.cc:1434] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 13:10:53.096777 30778 tablet_bootstrap.cc:492] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d: Bootstrap starting.
I20260709 13:10:53.096997 31134 consensus_queue.cc:1048] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.105113 30774 tablet_bootstrap.cc:492] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:53.105060 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:53.105738 30501 raft_consensus.cc:3060] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.106770 30865 leader_election.cc:290] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:53.113888 30501 raft_consensus.cc:2468] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:53.120321 30778 tablet_bootstrap.cc:654] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:53.121563 30545 leader_election.cc:304] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:53.123047 31046 raft_consensus.cc:2804] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:53.123558 31046 raft_consensus.cc:697] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:53.105738 30774 ts_tablet_manager.cc:1403] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.149s	user 0.036s	sys 0.027s
I20260709 13:10:53.124428 31046 consensus_queue.cc:237] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:53.093323 31193 raft_consensus.cc:3060] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.127075 30774 raft_consensus.cc:359] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:53.127864 30774 raft_consensus.cc:385] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:53.128156 30774 raft_consensus.cc:740] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:53.128917 30774 consensus_queue.cc:260] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:53.131246 30774 ts_tablet_manager.cc:1434] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:53.132314 30774 tablet_bootstrap.cc:492] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:53.133821 30404 catalog_manager.cc:5697] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.135504 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:53.136189 30651 raft_consensus.cc:3060] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.138759 30774 tablet_bootstrap.cc:654] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:53.153585 30778 tablet_bootstrap.cc:492] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d: No bootstrap required, opened a new log
I20260709 13:10:53.154928 30778 ts_tablet_manager.cc:1403] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent bootstrapping tablet: real 0.058s	user 0.002s	sys 0.010s
I20260709 13:10:53.165671 30862 raft_consensus.cc:493] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.166252 30862 raft_consensus.cc:515] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:53.167781 30778 raft_consensus.cc:359] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.168323 30862 leader_election.cc:290] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:53.171066 30778 raft_consensus.cc:385] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:53.171726 30778 raft_consensus.cc:740] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:53.173776 30778 consensus_queue.cc:260] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.180061 30778 ts_tablet_manager.cc:1434] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:10:53.180249 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:53.182675 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:53.183652 30501 raft_consensus.cc:2393] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate fe9b995b077d4cb795f08934ed7d9088 in this term.
I20260709 13:10:53.165400 31193 raft_consensus.cc:515] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:53.187618 30693 leader_election.cc:304] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:53.190763 30862 raft_consensus.cc:3060] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.192713 30651 raft_consensus.cc:2468] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:53.195294 31193 leader_election.cc:290] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:53.195924 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a1eefeef3847b8ad88b05ca970c43f" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:53.196534 30578 raft_consensus.cc:3060] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.198468 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a1eefeef3847b8ad88b05ca970c43f" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:53.199110 30651 raft_consensus.cc:3060] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.211287 30578 raft_consensus.cc:2468] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:53.212456 30774 tablet_bootstrap.cc:492] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:53.219264 30774 ts_tablet_manager.cc:1403] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.087s	user 0.020s	sys 0.009s
I20260709 13:10:53.212725 30694 leader_election.cc:304] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:53.223064 30862 raft_consensus.cc:2749] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:53.224922 31144 raft_consensus.cc:2804] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:53.225498 31144 raft_consensus.cc:697] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:53.225486 30651 raft_consensus.cc:2468] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:53.229864 31129 consensus_queue.cc:1048] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.226425 31144 consensus_queue.cc:237] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:10:53.244092 30404 catalog_manager.cc:5697] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.259744 30774 raft_consensus.cc:359] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.260509 30774 raft_consensus.cc:385] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:53.260790 30774 raft_consensus.cc:740] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:53.261516 30774 consensus_queue.cc:260] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.269027 30774 ts_tablet_manager.cc:1434] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.049s	user 0.001s	sys 0.005s
I20260709 13:10:53.269593 30402 catalog_manager.cc:5697] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 0 to 1, leader changed from <none> to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 1 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.270028 30774 tablet_bootstrap.cc:492] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb: Bootstrap starting.
I20260709 13:10:53.280615 30774 tablet_bootstrap.cc:654] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:53.280565 30400 catalog_manager.cc:5697] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.286623 30774 tablet_bootstrap.cc:492] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb: No bootstrap required, opened a new log
I20260709 13:10:53.287210 30774 ts_tablet_manager.cc:1403] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.003s
I20260709 13:10:53.290472 30774 raft_consensus.cc:359] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.291512 30774 raft_consensus.cc:385] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:53.292053 30774 raft_consensus.cc:740] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Initialized, Role: FOLLOWER
I20260709 13:10:53.292794 30774 consensus_queue.cc:260] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.295579 30774 ts_tablet_manager.cc:1434] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:10:53.372092 31046 consensus_queue.cc:1048] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.383900 31129 consensus_queue.cc:1048] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.390887 31193 raft_consensus.cc:493] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.392283 31193 raft_consensus.cc:515] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.398077 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:53.400647 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:53.401690 30501 raft_consensus.cc:2393] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 1: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:53.403730 30693 leader_election.cc:304] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:53.404569 31144 raft_consensus.cc:3060] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.394665 31193 leader_election.cc:290] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:53.413833 30844 consensus_queue.cc:1048] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.427932 30983 consensus_queue.cc:1048] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.467500 31144 raft_consensus.cc:2749] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:53.518993 31191 raft_consensus.cc:493] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.519577 31191 raft_consensus.cc:515] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.521781 31191 leader_election.cc:290] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:53.523496 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:53.524377 30721 raft_consensus.cc:2468] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:53.525820 30621 leader_election.cc:304] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:53.526304 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:10:53.526963 30983 raft_consensus.cc:2804] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:53.527127 30501 raft_consensus.cc:2468] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 0.
I20260709 13:10:53.527361 30983 raft_consensus.cc:493] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.527711 30983 raft_consensus.cc:3060] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.531908 31069 consensus_queue.cc:1048] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.534570 30983 raft_consensus.cc:515] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.537484 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:53.538144 30727 raft_consensus.cc:3060] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.546360 30727 raft_consensus.cc:2468] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:53.551569 30983 leader_election.cc:290] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:53.560843 30621 leader_election.cc:304] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:53.562603 31134 raft_consensus.cc:2804] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:53.563158 31134 raft_consensus.cc:697] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:53.564030 31134 consensus_queue.cc:237] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:53.570475 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:10:53.571275 30501 raft_consensus.cc:3060] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.572580 30983 consensus_queue.cc:1048] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.597888 30501 raft_consensus.cc:2468] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:53.598714 30404 catalog_manager.cc:5697] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.666880 31046 consensus_queue.cc:1048] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.682688 30864 consensus_queue.cc:1048] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.711448 31193 consensus_queue.cc:1048] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.754292 31193 consensus_queue.cc:1048] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.987968 31129 consensus_queue.cc:1048] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:54.010246 31129 consensus_queue.cc:1048] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:55.409644 20382 tablet_server.cc:179] TabletServer@127.19.231.129:0 shutting down...
W20260709 13:10:55.452211 30619 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:10:55.465786 30619 consensus_peers.cc:597] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.470134 30693 consensus_peers.cc:597] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.472078 30693 consensus_peers.cc:597] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.472632 30693 consensus_peers.cc:597] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.514164 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:55.517668 20382 tablet_replica.cc:333] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
W20260709 13:10:55.519958 30619 consensus_peers.cc:597] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.520136 20382 raft_consensus.cc:2243] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.522830 20382 raft_consensus.cc:2272] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.526528 20382 tablet_replica.cc:333] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.527470 20382 raft_consensus.cc:2243] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.528048 20382 raft_consensus.cc:2272] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.531934 20382 tablet_replica.cc:333] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.533605 20382 raft_consensus.cc:2243] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:55.536345 30545 consensus_peers.cc:597] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.536758 30619 consensus_peers.cc:597] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.537029 30545 consensus_peers.cc:597] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.537678 30545 consensus_peers.cc:597] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.540066 20382 raft_consensus.cc:2272] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.542560 30619 consensus_peers.cc:597] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.544703 30693 consensus_peers.cc:597] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.547919 20382 tablet_replica.cc:333] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.548898 20382 raft_consensus.cc:2243] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.549425 20382 raft_consensus.cc:2272] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.555589 20382 tablet_replica.cc:333] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.556666 20382 raft_consensus.cc:2243] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.557284 20382 raft_consensus.cc:2272] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.562389 30619 consensus_peers.cc:597] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.564119 20382 tablet_replica.cc:333] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.565228 20382 raft_consensus.cc:2243] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.565796 20382 raft_consensus.cc:2272] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.567626 30545 consensus_peers.cc:597] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.570043 20382 tablet_replica.cc:333] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.577366 20382 raft_consensus.cc:2243] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.578162 20382 raft_consensus.cc:2272] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.582077 20382 tablet_replica.cc:333] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.583037 20382 raft_consensus.cc:2243] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.583598 20382 raft_consensus.cc:2272] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.584687 30545 consensus_peers.cc:597] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.587716 20382 tablet_replica.cc:333] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.591770 20382 raft_consensus.cc:2243] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.592346 20382 raft_consensus.cc:2272] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.595300 20382 tablet_replica.cc:333] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.596081 20382 raft_consensus.cc:2243] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.597137 20382 raft_consensus.cc:2272] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.602320 30619 consensus_peers.cc:597] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.604203 30545 consensus_peers.cc:597] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.605821 20382 tablet_replica.cc:333] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.607429 20382 raft_consensus.cc:2243] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.608001 20382 raft_consensus.cc:2272] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.612330 20382 tablet_replica.cc:333] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.613164 20382 raft_consensus.cc:2243] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.614483 20382 raft_consensus.cc:2272] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.617561 20382 tablet_replica.cc:333] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.618331 20382 raft_consensus.cc:2243] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.619227 20382 raft_consensus.cc:2272] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.621155 20382 tablet_replica.cc:333] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.621961 20382 raft_consensus.cc:2243] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.622464 20382 raft_consensus.cc:2272] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.626230 20382 tablet_replica.cc:333] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.627058 20382 raft_consensus.cc:2243] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.627614 20382 raft_consensus.cc:2272] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.629436 30545 consensus_peers.cc:597] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.630359 20382 tablet_replica.cc:333] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.631294 20382 raft_consensus.cc:2243] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.632370 20382 raft_consensus.cc:2272] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.634770 20382 tablet_replica.cc:333] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
W20260709 13:10:55.635272 30545 consensus_peers.cc:597] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.635493 20382 raft_consensus.cc:2243] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.636684 20382 raft_consensus.cc:2272] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.639680 20382 tablet_replica.cc:333] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.640507 20382 raft_consensus.cc:2243] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.641000 20382 raft_consensus.cc:2272] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.644682 20382 tablet_replica.cc:333] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.645501 20382 raft_consensus.cc:2243] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.646023 20382 raft_consensus.cc:2272] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.647944 20382 tablet_replica.cc:333] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.648554 20382 raft_consensus.cc:2243] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.649298 20382 raft_consensus.cc:2272] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.651473 20382 tablet_replica.cc:333] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.652195 20382 raft_consensus.cc:2243] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.653242 20382 raft_consensus.cc:2272] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.656098 20382 tablet_replica.cc:333] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.656843 20382 raft_consensus.cc:2243] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.657941 20382 raft_consensus.cc:2272] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.660738 20382 tablet_replica.cc:333] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.661512 20382 raft_consensus.cc:2243] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.662031 20382 raft_consensus.cc:2272] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.664431 20382 tablet_replica.cc:333] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.665186 20382 raft_consensus.cc:2243] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.665771 20382 raft_consensus.cc:2272] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.668565 20382 tablet_replica.cc:333] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.669340 20382 raft_consensus.cc:2243] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.669863 20382 raft_consensus.cc:2272] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.672335 20382 tablet_replica.cc:333] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.673128 20382 raft_consensus.cc:2243] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:55.673280 30545 consensus_peers.cc:597] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.674217 20382 raft_consensus.cc:2272] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.675289 30693 consensus_peers.cc:597] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.677264 20382 tablet_replica.cc:333] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.678165 20382 raft_consensus.cc:2243] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.678823 20382 raft_consensus.cc:2272] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.678823 30619 consensus_peers.cc:597] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.681804 20382 tablet_replica.cc:333] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.682459 20382 raft_consensus.cc:2243] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.683467 20382 raft_consensus.cc:2272] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.686237 20382 tablet_replica.cc:333] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.686940 20382 raft_consensus.cc:2243] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.687403 20382 raft_consensus.cc:2272] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.689585 20382 tablet_replica.cc:333] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.690403 20382 raft_consensus.cc:2243] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.690972 20382 raft_consensus.cc:2272] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.693966 20382 tablet_replica.cc:333] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.694716 20382 raft_consensus.cc:2243] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.695250 20382 raft_consensus.cc:2272] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.697579 20382 tablet_replica.cc:333] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.698328 20382 raft_consensus.cc:2243] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.698930 20382 raft_consensus.cc:2272] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.701671 20382 tablet_replica.cc:333] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.702309 20382 raft_consensus.cc:2243] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.702826 20382 raft_consensus.cc:2272] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.705039 20382 tablet_replica.cc:333] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.705659 20382 raft_consensus.cc:2243] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.706553 20382 raft_consensus.cc:2272] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.708911 20382 tablet_replica.cc:333] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.709458 20382 raft_consensus.cc:2243] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.710256 20382 raft_consensus.cc:2272] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.712996 20382 tablet_replica.cc:333] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.713819 20382 raft_consensus.cc:2243] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.714917 20382 raft_consensus.cc:2272] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.717101 20382 tablet_replica.cc:333] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.717694 20382 raft_consensus.cc:2243] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.718140 20382 raft_consensus.cc:2272] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.720407 20382 tablet_replica.cc:333] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.720968 20382 raft_consensus.cc:2243] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.721416 20382 raft_consensus.cc:2272] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.723120 20382 tablet_replica.cc:333] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.723812 20382 raft_consensus.cc:2243] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.724627 20382 raft_consensus.cc:2272] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.726979 20382 tablet_replica.cc:333] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.727638 20382 raft_consensus.cc:2243] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.728174 20382 raft_consensus.cc:2272] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.730598 20382 tablet_replica.cc:333] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.731217 20382 raft_consensus.cc:2243] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.731665 20382 raft_consensus.cc:2272] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.732914 30693 consensus_peers.cc:597] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.734292 20382 tablet_replica.cc:333] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.735159 20382 raft_consensus.cc:2243] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.735603 20382 raft_consensus.cc:2272] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.738194 20382 tablet_replica.cc:333] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.738857 20382 raft_consensus.cc:2243] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.739281 20382 raft_consensus.cc:2272] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.739491 30545 consensus_peers.cc:597] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.741673 20382 tablet_replica.cc:333] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.742419 20382 raft_consensus.cc:2243] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.743016 20382 raft_consensus.cc:2272] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.745731 20382 tablet_replica.cc:333] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: stopping tablet replica
I20260709 13:10:55.746333 20382 raft_consensus.cc:2243] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.747355 20382 raft_consensus.cc:2272] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.772614 30545 consensus_peers.cc:597] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.777472 30545 consensus_peers.cc:597] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.789067 30619 consensus_peers.cc:597] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.790144 30619 consensus_peers.cc:597] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.883870 30547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 52505.4us
W20260709 13:10:55.879791 30693 consensus_peers.cc:597] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.904333 30619 connection.cc:769] client connection to 127.19.231.129:44027 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:10:55.941706 30619 consensus_peers.cc:597] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.942226 30619 consensus_peers.cc:597] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.962576 30619 consensus_peers.cc:597] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.745335 30983 raft_consensus.cc:493] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.745898 30983 raft_consensus.cc:515] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:56.748108 30983 leader_election.cc:290] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:56.749240 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:56.751272 30864 raft_consensus.cc:493] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.751816 30864 raft_consensus.cc:515] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:56.751894 30619 leader_election.cc:336] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.752444 30619 leader_election.cc:304] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:56.753190 30983 raft_consensus.cc:2749] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.753573 30864 leader_election.cc:290] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:56.755496 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:56.759002 30545 leader_election.cc:336] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.759477 30545 leader_election.cc:304] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:56.760195 30864 raft_consensus.cc:2749] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.765447 31258 raft_consensus.cc:493] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.766031 31258 raft_consensus.cc:515] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:56.767081 31254 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.767644 31254 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:56.769871 31254 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:56.771047 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:56.768338 31258 leader_election.cc:290] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
W20260709 13:10:56.774287 30693 leader_election.cc:336] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.774610 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:56.774704 30693 leader_election.cc:304] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
W20260709 13:10:56.776700 30693 leader_election.cc:336] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.777048 30693 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:56.777639 31254 raft_consensus.cc:2749] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.778151 31258 raft_consensus.cc:2749] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.783949 30983 raft_consensus.cc:493] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.784453 30983 raft_consensus.cc:515] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:56.786080 30983 leader_election.cc:290] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:56.787204 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:56.787921 30579 raft_consensus.cc:2468] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:56.789240 30620 leader_election.cc:304] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:56.789903 30983 raft_consensus.cc:2804] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.790211 30983 raft_consensus.cc:493] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.790488 30983 raft_consensus.cc:3060] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.790951 30864 raft_consensus.cc:493] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.791500 30864 raft_consensus.cc:515] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:56.793519 30619 leader_election.cc:336] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.794499 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:56.796049 30864 leader_election.cc:290] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:56.800633 30983 raft_consensus.cc:515] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:56.801939 30654 raft_consensus.cc:2393] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 2: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:10:56.802600 30983 leader_election.cc:290] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:56.804431 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:56.805094 30579 raft_consensus.cc:3060] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.813485 30579 raft_consensus.cc:2468] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 2.
I20260709 13:10:56.814256 30864 raft_consensus.cc:493] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.814736 30620 leader_election.cc:304] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:56.814924 30864 raft_consensus.cc:515] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:56.815848 30983 raft_consensus.cc:2804] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:56.816340 30983 raft_consensus.cc:697] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:56.817153 30983 consensus_queue.cc:237] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:56.818254 30619 leader_election.cc:336] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.819099 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:56.804054 30545 leader_election.cc:336] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.820366 30546 leader_election.cc:304] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:56.820571 31264 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.821416 31263 raft_consensus.cc:2749] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.821352 31264 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:56.823452 31263 raft_consensus.cc:493] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.823982 31263 raft_consensus.cc:515] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:56.826318 31263 leader_election.cc:290] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:56.825330 31264 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:56.827220 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:56.828919 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:56.830760 30864 leader_election.cc:290] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:56.836100 31258 raft_consensus.cc:493] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.836668 31258 raft_consensus.cc:515] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:56.838853 31258 leader_election.cc:290] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
W20260709 13:10:56.839263 30619 leader_election.cc:336] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.839812 30619 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:56.840593 31264 raft_consensus.cc:2749] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.842031 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
W20260709 13:10:56.845327 30545 leader_election.cc:336] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
W20260709 13:10:56.845805 30693 leader_election.cc:336] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.845909 30545 leader_election.cc:304] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:56.846909 31263 raft_consensus.cc:2749] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:56.847537 30545 leader_election.cc:336] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.848017 30545 leader_election.cc:304] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:56.848781 31263 raft_consensus.cc:2749] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.849527 31264 raft_consensus.cc:493] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.850050 31264 raft_consensus.cc:515] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:56.852224 31264 leader_election.cc:290] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:10:56.852418 30864 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.852998 31258 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.853017 30864 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:56.854115 31258 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:56.855474 30864 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:56.855706 30694 leader_election.cc:304] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:56.856427 31258 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:56.857548 31254 raft_consensus.cc:2749] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.858331 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:56.858515 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:56.859040 30579 raft_consensus.cc:2468] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:56.859144 30724 raft_consensus.cc:2468] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:56.862406 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:56.865690 30545 leader_election.cc:336] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.866014 30694 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:56.866986 30547 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:10:56.867241 31258 raft_consensus.cc:2804] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.867789 31258 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.868211 31258 raft_consensus.cc:3060] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.868582 31263 raft_consensus.cc:2804] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.869002 31263 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.869390 31263 raft_consensus.cc:3060] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:56.877388 30619 leader_election.cc:336] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.877948 30619 leader_election.cc:304] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:56.879033 31129 raft_consensus.cc:2749] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.863763 30402 catalog_manager.cc:5697] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.881731 31258 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:56.884635 31258 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:56.885247 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
W20260709 13:10:56.891328 30693 leader_election.cc:336] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
W20260709 13:10:56.901149 30693 leader_election.cc:336] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
W20260709 13:10:56.904527 20382 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30527)
I20260709 13:10:56.907842 31263 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:56.909521 30579 raft_consensus.cc:2393] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 2: Already voted for candidate fe9b995b077d4cb795f08934ed7d9088 in this term.
I20260709 13:10:56.910995 30694 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:10:56.912289 31263 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:56.912423 31258 raft_consensus.cc:2749] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.912590 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:56.913555 30724 raft_consensus.cc:2393] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 2: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
W20260709 13:10:56.918385 30545 leader_election.cc:336] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.918913 30545 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:56.921397 30864 raft_consensus.cc:2749] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.928196 30864 raft_consensus.cc:493] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.928704 30864 raft_consensus.cc:515] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:56.930863 30864 leader_election.cc:290] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:56.931915 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:56.932688 30654 raft_consensus.cc:2468] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:56.933929 30546 leader_election.cc:304] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:56.934748 30864 raft_consensus.cc:2804] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.934962 31258 raft_consensus.cc:493] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.935681 30864 raft_consensus.cc:493] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.936156 30864 raft_consensus.cc:3060] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.935806 31258 raft_consensus.cc:515] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:56.938354 31258 leader_election.cc:290] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:56.940120 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:56.940809 30579 raft_consensus.cc:2468] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:56.941618 30983 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.942055 30694 leader_election.cc:304] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:56.942127 30983 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:56.943046 31258 raft_consensus.cc:2804] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.943689 31258 raft_consensus.cc:493] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.944070 31258 raft_consensus.cc:3060] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.944306 30983 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:56.945955 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
W20260709 13:10:56.946102 30545 leader_election.cc:336] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.946745 30724 raft_consensus.cc:2468] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:56.947960 30621 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:56.948614 30864 raft_consensus.cc:515] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:56.948985 30983 raft_consensus.cc:2804] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.949425 30983 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.949769 30983 raft_consensus.cc:3060] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:56.958678 30693 leader_election.cc:336] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
W20260709 13:10:56.970057 30619 leader_election.cc:336] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:56.970942 30983 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:56.973268 30864 leader_election.cc:290] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:56.974484 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:56.978225 30654 raft_consensus.cc:3060] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.980187 30983 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:56.981110 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:56.981763 30724 raft_consensus.cc:3060] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.986069 30654 raft_consensus.cc:2468] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:10:56.987624 30546 leader_election.cc:304] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:56.987700 31257 raft_consensus.cc:493] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:56.988581 30864 raft_consensus.cc:2804] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:56.989122 30864 raft_consensus.cc:697] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:56.990162 30864 consensus_queue.cc:237] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:56.988677 31257 raft_consensus.cc:515] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:56.992650 31257 leader_election.cc:290] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:56.996040 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:10:57.007303 30693 leader_election.cc:336] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.007802 30693 leader_election.cc:304] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:10:57.008598 31257 raft_consensus.cc:2749] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:57.013672 30724 raft_consensus.cc:2468] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 2.
W20260709 13:10:57.011189 30619 leader_election.cc:336] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.012442 31257 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.015336 30621 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:10:57.011454 31258 raft_consensus.cc:515] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.015805 31257 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:57.016495 31264 raft_consensus.cc:2804] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.017036 31264 raft_consensus.cc:697] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:57.017700 31258 leader_election.cc:290] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:57.018050 31257 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.020963 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:57.035300 30579 raft_consensus.cc:3060] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:57.041656 30693 leader_election.cc:336] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.019625 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:57.017935 31264 consensus_queue.cc:237] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:10:57.042374 30693 leader_election.cc:336] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.042593 30654 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:57.044039 30694 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:10:57.044520 30579 raft_consensus.cc:2468] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
W20260709 13:10:57.009877 30545 leader_election.cc:336] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.046128 31258 raft_consensus.cc:2804] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:57.046586 31258 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.046998 31258 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.051882 30694 leader_election.cc:304] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:10:57.053187 31257 raft_consensus.cc:2804] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.053730 31257 raft_consensus.cc:697] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:57.054610 31257 consensus_queue.cc:237] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.066162 31254 raft_consensus.cc:493] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.066882 31254 raft_consensus.cc:515] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.069181 31254 leader_election.cc:290] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:57.069494 31263 raft_consensus.cc:493] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.070104 31263 raft_consensus.cc:515] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.070854 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:57.071542 30578 raft_consensus.cc:2468] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:57.072245 31263 leader_election.cc:290] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:10:57.078948 30545 leader_election.cc:336] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.080246 31264 raft_consensus.cc:493] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.080880 31264 raft_consensus.cc:515] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:57.083940 31264 leader_election.cc:290] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.084053 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:57.085711 31263 raft_consensus.cc:493] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.086354 31263 raft_consensus.cc:515] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.088975 31263 leader_election.cc:290] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.089641 31264 raft_consensus.cc:493] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.089774 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:57.090485 30726 raft_consensus.cc:2468] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:57.090201 31264 raft_consensus.cc:515] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:57.091461 30694 leader_election.cc:304] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:57.093025 30547 leader_election.cc:304] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:57.094529 31263 raft_consensus.cc:2804] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:57.095491 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:57.096477 30721 raft_consensus.cc:2468] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:57.096948 31254 raft_consensus.cc:2804] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:57.097419 31254 raft_consensus.cc:493] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.095805 31264 leader_election.cc:290] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.097798 31254 raft_consensus.cc:3060] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:57.099151 30619 leader_election.cc:336] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.094959 31263 raft_consensus.cc:493] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.099598 30619 leader_election.cc:304] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:57.101835 31265 raft_consensus.cc:2749] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:57.100301 31263 raft_consensus.cc:3060] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.104602 30402 catalog_manager.cc:5697] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:57.099741 30545 leader_election.cc:336] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.107097 31264 raft_consensus.cc:493] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.107587 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:57.107787 31264 raft_consensus.cc:515] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:57.108801 30619 leader_election.cc:336] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.113417 30864 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.109998 31264 leader_election.cc:290] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:57.114275 30864 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.114925 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:57.115681 30578 raft_consensus.cc:2468] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:10:57.117422 30620 leader_election.cc:304] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:57.128082 31265 raft_consensus.cc:2804] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:57.132784 31265 raft_consensus.cc:493] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.123559 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:57.133222 31265 raft_consensus.cc:3060] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.136488 31278 raft_consensus.cc:493] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.118818 31257 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.108356 30724 raft_consensus.cc:2468] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:57.118512 30864 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.137461 31257 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.139912 31257 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:57.140808 30726 raft_consensus.cc:2468] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:10:57.143818 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:10:57.144567 30578 raft_consensus.cc:2468] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:57.145867 30694 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:57.137159 31278 raft_consensus.cc:515] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:57.157768 30619 leader_election.cc:336] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
W20260709 13:10:57.158043 30693 leader_election.cc:336] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.160187 31278 leader_election.cc:290] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:10:57.161120 30402 catalog_manager.cc:5697] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.167042 31257 raft_consensus.cc:2804] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:57.171481 31254 raft_consensus.cc:515] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.173394 31282 raft_consensus.cc:493] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.162288 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:57.163565 30547 leader_election.cc:304] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:10:57.175357 30654 raft_consensus.cc:2468] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:57.175961 30547 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:57.176658 31282 raft_consensus.cc:515] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:57.177558 31284 raft_consensus.cc:2804] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:57.177639 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:57.178079 31284 raft_consensus.cc:493] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.178326 30578 raft_consensus.cc:3060] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.178553 31284 raft_consensus.cc:3060] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.179260 31282 leader_election.cc:290] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.173050 30404 catalog_manager.cc:5697] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.183882 30578 raft_consensus.cc:2468] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:10:57.183758 31265 raft_consensus.cc:515] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:57.185220 30694 leader_election.cc:304] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:57.186053 31282 raft_consensus.cc:2804] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:57.186455 31282 raft_consensus.cc:493] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.186842 31282 raft_consensus.cc:3060] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.186964 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:10:57.187628 30654 raft_consensus.cc:2468] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:10:57.188900 31283 raft_consensus.cc:2804] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:57.190393 30694 leader_election.cc:304] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:57.191686 30694 leader_election.cc:304] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:57.192456 31281 raft_consensus.cc:2804] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.194630 31278 raft_consensus.cc:2804] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:57.195050 31278 raft_consensus.cc:493] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.195412 31278 raft_consensus.cc:3060] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.189388 31283 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.161777 31258 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:57.199031 31283 raft_consensus.cc:3060] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.200681 31258 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.167888 30621 leader_election.cc:304] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6
W20260709 13:10:57.212817 30621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 45017.8us
I20260709 13:10:57.214617 31272 raft_consensus.cc:2804] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:57.214520 31282 raft_consensus.cc:515] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:57.148006 31263 raft_consensus.cc:515] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.216841 31263 leader_election.cc:290] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.216878 31282 leader_election.cc:290] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
W20260709 13:10:57.202997 30693 leader_election.cc:336] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.204881 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:57.217792 30654 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:57.198522 30545 leader_election.cc:336] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.207830 31281 raft_consensus.cc:697] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
W20260709 13:10:57.211728 30619 leader_election.cc:336] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.215142 31272 raft_consensus.cc:493] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.174556 31257 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:10:57.173846 31254 leader_election.cc:290] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:57.225895 30654 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:10:57.226440 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:57.227545 30726 raft_consensus.cc:3060] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.234078 31265 leader_election.cc:290] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:57.226651 31272 raft_consensus.cc:3060] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.214046 31283 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.233805 31284 raft_consensus.cc:515] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.237106 30694 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:57.239672 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
W20260709 13:10:57.240140 30545 leader_election.cc:336] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.228164 31257 raft_consensus.cc:3060] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.240875 31284 leader_election.cc:290] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.243180 31254 raft_consensus.cc:2804] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.240262 30654 raft_consensus.cc:3060] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.243732 31254 raft_consensus.cc:697] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:57.242300 31278 raft_consensus.cc:515] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:10:57.247181 30545 leader_election.cc:336] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.247723 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:10:57.247546 31281 consensus_queue.cc:237] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.248317 30651 raft_consensus.cc:3060] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.244699 31254 consensus_queue.cc:237] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:10:57.258195 30545 leader_election.cc:336] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.261399 30726 raft_consensus.cc:2468] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:10:57.262080 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:57.262712 30579 raft_consensus.cc:3060] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.263972 30651 raft_consensus.cc:2468] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:10:57.265980 30654 raft_consensus.cc:2468] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:10:57.269318 30579 raft_consensus.cc:2468] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 2.
I20260709 13:10:57.270478 30620 leader_election.cc:304] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:10:57.271199 30983 raft_consensus.cc:2804] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.271636 30983 raft_consensus.cc:697] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:57.272156 30547 leader_election.cc:304] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:10:57.272644 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:57.273520 30721 raft_consensus.cc:3060] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.274857 31278 leader_election.cc:290] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.276193 31272 raft_consensus.cc:515] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:57.277529 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:57.281486 30983 consensus_queue.cc:237] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:10:57.282980 31285 raft_consensus.cc:2804] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.283555 31285 raft_consensus.cc:697] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:57.272193 30694 leader_election.cc:304] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:57.286818 30694 leader_election.cc:304] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:10:57.287113 31258 raft_consensus.cc:2804] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.238250 31283 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.293526 30721 raft_consensus.cc:2468] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:10:57.284456 31285 consensus_queue.cc:237] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.292718 31272 leader_election.cc:290] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:57.301132 30547 leader_election.cc:304] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6
W20260709 13:10:57.301337 30619 leader_election.cc:336] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
W20260709 13:10:57.308209 30621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 93559.9us
I20260709 13:10:57.300582 31278 raft_consensus.cc:2804] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.310920 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
W20260709 13:10:57.311342 30693 leader_election.cc:336] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.311540 30726 raft_consensus.cc:3060] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:57.312799 30693 leader_election.cc:336] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.311496 31278 raft_consensus.cc:697] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
W20260709 13:10:57.313598 30693 leader_election.cc:336] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.314097 31278 consensus_queue.cc:237] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:10:57.314636 30693 leader_election.cc:336] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
W20260709 13:10:57.315379 30693 leader_election.cc:336] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.318845 30726 raft_consensus.cc:2468] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 2.
I20260709 13:10:57.293051 31257 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.320272 30724 raft_consensus.cc:2393] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 2: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:10:57.332795 31258 raft_consensus.cc:697] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:10:57.334599 30621 leader_election.cc:304] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:10:57.334815 31258 consensus_queue.cc:237] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:57.335579 31265 raft_consensus.cc:2804] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:10:57.337216 30693 leader_election.cc:336] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.340464 31265 raft_consensus.cc:697] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:10:57.341544 31265 consensus_queue.cc:237] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:10:57.317301 31283 raft_consensus.cc:2804] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.357081 30547 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:10:57.359225 30864 raft_consensus.cc:2749] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:57.366902 30579 raft_consensus.cc:1275] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.369266 31129 consensus_queue.cc:1048] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.357755 31283 raft_consensus.cc:697] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:57.388463 30404 catalog_manager.cc:5697] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.391705 31257 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:10:57.394599 31283 consensus_queue.cc:237] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:57.396324 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:10:57.397251 30578 raft_consensus.cc:2393] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 2: Already voted for candidate fe9b995b077d4cb795f08934ed7d9088 in this term.
W20260709 13:10:57.398741 30693 leader_election.cc:336] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:57.406529 30694 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
W20260709 13:10:57.408052 30619 consensus_peers.cc:597] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.407531 30402 catalog_manager.cc:5697] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.416131 31286 raft_consensus.cc:2749] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:57.430603 30651 raft_consensus.cc:1275] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.450659 30404 catalog_manager.cc:5697] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.440402 31285 consensus_queue.cc:1048] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 13:10:57.473596 30545 consensus_peers.cc:597] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.484460 30578 raft_consensus.cc:1275] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.486106 31281 consensus_queue.cc:1048] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.540560 30402 catalog_manager.cc:5697] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.556934 30724 raft_consensus.cc:1275] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:57.559921 30619 consensus_peers.cc:597] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.561755 30401 catalog_manager.cc:5697] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.563619 30401 catalog_manager.cc:5697] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.568770 31264 consensus_queue.cc:1048] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:57.570498 30693 consensus_peers.cc:597] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.572095 30401 catalog_manager.cc:5697] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.575835 30404 catalog_manager.cc:5697] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 1 to 2, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:57.652623 30693 consensus_peers.cc:597] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.669221 30655 raft_consensus.cc:1275] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.670977 31288 consensus_queue.cc:1048] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.691380 30579 raft_consensus.cc:1275] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.693563 31272 consensus_queue.cc:1048] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:57.714718 30693 consensus_peers.cc:597] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.716188 30619 consensus_peers.cc:597] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.716928 30545 consensus_peers.cc:597] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.726281 30577 raft_consensus.cc:1275] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.728096 31278 consensus_queue.cc:1048] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:57.757759 30693 consensus_peers.cc:597] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.764717 30693 consensus_peers.cc:597] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.787189 30545 consensus_peers.cc:597] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.833750 30545 consensus_peers.cc:597] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.838507 30619 consensus_peers.cc:597] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.839022 30724 raft_consensus.cc:1275] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.841269 30983 consensus_queue.cc:1048] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:57.843616 30619 consensus_peers.cc:597] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:57.886075 30655 raft_consensus.cc:1275] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.889221 31258 consensus_queue.cc:1048] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:57.890265 30693 consensus_peers.cc:597] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.895376 30619 consensus_peers.cc:597] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.905014 20382 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30527)
I20260709 13:10:57.906387 30724 raft_consensus.cc:1275] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.917261 31263 consensus_queue.cc:1048] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:57.916491 30619 consensus_peers.cc:597] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:57.920946 30651 raft_consensus.cc:1275] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.928148 31258 consensus_queue.cc:1048] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:57.950505 30545 consensus_peers.cc:597] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.973587 30545 consensus_peers.cc:597] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.974076 30545 consensus_peers.cc:597] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:58.001968 30721 raft_consensus.cc:1275] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.003412 31263 consensus_queue.cc:1048] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:58.005682 30545 consensus_peers.cc:597] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.014976 30545 consensus_peers.cc:597] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.026613 30693 consensus_peers.cc:597] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.068738 30545 consensus_peers.cc:597] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.086722 30619 consensus_peers.cc:597] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.094403 30619 consensus_peers.cc:597] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.174728 30545 consensus_peers.cc:597] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.195209 30619 consensus_peers.cc:597] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.221336 30693 consensus_peers.cc:597] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.232321 30693 consensus_peers.cc:597] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.254410 30693 consensus_peers.cc:597] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.274282 30619 consensus_peers.cc:597] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.280287 30619 consensus_peers.cc:597] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.289011 30545 consensus_peers.cc:597] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.301162 30619 consensus_peers.cc:597] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.305876 30693 consensus_peers.cc:597] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.319790 30545 consensus_peers.cc:597] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.343521 30619 consensus_peers.cc:597] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.407637 30545 consensus_peers.cc:597] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.413445 30619 consensus_peers.cc:597] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.504782 30545 consensus_peers.cc:597] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.567956 30693 consensus_peers.cc:597] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.646436 30619 consensus_peers.cc:597] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:58.845026 31283 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.845506 31283 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:58.847494 31283 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:58.848255 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:58.849069 30721 raft_consensus.cc:2468] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:10:58.850934 30547 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:58.851843 31283 raft_consensus.cc:2804] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:58.852237 31283 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:58.852406 30545 leader_election.cc:336] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:58.852675 31283 raft_consensus.cc:3060] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.860955 31283 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:58.865651 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:58.866410 30721 raft_consensus.cc:3060] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.875591 31283 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:10:58.883379 30545 leader_election.cc:336] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:58.884439 30721 raft_consensus.cc:2468] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 3.
I20260709 13:10:58.885777 30547 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:10:58.886649 31283 raft_consensus.cc:2804] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:58.887485 31283 raft_consensus.cc:697] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:58.889264 31283 consensus_queue.cc:237] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:58.904456 30401 catalog_manager.cc:5697] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 1 to 3, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:58.905560 20382 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30527)
I20260709 13:10:59.293147 30721 raft_consensus.cc:1275] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:59.294447 31263 consensus_queue.cc:1048] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:59.341159 30545 consensus_peers.cc:597] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:59.410800 31263 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.411321 31263 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:59.414462 31263 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:59.417994 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:10:59.418865 30724 raft_consensus.cc:2468] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:10:59.419801 30547 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
W20260709 13:10:59.420245 30545 leader_election.cc:336] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:59.420431 31263 raft_consensus.cc:2804] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:59.421025 31263 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.421335 31263 raft_consensus.cc:3060] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.427860 31263 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:10:59.429807 31263 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:10:59.432386 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:10:59.433110 30724 raft_consensus.cc:3060] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.441673 30724 raft_consensus.cc:2468] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 3.
I20260709 13:10:59.443229 30547 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:10:59.444067 31263 raft_consensus.cc:2804] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:59.444631 31263 raft_consensus.cc:697] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:10:59.445500 31263 consensus_queue.cc:237] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
W20260709 13:10:59.446904 30545 leader_election.cc:336] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:10:59.457871 30401 catalog_manager.cc:5697] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 1 to 3, leader changed from 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129) to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:59.825730 30545 consensus_peers.cc:597] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.881848 30693 consensus_peers.cc:597] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:59.895066 30724 raft_consensus.cc:1275] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:10:59.896438 30619 consensus_peers.cc:597] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:59.897329 31334 consensus_queue.cc:1048] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:59.906206 20382 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 30527)
W20260709 13:10:59.940445 30545 consensus_peers.cc:597] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:59.953279 30693 consensus_peers.cc:597] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.994774 30693 consensus_peers.cc:597] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.018110 30619 consensus_peers.cc:597] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.123788 30693 consensus_peers.cc:597] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.197602 30619 consensus_peers.cc:597] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.202665 30545 consensus_peers.cc:597] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.247695 30693 consensus_peers.cc:597] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.265314 30545 consensus_peers.cc:597] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.284441 30693 consensus_peers.cc:597] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.298162 30619 consensus_peers.cc:597] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.318653 30619 consensus_peers.cc:597] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.320595 30545 consensus_peers.cc:597] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.361632 30619 consensus_peers.cc:597] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.393123 30545 consensus_peers.cc:597] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.451720 30545 consensus_peers.cc:597] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.452322 30545 consensus_peers.cc:597] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.454162 30619 consensus_peers.cc:597] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.460760 30545 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111) [suppressed 441 similar messages]
W20260709 13:11:00.473930 30545 consensus_peers.cc:597] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.495847 30619 consensus_peers.cc:597] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.510730 30619 consensus_peers.cc:597] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.556129 30693 consensus_peers.cc:597] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.566527 30545 consensus_peers.cc:597] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.585152 30619 consensus_peers.cc:597] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.588385 30545 consensus_peers.cc:597] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.596140 30619 consensus_peers.cc:597] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.604771 30693 consensus_peers.cc:597] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.627599 30545 consensus_peers.cc:597] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.667768 30619 consensus_peers.cc:597] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.702523 30545 consensus_peers.cc:597] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.708333 30619 consensus_peers.cc:597] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.715631 30545 consensus_peers.cc:597] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.739930 20382 tablet_server.cc:196] TabletServer@127.19.231.129:0 shutdown complete.
W20260709 13:11:00.774612 30693 consensus_peers.cc:597] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.804279 30545 consensus_peers.cc:597] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.807657 30693 consensus_peers.cc:597] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.856302 30619 consensus_peers.cc:597] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.880020 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:00.889765 31341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:00.890867 31343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:00.889915 31340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:00.897063 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:00.900425 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:00.900735 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:00.900954 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602660900929 us; error 0 us; skew 500 ppm
I20260709 13:11:00.901788 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:00.907459 20382 webserver.cc:533] Webserver started at http://127.19.231.129:35737/ using document root <none> and password file <none>
I20260709 13:11:00.909178 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:00.910104 20382 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:11:00.911012 30693 consensus_peers.cc:597] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.914686 20382 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:11:00.924072 31348 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:00.925122 20382 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:11:00.925534 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-0-root
uuid: "5eebf0fa5aba46afa04623642d7795e6"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-1t6m"
I20260709 13:11:00.926173 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337466250-20382-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:11:00.954536 30545 consensus_peers.cc:597] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.964304 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:00.966048 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:00.967986 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:11:00.969201 30619 consensus_peers.cc:597] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.974013 31355 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:11:01.208248 30693 consensus_peers.cc:597] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:01.260142 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:11:01.260589 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.288s	user 0.004s	sys 0.006s
I20260709 13:11:01.260972 20382 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:11:01.271692 31355 tablet_bootstrap.cc:492] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.291918 31355 tablet_bootstrap.cc:492] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.292922 31355 tablet_bootstrap.cc:492] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.293586 31355 ts_tablet_manager.cc:1403] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:11:01.296365 31355 raft_consensus.cc:359] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.297125 31355 raft_consensus.cc:740] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.297899 31355 consensus_queue.cc:260] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.307823 31355 ts_tablet_manager.cc:1434] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.004s
I20260709 13:11:01.308840 31355 tablet_bootstrap.cc:492] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.323004 31355 tablet_bootstrap.cc:492] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.323778 31355 tablet_bootstrap.cc:492] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.324316 31355 ts_tablet_manager.cc:1403] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:11:01.326685 31355 raft_consensus.cc:359] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.327358 31355 raft_consensus.cc:740] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.328013 31355 consensus_queue.cc:260] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.329988 31355 ts_tablet_manager.cc:1434] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:11:01.330847 31355 tablet_bootstrap.cc:492] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
W20260709 13:11:01.334401 30619 consensus_peers.cc:597] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:01.346339 31355 tablet_bootstrap.cc:492] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.347234 31355 tablet_bootstrap.cc:492] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.347766 31355 ts_tablet_manager.cc:1403] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:11:01.349619 31355 raft_consensus.cc:359] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.350137 31355 raft_consensus.cc:740] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.350725 31355 consensus_queue.cc:260] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.352118 31355 ts_tablet_manager.cc:1434] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:01.352762 31355 tablet_bootstrap.cc:492] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.365139 31355 tablet_bootstrap.cc:492] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.366119 31355 tablet_bootstrap.cc:492] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.366740 31355 ts_tablet_manager.cc:1403] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:11:01.369163 31355 raft_consensus.cc:359] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.369825 31355 raft_consensus.cc:740] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.370460 31355 consensus_queue.cc:260] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.372308 31355 ts_tablet_manager.cc:1434] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:01.373107 31355 tablet_bootstrap.cc:492] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.387902 31355 tablet_bootstrap.cc:492] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.388892 31355 tablet_bootstrap.cc:492] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.389528 31355 ts_tablet_manager.cc:1403] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:11:01.392032 31355 raft_consensus.cc:359] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.392720 31355 raft_consensus.cc:740] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.393352 31355 consensus_queue.cc:260] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.395159 31355 ts_tablet_manager.cc:1434] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:11:01.395912 31355 tablet_bootstrap.cc:492] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.411919 31355 tablet_bootstrap.cc:492] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.412883 31355 tablet_bootstrap.cc:492] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.413509 31355 ts_tablet_manager.cc:1403] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:11:01.415978 31355 raft_consensus.cc:359] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.416653 31355 raft_consensus.cc:740] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.417387 31355 consensus_queue.cc:260] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.419210 31355 ts_tablet_manager.cc:1434] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:11:01.419989 31355 tablet_bootstrap.cc:492] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.436471 31355 tablet_bootstrap.cc:492] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.437354 31355 tablet_bootstrap.cc:492] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.437870 31355 ts_tablet_manager.cc:1403] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:11:01.440140 31355 raft_consensus.cc:359] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.440831 31355 raft_consensus.cc:740] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.441495 31355 consensus_queue.cc:260] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.443284 31355 ts_tablet_manager.cc:1434] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:11:01.443897 31355 tablet_bootstrap.cc:492] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.457404 31355 tablet_bootstrap.cc:492] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.458343 31355 tablet_bootstrap.cc:492] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.458982 31355 ts_tablet_manager.cc:1403] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.004s
I20260709 13:11:01.461506 31355 raft_consensus.cc:359] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.462174 31355 raft_consensus.cc:740] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.462985 31355 consensus_queue.cc:260] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.465045 31355 ts_tablet_manager.cc:1434] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:01.465791 31355 tablet_bootstrap.cc:492] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.481045 31355 tablet_bootstrap.cc:492] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.481988 31355 tablet_bootstrap.cc:492] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.482596 31355 ts_tablet_manager.cc:1403] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:11:01.485039 31355 raft_consensus.cc:359] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.485715 31355 raft_consensus.cc:740] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.486337 31355 consensus_queue.cc:260] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.488509 31355 ts_tablet_manager.cc:1434] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:11:01.489272 31355 tablet_bootstrap.cc:492] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.506681 31355 tablet_bootstrap.cc:492] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.507709 31355 tablet_bootstrap.cc:492] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.508612 31355 ts_tablet_manager.cc:1403] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:11:01.511179 31355 raft_consensus.cc:359] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.511878 31355 raft_consensus.cc:740] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.512566 31355 consensus_queue.cc:260] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.527002 31355 ts_tablet_manager.cc:1434] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:11:01.528216 31355 tablet_bootstrap.cc:492] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.539649 20382 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:11:01.540058 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.279s	user 0.246s	sys 0.013s
I20260709 13:11:01.632501 31355 tablet_bootstrap.cc:492] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.633513 31355 tablet_bootstrap.cc:492] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.634167 31355 ts_tablet_manager.cc:1403] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.106s	user 0.022s	sys 0.039s
I20260709 13:11:01.636718 31355 raft_consensus.cc:359] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.637385 31355 raft_consensus.cc:740] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.638104 31355 consensus_queue.cc:260] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.640134 31355 ts_tablet_manager.cc:1434] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:01.640928 31355 tablet_bootstrap.cc:492] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.661886 31355 tablet_bootstrap.cc:492] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.663125 31355 tablet_bootstrap.cc:492] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.663993 31355 ts_tablet_manager.cc:1403] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:11:01.667248 31355 raft_consensus.cc:359] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.668174 31355 raft_consensus.cc:740] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.669062 31355 consensus_queue.cc:260] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.671716 31355 ts_tablet_manager.cc:1434] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:11:01.672755 31355 tablet_bootstrap.cc:492] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.697701 31355 tablet_bootstrap.cc:492] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.698840 31355 tablet_bootstrap.cc:492] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.699494 31355 ts_tablet_manager.cc:1403] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:11:01.702358 31355 raft_consensus.cc:359] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.702950 31355 raft_consensus.cc:740] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.703601 31355 consensus_queue.cc:260] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.707080 31355 ts_tablet_manager.cc:1434] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:01.707859 31355 tablet_bootstrap.cc:492] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.724150 31355 tablet_bootstrap.cc:492] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.725124 31355 tablet_bootstrap.cc:492] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.725780 31355 ts_tablet_manager.cc:1403] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:11:01.728312 31355 raft_consensus.cc:359] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.729147 31355 raft_consensus.cc:740] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.729833 31355 consensus_queue.cc:260] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.731662 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.129:44027
I20260709 13:11:01.731802 31428 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.129:44027 every 8 connection(s)
I20260709 13:11:01.731685 31355 ts_tablet_manager.cc:1434] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:01.734378 31355 tablet_bootstrap.cc:492] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.820860 31355 tablet_bootstrap.cc:492] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.822269 31355 tablet_bootstrap.cc:492] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.823052 31355 ts_tablet_manager.cc:1403] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.089s	user 0.030s	sys 0.025s
I20260709 13:11:01.826287 31355 raft_consensus.cc:359] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.827059 31355 raft_consensus.cc:740] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.827069 31430 heartbeater.cc:344] Connected to a master server at 127.19.231.190:46409
I20260709 13:11:01.827441 31402 raft_consensus.cc:3060] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.827735 31430 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:01.828770 31430 heartbeater.cc:507] Master 127.19.231.190:46409 requested a full tablet report, sending...
I20260709 13:11:01.828173 31355 consensus_queue.cc:260] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.833634 31355 ts_tablet_manager.cc:1434] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:11:01.834607 31355 tablet_bootstrap.cc:492] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.856567 31355 tablet_bootstrap.cc:492] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.857437 31355 tablet_bootstrap.cc:492] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.858016 31355 ts_tablet_manager.cc:1403] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.007s
I20260709 13:11:01.860373 31355 raft_consensus.cc:359] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.861033 31355 raft_consensus.cc:740] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.861586 31355 consensus_queue.cc:260] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:01.863377 31355 ts_tablet_manager.cc:1434] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:11:01.864111 31355 tablet_bootstrap.cc:492] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.864281 30401 ts_manager.cc:194] Re-registered known tserver with Master: 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:01.876446 31355 tablet_bootstrap.cc:492] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.877521 31355 tablet_bootstrap.cc:492] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.878206 31355 ts_tablet_manager.cc:1403] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.006s
W20260709 13:11:01.880999 30545 consensus_peers.cc:597] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:01.881074 31355 raft_consensus.cc:359] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.881851 31355 raft_consensus.cc:740] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.882671 31355 consensus_queue.cc:260] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.883741 31401 raft_consensus.cc:3060] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.885039 31355 ts_tablet_manager.cc:1434] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:11:01.885980 31355 tablet_bootstrap.cc:492] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.905834 31355 tablet_bootstrap.cc:492] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.906603 31355 tablet_bootstrap.cc:492] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.907181 31355 ts_tablet_manager.cc:1403] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:11:01.908416 30401 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49486
I20260709 13:11:01.909356 31355 raft_consensus.cc:359] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.909970 31355 raft_consensus.cc:740] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.910539 31355 consensus_queue.cc:260] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.912251 31355 ts_tablet_manager.cc:1434] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:01.912945 31355 tablet_bootstrap.cc:492] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.913053 31430 heartbeater.cc:499] Master 127.19.231.190:46409 was elected leader, sending a full tablet report...
I20260709 13:11:01.927489 31355 tablet_bootstrap.cc:492] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.928439 31355 tablet_bootstrap.cc:492] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.929077 31355 ts_tablet_manager.cc:1403] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:11:01.930987 31355 raft_consensus.cc:359] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.931489 31355 raft_consensus.cc:740] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.932157 31355 consensus_queue.cc:260] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.934185 31355 ts_tablet_manager.cc:1434] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:01.935019 31355 tablet_bootstrap.cc:492] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.949597 31355 tablet_bootstrap.cc:492] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.950737 31355 tablet_bootstrap.cc:492] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.951521 31355 ts_tablet_manager.cc:1403] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:11:01.955199 31355 raft_consensus.cc:359] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.955982 31355 raft_consensus.cc:740] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.956808 31355 consensus_queue.cc:260] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:01.958983 31355 ts_tablet_manager.cc:1434] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:01.959599 31400 raft_consensus.cc:3060] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.959880 31355 tablet_bootstrap.cc:492] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:01.987030 31355 tablet_bootstrap.cc:492] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:01.988106 31355 tablet_bootstrap.cc:492] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:01.988758 31355 ts_tablet_manager.cc:1403] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.004s
I20260709 13:11:01.991688 31355 raft_consensus.cc:359] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.992381 31355 raft_consensus.cc:740] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.993124 31355 consensus_queue.cc:260] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:01.995220 31355 ts_tablet_manager.cc:1434] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:01.996236 31355 tablet_bootstrap.cc:492] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.012070 31355 tablet_bootstrap.cc:492] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.012897 31355 tablet_bootstrap.cc:492] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.013480 31355 ts_tablet_manager.cc:1403] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:11:02.016028 31355 raft_consensus.cc:359] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.016696 31400 raft_consensus.cc:3060] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.016815 31355 raft_consensus.cc:740] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.018188 31355 consensus_queue.cc:260] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.020457 31355 ts_tablet_manager.cc:1434] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:02.021904 31355 tablet_bootstrap.cc:492] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.037748 31400 raft_consensus.cc:3060] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.038491 31355 tablet_bootstrap.cc:492] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.039625 31355 tablet_bootstrap.cc:492] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.040292 31355 ts_tablet_manager.cc:1403] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:11:02.042891 31355 raft_consensus.cc:359] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.043593 31355 raft_consensus.cc:740] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.044296 31355 consensus_queue.cc:260] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.045995 31355 ts_tablet_manager.cc:1434] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:02.046700 31355 tablet_bootstrap.cc:492] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.085225 31402 raft_consensus.cc:3060] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.121958 31355 tablet_bootstrap.cc:492] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.122988 31355 tablet_bootstrap.cc:492] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.123626 31355 ts_tablet_manager.cc:1403] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.077s	user 0.036s	sys 0.039s
I20260709 13:11:02.126207 31355 raft_consensus.cc:359] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.126853 31355 raft_consensus.cc:740] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.127578 31355 consensus_queue.cc:260] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.129601 31355 ts_tablet_manager.cc:1434] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:02.130293 31355 tablet_bootstrap.cc:492] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.146041 31355 tablet_bootstrap.cc:492] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.147013 31355 tablet_bootstrap.cc:492] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.147679 31355 ts_tablet_manager.cc:1403] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 13:11:02.149371 31400 raft_consensus.cc:3060] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.150038 31355 raft_consensus.cc:359] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.150739 31355 raft_consensus.cc:740] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.151463 31355 consensus_queue.cc:260] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.153553 31355 ts_tablet_manager.cc:1434] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:11:02.154352 31355 tablet_bootstrap.cc:492] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.177384 31355 tablet_bootstrap.cc:492] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.178386 31355 tablet_bootstrap.cc:492] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.179194 31355 ts_tablet_manager.cc:1403] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 13:11:02.181629 31355 raft_consensus.cc:359] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.182139 31355 raft_consensus.cc:740] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.182703 31355 consensus_queue.cc:260] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.184566 31355 ts_tablet_manager.cc:1434] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:02.185201 31355 tablet_bootstrap.cc:492] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.197098 31400 raft_consensus.cc:3060] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.198127 31355 tablet_bootstrap.cc:492] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.199098 31355 tablet_bootstrap.cc:492] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.199628 31355 ts_tablet_manager.cc:1403] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:11:02.201601 31355 raft_consensus.cc:359] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.202112 31355 raft_consensus.cc:740] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.202672 31355 consensus_queue.cc:260] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.205027 31355 ts_tablet_manager.cc:1434] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:02.205919 31355 tablet_bootstrap.cc:492] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.224388 31355 tablet_bootstrap.cc:492] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.225364 31355 tablet_bootstrap.cc:492] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.226104 31355 ts_tablet_manager.cc:1403] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:11:02.228340 31355 raft_consensus.cc:359] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.229097 31355 raft_consensus.cc:740] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.229764 31355 consensus_queue.cc:260] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.231734 31355 ts_tablet_manager.cc:1434] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:02.232577 31355 tablet_bootstrap.cc:492] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.247571 31355 tablet_bootstrap.cc:492] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.248340 31355 tablet_bootstrap.cc:492] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.248886 31355 ts_tablet_manager.cc:1403] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:11:02.250982 31355 raft_consensus.cc:359] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.251538 31355 raft_consensus.cc:740] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.252146 31355 consensus_queue.cc:260] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.253618 31355 ts_tablet_manager.cc:1434] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:02.254475 31355 tablet_bootstrap.cc:492] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.256381 31402 raft_consensus.cc:3060] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:02.274175 31355 tablet_bootstrap.cc:492] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.275210 31355 tablet_bootstrap.cc:492] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.275907 31355 ts_tablet_manager.cc:1403] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:11:02.278308 31355 raft_consensus.cc:359] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.278847 31355 raft_consensus.cc:740] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.279449 31355 consensus_queue.cc:260] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.281345 31355 ts_tablet_manager.cc:1434] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20260709 13:11:02.282364 30693 consensus_peers.cc:597] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:02.282401 31355 tablet_bootstrap.cc:492] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.311673 31355 tablet_bootstrap.cc:492] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.312631 31355 tablet_bootstrap.cc:492] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.313313 31355 ts_tablet_manager.cc:1403] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.012s
I20260709 13:11:02.315459 31400 raft_consensus.cc:3060] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.316601 31355 raft_consensus.cc:359] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.317373 31355 raft_consensus.cc:740] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.318061 31355 consensus_queue.cc:260] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.320289 31355 ts_tablet_manager.cc:1434] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:02.321312 31355 tablet_bootstrap.cc:492] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
W20260709 13:11:02.336978 30693 consensus_peers.cc:597] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:02.347600 31355 tablet_bootstrap.cc:492] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.348493 31355 tablet_bootstrap.cc:492] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.349066 31355 ts_tablet_manager.cc:1403] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.011s
I20260709 13:11:02.351251 31355 raft_consensus.cc:359] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.351845 31355 raft_consensus.cc:740] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.352452 31355 consensus_queue.cc:260] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.353777 31355 ts_tablet_manager.cc:1434] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:02.354561 31355 tablet_bootstrap.cc:492] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.393384 31355 tablet_bootstrap.cc:492] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.394734 31355 tablet_bootstrap.cc:492] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.395406 31355 ts_tablet_manager.cc:1403] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.013s
I20260709 13:11:02.397878 31355 raft_consensus.cc:359] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.398437 31355 raft_consensus.cc:740] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.398996 31355 consensus_queue.cc:260] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.400722 31355 ts_tablet_manager.cc:1434] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:11:02.402313 31355 tablet_bootstrap.cc:492] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.415586 31355 tablet_bootstrap.cc:492] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.416797 31355 tablet_bootstrap.cc:492] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.417548 31355 ts_tablet_manager.cc:1403] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:11:02.420328 31355 raft_consensus.cc:359] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.421064 31355 raft_consensus.cc:740] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.421787 31355 consensus_queue.cc:260] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.424042 31355 ts_tablet_manager.cc:1434] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:02.424867 31355 tablet_bootstrap.cc:492] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.441704 31355 tablet_bootstrap.cc:492] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.442466 31355 tablet_bootstrap.cc:492] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.443145 31355 ts_tablet_manager.cc:1403] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
I20260709 13:11:02.445616 31355 raft_consensus.cc:359] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.446353 31355 raft_consensus.cc:740] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.447073 31355 consensus_queue.cc:260] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.457542 31400 raft_consensus.cc:3060] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.458086 31355 ts_tablet_manager.cc:1434] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:11:02.459144 31355 tablet_bootstrap.cc:492] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.475544 31355 tablet_bootstrap.cc:492] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.476300 31355 tablet_bootstrap.cc:492] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.476891 31355 ts_tablet_manager.cc:1403] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:11:02.479176 31355 raft_consensus.cc:359] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.479816 31355 raft_consensus.cc:740] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.480476 31355 consensus_queue.cc:260] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.482347 31355 ts_tablet_manager.cc:1434] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:02.483107 31355 tablet_bootstrap.cc:492] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.496534 31355 tablet_bootstrap.cc:492] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.497558 31355 tablet_bootstrap.cc:492] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.498222 31355 ts_tablet_manager.cc:1403] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:11:02.500383 31355 raft_consensus.cc:359] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.501024 31355 raft_consensus.cc:740] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.501700 31355 consensus_queue.cc:260] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.503748 31355 ts_tablet_manager.cc:1434] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:11:02.509843 31355 tablet_bootstrap.cc:492] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.527228 31355 tablet_bootstrap.cc:492] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.528256 31355 tablet_bootstrap.cc:492] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.529214 31355 ts_tablet_manager.cc:1403] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:11:02.531643 31355 raft_consensus.cc:359] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.532322 31355 raft_consensus.cc:740] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.533067 31355 consensus_queue.cc:260] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.537933 31355 ts_tablet_manager.cc:1434] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:11:02.539777 31355 tablet_bootstrap.cc:492] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.556493 31355 tablet_bootstrap.cc:492] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.559042 31355 tablet_bootstrap.cc:492] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.559715 31355 ts_tablet_manager.cc:1403] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:11:02.563295 31355 raft_consensus.cc:359] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.563875 31355 raft_consensus.cc:740] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.564548 31355 consensus_queue.cc:260] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:02.566695 31355 ts_tablet_manager.cc:1434] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:11:02.569748 31355 tablet_bootstrap.cc:492] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.581972 31355 tablet_bootstrap.cc:492] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.582721 31355 tablet_bootstrap.cc:492] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.583427 31355 ts_tablet_manager.cc:1403] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 13:11:02.585232 31355 raft_consensus.cc:359] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.585721 31355 raft_consensus.cc:740] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.586342 31355 consensus_queue.cc:260] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:02.588212 31355 ts_tablet_manager.cc:1434] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:02.589206 31355 tablet_bootstrap.cc:492] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:02.606952 31355 tablet_bootstrap.cc:492] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:02.607905 31355 tablet_bootstrap.cc:492] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:02.608589 31355 ts_tablet_manager.cc:1403] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.007s
I20260709 13:11:02.611012 31355 raft_consensus.cc:359] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.611685 31355 raft_consensus.cc:740] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.612325 31355 consensus_queue.cc:260] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:02.614473 31355 ts_tablet_manager.cc:1434] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:02.619835 31355 tablet_bootstrap.cc:492] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
W20260709 13:11:02.694772 30620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 50253.4us
W20260709 13:11:03.311036 31355 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.036s	sys 0.041s
W20260709 13:11:03.311429 31355 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.036s	sys 0.041s
I20260709 13:11:04.029613 31484 raft_consensus.cc:493] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.030754 31485 raft_consensus.cc:493] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.031432 31485 raft_consensus.cc:515] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.032491 31486 raft_consensus.cc:493] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.033243 31486 raft_consensus.cc:515] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.034051 31485 leader_election.cc:290] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.034650 31485 raft_consensus.cc:493] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.035082 31485 raft_consensus.cc:515] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.036254 31486 leader_election.cc:290] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.037322 31485 leader_election.cc:290] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.030776 31484 raft_consensus.cc:515] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.040495 31484 leader_election.cc:290] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.043645 31487 raft_consensus.cc:493] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.044497 31484 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.045173 31484 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.044283 31487 raft_consensus.cc:515] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.048445 31484 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.048624 31485 raft_consensus.cc:493] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.048398 31487 leader_election.cc:290] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.049742 31485 raft_consensus.cc:515] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.054112 31485 leader_election.cc:290] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.065994 31491 raft_consensus.cc:493] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.066900 31491 raft_consensus.cc:515] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.069862 31491 leader_election.cc:290] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.070413 31490 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.071185 31490 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:11:04.071923 30692 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.255s	user 0.015s	sys 0.005s
W20260709 13:11:04.072432 30692 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.256s	user 0.015s	sys 0.005s
I20260709 13:11:04.073455 31490 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.074635 31485 raft_consensus.cc:493] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.075591 31485 raft_consensus.cc:515] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.078534 31485 leader_election.cc:290] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.079622 31487 raft_consensus.cc:493] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.080329 31487 raft_consensus.cc:515] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.082849 31487 leader_election.cc:290] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.083328 31487 raft_consensus.cc:493] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.083767 31487 raft_consensus.cc:515] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.085897 31487 leader_election.cc:290] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.086084 31495 raft_consensus.cc:493] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.088218 31495 raft_consensus.cc:515] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.090258 31495 leader_election.cc:290] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:11:04.091539 30618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.376s	user 0.012s	sys 0.037s
I20260709 13:11:04.092415 31495 raft_consensus.cc:493] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.093050 31495 raft_consensus.cc:515] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.093369 31496 raft_consensus.cc:493] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
W20260709 13:11:04.093895 30618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.379s	user 0.014s	sys 0.038s
I20260709 13:11:04.094028 31496 raft_consensus.cc:515] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.095688 31495 leader_election.cc:290] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.096755 31496 leader_election.cc:290] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.096896 31495 raft_consensus.cc:493] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.097409 31496 raft_consensus.cc:493] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.097534 31495 raft_consensus.cc:515] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.102591 31371 raft_consensus.cc:493] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.103201 31371 raft_consensus.cc:515] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.097950 31496 raft_consensus.cc:515] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.105391 31371 leader_election.cc:290] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.101112 31489 raft_consensus.cc:493] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.106170 31489 raft_consensus.cc:515] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.110024 31489 leader_election.cc:290] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.111339 31495 leader_election.cc:290] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.105626 31496 leader_election.cc:290] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
W20260709 13:11:04.117722 30619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.395s	user 0.009s	sys 0.015s
W20260709 13:11:04.117974 30620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.405s	user 0.018s	sys 0.003s
I20260709 13:11:04.118430 31490 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.119045 31490 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.119405 31485 raft_consensus.cc:493] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.119915 31485 raft_consensus.cc:515] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:11:04.118150 30619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.009s	sys 0.015s
I20260709 13:11:04.121239 31490 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.122041 31485 leader_election.cc:290] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
W20260709 13:11:04.122833 30619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 1.41109e+06us
I20260709 13:11:04.122915 31487 raft_consensus.cc:493] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.123391 31484 raft_consensus.cc:493] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
W20260709 13:11:04.118634 30620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.018s	sys 0.003s
I20260709 13:11:04.124589 31500 raft_consensus.cc:493] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.124279 31487 raft_consensus.cc:515] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.122555 31485 raft_consensus.cc:493] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.125084 31500 raft_consensus.cc:515] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.127837 31485 raft_consensus.cc:515] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.129787 31500 leader_election.cc:290] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.130313 31500 raft_consensus.cc:493] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
W20260709 13:11:04.130481 30693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.311s	user 0.002s	sys 0.024s
W20260709 13:11:04.131489 30693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.003s	sys 0.024s
I20260709 13:11:04.130865 31500 raft_consensus.cc:515] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.130445 31486 raft_consensus.cc:493] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.124303 31484 raft_consensus.cc:515] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.135125 31486 raft_consensus.cc:515] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.136927 31484 leader_election.cc:290] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.137035 31486 leader_election.cc:290] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.123467 31332 raft_consensus.cc:493] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.138185 31332 raft_consensus.cc:515] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.140756 31500 leader_election.cc:290] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.141239 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.142071 31398 raft_consensus.cc:2468] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:11:04.143141 31465 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.143739 31465 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.145813 31465 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.129791 31485 leader_election.cc:290] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.126683 31487 leader_election.cc:290] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.164407 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.164718 31490 raft_consensus.cc:493] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.165194 31398 raft_consensus.cc:2468] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:11:04.165789 31489 raft_consensus.cc:493] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.165509 31490 raft_consensus.cc:515] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.166368 31489 raft_consensus.cc:515] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.166936 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.168403 31489 leader_election.cc:290] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.168378 31490 leader_election.cc:290] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.168841 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.169431 31490 raft_consensus.cc:493] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.169787 31398 raft_consensus.cc:2468] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:11:04.170001 31490 raft_consensus.cc:515] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
W20260709 13:11:04.170855 30695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.173s	user 0.025s	sys 0.006s
I20260709 13:11:04.171905 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.172324 31490 leader_election.cc:290] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.172902 31398 raft_consensus.cc:2468] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:11:04.168439 31332 leader_election.cc:290] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.179139 31401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.179427 31371 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.179901 31401 raft_consensus.cc:2468] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:11:04.180009 31371 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
W20260709 13:11:04.172406 30695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.026s	sys 0.007s
I20260709 13:11:04.182471 31371 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.183046 31371 raft_consensus.cc:493] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.183609 31371 raft_consensus.cc:515] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.185545 31355 tablet_bootstrap.cc:492] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:04.185403 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.186614 31355 tablet_bootstrap.cc:492] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:04.186959 31371 leader_election.cc:290] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.187407 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.187569 31497 raft_consensus.cc:493] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.188671 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.249028 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.189508 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.190554 31495 raft_consensus.cc:493] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.259449 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.259744 31495 raft_consensus.cc:515] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.260286 31394 raft_consensus.cc:2468] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:11:04.261257 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.192693 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.193809 31496 raft_consensus.cc:493] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.197820 31492 raft_consensus.cc:493] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.199095 31500 raft_consensus.cc:493] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.200613 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.272061 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.201484 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.188123 31464 raft_consensus.cc:493] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.192526 31465 raft_consensus.cc:493] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.329638 31465 raft_consensus.cc:515] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.332657 31465 leader_election.cc:290] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.207803 31486 raft_consensus.cc:493] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.334151 31486 raft_consensus.cc:515] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.337311 31486 leader_election.cc:290] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.338001 31486 raft_consensus.cc:493] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.208379 31484 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.339107 31484 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.342011 31484 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.209558 31494 raft_consensus.cc:493] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.210218 30402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42146 (request call id 128) took 1575 ms. Trace:
I20260709 13:11:04.343078 30402 rpcz_store.cc:276] 0709 13:11:02.635174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.644447 (+  9273us) service_pool.cc:224] Handling call
0709 13:11:04.210020 (+1565573us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:11:04.210541 31499 raft_consensus.cc:493] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.214087 31491 raft_consensus.cc:493] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.344578 31499 raft_consensus.cc:515] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.344717 31491 raft_consensus.cc:515] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.333405 31465 raft_consensus.cc:493] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.346032 31465 raft_consensus.cc:515] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.220048 31505 raft_consensus.cc:493] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.352406 31505 raft_consensus.cc:515] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.220690 31504 raft_consensus.cc:493] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.221123 31502 raft_consensus.cc:493] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.180522 30400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42156 (request call id 104) took 1484 ms. Trace:
I20260709 13:11:04.226243 31510 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.236728 31355 ts_tablet_manager.cc:1403] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 1.617s	user 0.060s	sys 0.048s
I20260709 13:11:04.246536 31497 raft_consensus.cc:515] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.355391 31505 leader_election.cc:290] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.251448 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c896f7c3954b098ac0769a5ce664a1" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.252455 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.252714 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.259805 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb5e8eecef48b5831eb8cf4003e561" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.191232 31490 raft_consensus.cc:493] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.391139 31490 raft_consensus.cc:515] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.393949 31490 leader_election.cc:290] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.267581 31394 raft_consensus.cc:2468] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:11:04.267719 31495 leader_election.cc:290] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.268002 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.268388 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.395792 31393 raft_consensus.cc:2468] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 3.
I20260709 13:11:04.245602 31485 raft_consensus.cc:493] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.396338 31495 raft_consensus.cc:493] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.269786 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.273535 30654 raft_consensus.cc:2468] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:11:04.396546 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.269222 31496 raft_consensus.cc:515] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.398113 31515 raft_consensus.cc:493] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.398198 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.399313 31496 leader_election.cc:290] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.399058 31515 raft_consensus.cc:515] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.399899 31496 raft_consensus.cc:493] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.400566 31496 raft_consensus.cc:515] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.274513 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.274971 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.266261 30648 raft_consensus.cc:2468] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:11:04.259509 30652 raft_consensus.cc:2468] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 1.
I20260709 13:11:04.229151 31487 raft_consensus.cc:493] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.279286 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.254848 31371 raft_consensus.cc:493] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.306651 31503 raft_consensus.cc:493] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.307057 31511 raft_consensus.cc:493] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.327023 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.343146 31494 raft_consensus.cc:515] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.342682 31484 raft_consensus.cc:493] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.346968 31499 leader_election.cc:290] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.218222 31506 raft_consensus.cc:493] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.346978 31491 leader_election.cc:290] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.347463 31464 raft_consensus.cc:515] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.338649 31486 raft_consensus.cc:515] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.189450 31332 raft_consensus.cc:493] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.355217 31502 raft_consensus.cc:515] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.355087 31504 raft_consensus.cc:515] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.355456 31510 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.355219 30400 rpcz_store.cc:276] 0709 13:11:02.695682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.083990 (+1388308us) service_pool.cc:224] Handling call
0709 13:11:04.180358 (+ 96368us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:11:04.358995 31465 leader_election.cc:290] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.368357 31509 raft_consensus.cc:493] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.369361 31512 raft_consensus.cc:493] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.372026 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d758ec9801614080a6a30dd820a62459" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.373798 30653 raft_consensus.cc:2468] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:04.374212 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.375607 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.286434 31492 raft_consensus.cc:515] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.285812 31500 raft_consensus.cc:515] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.384702 31497 leader_election.cc:290] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.396896 31495 raft_consensus.cc:515] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.473296 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
W20260709 13:11:04.474978 30693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 283114us
I20260709 13:11:04.565671 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.476629 31521 raft_consensus.cc:493] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
W20260709 13:11:04.477952 30620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 110191us
I20260709 13:11:04.479153 31523 raft_consensus.cc:493] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.482424 31501 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.470121 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ec91d866c84f30813b1d51ebf9a214" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.484839 31355 raft_consensus.cc:359] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.570205 31355 raft_consensus.cc:740] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.481627 31515 leader_election.cc:290] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.512491 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb5e8eecef48b5831eb8cf4003e561" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:04.514376 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:04.518374 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:04.518863 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb61d7cc4374a2ba332ae4af88d0f63" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:04.524592 31496 leader_election.cc:290] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.529495 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.532626 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c896f7c3954b098ac0769a5ce664a1" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:04.534747 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:04.592417 30720 raft_consensus.cc:2468] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:11:04.536873 31486 leader_election.cc:290] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.396739 31485 raft_consensus.cc:515] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.558123 30655 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:11:04.488248 31487 raft_consensus.cc:515] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.566424 30693 leader_election.cc:304] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:11:04.493000 31484 raft_consensus.cc:515] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.571194 31355 consensus_queue.cc:260] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.491132 31371 raft_consensus.cc:515] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.556521 31465 raft_consensus.cc:493] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.493150 31511 raft_consensus.cc:515] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.589181 31501 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.563225 31333 raft_consensus.cc:493] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.499168 31506 raft_consensus.cc:515] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.490988 31503 raft_consensus.cc:515] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.503983 31332 raft_consensus.cc:515] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:11:04.635545 30619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 67166.9us
W20260709 13:11:04.638182 30693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 71836.2us
I20260709 13:11:04.641551 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.631287 31486 raft_consensus.cc:493] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.557757 31512 raft_consensus.cc:515] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.645005 30619 leader_election.cc:304] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:04.549645 31509 raft_consensus.cc:515] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.647146 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:04.649652 30693 leader_election.cc:304] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:11:04.650084 31526 raft_consensus.cc:493] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.650270 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.650741 31526 raft_consensus.cc:515] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.651366 31508 raft_consensus.cc:2804] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:04.651818 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.652524 31464 leader_election.cc:290] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.653066 31526 leader_election.cc:290] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.645804 31351 leader_election.cc:304] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:11:04.653791 31397 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:11:04.654405 31484 leader_election.cc:290] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.640491 31465 raft_consensus.cc:515] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.655817 31503 leader_election.cc:290] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.656280 31524 raft_consensus.cc:493] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.656556 31465 leader_election.cc:290] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.640019 31525 raft_consensus.cc:493] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.656880 31524 raft_consensus.cc:515] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.657428 31525 raft_consensus.cc:515] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.639394 31496 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.641813 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.641495 31515 raft_consensus.cc:2804] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:04.664842 30693 leader_election.cc:304] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:11:04.574270 31523 raft_consensus.cc:515] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.670260 31513 raft_consensus.cc:493] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.573043 31521 raft_consensus.cc:515] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.672605 30693 leader_election.cc:304] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
W20260709 13:11:04.687922 31351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 206321us
I20260709 13:11:04.689744 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.690714 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.691381 30646 raft_consensus.cc:2468] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:04.693095 31351 leader_election.cc:304] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:04.653074 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03df1e0d5cf741c0b915e09e00ebc9d3" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.651839 31508 raft_consensus.cc:493] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.654417 31497 raft_consensus.cc:493] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.668957 31484 raft_consensus.cc:493] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
W20260709 13:11:04.708644 30693 consensus_peers.cc:597] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:04.710928 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf3caefe70453bbed914700540bef7" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.711314 30693 leader_election.cc:304] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:11:04.671974 31496 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.647056 31333 raft_consensus.cc:515] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.671751 31515 raft_consensus.cc:493] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.676635 31465 raft_consensus.cc:2804] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:04.714847 30693 consensus_peers.cc:597] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:04.712234 31533 raft_consensus.cc:2804] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:04.715821 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.719900 31496 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.648991 31486 raft_consensus.cc:515] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.722469 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:04.732529 31355 ts_tablet_manager.cc:1434] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.377s	user 0.020s	sys 0.043s
I20260709 13:11:04.708592 31508 raft_consensus.cc:3060] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.723999 31526 raft_consensus.cc:2804] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:04.720359 31512 leader_election.cc:290] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.707261 31529 raft_consensus.cc:493] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.726773 31515 raft_consensus.cc:3060] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.749075 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.753878 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d758ec9801614080a6a30dd820a62459" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.723379 31484 raft_consensus.cc:515] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.754343 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.727253 31465 raft_consensus.cc:493] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.720391 31521 leader_election.cc:290] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.741261 31495 leader_election.cc:290] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.752343 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.754020 31333 leader_election.cc:290] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.737954 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.741117 31518 raft_consensus.cc:2804] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:04.755455 31355 tablet_bootstrap.cc:492] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:04.738471 31526 raft_consensus.cc:493] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.713387 31497 raft_consensus.cc:515] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.744359 31536 raft_consensus.cc:493] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.720846 31513 raft_consensus.cc:515] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.757467 31465 raft_consensus.cc:3060] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.763324 31537 raft_consensus.cc:493] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.772917 31537 raft_consensus.cc:515] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.773741 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafe994543a04390ab335d1abeaa6f4e" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.740243 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.764222 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.780463 30647 raft_consensus.cc:2468] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 1.
I20260709 13:11:04.781250 31538 raft_consensus.cc:2749] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.764782 31393 raft_consensus.cc:2468] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:11:04.787771 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.789139 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.789819 30573 raft_consensus.cc:2468] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:04.739118 31533 raft_consensus.cc:493] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.749744 31371 leader_election.cc:290] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.752081 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e3aaad672f42e5838c628da427a0b7" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.795049 31533 raft_consensus.cc:3060] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.795104 31400 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.748320 31401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e3aaad672f42e5838c628da427a0b7" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
W20260709 13:11:04.795948 30621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 66267.9us
I20260709 13:11:04.766745 31530 raft_consensus.cc:2804] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:04.796660 31530 raft_consensus.cc:493] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.797159 31530 raft_consensus.cc:3060] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.761952 31526 raft_consensus.cc:3060] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.745018 31494 leader_election.cc:290] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.765794 31518 raft_consensus.cc:493] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.742969 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.767913 30580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.768381 31535 raft_consensus.cc:493] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.768388 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9687bd5f80bd4d869a68cbbecda69806" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.769611 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.770191 31536 raft_consensus.cc:515] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.736689 31528 raft_consensus.cc:493] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:04.771736 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb5e8eecef48b5831eb8cf4003e561" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.742362 31529 raft_consensus.cc:515] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.797530 31465 raft_consensus.cc:515] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.823444 31497 leader_election.cc:290] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.829041 31535 raft_consensus.cc:515] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.841514 31528 raft_consensus.cc:515] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.842402 31465 leader_election.cc:290] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.819620 31518 raft_consensus.cc:3060] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.843963 31528 leader_election.cc:290] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.844856 31529 leader_election.cc:290] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.846086 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.846838 31393 raft_consensus.cc:2468] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:11:04.847355 31536 leader_election.cc:290] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.847803 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.850565 31502 leader_election.cc:290] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.851491 31492 leader_election.cc:290] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.851859 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9687bd5f80bd4d869a68cbbecda69806" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.830703 31523 leader_election.cc:290] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.853271 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.853488 31510 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.856786 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.831475 31500 leader_election.cc:290] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.823444 31509 leader_election.cc:290] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.860229 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.860419 31535 leader_election.cc:290] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.861617 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.861757 30621 leader_election.cc:304] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:04.843034 30726 raft_consensus.cc:1240] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.860532 31332 leader_election.cc:290] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.858434 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.854506 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1b94fe3ebf42e090e8c6ef27e1c4df" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.864056 30621 leader_election.cc:304] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:04.865900 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.862648 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.877069 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.872769 31508 raft_consensus.cc:515] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:04.865110 31492 raft_consensus.cc:2749] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.882607 31486 leader_election.cc:290] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.882910 31530 raft_consensus.cc:515] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.883781 31487 leader_election.cc:290] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.884130 31485 leader_election.cc:290] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.884598 31513 leader_election.cc:290] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.877676 31494 raft_consensus.cc:2804] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:04.885231 31494 raft_consensus.cc:493] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.885426 31530 leader_election.cc:290] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.885633 31506 leader_election.cc:290] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.886379 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.892927 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:04.872970 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf3caefe70453bbed914700540bef7" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.905344 30725 raft_consensus.cc:1240] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.882655 31525 leader_election.cc:290] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.906103 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a9c51005141eb9c585ad91a67d779" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:04.885653 31494 raft_consensus.cc:3060] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.912770 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.913605 31508 leader_election.cc:290] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
W20260709 13:11:04.908250 31351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 215164us
I20260709 13:11:04.914829 31351 leader_election.cc:304] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:04.914984 31511 leader_election.cc:290] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.916069 31351 leader_election.cc:304] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:11:04.917455 31351 leader_election.cc:304] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:11:04.919935 31537 leader_election.cc:290] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.921574 31501 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.922003 31504 leader_election.cc:290] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.897346 31395 raft_consensus.cc:1240] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.927155 31542 raft_consensus.cc:2804] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:04.927713 31542 raft_consensus.cc:493] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.936440 31542 raft_consensus.cc:3060] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.936856 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.918232 31518 raft_consensus.cc:515] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.928212 31537 raft_consensus.cc:2804] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:04.941639 31537 raft_consensus.cc:493] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.942123 31537 raft_consensus.cc:3060] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.942559 31494 raft_consensus.cc:515] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:04.945868 31494 leader_election.cc:290] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:04.947616 31396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.952402 31518 leader_election.cc:290] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:04.928898 31351 leader_election.cc:304] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:11:04.929209 31501 raft_consensus.cc:2804] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:04.954651 31501 raft_consensus.cc:493] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:04.955302 31501 raft_consensus.cc:3060] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.956230 31524 leader_election.cc:290] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.930760 31484 leader_election.cc:290] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:04.931246 31533 raft_consensus.cc:515] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.933084 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:04.959391 31484 raft_consensus.cc:2804] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:04.959535 31533 leader_election.cc:290] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.959831 31484 raft_consensus.cc:493] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.960278 31484 raft_consensus.cc:3060] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.933244 31515 raft_consensus.cc:515] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:04.972265 31515 leader_election.cc:290] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:04.973933 31526 raft_consensus.cc:515] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:11:04.974602 31351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 45797us
I20260709 13:11:04.984299 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.984289 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.987030 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec7a3e0f271468aa4e4809f9707f7a3" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.987600 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.988165 30545 leader_election.cc:304] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:04.990103 31537 raft_consensus.cc:515] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:04.990540 31506 raft_consensus.cc:2804] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:04.994251 30651 raft_consensus.cc:1240] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.994585 31506 raft_consensus.cc:493] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:04.994592 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.995213 31506 raft_consensus.cc:3060] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.995687 30654 raft_consensus.cc:1240] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.992808 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:04.996848 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a1eefeef3847b8ad88b05ca970c43f" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.997334 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.997743 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.998381 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.999750 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:04.993326 31542 raft_consensus.cc:515] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.003063 31542 leader_election.cc:290] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:05.004907 31537 leader_election.cc:290] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:05.005442 31501 raft_consensus.cc:515] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.008665 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.013048 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.014716 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.017021 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
W20260709 13:11:05.011518 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 280917us
I20260709 13:11:05.021641 31501 leader_election.cc:290] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:05.022189 31524 consensus_queue.cc:1059] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:05.022500 31511 consensus_queue.cc:1059] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.023643 31511 raft_consensus.cc:3055] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.023444 31484 raft_consensus.cc:515] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.023972 31524 raft_consensus.cc:3055] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.024492 31524 raft_consensus.cc:740] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:05.025763 31484 leader_election.cc:290] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:05.025377 31524 consensus_queue.cc:260] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
W20260709 13:11:05.026453 30619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 349274us
I20260709 13:11:05.024009 31511 raft_consensus.cc:740] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
W20260709 13:11:05.029628 30545 consensus_peers.cc:597] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:05.032797 31526 leader_election.cc:290] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:05.033267 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
W20260709 13:11:05.035799 30619 leader_election.cc:343] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.036239 30619 leader_election.cc:304] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:05.037542 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.038353 31402 raft_consensus.cc:2468] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:11:05.038538 31511 consensus_queue.cc:260] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.039153 31513 consensus_queue.cc:1059] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.040032 31511 raft_consensus.cc:3060] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.040601 31531 raft_consensus.cc:3055] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.041042 31531 raft_consensus.cc:740] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:05.041923 31531 consensus_queue.cc:260] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.043591 31490 raft_consensus.cc:2749] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.044068 31531 raft_consensus.cc:3060] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.044796 31506 raft_consensus.cc:515] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:05.045101 30619 leader_election.cc:304] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:05.045856 31489 raft_consensus.cc:2749] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:05.046720 30546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.047173 30619 leader_election.cc:304] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.053031 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.053682 31396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.053963 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1acee1ab5494c3a87ba7e6a84ef73cf" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.054471 31396 raft_consensus.cc:2468] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 1.
I20260709 13:11:05.055833 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.056295 31355 tablet_bootstrap.cc:492] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:05.056705 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04593214c5bf43b6b52bc5d7b4d27ee1" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.038378 31524 raft_consensus.cc:3060] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.058754 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.060191 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.061525 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1b94fe3ebf42e090e8c6ef27e1c4df" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.062703 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.064067 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.058027 30655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.065923 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.067057 31506 leader_election.cc:290] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:05.067268 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.068382 30621 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.068646 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.069559 31489 raft_consensus.cc:2749] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.071432 30545 leader_election.cc:304] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:05.072501 31516 raft_consensus.cc:2804] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:05.072631 30621 leader_election.cc:304] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.073012 31516 raft_consensus.cc:493] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:05.073374 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:05.073601 31516 raft_consensus.cc:3060] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.076756 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.079576 30545 leader_election.cc:304] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:05.086995 31506 raft_consensus.cc:2804] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:05.087513 31506 raft_consensus.cc:493] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:05.087967 31506 raft_consensus.cc:3060] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:05.088616 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 46143.9us
I20260709 13:11:05.057369 31355 tablet_bootstrap.cc:492] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:05.092379 31355 ts_tablet_manager.cc:1403] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.352s	user 0.035s	sys 0.004s
I20260709 13:11:05.092121 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.094965 31355 raft_consensus.cc:359] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.095645 31355 raft_consensus.cc:740] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.096361 31355 consensus_queue.cc:260] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.097901 31355 ts_tablet_manager.cc:1434] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:11:05.085588 31516 raft_consensus.cc:515] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:05.098546 30694 leader_election.cc:304] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
W20260709 13:11:05.200384 31425 debug-util.cc:398] Leaking SignalData structure 0x7b080031b340 after lost signal to thread 20385
I20260709 13:11:05.107784 31546 raft_consensus.cc:2749] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:05.112236 30619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 65139.7us
I20260709 13:11:05.219743 31401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafe994543a04390ab335d1abeaa6f4e" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.320048 30619 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:05.200758 30724 raft_consensus.cc:1240] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Rejecting Update request from peer e4b8e689773b4a9d8e6de6d82d225c0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:05.307952 31508 raft_consensus.cc:2749] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.126485 30576 raft_consensus.cc:2468] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:05.320827 31546 raft_consensus.cc:2804] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:05.204514 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ec91d866c84f30813b1d51ebf9a214" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.107177 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
W20260709 13:11:05.308226 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 209717us
I20260709 13:11:05.114024 31489 raft_consensus.cc:2804] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:05.115881 30546 leader_election.cc:304] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:05.325695 30694 leader_election.cc:304] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
W20260709 13:11:05.252650 30621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 58696.2us
I20260709 13:11:05.326050 31489 raft_consensus.cc:493] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:05.326843 31401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.138672 31396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.103632 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.326668 31489 raft_consensus.cc:3060] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.329507 31396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.126609 31506 raft_consensus.cc:515] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:05.330513 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.098706 31355 tablet_bootstrap.cc:492] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:05.311894 31516 leader_election.cc:290] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:05.333436 31332 consensus_queue.cc:1059] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.332031 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.331059 31396 raft_consensus.cc:3060] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.325765 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.337073 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.122123 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.151662 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.339030 31513 raft_consensus.cc:2749] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:05.340234 30546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 224416us
I20260709 13:11:05.323807 31546 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:05.326958 31508 raft_consensus.cc:2749] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.327296 30694 leader_election.cc:304] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.341872 31508 raft_consensus.cc:2749] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.340934 31546 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:05.344280 30546 leader_election.cc:304] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:05.346272 30694 leader_election.cc:304] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.332901 31506 leader_election.cc:290] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:05.335525 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.165151 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.349152 31508 raft_consensus.cc:2749] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.101509 31394 raft_consensus.cc:3060] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.334626 31514 raft_consensus.cc:3055] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:05.318732 31425 debug-util.cc:398] Leaking SignalData structure 0x7b0800349420 after lost signal to thread 30438
I20260709 13:11:05.325137 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.350303 30694 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.351361 31401 raft_consensus.cc:1240] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:05.133816 31400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1b94fe3ebf42e090e8c6ef27e1c4df" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.351358 30619 leader_election.cc:304] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:05.361495 30694 leader_election.cc:304] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.363049 31513 raft_consensus.cc:2749] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:05.365598 30694 leader_election.cc:304] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.365722 30546 leader_election.cc:304] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:05.366978 30619 leader_election.cc:304] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.348163 31397 raft_consensus.cc:1240] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Rejecting Update request from peer ce7bd1ecd6e44f32879851d7b3174acb for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:05.371460 30619 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:05.373515 30694 leader_election.cc:304] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
W20260709 13:11:05.373737 30619 leader_election.cc:343] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.374246 30619 leader_election.cc:304] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.360328 31514 raft_consensus.cc:740] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:05.378459 30724 raft_consensus.cc:1240] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Rejecting Update request from peer e4b8e689773b4a9d8e6de6d82d225c0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:05.365630 31508 raft_consensus.cc:2804] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:05.364868 31490 raft_consensus.cc:2749] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.367844 31515 raft_consensus.cc:2804] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:05.385586 31515 raft_consensus.cc:493] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:05.386057 31515 raft_consensus.cc:3060] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.386127 31401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a9c51005141eb9c585ad91a67d779" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.387168 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.388536 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec7a3e0f271468aa4e4809f9707f7a3" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.389779 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.382025 30546 leader_election.cc:304] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:05.376981 31519 raft_consensus.cc:2804] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:05.375182 31526 raft_consensus.cc:2749] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.383466 31514 consensus_queue.cc:260] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.380442 31534 raft_consensus.cc:2749] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.377593 31491 raft_consensus.cc:2804] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:05.397495 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.395274 31396 raft_consensus.cc:2468] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:11:05.372946 31531 raft_consensus.cc:2749] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.398133 31519 raft_consensus.cc:493] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:05.377455 31547 raft_consensus.cc:2749] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.402101 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafe994543a04390ab335d1abeaa6f4e" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.379931 31508 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:05.404536 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ec91d866c84f30813b1d51ebf9a214" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
W20260709 13:11:05.402299 31425 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2b40 after lost signal to thread 30605
I20260709 13:11:05.412245 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a322c98a8d493ab4377fe92a1c01db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.419184 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a322c98a8d493ab4377fe92a1c01db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.411782 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.404950 31491 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:05.420598 31491 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.412621 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca31368027748349419b6fe09ea1375" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.412773 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca31368027748349419b6fe09ea1375" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.402576 31516 raft_consensus.cc:2749] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.401711 31332 consensus_queue.cc:1059] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:05.410713 31519 raft_consensus.cc:3060] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.412258 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.411589 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.411811 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.404103 31351 leader_election.cc:304] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.425324 31398 raft_consensus.cc:1240] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Rejecting Update request from peer ce7bd1ecd6e44f32879851d7b3174acb for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:05.417678 31508 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.434418 31514 raft_consensus.cc:3060] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.453629 30545 leader_election.cc:304] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
W20260709 13:11:05.464476 31351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 68773.4us
I20260709 13:11:05.465099 31484 raft_consensus.cc:2749] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.411338 31504 consensus_queue.cc:1059] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:11:05.483497 31516 raft_consensus.cc:2804] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.491184 31516 raft_consensus.cc:697] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:05.492188 31516 consensus_queue.cc:237] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:05.497238 31539 raft_consensus.cc:3055] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.497702 31539 raft_consensus.cc:740] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:05.499418 31531 raft_consensus.cc:3055] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:05.499856 31531 raft_consensus.cc:740] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:05.500671 31531 consensus_queue.cc:260] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.502055 31531 raft_consensus.cc:3060] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.505642 31351 leader_election.cc:304] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.507121 31351 leader_election.cc:304] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:05.508002 31501 raft_consensus.cc:2749] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.508641 31501 raft_consensus.cc:2804] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:05.508949 31501 raft_consensus.cc:493] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:05.509290 31501 raft_consensus.cc:3060] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.462291 31491 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
W20260709 13:11:05.482620 31425 debug-util.cc:398] Leaking SignalData structure 0x7b0800162140 after lost signal to thread 30679
W20260709 13:11:05.520762 30546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 111414us
I20260709 13:11:05.524811 31489 raft_consensus.cc:515] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
W20260709 13:11:05.526146 31425 debug-util.cc:398] Leaking SignalData structure 0x7b08001e29e0 after lost signal to thread 30753
W20260709 13:11:05.527043 31425 debug-util.cc:398] Leaking SignalData structure 0x7b080019e700 after lost signal to thread 30983
W20260709 13:11:05.527459 31425 debug-util.cc:398] Leaking SignalData structure 0x7b0800334f60 after lost signal to thread 31334
W20260709 13:11:05.527904 31425 debug-util.cc:398] Leaking SignalData structure 0x7b08000be720 after lost signal to thread 31356
I20260709 13:11:05.528309 31489 leader_election.cc:290] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:11:05.530175 31425 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3a60 after lost signal to thread 31428
I20260709 13:11:05.532872 31491 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:05.533924 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:05.536685 31351 leader_election.cc:304] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:05.498517 31539 consensus_queue.cc:260] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.538321 31539 raft_consensus.cc:3060] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.546161 31546 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.538389 31519 raft_consensus.cc:515] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.549641 31546 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 4 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:05.549824 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:05.551082 31515 raft_consensus.cc:515] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:05.554904 31484 raft_consensus.cc:2804] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.557039 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.559245 31501 raft_consensus.cc:515] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:05.565289 30575 raft_consensus.cc:2468] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:05.584120 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
W20260709 13:11:05.591230 30547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 164873us
I20260709 13:11:05.593907 31511 consensus_queue.cc:1059] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.594965 31513 raft_consensus.cc:3055] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.595534 31513 raft_consensus.cc:740] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:05.596685 31513 consensus_queue.cc:260] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:05.593942 31504 consensus_queue.cc:1059] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:11:05.600294 31504 raft_consensus.cc:3055] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.600806 31504 raft_consensus.cc:740] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:05.601809 31508 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:05.603057 31515 leader_election.cc:290] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:05.586220 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:05.612470 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.579687 31519 leader_election.cc:290] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:05.615273 30576 raft_consensus.cc:1240] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Rejecting Update request from peer ce7bd1ecd6e44f32879851d7b3174acb for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:05.604444 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4221f91ccf44480aa2e341f14c10588" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:05.616671 31508 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:05.617193 30646 raft_consensus.cc:2393] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 in current term 2: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:11:05.598523 31513 raft_consensus.cc:3060] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.636966 30619 leader_election.cc:304] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:05.638459 30619 leader_election.cc:304] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.655483 31355 tablet_bootstrap.cc:492] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:05.653313 30654 raft_consensus.cc:1240] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Rejecting Update request from peer ce7bd1ecd6e44f32879851d7b3174acb for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:05.601984 31504 consensus_queue.cc:260] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:05.672904 30619 leader_election.cc:304] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.667497 31393 raft_consensus.cc:1240] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:05.668761 31400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.664368 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.667974 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.688261 30646 raft_consensus.cc:1240] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:05.688840 31401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.664880 30652 raft_consensus.cc:2468] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:11:05.689738 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.673687 31484 raft_consensus.cc:697] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:05.692351 31520 raft_consensus.cc:2749] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.674698 31550 raft_consensus.cc:2749] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.692441 30619 leader_election.cc:304] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.695007 31520 raft_consensus.cc:2749] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.695298 30648 raft_consensus.cc:2468] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:11:05.696116 31511 consensus_queue.cc:1059] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.702406 30577 raft_consensus.cc:1240] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Rejecting Update request from peer ce7bd1ecd6e44f32879851d7b3174acb for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:05.642742 31539 raft_consensus.cc:2749] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.670770 31501 leader_election.cc:290] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:05.713378 31502 raft_consensus.cc:3055] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.713810 31502 raft_consensus.cc:740] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:05.714156 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:05.714666 31502 consensus_queue.cc:260] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.716163 31502 raft_consensus.cc:3060] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.719924 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.720644 30693 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.724081 31515 raft_consensus.cc:2749] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:05.724790 31504 raft_consensus.cc:3060] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.726536 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:05.727517 31355 tablet_bootstrap.cc:492] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:05.722620 30693 leader_election.cc:304] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:05.728379 31355 ts_tablet_manager.cc:1403] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.630s	user 0.042s	sys 0.031s
I20260709 13:11:05.729130 30693 leader_election.cc:304] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:05.729909 31526 raft_consensus.cc:2749] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.730515 31526 raft_consensus.cc:2749] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.731245 31355 raft_consensus.cc:359] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.731693 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056efc360d6c4950a5e033e7a145395e" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:05.731953 31355 raft_consensus.cc:740] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.734988 30693 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.698777 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.739013 30577 raft_consensus.cc:2468] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 3.
I20260709 13:11:05.735524 31355 consensus_queue.cc:260] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.736845 30693 leader_election.cc:304] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.742372 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:05.743597 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a1eefeef3847b8ad88b05ca970c43f" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:05.745604 30577 raft_consensus.cc:1240] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Rejecting Update request from peer ce7bd1ecd6e44f32879851d7b3174acb for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:05.747252 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:05.748417 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8653cfe6a71495f8708ab4726905d40" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.751746 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:05.753012 30572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.753316 30647 raft_consensus.cc:1240] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Rejecting Update request from peer ce7bd1ecd6e44f32879851d7b3174acb for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:05.753525 30725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:05.754778 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:05.747666 31515 raft_consensus.cc:2749] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.752018 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:05.756140 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3a53f4eac747b2b57fe6b5c5516cee" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.756911 30646 raft_consensus.cc:2393] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce7bd1ecd6e44f32879851d7b3174acb in current term 2: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:11:05.757076 30574 raft_consensus.cc:2393] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e4b8e689773b4a9d8e6de6d82d225c0d in current term 2: Already voted for candidate 5eebf0fa5aba46afa04623642d7795e6 in this term.
I20260709 13:11:05.757710 31511 consensus_queue.cc:1059] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.758747 31511 raft_consensus.cc:3055] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.759105 31511 raft_consensus.cc:740] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:05.759235 31520 raft_consensus.cc:493] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:05.759812 31520 raft_consensus.cc:515] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:05.759989 31511 consensus_queue.cc:260] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.761401 31511 raft_consensus.cc:3060] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.762288 31520 leader_election.cc:290] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:05.763521 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:05.763687 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a1eefeef3847b8ad88b05ca970c43f" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:05.764678 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d68b0f1c1e48609d42244622ea1d7c" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.768246 30694 leader_election.cc:304] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.768932 30726 raft_consensus.cc:1240] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:05.770058 30694 leader_election.cc:304] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.691712 31484 consensus_queue.cc:237] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.770922 31508 raft_consensus.cc:2749] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.771615 31508 raft_consensus.cc:2749] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.774241 30694 leader_election.cc:304] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.775094 31559 raft_consensus.cc:2749] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.739070 31547 raft_consensus.cc:2749] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:05.776473 30694 leader_election.cc:304] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.777298 31547 raft_consensus.cc:2749] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.779901 30693 leader_election.cc:304] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.780412 31351 leader_election.cc:304] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.780611 31559 raft_consensus.cc:2749] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.781046 30693 leader_election.cc:304] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.781665 31351 leader_election.cc:304] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.782291 31547 raft_consensus.cc:2749] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.770279 30581 raft_consensus.cc:2468] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 2.
I20260709 13:11:05.785224 30619 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:05.786957 31520 raft_consensus.cc:2749] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:05.790925 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a1eefeef3847b8ad88b05ca970c43f" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:05.793535 30619 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:05.793869 31515 consensus_queue.cc:1059] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.793383 31508 consensus_queue.cc:1059] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:05.797341 31546 raft_consensus.cc:2749] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.797863 31515 raft_consensus.cc:3055] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.798354 31515 raft_consensus.cc:740] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:05.800796 31515 consensus_queue.cc:260] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:05.801959 31515 raft_consensus.cc:3060] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.802681 31508 raft_consensus.cc:3055] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:05.803432 31508 raft_consensus.cc:740] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:05.804556 31508 consensus_queue.cc:260] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.807142 31526 consensus_queue.cc:1059] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:05.808440 31496 raft_consensus.cc:3055] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:05.808805 31496 raft_consensus.cc:740] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:05.809626 31496 consensus_queue.cc:260] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:05.813417 31496 raft_consensus.cc:3060] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.814337 31556 raft_consensus.cc:2749] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:05.815335 31556 raft_consensus.cc:2749] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.816931 31351 leader_election.cc:304] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.817381 31355 ts_tablet_manager.cc:1434] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.000s
I20260709 13:11:05.830147 31355 tablet_bootstrap.cc:492] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap starting.
I20260709 13:11:05.830338 30620 leader_election.cc:304] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:05.822353 30400 catalog_manager.cc:5697] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 1 to 2, leader changed from ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132) to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:05.832150 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 48573us
I20260709 13:11:05.833981 31526 consensus_queue.cc:1059] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.821944 31511 raft_consensus.cc:493] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:05.824553 31508 raft_consensus.cc:3060] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.835153 31559 raft_consensus.cc:3055] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.835196 31511 raft_consensus.cc:515] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:05.840106 31511 leader_election.cc:290] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:05.842082 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c896f7c3954b098ac0769a5ce664a1" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:05.842523 31520 raft_consensus.cc:493] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:05.843108 31520 raft_consensus.cc:515] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.845551 30620 leader_election.cc:304] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.835865 30694 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:05.846504 30722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:05.847298 31496 raft_consensus.cc:2749] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.847739 30694 leader_election.cc:304] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.848812 31496 raft_consensus.cc:2749] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.848960 30694 leader_election.cc:304] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.853685 30579 raft_consensus.cc:2468] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:11:05.852825 31332 raft_consensus.cc:2749] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.836663 31534 raft_consensus.cc:2804] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.871729 31534 raft_consensus.cc:697] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:05.873018 31534 consensus_queue.cc:237] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.834745 31351 leader_election.cc:304] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.834944 31501 raft_consensus.cc:2749] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.856984 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:05.879712 31395 raft_consensus.cc:2468] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 1.
I20260709 13:11:05.855774 31520 leader_election.cc:290] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:05.836825 31559 raft_consensus.cc:740] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:05.881428 31501 raft_consensus.cc:2749] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.882066 31559 consensus_queue.cc:260] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
W20260709 13:11:05.882817 31351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 48132us
I20260709 13:11:05.883613 31559 raft_consensus.cc:3060] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.884615 31351 leader_election.cc:304] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.881423 30619 leader_election.cc:304] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:05.888891 31332 raft_consensus.cc:2804] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:05.889454 31332 raft_consensus.cc:493] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:05.889930 31332 raft_consensus.cc:3060] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.898942 31355 tablet_bootstrap.cc:492] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:05.870039 30575 raft_consensus.cc:2468] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
W20260709 13:11:05.901396 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 52507.3us
I20260709 13:11:05.905680 31496 raft_consensus.cc:2749] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.915789 31501 raft_consensus.cc:2749] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.924351 31332 raft_consensus.cc:515] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.919235 31355 tablet_bootstrap.cc:492] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: Bootstrap complete.
I20260709 13:11:05.925906 31355 ts_tablet_manager.cc:1403] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.000s
I20260709 13:11:05.919653 30694 leader_election.cc:304] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.940716 31332 leader_election.cc:290] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:05.942375 30694 leader_election.cc:304] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:05.941838 30722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:05.943598 31508 consensus_queue.cc:1059] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:05.944324 30694 leader_election.cc:304] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:05.944612 31508 raft_consensus.cc:3055] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:05.945109 31508 raft_consensus.cc:740] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:05.945575 30694 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.944545 31526 raft_consensus.cc:2804] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.945889 31508 consensus_queue.cc:260] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.946467 31515 raft_consensus.cc:2749] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.946341 31547 raft_consensus.cc:2804] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.947325 31547 raft_consensus.cc:697] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:05.948226 31547 consensus_queue.cc:237] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.948835 30619 leader_election.cc:304] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.949965 31520 raft_consensus.cc:2749] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.941859 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "723f558d9f1b4b448a1d027e5e116bf2" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:05.939244 31496 raft_consensus.cc:2749] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.946321 31526 raft_consensus.cc:697] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:05.954990 31355 raft_consensus.cc:359] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.959967 31355 raft_consensus.cc:740] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.961478 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:05.962014 31355 consensus_queue.cc:260] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.950917 31395 raft_consensus.cc:3060] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.965294 31355 ts_tablet_manager.cc:1434] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:11:05.967120 31484 raft_consensus.cc:493] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:05.967528 31351 leader_election.cc:304] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:05.967757 31484 raft_consensus.cc:515] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.968881 31351 leader_election.cc:304] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:05.969715 31556 raft_consensus.cc:2804] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.970126 31484 leader_election.cc:290] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:05.970122 31351 leader_election.cc:304] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:05.981168 31395 raft_consensus.cc:2468] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 2.
I20260709 13:11:05.981920 31526 consensus_queue.cc:237] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:05.984310 31484 raft_consensus.cc:2804] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:05.985031 31484 raft_consensus.cc:697] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 3 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:05.987154 30619 leader_election.cc:304] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:05.989213 31520 raft_consensus.cc:2804] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.989764 31520 raft_consensus.cc:697] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:05.985952 30400 catalog_manager.cc:5697] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 1 to 2, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.986176 31484 consensus_queue.cc:237] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:05.977077 31501 raft_consensus.cc:2749] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:06.012032 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 64228.4us
I20260709 13:11:05.993852 31508 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:06.012183 31394 raft_consensus.cc:1240] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Rejecting Update request from peer ce7bd1ecd6e44f32879851d7b3174acb for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:06.015363 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:06.025996 31395 raft_consensus.cc:3060] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.014568 31556 raft_consensus.cc:697] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:05.990633 31520 consensus_queue.cc:237] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:06.054020 30547 leader_election.cc:304] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.055299 30547 leader_election.cc:304] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:06.056475 30547 leader_election.cc:304] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:06.061316 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ec91d866c84f30813b1d51ebf9a214" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.067183 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba73d0b006bc437393ba09c76a909614" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.067956 30721 raft_consensus.cc:2468] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:06.079416 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155c2eeaa7cc439c8c8e42ec57accfd3" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.066201 30652 raft_consensus.cc:2393] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 in current term 2: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:11:06.057801 31511 raft_consensus.cc:2749] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.059573 31502 raft_consensus.cc:2749] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.077526 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.052850 31496 consensus_queue.cc:1059] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:11:06.099575 30726 raft_consensus.cc:2468] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 3.
I20260709 13:11:06.061676 31513 raft_consensus.cc:2749] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:06.108311 31556 consensus_queue.cc:237] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:06.076406 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.115913 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904d28f33ba4b9298735fe0bbaf6855" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.076045 30725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb5e8eecef48b5831eb8cf4003e561" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.120501 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafe994543a04390ab335d1abeaa6f4e" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.122656 30727 raft_consensus.cc:2393] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 in current term 2: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:11:06.124349 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5f081bede942ccbbb7ab42a42bf354" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.130589 30722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60650c912f44bac84d7e81cf49ad99d" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.132351 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe10cb5a2eb471f86bec2723e5dbe97" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.132597 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.124007 30729 raft_consensus.cc:2468] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 3.
I20260709 13:11:06.077059 31557 consensus_queue.cc:1059] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:11:06.136448 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.136725 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1acee1ab5494c3a87ba7e6a84ef73cf" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.137105 30728 raft_consensus.cc:2468] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:06.137702 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b210bd1ede94a3abb6560f301be6a7b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.136083 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.142881 31402 raft_consensus.cc:1275] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.143656 31557 raft_consensus.cc:3055] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:06.144104 31557 raft_consensus.cc:740] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:06.144829 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c73c344ee48698633b2153ac2bce0" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.144987 31557 consensus_queue.cc:260] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:06.146631 31557 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.160531 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacc589c8fd4465d9a8549c531711c32" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.165445 31504 consensus_queue.cc:1048] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.175908 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.176824 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1b94fe3ebf42e090e8c6ef27e1c4df" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.177196 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ca8d69123d49ada168ec5581c199d4" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:06.178412 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3860c6607e4192b0fa932efa48a730" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:06.179239 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253c47b0c1749e39622495eb339195c" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.179648 30729 raft_consensus.cc:1240] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:06.192412 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb671441fb4addaa5108aea6093d4f" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.195838 30694 leader_election.cc:304] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.196383 30724 raft_consensus.cc:1275] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.196919 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c896f7c3954b098ac0769a5ce664a1" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.199674 30723 raft_consensus.cc:2468] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 3.
I20260709 13:11:06.200819 30721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71865a4b38b04d879e4188a8eebba7e7" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.216167 31559 raft_consensus.cc:3055] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:06.216614 31559 raft_consensus.cc:740] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:06.204074 30694 leader_election.cc:304] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:06.214490 31571 raft_consensus.cc:2804] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:06.217387 31559 consensus_queue.cc:260] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:06.221778 30652 raft_consensus.cc:1275] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.238624 30547 leader_election.cc:304] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.239714 31502 consensus_queue.cc:1059] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.240913 31352 leader_election.cc:304] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.242162 31352 leader_election.cc:304] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.243000 31511 consensus_queue.cc:1048] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.243040 31570 raft_consensus.cc:2749] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.243870 31352 leader_election.cc:304] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.244454 31511 raft_consensus.cc:2749] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.253849 30727 raft_consensus.cc:2468] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 3.
I20260709 13:11:06.248108 30648 raft_consensus.cc:1240] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Rejecting Update request from peer ce7bd1ecd6e44f32879851d7b3174acb for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:06.223418 31526 raft_consensus.cc:2804] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:11:06.256814 30693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:44027, user_credentials={real_user=slave}} blocked reactor thread for 204794us
I20260709 13:11:06.235276 31571 raft_consensus.cc:697] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:06.254683 31484 consensus_queue.cc:1048] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:11:06.252559 31501 raft_consensus.cc:2749] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:06.256940 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcef0a31d14c3e90d15d1bbbf329c2" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.260720 31526 raft_consensus.cc:697] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:06.269409 31562 consensus_queue.cc:1059] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:11:06.281091 31570 raft_consensus.cc:2764] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:06.284456 31571 consensus_queue.cc:237] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:06.295043 31526 consensus_queue.cc:237] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:06.301482 30404 catalog_manager.cc:5697] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 1 to 2, leader changed from ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132) to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.276517 31352 leader_election.cc:304] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.310603 31556 raft_consensus.cc:3060] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:06.310776 31352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 44689.1us
I20260709 13:11:06.311379 31559 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.311872 31352 leader_election.cc:304] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.312733 31570 raft_consensus.cc:2749] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.313915 31352 leader_election.cc:304] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.318804 31556 raft_consensus.cc:2749] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.326459 30400 catalog_manager.cc:5697] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.335544 31496 raft_consensus.cc:3055] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:06.335831 30575 raft_consensus.cc:1275] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.336063 31496 raft_consensus.cc:740] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:06.336992 31496 consensus_queue.cc:260] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:06.337385 31520 consensus_queue.cc:1048] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.338992 31570 raft_consensus.cc:2749] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.338166 31496 raft_consensus.cc:3060] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.346510 31513 raft_consensus.cc:3055] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:06.347007 31513 raft_consensus.cc:740] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:06.347854 31513 consensus_queue.cc:260] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:06.349370 31513 raft_consensus.cc:3060] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.352586 31352 leader_election.cc:304] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.357591 31570 raft_consensus.cc:2749] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:06.357905 31352 leader_election.cc:304] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.358829 31570 raft_consensus.cc:2749] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.359305 31352 leader_election.cc:304] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.360956 31570 raft_consensus.cc:2749] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:06.361379 30694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.362380 31352 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.363238 31570 raft_consensus.cc:2749] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:06.366046 31352 leader_election.cc:304] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.370682 31570 raft_consensus.cc:2749] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.392792 30400 catalog_manager.cc:5697] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 1 to 2, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } }
I20260709 13:11:06.404285 31399 raft_consensus.cc:3060] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.398761 30404 catalog_manager.cc:5697] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:06.408543 30404 catalog_manager.cc:5697] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.410318 30404 catalog_manager.cc:5697] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.423305 30575 raft_consensus.cc:1275] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.420367 31352 leader_election.cc:304] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.424921 31570 raft_consensus.cc:2804] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.425176 31501 consensus_queue.cc:1048] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:06.425477 31570 raft_consensus.cc:493] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:06.426137 31570 raft_consensus.cc:3060] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.437963 31399 raft_consensus.cc:1275] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.452919 31508 consensus_queue.cc:1048] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:06.467885 31402 raft_consensus.cc:3060] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.462913 31352 leader_election.cc:304] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.479590 31501 raft_consensus.cc:2749] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.480893 31352 leader_election.cc:304] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.481694 31501 raft_consensus.cc:2749] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.482903 31352 leader_election.cc:304] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.483717 31501 raft_consensus.cc:2749] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.484997 31352 leader_election.cc:304] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.507202 30648 raft_consensus.cc:1275] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.517930 31496 consensus_queue.cc:1048] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.518967 31501 raft_consensus.cc:2749] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:06.526568 31352 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.534569 31501 raft_consensus.cc:2749] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.540661 30647 raft_consensus.cc:1275] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.527220 31570 raft_consensus.cc:515] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:06.542655 31559 consensus_queue.cc:1048] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.543566 30727 raft_consensus.cc:1275] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.542824 31352 leader_election.cc:304] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.545701 31501 raft_consensus.cc:2749] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.528097 31402 raft_consensus.cc:1275] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.546387 31546 consensus_queue.cc:1048] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.548473 31491 consensus_queue.cc:1048] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.550597 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:06.551463 30575 raft_consensus.cc:2393] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 in current term 2: Already voted for candidate fe9b995b077d4cb795f08934ed7d9088 in this term.
I20260709 13:11:06.555495 31570 leader_election.cc:290] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:06.545660 31352 leader_election.cc:304] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.558403 31501 raft_consensus.cc:2749] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.563341 30646 raft_consensus.cc:3060] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.566754 31399 raft_consensus.cc:3060] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.587273 30646 raft_consensus.cc:1275] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:06.594473 31570 consensus_queue.cc:1048] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:06.558255 31352 leader_election.cc:304] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.599388 31501 raft_consensus.cc:2749] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:06.603799 31352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 45635.8us
I20260709 13:11:06.611253 31352 leader_election.cc:304] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.612190 31570 raft_consensus.cc:493] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:06.619102 31501 raft_consensus.cc:2804] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:06.619668 31501 raft_consensus.cc:697] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:06.619907 31395 raft_consensus.cc:1275] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.620529 31501 consensus_queue.cc:237] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:06.621260 31570 raft_consensus.cc:515] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:06.624646 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:06.625335 30575 raft_consensus.cc:2468] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:06.627192 31351 leader_election.cc:304] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:06.628027 31556 raft_consensus.cc:2804] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.628444 31556 raft_consensus.cc:493] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:06.628810 31556 raft_consensus.cc:3060] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.628995 31570 leader_election.cc:290] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:06.627810 31550 consensus_queue.cc:1048] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.637343 30575 raft_consensus.cc:1275] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.641023 31556 raft_consensus.cc:515] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:06.641507 31484 consensus_queue.cc:1048] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.647100 31399 raft_consensus.cc:1275] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.642266 31352 leader_election.cc:304] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.648646 31526 consensus_queue.cc:1048] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.656075 31484 raft_consensus.cc:2749] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.658195 31352 leader_election.cc:304] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.665341 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:06.665685 31556 leader_election.cc:290] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:06.666664 31484 raft_consensus.cc:2804] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:06.667371 31484 raft_consensus.cc:697] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:06.668803 31484 consensus_queue.cc:237] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:06.661221 30574 raft_consensus.cc:1275] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:06.679208 31603 consensus_queue.cc:1048] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:11:06.670734 30400 catalog_manager.cc:5697] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 2 to 3, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } }
I20260709 13:11:06.683640 30647 raft_consensus.cc:1275] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.698501 31603 consensus_queue.cc:1048] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.687230 30579 raft_consensus.cc:2468] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:06.678763 31352 leader_election.cc:304] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6; no voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.710675 31351 leader_election.cc:304] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:06.710316 30402 catalog_manager.cc:5697] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 1 to 2, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } }
I20260709 13:11:06.710333 31603 raft_consensus.cc:2749] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.715008 31501 raft_consensus.cc:2804] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:06.716599 31501 raft_consensus.cc:697] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:06.717504 31501 consensus_queue.cc:237] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
W20260709 13:11:06.726189 31352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 47538.6us
I20260709 13:11:06.735100 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ee8459c7f745eb8bb1fb0d6ea88f2a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:06.754227 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.755261 30729 raft_consensus.cc:2393] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 in current term 2: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:11:06.755543 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d1b96e1d27444ebfb159aae9bbe85b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:06.756593 30720 raft_consensus.cc:2393] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 in current term 2: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:11:06.757946 30727 raft_consensus.cc:2468] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:06.775065 31352 leader_election.cc:304] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:06.786267 31603 raft_consensus.cc:2804] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:06.789388 31603 raft_consensus.cc:697] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:06.792708 31603 consensus_queue.cc:237] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:06.816812 30400 catalog_manager.cc:5697] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 2 to 3, leader changed from ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.820394 30400 catalog_manager.cc:5697] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 2 to 3, leader changed from ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.823698 31399 raft_consensus.cc:1275] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.826584 30648 raft_consensus.cc:1275] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.827666 30400 catalog_manager.cc:5697] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 1 to 2, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.829334 31526 consensus_queue.cc:1048] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.829680 31559 consensus_queue.cc:1048] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.848932 30574 raft_consensus.cc:1275] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.854642 31559 consensus_queue.cc:1048] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:11:06.866830 30574 raft_consensus.cc:1275] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.869762 31496 consensus_queue.cc:1048] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:06.928045 31513 raft_consensus.cc:493] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.928565 31513 raft_consensus.cc:515] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:06.931178 31513 leader_election.cc:290] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:06.932663 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:06.941469 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:06.948745 31402 raft_consensus.cc:2468] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:11:06.942129 31603 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:06.950254 31603 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:06.952392 31603 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:06.954207 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:06.954952 30545 leader_election.cc:304] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:06.955214 30720 raft_consensus.cc:2468] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 4.
I20260709 13:11:06.956786 31582 raft_consensus.cc:2804] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.957226 31582 raft_consensus.cc:493] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.957578 31582 raft_consensus.cc:3060] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.959255 31352 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:11:06.960224 31603 raft_consensus.cc:2804] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:06.960651 31603 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce7bd1ecd6e44f32879851d7b3174acb)
I20260709 13:11:06.962446 31603 raft_consensus.cc:3060] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:06.963019 30402 catalog_manager.cc:5697] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 1 to 2, leader changed from ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.968386 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:06.971143 30648 raft_consensus.cc:2393] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 in current term 4: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:11:07.007838 30720 raft_consensus.cc:1275] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:07.009732 31501 consensus_queue.cc:1048] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:07.006275 31582 raft_consensus.cc:515] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:07.013233 31582 leader_election.cc:290] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:07.014824 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:07.018729 31603 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:07.022367 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:07.022943 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:07.023279 31394 raft_consensus.cc:3060] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.023774 30648 raft_consensus.cc:2393] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 in current term 4: Already voted for candidate e4b8e689773b4a9d8e6de6d82d225c0d in this term.
I20260709 13:11:07.025355 31603 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 4 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:07.025892 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9f8c7ed7744cb9b06471b91d2bec4a" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:07.032416 31394 raft_consensus.cc:2468] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 3.
I20260709 13:11:07.033939 30545 leader_election.cc:304] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:07.034766 31513 raft_consensus.cc:2804] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:07.034658 30727 raft_consensus.cc:2468] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 4.
I20260709 13:11:07.035439 31513 raft_consensus.cc:697] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:07.036265 31352 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:07.036904 31513 consensus_queue.cc:237] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:07.037580 31603 raft_consensus.cc:2804] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:07.038937 31603 raft_consensus.cc:697] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 4 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:07.040023 31603 consensus_queue.cc:237] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:07.052037 30574 raft_consensus.cc:1275] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:07.055526 31570 consensus_queue.cc:1048] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:07.071012 30403 catalog_manager.cc:5697] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.102710 30402 catalog_manager.cc:5697] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 3 to 4, leader changed from ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 4 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.110278 31520 raft_consensus.cc:493] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:07.110924 31520 raft_consensus.cc:515] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:07.113864 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:07.114697 31394 raft_consensus.cc:2368] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4b8e689773b4a9d8e6de6d82d225c0d for earlier term 2. Current term is 3.
I20260709 13:11:07.116957 30619 leader_election.cc:400] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027) with higher term. Message: Invalid argument: T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4b8e689773b4a9d8e6de6d82d225c0d for earlier term 2. Current term is 3.
I20260709 13:11:07.117267 30619 leader_election.cc:403] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:07.118167 31546 raft_consensus.cc:3060] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.122928 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4a06fb8568471d8db2b93426f9d678" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:07.124133 31520 leader_election.cc:290] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:07.125960 31546 raft_consensus.cc:2749] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027) with higher term. Message: Invalid argument: T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4b8e689773b4a9d8e6de6d82d225c0d for earlier term 2. Current term is 3.
I20260709 13:11:07.138652 30720 raft_consensus.cc:1275] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.140018 31603 consensus_queue.cc:1048] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.154675 30579 raft_consensus.cc:1275] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.156585 31556 consensus_queue.cc:1048] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.166898 30648 raft_consensus.cc:3060] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.184196 30648 raft_consensus.cc:1275] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:07.190039 31556 consensus_queue.cc:1048] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:07.217974 30729 raft_consensus.cc:1275] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:07.219960 31603 consensus_queue.cc:1048] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:07.299451 30579 raft_consensus.cc:1275] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.300830 31603 consensus_queue.cc:1048] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.312959 30720 raft_consensus.cc:1275] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.314667 31501 consensus_queue.cc:1048] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.359148 31520 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:07.359771 31520 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:07.362198 31520 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:07.363368 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:07.363535 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:07.364059 30579 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 2.
I20260709 13:11:07.364486 30720 raft_consensus.cc:2393] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4b8e689773b4a9d8e6de6d82d225c0d in current term 2: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:11:07.365226 30620 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:07.366139 31546 raft_consensus.cc:2804] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:07.366550 31546 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:07.367063 31546 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.375944 31546 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:07.379350 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:07.380280 30720 raft_consensus.cc:2393] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e4b8e689773b4a9d8e6de6d82d225c0d in current term 2: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:11:07.381819 31546 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:07.378892 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:07.390698 30579 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 2.
I20260709 13:11:07.391801 30620 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:07.392676 31520 raft_consensus.cc:2804] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:07.393177 31520 raft_consensus.cc:697] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:07.394029 31520 consensus_queue.cc:237] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:07.405732 30403 catalog_manager.cc:5697] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 1 to 2, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.524811 30647 raft_consensus.cc:1275] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:07.526216 31513 consensus_queue.cc:1048] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.544647 31394 raft_consensus.cc:1275] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:07.546397 31553 consensus_queue.cc:1048] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.558612 30729 raft_consensus.cc:1275] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:07.562106 31526 raft_consensus.cc:493] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.562804 31526 raft_consensus.cc:515] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:07.564347 31484 consensus_queue.cc:1048] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:07.564978 31526 leader_election.cc:290] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:07.566540 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:07.568307 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:07.568933 30579 raft_consensus.cc:2468] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:11:07.569914 30694 leader_election.cc:304] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:07.571437 31559 raft_consensus.cc:2804] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:07.571812 31559 raft_consensus.cc:493] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.572146 31559 raft_consensus.cc:3060] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.599028 31559 raft_consensus.cc:515] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:07.603312 30647 raft_consensus.cc:1275] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:07.603319 31559 leader_election.cc:290] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:07.605880 31556 consensus_queue.cc:1048] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:11:07.607643 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:07.608356 30575 raft_consensus.cc:3060] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.622018 30575 raft_consensus.cc:2468] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 3.
I20260709 13:11:07.623315 30694 leader_election.cc:304] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:07.624869 31526 raft_consensus.cc:2804] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:07.625427 31526 raft_consensus.cc:697] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 3 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:07.626401 31526 consensus_queue.cc:237] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:07.628598 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:07.670568 31501 raft_consensus.cc:493] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe9b995b077d4cb795f08934ed7d9088)
I20260709 13:11:07.671160 31501 raft_consensus.cc:515] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:07.673449 31501 leader_election.cc:290] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:07.675199 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:07.687335 30402 catalog_manager.cc:5697] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 3, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 3 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.679446 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df38dc922fb445c48c8c877918cea7db" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:07.692927 30575 raft_consensus.cc:2368] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 for earlier term 2. Current term is 3.
I20260709 13:11:07.700120 31351 leader_election.cc:400] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481) with higher term. Message: Invalid argument: T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 for earlier term 2. Current term is 3.
I20260709 13:11:07.702235 31351 leader_election.cc:403] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:07.702915 31570 raft_consensus.cc:3060] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.712790 31570 raft_consensus.cc:2749] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481) with higher term. Message: Invalid argument: T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eebf0fa5aba46afa04623642d7795e6 for earlier term 2. Current term is 3.
I20260709 13:11:07.811003 31630 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.812600 31630 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:07.814744 31630 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:07.816073 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:07.816864 30727 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 3.
I20260709 13:11:07.819597 30621 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:11:07.820487 31546 raft_consensus.cc:2804] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.820979 31546 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.821362 31546 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.829860 31394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6" is_pre_election: true
I20260709 13:11:07.830758 31394 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 2.
I20260709 13:11:07.867523 31546 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:07.869726 31546 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 4 election: Requested vote from peers ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:07.870456 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:07.871254 30727 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.871649 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:07.872291 31402 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.879745 31402 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 4.
I20260709 13:11:07.880920 30619 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:11:07.882125 31546 raft_consensus.cc:2804] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:07.882608 31546 raft_consensus.cc:697] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 LEADER]: Becoming Leader. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:07.883502 31546 consensus_queue.cc:237] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:07.884479 30727 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4b8e689773b4a9d8e6de6d82d225c0d in term 4.
I20260709 13:11:07.893014 30402 catalog_manager.cc:5697] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d reported cstate change: term changed from 2 to 4, leader changed from ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132) to e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131). New cstate: current_term: 4 leader_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.983596 30574 raft_consensus.cc:1275] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.988925 31559 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.989500 31559 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:07.991840 31559 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:07.996928 31546 consensus_queue.cc:1048] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.997917 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:07.999869 30727 raft_consensus.cc:1275] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.998466 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:08.001163 30574 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:11:08.001375 31546 consensus_queue.cc:1048] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.002388 30694 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:08.008718 31559 raft_consensus.cc:2804] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.017306 31559 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:08.024288 31559 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.121819 31559 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:08.122951 30727 raft_consensus.cc:1240] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Rejecting Update request from peer e4b8e689773b4a9d8e6de6d82d225c0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.127297 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:08.128048 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:08.131137 30694 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:08.131910 31526 raft_consensus.cc:2749] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.132768 31559 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
W20260709 13:11:08.144502 30621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.132:38089, user_credentials={real_user=slave}} blocked reactor thread for 66489.8us
I20260709 13:11:08.155112 31520 consensus_queue.cc:1059] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.165777 31534 raft_consensus.cc:3055] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:08.166222 31534 raft_consensus.cc:740] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:08.167881 31534 consensus_queue.cc:260] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:08.169561 31534 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.203591 31394 raft_consensus.cc:1275] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:08.205931 31559 consensus_queue.cc:1048] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.230165 30579 raft_consensus.cc:1275] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:08.232050 31526 consensus_queue.cc:1048] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.378731 30727 raft_consensus.cc:1275] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:08.380683 31520 consensus_queue.cc:1048] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:11:08.401166 31402 raft_consensus.cc:1275] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 4 FOLLOWER]: Refusing update from remote peer e4b8e689773b4a9d8e6de6d82d225c0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:08.410820 31635 consensus_queue.cc:1048] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:09.658984 31648 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:09.660820 31648 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:09.667694 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" is_pre_election: true
I20260709 13:11:09.668917 31648 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:09.669487 30727 raft_consensus.cc:2393] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 3: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:11:09.684995 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:09.686111 30646 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 3.
I20260709 13:11:09.691700 30546 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
W20260709 13:11:09.696800 31351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 45755.9us
I20260709 13:11:09.706681 31582 raft_consensus.cc:2804] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:09.707377 31582 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4b8e689773b4a9d8e6de6d82d225c0d)
I20260709 13:11:09.707860 31582 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:09.778949 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 48837.7us
W20260709 13:11:09.809044 30620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:37481, user_credentials={real_user=slave}} blocked reactor thread for 92662.2us
I20260709 13:11:09.815529 31582 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:09.817420 31582 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:09.818624 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:09.834005 30648 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 3.
I20260709 13:11:09.836350 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:09.837460 30720 raft_consensus.cc:2393] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe9b995b077d4cb795f08934ed7d9088 in current term 3: Already voted for candidate ce7bd1ecd6e44f32879851d7b3174acb in this term.
I20260709 13:11:09.854095 30546 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4b8e689773b4a9d8e6de6d82d225c0d, fe9b995b077d4cb795f08934ed7d9088; no voters: ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:09.855600 31582 raft_consensus.cc:2804] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:09.861317 31582 raft_consensus.cc:697] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:09.862741 31582 consensus_queue.cc:237] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:09.929540 30402 catalog_manager.cc:5697] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 2 to 3, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.036748 31559 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.037369 31559 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:10.039824 31559 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:10.041649 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" is_pre_election: true
I20260709 13:11:10.042538 30646 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 3.
I20260709 13:11:10.044049 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088" is_pre_election: true
I20260709 13:11:10.046509 30694 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:11:10.047590 31652 raft_consensus.cc:2804] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:10.047966 31652 raft_consensus.cc:493] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.048333 31652 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.069847 31652 raft_consensus.cc:515] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:10.072889 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:10.076232 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac028c5a7bd40c28ecec9a4bd1e83f0" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:10.076849 30646 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.089264 31652 leader_election.cc:290] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:10.091470 30646 raft_consensus.cc:2468] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 4.
I20260709 13:11:10.095552 30694 leader_election.cc:304] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:10.096477 31652 raft_consensus.cc:2804] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:10.096982 31652 raft_consensus.cc:697] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 4 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:10.097934 31652 consensus_queue.cc:237] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:10.108105 30402 catalog_manager.cc:5697] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 3 to 4, leader changed from fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 4 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.419942 30646 raft_consensus.cc:1240] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Rejecting Update request from peer fe9b995b077d4cb795f08934ed7d9088 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:10.421396 31513 consensus_queue.cc:1059] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:10.422258 31582 raft_consensus.cc:3055] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:10.422576 31582 raft_consensus.cc:740] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:10.423368 31582 consensus_queue.cc:260] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:10.424268 31582 raft_consensus.cc:3060] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.497716 30574 raft_consensus.cc:1275] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 4 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:11:10.498215 30574 pending_rounds.cc:85] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088: Aborting all ops after (but not including) 2
I20260709 13:11:10.498492 30574 pending_rounds.cc:107] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:11:10.498791 30574 raft_consensus.cc:2889] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:10.500196 31559 consensus_queue.cc:1048] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:10.522385 30646 raft_consensus.cc:1275] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:10.532763 31559 consensus_queue.cc:1048] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:12.434455 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:12.531865 30646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:12.532694 30646 raft_consensus.cc:606] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Received request to transfer leadership to TS 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:12.537568 30648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:12.538275 30648 raft_consensus.cc:606] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Received request to transfer leadership to TS 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:12.542686 30646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:12.543483 30646 raft_consensus.cc:606] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Received request to transfer leadership to TS 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:12.551226 30646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "fe9b995b077d4cb795f08934ed7d9088"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:12.551783 30646 raft_consensus.cc:606] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Received request to transfer leadership to TS fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:12.554277 30646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "fe9b995b077d4cb795f08934ed7d9088"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:12.555527 30646 raft_consensus.cc:606] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Received request to transfer leadership to TS fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:12.556991 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:12.558431 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:12.651926 31534 raft_consensus.cc:993] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower fe9b995b077d4cb795f08934ed7d9088 to start an election
I20260709 13:11:12.652758 31647 raft_consensus.cc:1081] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Signalling peer fe9b995b077d4cb795f08934ed7d9088 to start an election
I20260709 13:11:12.654538 30579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0"
dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
 from {username='slave'} at 127.0.0.1:36412
I20260709 13:11:12.655304 30579 raft_consensus.cc:493] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.655759 30579 raft_consensus.cc:3060] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.664700 30579 raft_consensus.cc:515] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:12.667301 30579 leader_election.cc:290] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:12.667565 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:12.668278 30646 raft_consensus.cc:3055] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.668609 30646 raft_consensus.cc:740] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:12.668682 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ffcc3dff924a86a1403a064784dba0" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:12.669275 30720 raft_consensus.cc:3060] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.669552 30646 consensus_queue.cc:260] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:12.670974 30646 raft_consensus.cc:3060] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.678614 30720 raft_consensus.cc:2468] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:11:12.680279 30547 leader_election.cc:304] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:12.681192 31513 raft_consensus.cc:2804] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:12.681641 31513 raft_consensus.cc:697] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:12.682462 31513 consensus_queue.cc:237] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:12.692638 30646 raft_consensus.cc:2468] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:11:12.697541 30403 catalog_manager.cc:5697] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 1 to 2, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.732437 31647 raft_consensus.cc:993] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower fe9b995b077d4cb795f08934ed7d9088 to start an election
I20260709 13:11:12.732957 31534 raft_consensus.cc:1081] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Signalling peer fe9b995b077d4cb795f08934ed7d9088 to start an election
I20260709 13:11:12.734584 30579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e"
dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
 from {username='slave'} at 127.0.0.1:36412
I20260709 13:11:12.735179 30579 raft_consensus.cc:493] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.735520 30579 raft_consensus.cc:3060] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.743654 30579 raft_consensus.cc:515] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:12.746227 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:12.746855 30646 raft_consensus.cc:3055] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.747135 30646 raft_consensus.cc:740] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:12.747980 30646 consensus_queue.cc:260] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:12.748895 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5c236d415d4a2ba5cab92446b2cc9e" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:12.749527 30720 raft_consensus.cc:3060] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.749634 30579 leader_election.cc:290] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:12.749115 30646 raft_consensus.cc:3060] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.760195 30720 raft_consensus.cc:2468] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:11:12.760749 30646 raft_consensus.cc:2468] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 2.
I20260709 13:11:12.761463 30547 leader_election.cc:304] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:12.762570 31513 raft_consensus.cc:2804] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:12.763048 31513 raft_consensus.cc:697] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:12.763746 31513 consensus_queue.cc:237] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:12.774487 31534 raft_consensus.cc:993] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:12.774974 31534 raft_consensus.cc:1081] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Signalling peer 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:12.776417 30403 catalog_manager.cc:5697] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 1 to 2, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.776945 31399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b"
dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:57196
I20260709 13:11:12.777607 31399 raft_consensus.cc:493] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.777988 31399 raft_consensus.cc:3060] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.804513 31399 raft_consensus.cc:515] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:12.807147 31399 leader_election.cc:290] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:12.810384 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:12.811064 30646 raft_consensus.cc:3055] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.811378 30646 raft_consensus.cc:740] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:12.811805 30720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c44012ec644ddbbe5ec4685054ed5b" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:12.812440 30720 raft_consensus.cc:3060] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.812184 30646 consensus_queue.cc:260] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:12.813666 30646 raft_consensus.cc:3060] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.820013 30720 raft_consensus.cc:2468] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:12.822261 31352 leader_election.cc:304] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, ce7bd1ecd6e44f32879851d7b3174acb; no voters: 
I20260709 13:11:12.823421 31666 raft_consensus.cc:2804] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:12.823951 31666 raft_consensus.cc:697] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:12.824954 31666 consensus_queue.cc:237] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:12.849210 30646 raft_consensus.cc:2468] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:12.854475 30403 catalog_manager.cc:5697] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 1 to 2, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.870756 31653 raft_consensus.cc:993] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:12.871330 31647 raft_consensus.cc:1081] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Signalling peer 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:12.872746 31399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210"
dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:57196
I20260709 13:11:12.873219 31399 raft_consensus.cc:493] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.873499 31399 raft_consensus.cc:3060] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.878461 31399 raft_consensus.cc:515] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:12.882217 31399 leader_election.cc:290] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:12.884013 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:12.884729 30647 raft_consensus.cc:3055] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.885043 30647 raft_consensus.cc:740] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:12.885959 30647 consensus_queue.cc:260] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:12.888388 30647 raft_consensus.cc:3060] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.891052 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90a5be13c8840bd8045433a356f8210" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:12.891726 30579 raft_consensus.cc:3060] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.897706 30647 raft_consensus.cc:2468] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:12.899215 31351 leader_election.cc:304] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:11:12.899991 31666 raft_consensus.cc:2804] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:12.900482 31666 raft_consensus.cc:697] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:12.901310 31666 consensus_queue.cc:237] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:12.903550 30579 raft_consensus.cc:2468] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:12.914175 30403 catalog_manager.cc:5697] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 1 to 2, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.944264 31653 raft_consensus.cc:993] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:12.944765 31653 raft_consensus.cc:1081] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Signalling peer 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:12.948426 31399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f"
dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:57196
I20260709 13:11:12.949061 31399 raft_consensus.cc:493] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.949484 31399 raft_consensus.cc:3060] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.959539 31399 raft_consensus.cc:515] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:12.961289 31399 leader_election.cc:290] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:12.962831 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:12.962962 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31877ad6fd384cf68ca3b0a20380b50f" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:12.964098 30647 raft_consensus.cc:3055] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.964795 30647 raft_consensus.cc:740] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:12.965281 30579 raft_consensus.cc:3060] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.966255 30647 consensus_queue.cc:260] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:12.968094 30647 raft_consensus.cc:3060] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.971112 30579 raft_consensus.cc:2468] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:12.973255 31351 leader_election.cc:304] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:12.974097 31666 raft_consensus.cc:2804] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:12.974606 31666 raft_consensus.cc:697] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:12.976313 31666 consensus_queue.cc:237] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:12.977383 30647 raft_consensus.cc:2468] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:12.988190 30403 catalog_manager.cc:5697] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 1 to 2, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.213255 30720 raft_consensus.cc:1275] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.214856 30647 raft_consensus.cc:1275] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.215162 31668 consensus_queue.cc:1048] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:13.216513 31513 consensus_queue.cc:1048] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.240933 30720 raft_consensus.cc:1275] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.244243 31668 consensus_queue.cc:1048] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:13.263813 30648 raft_consensus.cc:1275] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.265587 31668 consensus_queue.cc:1048] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.301149 30647 raft_consensus.cc:1275] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.303128 31666 consensus_queue.cc:1048] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.324867 30720 raft_consensus.cc:1275] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.327687 30579 raft_consensus.cc:1275] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.336714 31666 consensus_queue.cc:1048] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 13:11:13.399179 30694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 58706.7us
W20260709 13:11:13.400072 31351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 46980.7us
I20260709 13:11:13.402962 31690 consensus_queue.cc:1048] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:13.410174 30648 raft_consensus.cc:1275] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.423039 31690 consensus_queue.cc:1048] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.494836 30647 raft_consensus.cc:1275] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.496423 31690 consensus_queue.cc:1048] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.529450 30575 raft_consensus.cc:1275] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.532282 31691 consensus_queue.cc:1048] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.560257 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:13.602538 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:13.672433 30647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b9a111191e34c528c226549c74a4453"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:13.673125 30647 raft_consensus.cc:606] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Received request to transfer leadership to TS 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:13.676467 30647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:13.677076 30647 raft_consensus.cc:606] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Received request to transfer leadership to TS 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:13.679752 30647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65bf3caefe70453bbed914700540bef7"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:13.680337 30647 raft_consensus.cc:606] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Received request to transfer leadership to TS ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:13.682961 30647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:13.683597 30647 raft_consensus.cc:606] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 LEADER]: Received request to transfer leadership to TS 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:13.687197 30648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "fe9b995b077d4cb795f08934ed7d9088"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:13.687800 30648 raft_consensus.cc:606] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Received request to transfer leadership to TS fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:13.689110 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:13.690825 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:13.735879 31647 raft_consensus.cc:993] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower ce7bd1ecd6e44f32879851d7b3174acb to start an election
I20260709 13:11:13.736479 31647 raft_consensus.cc:1081] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Signalling peer ce7bd1ecd6e44f32879851d7b3174acb to start an election
I20260709 13:11:13.738202 30729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65bf3caefe70453bbed914700540bef7"
dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
 from {username='slave'} at 127.0.0.1:41788
I20260709 13:11:13.738765 30729 raft_consensus.cc:493] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.739118 30729 raft_consensus.cc:3060] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.746371 30729 raft_consensus.cc:515] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:13.748327 30729 leader_election.cc:290] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:13.749329 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf3caefe70453bbed914700540bef7" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:13.749960 30579 raft_consensus.cc:3060] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.751353 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf3caefe70453bbed914700540bef7" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:13.752628 30647 raft_consensus.cc:3055] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:13.753041 30647 raft_consensus.cc:740] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:13.753937 30647 consensus_queue.cc:260] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:13.755386 30647 raft_consensus.cc:3060] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.756129 30579 raft_consensus.cc:2468] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:11:13.757153 30694 leader_election.cc:304] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:13.757915 31693 raft_consensus.cc:2804] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:13.758380 31693 raft_consensus.cc:697] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:13.759235 31693 consensus_queue.cc:237] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:13.762820 30647 raft_consensus.cc:2468] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:11:13.770099 30402 catalog_manager.cc:5697] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.795161 31647 raft_consensus.cc:993] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:13.795645 31534 raft_consensus.cc:1081] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Signalling peer 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:13.797394 31399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad"
dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:57196
I20260709 13:11:13.797942 31399 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.798336 31399 raft_consensus.cc:3060] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.805576 31399 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:13.808467 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:13.809098 30647 raft_consensus.cc:3055] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:13.809401 30647 raft_consensus.cc:740] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:13.810163 30647 consensus_queue.cc:260] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:13.811116 31399 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:13.811283 30647 raft_consensus.cc:3060] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.813235 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f015cc36aa4db08cb18e49721204ad" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:13.813812 30729 raft_consensus.cc:3060] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.820658 30647 raft_consensus.cc:2468] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 3.
I20260709 13:11:13.822027 31351 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:11:13.823040 31698 raft_consensus.cc:2804] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:13.823544 31698 raft_consensus.cc:697] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 3 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:13.823407 30729 raft_consensus.cc:2468] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 3.
I20260709 13:11:13.824556 31698 consensus_queue.cc:237] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:13.836027 30402 catalog_manager.cc:5697] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 2 to 3, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.843318 31647 raft_consensus.cc:993] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:13.843794 31647 raft_consensus.cc:1081] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Signalling peer 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:13.846158 31402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b9a111191e34c528c226549c74a4453"
dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:57196
I20260709 13:11:13.846810 31402 raft_consensus.cc:493] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.847155 31402 raft_consensus.cc:3060] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.855260 31402 raft_consensus.cc:515] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:13.857386 31402 leader_election.cc:290] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:13.858505 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:13.858505 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9a111191e34c528c226549c74a4453" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:13.859269 30579 raft_consensus.cc:3060] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.859366 30647 raft_consensus.cc:3055] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:13.859742 30647 raft_consensus.cc:740] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:13.860496 30647 consensus_queue.cc:260] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:13.861756 30647 raft_consensus.cc:3060] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.866236 30579 raft_consensus.cc:2468] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:13.867676 31351 leader_election.cc:304] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:13.868602 30647 raft_consensus.cc:2468] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 2.
I20260709 13:11:13.869477 31698 raft_consensus.cc:2804] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:13.870748 31698 raft_consensus.cc:697] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:13.871729 31698 consensus_queue.cc:237] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:13.881526 31653 raft_consensus.cc:993] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower fe9b995b077d4cb795f08934ed7d9088 to start an election
I20260709 13:11:13.882256 31653 raft_consensus.cc:1081] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Signalling peer fe9b995b077d4cb795f08934ed7d9088 to start an election
I20260709 13:11:13.884259 30579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b"
dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
 from {username='slave'} at 127.0.0.1:36412
I20260709 13:11:13.885295 30579 raft_consensus.cc:493] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.897799 30579 raft_consensus.cc:3060] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.915544 30579 raft_consensus.cc:515] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:13.919867 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
I20260709 13:11:13.920465 31402 raft_consensus.cc:3060] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.928593 31402 raft_consensus.cc:2468] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 3.
I20260709 13:11:13.930126 30545 leader_election.cc:304] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:13.931303 31513 raft_consensus.cc:2804] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:13.931751 31513 raft_consensus.cc:697] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Becoming Leader. State: Replica: fe9b995b077d4cb795f08934ed7d9088, State: Running, Role: LEADER
I20260709 13:11:13.932618 31513 consensus_queue.cc:237] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:13.946666 30579 leader_election.cc:290] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [CANDIDATE]: Term 3 election: Requested vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:13.947523 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a0db3fa3f64190af9ad01781659e3b" candidate_uuid: "fe9b995b077d4cb795f08934ed7d9088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:13.948176 30647 raft_consensus.cc:3055] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:13.948478 30647 raft_consensus.cc:740] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:13.949303 30647 consensus_queue.cc:260] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:13.952122 30647 raft_consensus.cc:3060] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.959962 30647 raft_consensus.cc:2468] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9b995b077d4cb795f08934ed7d9088 in term 3.
I20260709 13:11:13.975208 30400 catalog_manager.cc:5697] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 reported cstate change: term changed from 2 to 3, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "fe9b995b077d4cb795f08934ed7d9088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.974684 30402 catalog_manager.cc:5697] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 1 to 2, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.094342 31647 raft_consensus.cc:993] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:14.094897 31653 raft_consensus.cc:1081] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 LEADER]: Signalling peer 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:14.096657 31402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59"
dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:57196
I20260709 13:11:14.097270 31402 raft_consensus.cc:493] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.097667 31402 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.105417 31402 raft_consensus.cc:515] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:14.108882 31402 leader_election.cc:290] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 5 election: Requested vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132:38089)
I20260709 13:11:14.111080 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:14.111773 30647 raft_consensus.cc:3055] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:14.111079 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684ac54b92e440b48092a7e38bd73e59" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
I20260709 13:11:14.112106 30647 raft_consensus.cc:740] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:14.112351 30727 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.113013 30647 consensus_queue.cc:260] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:14.114483 30647 raft_consensus.cc:3060] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.126154 30647 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 5.
I20260709 13:11:14.126266 30727 raft_consensus.cc:2468] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 5.
I20260709 13:11:14.127388 31351 leader_election.cc:304] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d; no voters: 
I20260709 13:11:14.128121 31707 raft_consensus.cc:2804] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:14.128635 31707 raft_consensus.cc:697] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 5 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:14.129500 31707 consensus_queue.cc:237] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:14.139256 30402 catalog_manager.cc:5697] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 4 to 5, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 5 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.217959 30579 raft_consensus.cc:1275] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.220053 31693 consensus_queue.cc:1048] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.260587 30647 raft_consensus.cc:1275] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.263619 31693 consensus_queue.cc:1048] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:14.329049 31394 raft_consensus.cc:1275] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:14.330219 31513 consensus_queue.cc:1048] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:14.337320 30579 raft_consensus.cc:1275] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.338759 31698 consensus_queue.cc:1048] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.342193 30647 raft_consensus.cc:1275] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Refusing update from remote peer fe9b995b077d4cb795f08934ed7d9088: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:14.347352 31682 consensus_queue.cc:1048] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:14.370398 30647 raft_consensus.cc:1275] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.372179 31707 consensus_queue.cc:1048] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.389304 30729 raft_consensus.cc:1275] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:14.392516 31707 consensus_queue.cc:1048] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:14.394330 30648 raft_consensus.cc:1275] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:14.400621 31667 consensus_queue.cc:1048] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:11:14.413160 30546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:34377, user_credentials={real_user=slave}} blocked reactor thread for 68180.4us
I20260709 13:11:14.691979 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:14.727784 30727 raft_consensus.cc:1275] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 5 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:14.729156 31666 consensus_queue.cc:1048] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:14.733500 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:14.739028 30648 raft_consensus.cc:1275] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 5 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:14.740477 31667 consensus_queue.cc:1048] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:14.801514 30648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:14.802193 30648 raft_consensus.cc:606] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Received request to transfer leadership to TS ce7bd1ecd6e44f32879851d7b3174acb
I20260709 13:11:14.805156 30648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84da8a48a44e4cbcb497791695726487"
dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
mode: GRACEFUL
new_leader_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:33500
I20260709 13:11:14.805843 30648 raft_consensus.cc:606] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Received request to transfer leadership to TS 5eebf0fa5aba46afa04623642d7795e6
I20260709 13:11:14.807209 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:14.808641 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:15.020188 31653 raft_consensus.cc:993] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:15.020812 31727 raft_consensus.cc:1081] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Signalling peer 5eebf0fa5aba46afa04623642d7795e6 to start an election
I20260709 13:11:15.022272 31394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84da8a48a44e4cbcb497791695726487"
dest_uuid: "5eebf0fa5aba46afa04623642d7795e6"
 from {username='slave'} at 127.0.0.1:57196
I20260709 13:11:15.022771 31394 raft_consensus.cc:493] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:15.023072 31394 raft_consensus.cc:3060] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.028575 31394 raft_consensus.cc:515] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:15.030884 31394 leader_election.cc:290] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:15.033617 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:15.031653 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84da8a48a44e4cbcb497791695726487" candidate_uuid: "5eebf0fa5aba46afa04623642d7795e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:15.038898 30574 raft_consensus.cc:3060] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.038220 30648 raft_consensus.cc:3055] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:15.043157 30648 raft_consensus.cc:740] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:15.046479 30574 raft_consensus.cc:2468] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 3.
I20260709 13:11:15.046490 30648 consensus_queue.cc:260] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:15.048002 31351 leader_election.cc:304] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:15.048015 30648 raft_consensus.cc:3060] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.048933 31707 raft_consensus.cc:2804] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:15.049561 31707 raft_consensus.cc:697] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 LEADER]: Becoming Leader. State: Replica: 5eebf0fa5aba46afa04623642d7795e6, State: Running, Role: LEADER
I20260709 13:11:15.050429 31707 consensus_queue.cc:237] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } }
I20260709 13:11:15.057660 30648 raft_consensus.cc:2468] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eebf0fa5aba46afa04623642d7795e6 in term 3.
I20260709 13:11:15.064826 30402 catalog_manager.cc:5697] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 reported cstate change: term changed from 2 to 3, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "5eebf0fa5aba46afa04623642d7795e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.094242 31653 raft_consensus.cc:993] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d: : Instructing follower ce7bd1ecd6e44f32879851d7b3174acb to start an election
I20260709 13:11:15.094837 31727 raft_consensus.cc:1081] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Signalling peer ce7bd1ecd6e44f32879851d7b3174acb to start an election
I20260709 13:11:15.097472 30729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e"
dest_uuid: "ce7bd1ecd6e44f32879851d7b3174acb"
 from {username='slave'} at 127.0.0.1:41788
I20260709 13:11:15.097949 30729 raft_consensus.cc:493] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:15.098239 30729 raft_consensus.cc:3060] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:15.104244 30729 raft_consensus.cc:515] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:15.106120 30729 leader_election.cc:290] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Requested vote from peers fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481), e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377)
I20260709 13:11:15.106812 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe9b995b077d4cb795f08934ed7d9088"
I20260709 13:11:15.107041 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a2ea7040e149929599d0d145c8264e" candidate_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d"
I20260709 13:11:15.107434 30579 raft_consensus.cc:3060] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:15.107656 30648 raft_consensus.cc:3055] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:15.108008 30648 raft_consensus.cc:740] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4b8e689773b4a9d8e6de6d82d225c0d, State: Running, Role: LEADER
I20260709 13:11:15.108668 30648 consensus_queue.cc:260] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:15.109591 30648 raft_consensus.cc:3060] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:15.112388 30579 raft_consensus.cc:2468] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:11:15.113575 30694 leader_election.cc:304] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb, fe9b995b077d4cb795f08934ed7d9088; no voters: 
I20260709 13:11:15.114456 30648 raft_consensus.cc:2468] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce7bd1ecd6e44f32879851d7b3174acb in term 2.
I20260709 13:11:15.114450 31710 raft_consensus.cc:2804] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:15.115797 31710 raft_consensus.cc:697] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Becoming Leader. State: Replica: ce7bd1ecd6e44f32879851d7b3174acb, State: Running, Role: LEADER
I20260709 13:11:15.116727 31710 consensus_queue.cc:237] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } }
I20260709 13:11:15.126570 30402 catalog_manager.cc:5697] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb reported cstate change: term changed from 1 to 2, leader changed from e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131) to ce7bd1ecd6e44f32879851d7b3174acb (127.19.231.132). New cstate: current_term: 2 leader_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.457690 30646 raft_consensus.cc:1275] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:15.458601 30579 raft_consensus.cc:1275] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Refusing update from remote peer 5eebf0fa5aba46afa04623642d7795e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:15.459215 31667 consensus_queue.cc:1048] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:15.460004 31698 consensus_queue.cc:1048] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:15.541096 30579 raft_consensus.cc:1275] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:15.542980 31662 consensus_queue.cc:1048] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:15.554543 30648 raft_consensus.cc:1275] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Refusing update from remote peer ce7bd1ecd6e44f32879851d7b3174acb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:15.555977 31662 consensus_queue.cc:1048] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:15.809430 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:15.848341 20382 tablet_server.cc:179] TabletServer@127.19.231.129:44027 shutting down...
I20260709 13:11:15.885330 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:15.886358 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.887506 20382 raft_consensus.cc:2243] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.888089 20382 raft_consensus.cc:2272] T 723f558d9f1b4b448a1d027e5e116bf2 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:15.888346 30693 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 112 similar messages]
W20260709 13:11:15.891978 30693 consensus_peers.cc:597] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:15.892097 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.893049 20382 raft_consensus.cc:2243] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.893600 20382 raft_consensus.cc:2272] T 8ec7a3e0f271468aa4e4809f9707f7a3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.896129 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.896996 20382 raft_consensus.cc:2243] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.897523 20382 raft_consensus.cc:2272] T c7e3aaad672f42e5838c628da427a0b7 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:15.898607 30545 consensus_peers.cc:597] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:15.900105 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.900843 20382 raft_consensus.cc:2243] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:15.901595 20382 raft_consensus.cc:2272] T 31877ad6fd384cf68ca3b0a20380b50f P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.903744 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.904390 20382 raft_consensus.cc:2243] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:11:15.905161 20382 raft_consensus.cc:2272] T 684ac54b92e440b48092a7e38bd73e59 P 5eebf0fa5aba46afa04623642d7795e6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.908105 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.909237 20382 raft_consensus.cc:2243] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.909879 20382 raft_consensus.cc:2272] T 71865a4b38b04d879e4188a8eebba7e7 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:15.910658 30545 consensus_peers.cc:597] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:15.912724 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.913461 20382 raft_consensus.cc:2243] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.913931 20382 raft_consensus.cc:2272] T a1acee1ab5494c3a87ba7e6a84ef73cf P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.916158 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.916843 20382 raft_consensus.cc:2243] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:15.917627 20382 raft_consensus.cc:2272] T 0b9a111191e34c528c226549c74a4453 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.920699 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.921590 20382 raft_consensus.cc:2243] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.922147 20382 raft_consensus.cc:2272] T 26ec91d866c84f30813b1d51ebf9a214 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:15.922820 30545 consensus_peers.cc:597] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:15.925172 20382 tablet_replica.cc:333] stopping tablet replica
W20260709 13:11:15.925745 30693 consensus_peers.cc:597] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:15.926189 20382 raft_consensus.cc:2243] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.926854 20382 raft_consensus.cc:2272] T ff5f081bede942ccbbb7ab42a42bf354 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.929445 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.930073 20382 raft_consensus.cc:2243] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:15.930925 20382 raft_consensus.cc:2272] T 8a3a53f4eac747b2b57fe6b5c5516cee P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.933243 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.933852 20382 raft_consensus.cc:2243] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:15.934674 20382 raft_consensus.cc:2272] T 84da8a48a44e4cbcb497791695726487 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.938032 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.939023 20382 raft_consensus.cc:2243] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:15.940093 20382 raft_consensus.cc:2272] T 9c9f8c7ed7744cb9b06471b91d2bec4a P 5eebf0fa5aba46afa04623642d7795e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.942215 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.942719 20382 raft_consensus.cc:2243] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:15.943544 20382 raft_consensus.cc:2272] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.946048 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.946774 20382 raft_consensus.cc:2243] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.947299 20382 raft_consensus.cc:2272] T df38dc922fb445c48c8c877918cea7db P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:15.948307 30545 consensus_peers.cc:597] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:15.950069 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.951023 20382 raft_consensus.cc:2243] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.951622 20382 raft_consensus.cc:2272] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.954377 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.955077 20382 raft_consensus.cc:2243] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.955528 20382 raft_consensus.cc:2272] T c8653cfe6a71495f8708ab4726905d40 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.957574 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.958186 20382 raft_consensus.cc:2243] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.958683 20382 raft_consensus.cc:2272] T efe10cb5a2eb471f86bec2723e5dbe97 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.960884 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.961444 20382 raft_consensus.cc:2243] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.961930 20382 raft_consensus.cc:2272] T 3253c47b0c1749e39622495eb339195c P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.964010 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.964579 20382 raft_consensus.cc:2243] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:15.965328 20382 raft_consensus.cc:2272] T a90a5be13c8840bd8045433a356f8210 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.967361 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.967963 20382 raft_consensus.cc:2243] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.968394 20382 raft_consensus.cc:2272] T ed4a06fb8568471d8db2b93426f9d678 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.970525 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.971160 20382 raft_consensus.cc:2243] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.971604 20382 raft_consensus.cc:2272] T aedcef0a31d14c3e90d15d1bbbf329c2 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.973942 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.974575 20382 raft_consensus.cc:2243] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.975080 20382 raft_consensus.cc:2272] T f4a0db3fa3f64190af9ad01781659e3b P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.977620 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.978282 20382 raft_consensus.cc:2243] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.978883 20382 raft_consensus.cc:2272] T 059a9c51005141eb9c585ad91a67d779 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.981648 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.982462 20382 raft_consensus.cc:2243] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.983083 20382 raft_consensus.cc:2272] T fafe994543a04390ab335d1abeaa6f4e P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.986297 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.987322 20382 raft_consensus.cc:2243] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:15.988473 20382 raft_consensus.cc:2272] T 55d1b96e1d27444ebfb159aae9bbe85b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.992259 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.993194 20382 raft_consensus.cc:2243] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.993891 20382 raft_consensus.cc:2272] T ba73d0b006bc437393ba09c76a909614 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:15.994946 30619 consensus_peers.cc:597] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:15.997009 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:15.998109 20382 raft_consensus.cc:2243] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.998818 20382 raft_consensus.cc:2272] T 2b210bd1ede94a3abb6560f301be6a7b P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.001405 30545 consensus_peers.cc:597] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.001780 20382 tablet_replica.cc:333] stopping tablet replica
W20260709 13:11:16.002007 30693 consensus_peers.cc:597] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.002564 20382 raft_consensus.cc:2243] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.003551 20382 raft_consensus.cc:2272] T 056efc360d6c4950a5e033e7a145395e P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.005607 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.006174 20382 raft_consensus.cc:2243] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.006584 20382 raft_consensus.cc:2272] T a8fb5e8eecef48b5831eb8cf4003e561 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.009434 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.010277 20382 raft_consensus.cc:2243] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.010645 20382 raft_consensus.cc:2272] T 497e9f19c992474c92f71cf517d1adfb P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.012938 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.013494 20382 raft_consensus.cc:2243] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.013963 20382 raft_consensus.cc:2272] T 87fb671441fb4addaa5108aea6093d4f P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.016821 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.017510 20382 raft_consensus.cc:2243] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.018466 20382 raft_consensus.cc:2272] T 23f015cc36aa4db08cb18e49721204ad P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.018582 30693 consensus_peers.cc:597] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.021164 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.021847 20382 raft_consensus.cc:2243] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.022764 20382 raft_consensus.cc:2272] T ec3860c6607e4192b0fa932efa48a730 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.025771 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.026472 20382 raft_consensus.cc:2243] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:16.026520 30619 consensus_peers.cc:597] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.027173 20382 raft_consensus.cc:2272] T 018c73c344ee48698633b2153ac2bce0 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.030202 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.031075 20382 raft_consensus.cc:2243] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.031710 20382 raft_consensus.cc:2272] T eacc589c8fd4465d9a8549c531711c32 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.033156 30545 consensus_peers.cc:597] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.034175 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.034880 20382 raft_consensus.cc:2243] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.035312 20382 raft_consensus.cc:2272] T 04593214c5bf43b6b52bc5d7b4d27ee1 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.037412 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.037930 20382 raft_consensus.cc:2243] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.038646 20382 raft_consensus.cc:2272] T 40c44012ec644ddbbe5ec4685054ed5b P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.040692 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.041250 20382 raft_consensus.cc:2243] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.041755 20382 raft_consensus.cc:2272] T 155c2eeaa7cc439c8c8e42ec57accfd3 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.043851 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.044325 20382 raft_consensus.cc:2243] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.044653 20382 raft_consensus.cc:2272] T 03df1e0d5cf741c0b915e09e00ebc9d3 P 5eebf0fa5aba46afa04623642d7795e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.046973 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.047775 20382 raft_consensus.cc:2243] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.048833 20382 raft_consensus.cc:2272] T e4221f91ccf44480aa2e341f14c10588 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.050058 30545 consensus_peers.cc:597] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.051647 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.052403 20382 raft_consensus.cc:2243] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.053243 20382 raft_consensus.cc:2272] T ecb61d7cc4374a2ba332ae4af88d0f63 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.055737 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.056409 20382 raft_consensus.cc:2243] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.056927 20382 raft_consensus.cc:2272] T 7904d28f33ba4b9298735fe0bbaf6855 P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.060149 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.061055 20382 raft_consensus.cc:2243] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.061596 20382 raft_consensus.cc:2272] T c60650c912f44bac84d7e81cf49ad99d P 5eebf0fa5aba46afa04623642d7795e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.063803 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.064284 20382 raft_consensus.cc:2243] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.065075 20382 raft_consensus.cc:2272] T 17ca8d69123d49ada168ec5581c199d4 P 5eebf0fa5aba46afa04623642d7795e6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.098418 30693 consensus_peers.cc:597] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.099717 30619 consensus_peers.cc:597] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.125370 30693 consensus_peers.cc:597] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.161072 30693 consensus_peers.cc:597] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.161463 30619 consensus_peers.cc:597] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.164081 30619 consensus_peers.cc:597] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.164546 30619 consensus_peers.cc:597] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.190186 30693 consensus_peers.cc:597] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.196640 20382 tablet_server.cc:196] TabletServer@127.19.231.129:44027 shutdown complete.
W20260709 13:11:16.236742 30693 consensus_peers.cc:597] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.245431 30545 consensus_peers.cc:597] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.249835 30619 consensus_peers.cc:597] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.250286 30545 consensus_peers.cc:597] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.270252 30545 consensus_peers.cc:597] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.284976 20382 tablet_server.cc:179] TabletServer@127.19.231.130:0 shutting down...
W20260709 13:11:16.296095 30619 consensus_peers.cc:597] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.301151 30619 consensus_peers.cc:597] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.330152 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:16.331183 20382 tablet_replica.cc:333] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.331924 20382 raft_consensus.cc:2243] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.332440 20382 raft_consensus.cc:2272] T e4221f91ccf44480aa2e341f14c10588 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.334450 20382 tablet_replica.cc:333] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.335183 20382 raft_consensus.cc:2243] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.336033 20382 raft_consensus.cc:2272] T 8ec7a3e0f271468aa4e4809f9707f7a3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.338428 20382 tablet_replica.cc:333] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.339109 20382 raft_consensus.cc:2243] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.339648 20382 raft_consensus.cc:2272] T 056efc360d6c4950a5e033e7a145395e P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.341022 30694 consensus_peers.cc:597] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.341913 20382 tablet_replica.cc:333] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.342564 20382 raft_consensus.cc:2243] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.343029 20382 raft_consensus.cc:2272] T 52a2ea7040e149929599d0d145c8264e P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.345496 20382 tablet_replica.cc:333] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.346158 20382 raft_consensus.cc:2243] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.346593 20382 raft_consensus.cc:2272] T 0b9a111191e34c528c226549c74a4453 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.349239 20382 tablet_replica.cc:333] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.350059 20382 raft_consensus.cc:2243] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.350566 20382 raft_consensus.cc:2272] T 03df1e0d5cf741c0b915e09e00ebc9d3 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.350867 30545 consensus_peers.cc:597] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 -> Peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Couldn't send request to peer 5eebf0fa5aba46afa04623642d7795e6. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.352741 20382 tablet_replica.cc:333] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.353457 20382 raft_consensus.cc:2243] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.353912 20382 raft_consensus.cc:2272] T ff5f081bede942ccbbb7ab42a42bf354 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.355885 20382 tablet_replica.cc:333] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.356459 20382 raft_consensus.cc:2243] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.357532 20382 raft_consensus.cc:2272] T 26ec91d866c84f30813b1d51ebf9a214 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.360474 20382 tablet_replica.cc:333] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.361173 20382 raft_consensus.cc:2243] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:16.361217 30694 consensus_peers.cc:597] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.361694 20382 raft_consensus.cc:2272] T f8d68b0f1c1e48609d42244622ea1d7c P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.363806 20382 tablet_replica.cc:333] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.364336 20382 raft_consensus.cc:2243] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.365126 20382 raft_consensus.cc:2272] T fafe994543a04390ab335d1abeaa6f4e P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.367292 20382 tablet_replica.cc:333] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.368119 20382 raft_consensus.cc:2243] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.368719 20382 raft_consensus.cc:2272] T 55d1b96e1d27444ebfb159aae9bbe85b P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.371634 20382 tablet_replica.cc:333] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.372323 20382 raft_consensus.cc:2243] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:16.372570 30620 consensus_peers.cc:597] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.372872 20382 raft_consensus.cc:2272] T 9687bd5f80bd4d869a68cbbecda69806 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.373276 30620 consensus_peers.cc:597] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.374725 30694 consensus_peers.cc:597] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.375742 20382 tablet_replica.cc:333] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.376387 20382 raft_consensus.cc:2243] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.376823 20382 raft_consensus.cc:2272] T 27a322c98a8d493ab4377fe92a1c01db P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.378878 20382 tablet_replica.cc:333] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.379469 20382 raft_consensus.cc:2243] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.379914 20382 raft_consensus.cc:2272] T d758ec9801614080a6a30dd820a62459 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.382019 20382 tablet_replica.cc:333] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.382869 20382 raft_consensus.cc:2243] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.383374 20382 raft_consensus.cc:2272] T 71865a4b38b04d879e4188a8eebba7e7 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.385483 20382 tablet_replica.cc:333] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.386019 20382 raft_consensus.cc:2243] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.386746 20382 raft_consensus.cc:2272] T f4a0db3fa3f64190af9ad01781659e3b P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.388615 20382 tablet_replica.cc:333] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.389145 20382 raft_consensus.cc:2243] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.389590 20382 raft_consensus.cc:2272] T 9b693fc5a9c3477a87a09ce7d3c57859 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.391557 20382 tablet_replica.cc:333] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.392127 20382 raft_consensus.cc:2243] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.392562 20382 raft_consensus.cc:2272] T a90a5be13c8840bd8045433a356f8210 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.394328 20382 tablet_replica.cc:333] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.394937 20382 raft_consensus.cc:2243] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.395740 20382 raft_consensus.cc:2272] T ed4a06fb8568471d8db2b93426f9d678 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.397632 20382 tablet_replica.cc:333] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.398175 20382 raft_consensus.cc:2243] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.398622 20382 raft_consensus.cc:2272] T fac028c5a7bd40c28ecec9a4bd1e83f0 P fe9b995b077d4cb795f08934ed7d9088 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.400486 20382 tablet_replica.cc:333] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.401005 20382 raft_consensus.cc:2243] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.401937 20382 raft_consensus.cc:2272] T eacc589c8fd4465d9a8549c531711c32 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.411887 20382 tablet_replica.cc:333] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.412943 20382 raft_consensus.cc:2243] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.413695 20382 raft_consensus.cc:2272] T 84da8a48a44e4cbcb497791695726487 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.418059 20382 tablet_replica.cc:333] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.419298 20382 raft_consensus.cc:2243] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.420017 20382 raft_consensus.cc:2272] T 17a1eefeef3847b8ad88b05ca970c43f P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.423359 20382 tablet_replica.cc:333] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.423902 20382 raft_consensus.cc:2243] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.424686 20382 raft_consensus.cc:2272] T 155c2eeaa7cc439c8c8e42ec57accfd3 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.426921 20382 tablet_replica.cc:333] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.427476 20382 raft_consensus.cc:2243] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.428244 20382 raft_consensus.cc:2272] T efe10cb5a2eb471f86bec2723e5dbe97 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.430466 20382 tablet_replica.cc:333] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.431241 20382 raft_consensus.cc:2243] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.431758 20382 raft_consensus.cc:2272] T 65bf3caefe70453bbed914700540bef7 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.433683 30694 consensus_peers.cc:597] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.434118 20382 tablet_replica.cc:333] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.434835 20382 raft_consensus.cc:2243] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.435376 20382 raft_consensus.cc:2272] T 04593214c5bf43b6b52bc5d7b4d27ee1 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.437865 20382 tablet_replica.cc:333] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.438529 20382 raft_consensus.cc:2243] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.438989 20382 raft_consensus.cc:2272] T 4a479c021bcf40f087e21cf6099daeb0 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.441020 20382 tablet_replica.cc:333] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.441740 20382 raft_consensus.cc:2243] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.442545 20382 raft_consensus.cc:2272] T b2ffcc3dff924a86a1403a064784dba0 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.445000 20382 tablet_replica.cc:333] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.445699 20382 raft_consensus.cc:2243] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.446269 20382 raft_consensus.cc:2272] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.448937 20382 tablet_replica.cc:333] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.449644 20382 raft_consensus.cc:2243] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.450173 20382 raft_consensus.cc:2272] T 7904d28f33ba4b9298735fe0bbaf6855 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.452739 20382 tablet_replica.cc:333] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.453286 20382 raft_consensus.cc:2243] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.453979 20382 raft_consensus.cc:2272] T c60650c912f44bac84d7e81cf49ad99d P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.455909 20382 tablet_replica.cc:333] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.456389 20382 raft_consensus.cc:2243] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.456799 20382 raft_consensus.cc:2272] T 17ca8d69123d49ada168ec5581c199d4 P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.458699 20382 tablet_replica.cc:333] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.459237 20382 raft_consensus.cc:2243] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.459609 20382 raft_consensus.cc:2272] T 5ca31368027748349419b6fe09ea1375 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.461490 20382 tablet_replica.cc:333] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.462023 20382 raft_consensus.cc:2243] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.462882 20382 raft_consensus.cc:2272] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.464802 20382 tablet_replica.cc:333] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.465337 20382 raft_consensus.cc:2243] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.465783 20382 raft_consensus.cc:2272] T df38dc922fb445c48c8c877918cea7db P fe9b995b077d4cb795f08934ed7d9088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.467855 20382 tablet_replica.cc:333] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.468394 20382 raft_consensus.cc:2243] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.468855 20382 raft_consensus.cc:2272] T c8653cfe6a71495f8708ab4726905d40 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.470738 20382 tablet_replica.cc:333] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.471284 20382 raft_consensus.cc:2243] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.471714 20382 raft_consensus.cc:2272] T 497e9f19c992474c92f71cf517d1adfb P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.473711 20382 tablet_replica.cc:333] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.474233 20382 raft_consensus.cc:2243] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.474689 20382 raft_consensus.cc:2272] T e0c896f7c3954b098ac0769a5ce664a1 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.476877 20382 tablet_replica.cc:333] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.477404 20382 raft_consensus.cc:2243] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.478199 20382 raft_consensus.cc:2272] T ba73d0b006bc437393ba09c76a909614 P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.480238 20382 tablet_replica.cc:333] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.480794 20382 raft_consensus.cc:2243] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.481616 20382 raft_consensus.cc:2272] T c7e3aaad672f42e5838c628da427a0b7 P fe9b995b077d4cb795f08934ed7d9088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.483789 20382 tablet_replica.cc:333] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.484453 20382 raft_consensus.cc:2243] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.484900 20382 raft_consensus.cc:2272] T 31877ad6fd384cf68ca3b0a20380b50f P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.486951 20382 tablet_replica.cc:333] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.487447 20382 raft_consensus.cc:2243] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.487916 20382 raft_consensus.cc:2272] T 8a3a53f4eac747b2b57fe6b5c5516cee P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.489790 20382 tablet_replica.cc:333] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088: stopping tablet replica
I20260709 13:11:16.490175 20382 raft_consensus.cc:2243] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.490909 20382 raft_consensus.cc:2272] T fe5c236d415d4a2ba5cab92446b2cc9e P fe9b995b077d4cb795f08934ed7d9088 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.533608 30694 consensus_peers.cc:597] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.559597 30694 consensus_peers.cc:597] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.560181 20382 tablet_server.cc:196] TabletServer@127.19.231.130:0 shutdown complete.
W20260709 13:11:16.562361 30620 consensus_peers.cc:597] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.565200 30694 consensus_peers.cc:597] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.573474 30694 consensus_peers.cc:597] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.608314 30620 consensus_peers.cc:597] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.631551 30620 consensus_peers.cc:597] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.644460 30694 consensus_peers.cc:597] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.652164 20382 tablet_server.cc:179] TabletServer@127.19.231.131:0 shutting down...
W20260709 13:11:16.660957 30620 consensus_peers.cc:597] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.694262 30620 consensus_peers.cc:597] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.694964 30620 consensus_peers.cc:597] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.699039 30694 consensus_peers.cc:597] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.717583 30694 consensus_peers.cc:597] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.726521 30620 consensus_peers.cc:597] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.729702 30694 consensus_peers.cc:597] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.731542 30694 consensus_peers.cc:597] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.735952 30694 consensus_peers.cc:597] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.737171 30620 consensus_peers.cc:597] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d -> Peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Couldn't send request to peer fe9b995b077d4cb795f08934ed7d9088. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.739804 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:16.740834 20382 tablet_replica.cc:333] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.741772 20382 raft_consensus.cc:2243] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.742372 20382 raft_consensus.cc:2272] T e4221f91ccf44480aa2e341f14c10588 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.745370 20382 tablet_replica.cc:333] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.746182 20382 raft_consensus.cc:2243] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.747320 20382 raft_consensus.cc:2272] T 2b210bd1ede94a3abb6560f301be6a7b P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.750238 20382 tablet_replica.cc:333] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.751029 20382 raft_consensus.cc:2243] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.751614 20382 raft_consensus.cc:2272] T 056efc360d6c4950a5e033e7a145395e P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.754336 20382 tablet_replica.cc:333] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.755209 20382 raft_consensus.cc:2243] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.755728 20382 raft_consensus.cc:2272] T 8ec7a3e0f271468aa4e4809f9707f7a3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.758423 20382 tablet_replica.cc:333] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.759244 20382 raft_consensus.cc:2243] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.760236 20382 raft_consensus.cc:2272] T 723f558d9f1b4b448a1d027e5e116bf2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.762892 20382 tablet_replica.cc:333] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.763595 20382 raft_consensus.cc:2243] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.764072 20382 raft_consensus.cc:2272] T 52a2ea7040e149929599d0d145c8264e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.766629 20382 tablet_replica.cc:333] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.767475 20382 raft_consensus.cc:2243] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.767987 20382 raft_consensus.cc:2272] T 17a1eefeef3847b8ad88b05ca970c43f P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.770660 20382 tablet_replica.cc:333] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.771443 20382 raft_consensus.cc:2243] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.771930 20382 raft_consensus.cc:2272] T 40c44012ec644ddbbe5ec4685054ed5b P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.774338 20382 tablet_replica.cc:333] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.775007 20382 raft_consensus.cc:2243] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.775560 20382 raft_consensus.cc:2272] T a8fb5e8eecef48b5831eb8cf4003e561 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.778182 20382 tablet_replica.cc:333] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.778968 20382 raft_consensus.cc:2243] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.779470 20382 raft_consensus.cc:2272] T 0b9a111191e34c528c226549c74a4453 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.781805 20382 tablet_replica.cc:333] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.782526 20382 raft_consensus.cc:2243] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.783543 20382 raft_consensus.cc:2272] T 03df1e0d5cf741c0b915e09e00ebc9d3 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.786235 20382 tablet_replica.cc:333] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.787101 20382 raft_consensus.cc:2243] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.787577 20382 raft_consensus.cc:2272] T b2ffcc3dff924a86a1403a064784dba0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.790105 20382 tablet_replica.cc:333] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.790880 20382 raft_consensus.cc:2243] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.791347 20382 raft_consensus.cc:2272] T 9c9f8c7ed7744cb9b06471b91d2bec4a P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.793285 20382 tablet_replica.cc:333] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.793826 20382 raft_consensus.cc:2243] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.794279 20382 raft_consensus.cc:2272] T 059a9c51005141eb9c585ad91a67d779 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.796263 20382 tablet_replica.cc:333] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.796836 20382 raft_consensus.cc:2243] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.797276 20382 raft_consensus.cc:2272] T f8d68b0f1c1e48609d42244622ea1d7c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.799226 20382 tablet_replica.cc:333] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.799786 20382 raft_consensus.cc:2243] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.800206 20382 raft_consensus.cc:2272] T 31877ad6fd384cf68ca3b0a20380b50f P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.802101 20382 tablet_replica.cc:333] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.802664 20382 raft_consensus.cc:2243] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.803140 20382 raft_consensus.cc:2272] T c7e3aaad672f42e5838c628da427a0b7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.805016 20382 tablet_replica.cc:333] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.805574 20382 raft_consensus.cc:2243] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.806334 20382 raft_consensus.cc:2272] T aedcef0a31d14c3e90d15d1bbbf329c2 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.808212 20382 tablet_replica.cc:333] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.808780 20382 raft_consensus.cc:2243] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.809198 20382 raft_consensus.cc:2272] T f4a0db3fa3f64190af9ad01781659e3b P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.811075 20382 tablet_replica.cc:333] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.811632 20382 raft_consensus.cc:2243] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.812431 20382 raft_consensus.cc:2272] T 9b693fc5a9c3477a87a09ce7d3c57859 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.814271 20382 tablet_replica.cc:333] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.814986 20382 raft_consensus.cc:2243] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.815538 20382 raft_consensus.cc:2272] T ed4a06fb8568471d8db2b93426f9d678 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.818035 20382 tablet_replica.cc:333] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.818778 20382 raft_consensus.cc:2243] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.819289 20382 raft_consensus.cc:2272] T a90a5be13c8840bd8045433a356f8210 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.821532 20382 tablet_replica.cc:333] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.822073 20382 raft_consensus.cc:2243] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.822503 20382 raft_consensus.cc:2272] T 84da8a48a44e4cbcb497791695726487 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.824543 20382 tablet_replica.cc:333] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.825091 20382 raft_consensus.cc:2243] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.825836 20382 raft_consensus.cc:2272] T 9687bd5f80bd4d869a68cbbecda69806 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.827720 20382 tablet_replica.cc:333] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.828250 20382 raft_consensus.cc:2243] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.829043 20382 raft_consensus.cc:2272] T 27a322c98a8d493ab4377fe92a1c01db P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.831379 20382 tablet_replica.cc:333] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.832090 20382 raft_consensus.cc:2243] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:16.832201 30694 consensus_peers.cc:597] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.832674 20382 raft_consensus.cc:2272] T fe5c236d415d4a2ba5cab92446b2cc9e P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.834916 20382 tablet_replica.cc:333] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.835484 20382 raft_consensus.cc:2243] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.835947 20382 raft_consensus.cc:2272] T 018c73c344ee48698633b2153ac2bce0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.837929 20382 tablet_replica.cc:333] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.838555 20382 raft_consensus.cc:2243] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.839367 20382 raft_consensus.cc:2272] T 4a479c021bcf40f087e21cf6099daeb0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.841251 20382 tablet_replica.cc:333] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.841800 20382 raft_consensus.cc:2243] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.842620 20382 raft_consensus.cc:2272] T 497e9f19c992474c92f71cf517d1adfb P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.845348 20382 tablet_replica.cc:333] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.846082 20382 raft_consensus.cc:2243] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.847044 20382 raft_consensus.cc:2272] T 87fb671441fb4addaa5108aea6093d4f P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.849403 20382 tablet_replica.cc:333] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.849947 20382 raft_consensus.cc:2243] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.850371 20382 raft_consensus.cc:2272] T 23f015cc36aa4db08cb18e49721204ad P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.852600 20382 tablet_replica.cc:333] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.853199 20382 raft_consensus.cc:2243] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.853672 20382 raft_consensus.cc:2272] T ec3860c6607e4192b0fa932efa48a730 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.855659 20382 tablet_replica.cc:333] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.856209 20382 raft_consensus.cc:2243] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.856653 20382 raft_consensus.cc:2272] T ecb61d7cc4374a2ba332ae4af88d0f63 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.858626 20382 tablet_replica.cc:333] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.859179 20382 raft_consensus.cc:2243] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.859970 20382 raft_consensus.cc:2272] T 5ca31368027748349419b6fe09ea1375 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.861855 20382 tablet_replica.cc:333] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.862468 20382 raft_consensus.cc:2243] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.863260 20382 raft_consensus.cc:2272] T c8653cfe6a71495f8708ab4726905d40 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.865064 20382 tablet_replica.cc:333] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.865597 20382 raft_consensus.cc:2243] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.866029 20382 raft_consensus.cc:2272] T e0c896f7c3954b098ac0769a5ce664a1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.868029 20382 tablet_replica.cc:333] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.868553 20382 raft_consensus.cc:2243] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.869299 20382 raft_consensus.cc:2272] T 04593214c5bf43b6b52bc5d7b4d27ee1 P e4b8e689773b4a9d8e6de6d82d225c0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.871177 20382 tablet_replica.cc:333] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.871680 20382 raft_consensus.cc:2243] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.872107 20382 raft_consensus.cc:2272] T 3253c47b0c1749e39622495eb339195c P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.874328 20382 tablet_replica.cc:333] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.874987 20382 raft_consensus.cc:2243] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.875437 20382 raft_consensus.cc:2272] T 65bf3caefe70453bbed914700540bef7 P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.877285 20382 tablet_replica.cc:333] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.877787 20382 raft_consensus.cc:2243] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.878563 20382 raft_consensus.cc:2272] T a1acee1ab5494c3a87ba7e6a84ef73cf P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.880435 20382 tablet_replica.cc:333] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.880949 20382 raft_consensus.cc:2243] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.881397 20382 raft_consensus.cc:2272] T fac028c5a7bd40c28ecec9a4bd1e83f0 P e4b8e689773b4a9d8e6de6d82d225c0d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.883283 20382 tablet_replica.cc:333] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.883780 20382 raft_consensus.cc:2243] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.884533 20382 raft_consensus.cc:2272] T d758ec9801614080a6a30dd820a62459 P e4b8e689773b4a9d8e6de6d82d225c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.886384 20382 tablet_replica.cc:333] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.886886 20382 raft_consensus.cc:2243] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.887282 20382 raft_consensus.cc:2272] T 684ac54b92e440b48092a7e38bd73e59 P e4b8e689773b4a9d8e6de6d82d225c0d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.889050 20382 tablet_replica.cc:333] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d: stopping tablet replica
I20260709 13:11:16.889524 20382 raft_consensus.cc:2243] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.889945 20382 raft_consensus.cc:2272] T 8a3a53f4eac747b2b57fe6b5c5516cee P e4b8e689773b4a9d8e6de6d82d225c0d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.916229 30694 consensus_peers.cc:597] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.951985 30694 consensus_peers.cc:597] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:34377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.958323 20382 tablet_server.cc:196] TabletServer@127.19.231.131:0 shutdown complete.
W20260709 13:11:17.012460 30694 consensus_peers.cc:597] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:34377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.038246 20382 tablet_server.cc:179] TabletServer@127.19.231.132:0 shutting down...
I20260709 13:11:17.049460 31710 raft_consensus.cc:493] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:11:17.050554 31710 raft_consensus.cc:515] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:17.053762 31710 leader_election.cc:290] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
W20260709 13:11:17.059871 30693 leader_election.cc:336] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
W20260709 13:11:17.060953 30694 leader_election.cc:336] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Network error: Client connection negotiation failed: client connection to 127.19.231.131:34377: connect: Connection refused (error 111)
I20260709 13:11:17.061393 30694 leader_election.cc:304] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
I20260709 13:11:17.062350 31710 raft_consensus.cc:2749] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:17.076913 30694 consensus_peers.cc:597] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:34377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.087113 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:11:17.087909 30694 consensus_peers.cc:597] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:34377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.088096 20382 tablet_replica.cc:333] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.088886 20382 raft_consensus.cc:2243] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.089408 20382 raft_consensus.cc:2272] T 2b210bd1ede94a3abb6560f301be6a7b P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.091511 20382 tablet_replica.cc:333] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.092077 20382 raft_consensus.cc:2243] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.092855 20382 raft_consensus.cc:2272] T 52a2ea7040e149929599d0d145c8264e P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.094955 20382 tablet_replica.cc:333] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.095777 20382 raft_consensus.cc:2243] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.096312 20382 raft_consensus.cc:2272] T aedcef0a31d14c3e90d15d1bbbf329c2 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.098958 20382 tablet_replica.cc:333] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.099793 20382 raft_consensus.cc:2243] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.100160 20382 raft_consensus.cc:2272] T 9b693fc5a9c3477a87a09ce7d3c57859 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.102098 20382 tablet_replica.cc:333] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.102602 20382 raft_consensus.cc:2243] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.103042 20382 raft_consensus.cc:2272] T 723f558d9f1b4b448a1d027e5e116bf2 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.104878 20382 tablet_replica.cc:333] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.105473 20382 raft_consensus.cc:2243] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.106196 20382 raft_consensus.cc:2272] T ff5f081bede942ccbbb7ab42a42bf354 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.108023 20382 tablet_replica.cc:333] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.108608 20382 raft_consensus.cc:2243] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.109028 20382 raft_consensus.cc:2272] T 26ec91d866c84f30813b1d51ebf9a214 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.111362 20382 tablet_replica.cc:333] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.112111 20382 raft_consensus.cc:2243] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.113075 20382 raft_consensus.cc:2272] T a8fb5e8eecef48b5831eb8cf4003e561 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.115696 20382 tablet_replica.cc:333] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.116353 20382 raft_consensus.cc:2243] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.117131 20382 raft_consensus.cc:2272] T 059a9c51005141eb9c585ad91a67d779 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.119156 20382 tablet_replica.cc:333] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.119738 20382 raft_consensus.cc:2243] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.120518 20382 raft_consensus.cc:2272] T f8d68b0f1c1e48609d42244622ea1d7c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.122720 20382 tablet_replica.cc:333] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.123379 20382 raft_consensus.cc:2243] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.123827 20382 raft_consensus.cc:2272] T b2ffcc3dff924a86a1403a064784dba0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.124496 31754 raft_consensus.cc:493] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:11:17.124979 31754 raft_consensus.cc:515] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4b8e689773b4a9d8e6de6d82d225c0d" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 34377 } } peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } }
I20260709 13:11:17.126157 20382 tablet_replica.cc:333] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.127405 20382 raft_consensus.cc:2243] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.127532 31754 leader_election.cc:290] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377), 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027)
I20260709 13:11:17.128161 20382 raft_consensus.cc:2272] T 73ee8459c7f745eb8bb1fb0d6ea88f2a P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.131137 20382 tablet_replica.cc:333] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.131939 20382 raft_consensus.cc:2243] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.132534 20382 raft_consensus.cc:2272] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:17.133198 30693 leader_election.cc:336] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
W20260709 13:11:17.133792 30694 leader_election.cc:336] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Network error: Client connection negotiation failed: client connection to 127.19.231.131:34377: connect: Connection refused (error 111)
I20260709 13:11:17.134188 30694 leader_election.cc:304] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, e4b8e689773b4a9d8e6de6d82d225c0d
W20260709 13:11:17.134690 30694 raft_consensus.cc:2686] T 9c9f8c7ed7744cb9b06471b91d2bec4a P ce7bd1ecd6e44f32879851d7b3174acb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:17.135313 20382 tablet_replica.cc:333] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.135967 20382 raft_consensus.cc:2243] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.136911 20382 raft_consensus.cc:2272] T 71865a4b38b04d879e4188a8eebba7e7 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.139433 20382 tablet_replica.cc:333] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.140187 20382 raft_consensus.cc:2243] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.140651 20382 raft_consensus.cc:2272] T d758ec9801614080a6a30dd820a62459 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.142742 20382 tablet_replica.cc:333] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.143332 20382 raft_consensus.cc:2243] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.143793 20382 raft_consensus.cc:2272] T 684ac54b92e440b48092a7e38bd73e59 P ce7bd1ecd6e44f32879851d7b3174acb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.145550 20382 tablet_replica.cc:333] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.146081 20382 raft_consensus.cc:2243] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.146476 20382 raft_consensus.cc:2272] T 9687bd5f80bd4d869a68cbbecda69806 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.148298 20382 tablet_replica.cc:333] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.148847 20382 raft_consensus.cc:2243] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.149266 20382 raft_consensus.cc:2272] T 27a322c98a8d493ab4377fe92a1c01db P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.151125 20382 tablet_replica.cc:333] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.151650 20382 raft_consensus.cc:2243] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.152379 20382 raft_consensus.cc:2272] T fac028c5a7bd40c28ecec9a4bd1e83f0 P ce7bd1ecd6e44f32879851d7b3174acb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.154196 20382 tablet_replica.cc:333] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.154841 20382 raft_consensus.cc:2243] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.155256 20382 raft_consensus.cc:2272] T eacc589c8fd4465d9a8549c531711c32 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.157058 20382 tablet_replica.cc:333] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.157594 20382 raft_consensus.cc:2243] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.158057 20382 raft_consensus.cc:2272] T fe5c236d415d4a2ba5cab92446b2cc9e P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.159933 20382 tablet_replica.cc:333] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.160518 20382 raft_consensus.cc:2243] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.161463 20382 raft_consensus.cc:2272] T 018c73c344ee48698633b2153ac2bce0 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.161366 31754 raft_consensus.cc:493] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5eebf0fa5aba46afa04623642d7795e6)
I20260709 13:11:17.162055 31754 raft_consensus.cc:515] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce7bd1ecd6e44f32879851d7b3174acb" member_type: VOTER last_known_addr { host: "127.19.231.132" port: 38089 } } peers { permanent_uuid: "5eebf0fa5aba46afa04623642d7795e6" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 44027 } } peers { permanent_uuid: "fe9b995b077d4cb795f08934ed7d9088" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 37481 } }
I20260709 13:11:17.163906 31754 leader_election.cc:290] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027), fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481)
I20260709 13:11:17.164055 20382 tablet_replica.cc:333] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.164964 20382 raft_consensus.cc:2243] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.165522 20382 raft_consensus.cc:2272] T 4a479c021bcf40f087e21cf6099daeb0 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.168181 20382 tablet_replica.cc:333] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.168840 20382 raft_consensus.cc:2243] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:11:17.169035 30694 leader_election.cc:336] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe9b995b077d4cb795f08934ed7d9088 (127.19.231.130:37481): Network error: Client connection negotiation failed: client connection to 127.19.231.130:37481: connect: Connection refused (error 111)
W20260709 13:11:17.169586 30693 leader_election.cc:336] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5eebf0fa5aba46afa04623642d7795e6 (127.19.231.129:44027): Network error: Client connection negotiation failed: client connection to 127.19.231.129:44027: connect: Connection refused (error 111)
I20260709 13:11:17.169857 20382 raft_consensus.cc:2272] T 7904d28f33ba4b9298735fe0bbaf6855 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.169968 30693 leader_election.cc:304] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce7bd1ecd6e44f32879851d7b3174acb; no voters: 5eebf0fa5aba46afa04623642d7795e6, fe9b995b077d4cb795f08934ed7d9088
I20260709 13:11:17.170691 31754 raft_consensus.cc:2749] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:17.172374 30694 consensus_peers.cc:597] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb -> Peer e4b8e689773b4a9d8e6de6d82d225c0d (127.19.231.131:34377): Couldn't send request to peer e4b8e689773b4a9d8e6de6d82d225c0d. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.131:34377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.172798 20382 tablet_replica.cc:333] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.173683 20382 raft_consensus.cc:2243] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.174134 20382 raft_consensus.cc:2272] T c60650c912f44bac84d7e81cf49ad99d P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.176128 20382 tablet_replica.cc:333] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.176616 20382 raft_consensus.cc:2243] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.176983 20382 raft_consensus.cc:2272] T 5ca31368027748349419b6fe09ea1375 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.178880 20382 tablet_replica.cc:333] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.179404 20382 raft_consensus.cc:2243] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.180141 20382 raft_consensus.cc:2272] T ecb61d7cc4374a2ba332ae4af88d0f63 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.181998 20382 tablet_replica.cc:333] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.182514 20382 raft_consensus.cc:2243] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.182997 20382 raft_consensus.cc:2272] T 17ca8d69123d49ada168ec5581c199d4 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.184890 20382 tablet_replica.cc:333] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.185374 20382 raft_consensus.cc:2243] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.185735 20382 raft_consensus.cc:2272] T fafe994543a04390ab335d1abeaa6f4e P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.187932 20382 tablet_replica.cc:333] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.188484 20382 raft_consensus.cc:2243] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.188855 20382 raft_consensus.cc:2272] T 55d1b96e1d27444ebfb159aae9bbe85b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.190580 20382 tablet_replica.cc:333] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.191148 20382 raft_consensus.cc:2243] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.191871 20382 raft_consensus.cc:2272] T 3253c47b0c1749e39622495eb339195c P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.193639 20382 tablet_replica.cc:333] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.194118 20382 raft_consensus.cc:2243] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.194839 20382 raft_consensus.cc:2272] T 65bf3caefe70453bbed914700540bef7 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.196619 20382 tablet_replica.cc:333] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.197105 20382 raft_consensus.cc:2243] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.197455 20382 raft_consensus.cc:2272] T efe10cb5a2eb471f86bec2723e5dbe97 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.199393 20382 tablet_replica.cc:333] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.199862 20382 raft_consensus.cc:2243] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.200207 20382 raft_consensus.cc:2272] T a1acee1ab5494c3a87ba7e6a84ef73cf P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.201903 20382 tablet_replica.cc:333] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.202375 20382 raft_consensus.cc:2243] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.203142 20382 raft_consensus.cc:2272] T e0c896f7c3954b098ac0769a5ce664a1 P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.205081 20382 tablet_replica.cc:333] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.205552 20382 raft_consensus.cc:2243] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.205932 20382 raft_consensus.cc:2272] T ba73d0b006bc437393ba09c76a909614 P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.207816 20382 tablet_replica.cc:333] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.208285 20382 raft_consensus.cc:2243] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.208637 20382 raft_consensus.cc:2272] T 23f015cc36aa4db08cb18e49721204ad P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.210341 20382 tablet_replica.cc:333] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.210882 20382 raft_consensus.cc:2243] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.211223 20382 raft_consensus.cc:2272] T 87fb671441fb4addaa5108aea6093d4f P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.213053 20382 tablet_replica.cc:333] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.213524 20382 raft_consensus.cc:2243] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.213984 20382 raft_consensus.cc:2272] T ec3860c6607e4192b0fa932efa48a730 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.215759 20382 tablet_replica.cc:333] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.216276 20382 raft_consensus.cc:2243] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.216991 20382 raft_consensus.cc:2272] T 17a1eefeef3847b8ad88b05ca970c43f P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.218840 20382 tablet_replica.cc:333] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.219305 20382 raft_consensus.cc:2243] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.219677 20382 raft_consensus.cc:2272] T 40c44012ec644ddbbe5ec4685054ed5b P ce7bd1ecd6e44f32879851d7b3174acb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.221444 20382 tablet_replica.cc:333] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.221869 20382 raft_consensus.cc:2243] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.222213 20382 raft_consensus.cc:2272] T 155c2eeaa7cc439c8c8e42ec57accfd3 P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.223997 20382 tablet_replica.cc:333] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.224473 20382 raft_consensus.cc:2243] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.224874 20382 raft_consensus.cc:2272] T 8c1b94fe3ebf42e090e8c6ef27e1c4df P ce7bd1ecd6e44f32879851d7b3174acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.226624 20382 tablet_replica.cc:333] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb: stopping tablet replica
I20260709 13:11:17.227095 20382 raft_consensus.cc:2243] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.227845 20382 raft_consensus.cc:2272] T df38dc922fb445c48c8c877918cea7db P ce7bd1ecd6e44f32879851d7b3174acb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.290940 20382 tablet_server.cc:196] TabletServer@127.19.231.132:0 shutdown complete.
I20260709 13:11:17.353103 20382 master.cc:562] Master@127.19.231.190:46409 shutting down...
I20260709 13:11:17.378639 20382 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.379304 20382 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.379648 20382 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9dab7df47a0245579717f453d37de123: stopping tablet replica
I20260709 13:11:17.401361 20382 master.cc:584] Master@127.19.231.190:46409 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (35299 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:11:17.489886 20382 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.231.190:41089
I20260709 13:11:17.491003 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:17.497148 31757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:17.497212 31758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:17.497598 31760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:17.498446 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:17.500494 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:17.500677 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:17.500891 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602677500856 us; error 0 us; skew 500 ppm
I20260709 13:11:17.501456 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:17.504055 20382 webserver.cc:533] Webserver started at http://127.19.231.190:46039/ using document root <none> and password file <none>
I20260709 13:11:17.504577 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:17.504769 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:17.505064 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:17.506206 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/master-0-root/instance:
uuid: "5279ccca571648098a39b6f107e9b9d6"
format_stamp: "Formatted at 2026-07-09 13:11:17 on dist-test-slave-1t6m"
I20260709 13:11:17.511014 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:11:17.514472 31765 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:17.515344 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:17.515616 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/master-0-root
uuid: "5279ccca571648098a39b6f107e9b9d6"
format_stamp: "Formatted at 2026-07-09 13:11:17 on dist-test-slave-1t6m"
I20260709 13:11:17.515872 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:17.541990 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:17.543298 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:17.581642 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.190:41089
I20260709 13:11:17.581732 31816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.190:41089 every 8 connection(s)
I20260709 13:11:17.585759 31817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.597047 31817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6: Bootstrap starting.
I20260709 13:11:17.602000 31817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.606319 31817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6: No bootstrap required, opened a new log
I20260709 13:11:17.608589 31817 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5279ccca571648098a39b6f107e9b9d6" member_type: VOTER }
I20260709 13:11:17.608971 31817 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.609238 31817 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5279ccca571648098a39b6f107e9b9d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.609812 31817 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5279ccca571648098a39b6f107e9b9d6" member_type: VOTER }
I20260709 13:11:17.610280 31817 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:17.610517 31817 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:17.610812 31817 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.615435 31817 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5279ccca571648098a39b6f107e9b9d6" member_type: VOTER }
I20260709 13:11:17.615967 31817 leader_election.cc:304] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5279ccca571648098a39b6f107e9b9d6; no voters: 
I20260709 13:11:17.617105 31817 leader_election.cc:290] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:17.617458 31820 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.618928 31820 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 1 LEADER]: Becoming Leader. State: Replica: 5279ccca571648098a39b6f107e9b9d6, State: Running, Role: LEADER
I20260709 13:11:17.619611 31820 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5279ccca571648098a39b6f107e9b9d6" member_type: VOTER }
I20260709 13:11:17.620210 31817 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:17.624449 31822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5279ccca571648098a39b6f107e9b9d6. Latest consensus state: current_term: 1 leader_uuid: "5279ccca571648098a39b6f107e9b9d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5279ccca571648098a39b6f107e9b9d6" member_type: VOTER } }
I20260709 13:11:17.625178 31822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:17.626379 31821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5279ccca571648098a39b6f107e9b9d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5279ccca571648098a39b6f107e9b9d6" member_type: VOTER } }
I20260709 13:11:17.627053 31821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:17.627316 31828 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:17.632576 31828 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:17.635908 20382 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:17.641212 31828 catalog_manager.cc:1383] Generated new cluster ID: 9cda2b6ec5f348b3806900769c798216
I20260709 13:11:17.641506 31828 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:17.656868 31828 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:17.658172 31828 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:17.675019 31828 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6: Generated new TSK 0
I20260709 13:11:17.675680 31828 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:17.703004 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:17.709436 31838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:17.711218 31839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:17.713672 31841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:17.713745 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:17.715145 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:17.715378 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:17.715556 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602677715533 us; error 0 us; skew 500 ppm
I20260709 13:11:17.716077 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:17.718752 20382 webserver.cc:533] Webserver started at http://127.19.231.129:46793/ using document root <none> and password file <none>
I20260709 13:11:17.719336 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:17.719544 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:17.719835 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:17.720949 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-0-root/instance:
uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
format_stamp: "Formatted at 2026-07-09 13:11:17 on dist-test-slave-1t6m"
I20260709 13:11:17.725651 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:11:17.729171 31846 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:17.730136 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:11:17.730448 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-0-root
uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
format_stamp: "Formatted at 2026-07-09 13:11:17 on dist-test-slave-1t6m"
I20260709 13:11:17.730751 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:17.750295 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:17.751677 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:17.753103 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:17.755470 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:17.755707 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:17.755973 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:17.756165 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:17.798516 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.129:36871
I20260709 13:11:17.798954 31908 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.129:36871 every 8 connection(s)
I20260709 13:11:17.803783 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:17.811592 31913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:17.812988 31914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:17.816296 20382 server_base.cc:1061] running on GCE node
W20260709 13:11:17.816421 31916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:17.818209 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:17.818442 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:17.818660 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602677818641 us; error 0 us; skew 500 ppm
I20260709 13:11:17.819303 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:17.821390 31909 heartbeater.cc:344] Connected to a master server at 127.19.231.190:41089
I20260709 13:11:17.821810 31909 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:17.822244 20382 webserver.cc:533] Webserver started at http://127.19.231.130:38665/ using document root <none> and password file <none>
I20260709 13:11:17.822626 31909 heartbeater.cc:507] Master 127.19.231.190:41089 requested a full tablet report, sending...
I20260709 13:11:17.822908 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:17.823228 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:17.823511 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:17.824844 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-1-root/instance:
uuid: "f0414f76a3b045f38f10808155062693"
format_stamp: "Formatted at 2026-07-09 13:11:17 on dist-test-slave-1t6m"
I20260709 13:11:17.825047 31782 ts_manager.cc:194] Registered new tserver with Master: 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871)
I20260709 13:11:17.826947 31782 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37980
I20260709 13:11:17.830128 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:11:17.833928 31921 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:17.834759 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:17.835148 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-1-root
uuid: "f0414f76a3b045f38f10808155062693"
format_stamp: "Formatted at 2026-07-09 13:11:17 on dist-test-slave-1t6m"
I20260709 13:11:17.835460 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:17.858736 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:17.860050 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:17.861534 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:17.863798 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:17.864039 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:17.864295 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:17.864470 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:17.905182 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.130:42063
I20260709 13:11:17.905289 31983 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.130:42063 every 8 connection(s)
I20260709 13:11:17.910128 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:17.917491 31987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:17.919554 31988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:17.922748 31990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:17.922870 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:17.923352 31984 heartbeater.cc:344] Connected to a master server at 127.19.231.190:41089
I20260709 13:11:17.923949 31984 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:17.924418 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:17.924728 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:17.924872 31984 heartbeater.cc:507] Master 127.19.231.190:41089 requested a full tablet report, sending...
I20260709 13:11:17.924953 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602677924932 us; error 0 us; skew 500 ppm
I20260709 13:11:17.925935 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:17.927532 31782 ts_manager.cc:194] Registered new tserver with Master: f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:17.928911 20382 webserver.cc:533] Webserver started at http://127.19.231.131:37167/ using document root <none> and password file <none>
I20260709 13:11:17.929476 31782 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37992
I20260709 13:11:17.929687 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:17.930047 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:17.930382 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:17.931957 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-2-root/instance:
uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
format_stamp: "Formatted at 2026-07-09 13:11:17 on dist-test-slave-1t6m"
I20260709 13:11:17.936767 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:17.940212 31995 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:17.941094 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:17.941514 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-2-root
uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
format_stamp: "Formatted at 2026-07-09 13:11:17 on dist-test-slave-1t6m"
I20260709 13:11:17.941828 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:17.959983 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:17.961256 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:17.962842 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:17.965165 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:17.965350 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:17.965667 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:17.965837 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.017086 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.131:37283
I20260709 13:11:18.017262 32057 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.131:37283 every 8 connection(s)
I20260709 13:11:18.031625 32058 heartbeater.cc:344] Connected to a master server at 127.19.231.190:41089
I20260709 13:11:18.032150 32058 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:18.033190 32058 heartbeater.cc:507] Master 127.19.231.190:41089 requested a full tablet report, sending...
I20260709 13:11:18.035398 31782 ts_manager.cc:194] Registered new tserver with Master: e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:18.035624 20382 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015336037s
I20260709 13:11:18.036947 31782 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38006
I20260709 13:11:18.064024 31782 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38008:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:18.067042 31782 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:18.164980 31874 tablet_service.cc:1511] Processing CreateTablet for tablet 11bee2ef3424429ea381dec7bd22824a (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:18.165323 32023 tablet_service.cc:1511] Processing CreateTablet for tablet 11bee2ef3424429ea381dec7bd22824a (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:18.165961 31870 tablet_service.cc:1511] Processing CreateTablet for tablet 47e33a09b4634ba4b5936b07b0c140a3 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:18.166805 31874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bee2ef3424429ea381dec7bd22824a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.167995 31872 tablet_service.cc:1511] Processing CreateTablet for tablet 5448d805ce9044d6aafd6595a9acff28 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:18.168352 31869 tablet_service.cc:1511] Processing CreateTablet for tablet 323345efe837451881ebe9ec2d0226a9 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:18.169441 31872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5448d805ce9044d6aafd6595a9acff28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.170499 32019 tablet_service.cc:1511] Processing CreateTablet for tablet 47e33a09b4634ba4b5936b07b0c140a3 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:18.171701 32021 tablet_service.cc:1511] Processing CreateTablet for tablet 5448d805ce9044d6aafd6595a9acff28 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:18.166265 31871 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe51c07e1a84727840d01c035ef734a (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:18.172845 31873 tablet_service.cc:1511] Processing CreateTablet for tablet ac451bfab48b4ca5860039551bdfc59a (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:18.173520 31871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe51c07e1a84727840d01c035ef734a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.174245 31873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac451bfab48b4ca5860039551bdfc59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.174139 32020 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe51c07e1a84727840d01c035ef734a (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:18.176004 32018 tablet_service.cc:1511] Processing CreateTablet for tablet 323345efe837451881ebe9ec2d0226a9 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:18.176436 31868 tablet_service.cc:1511] Processing CreateTablet for tablet d1cb7b9945cb47e7bb4031796f97722e (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:18.170509 32022 tablet_service.cc:1511] Processing CreateTablet for tablet ac451bfab48b4ca5860039551bdfc59a (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:18.166841 32023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bee2ef3424429ea381dec7bd22824a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.179054 31868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1cb7b9945cb47e7bb4031796f97722e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.181069 32022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac451bfab48b4ca5860039551bdfc59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.183938 32020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe51c07e1a84727840d01c035ef734a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.183938 31869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323345efe837451881ebe9ec2d0226a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.185685 31870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e33a09b4634ba4b5936b07b0c140a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.191267 32019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e33a09b4634ba4b5936b07b0c140a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.192071 32021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5448d805ce9044d6aafd6595a9acff28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.194901 32018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323345efe837451881ebe9ec2d0226a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.200565 31949 tablet_service.cc:1511] Processing CreateTablet for tablet 11bee2ef3424429ea381dec7bd22824a (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:18.202029 31949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bee2ef3424429ea381dec7bd22824a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.204414 31948 tablet_service.cc:1511] Processing CreateTablet for tablet ac451bfab48b4ca5860039551bdfc59a (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:18.205827 31948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac451bfab48b4ca5860039551bdfc59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.224712 31947 tablet_service.cc:1511] Processing CreateTablet for tablet 5448d805ce9044d6aafd6595a9acff28 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:18.226249 31947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5448d805ce9044d6aafd6595a9acff28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.228031 31946 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe51c07e1a84727840d01c035ef734a (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:18.229651 31946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe51c07e1a84727840d01c035ef734a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.232018 31945 tablet_service.cc:1511] Processing CreateTablet for tablet 47e33a09b4634ba4b5936b07b0c140a3 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:18.233493 31945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e33a09b4634ba4b5936b07b0c140a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.235605 31944 tablet_service.cc:1511] Processing CreateTablet for tablet 323345efe837451881ebe9ec2d0226a9 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:18.237133 31944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323345efe837451881ebe9ec2d0226a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.238765 31943 tablet_service.cc:1511] Processing CreateTablet for tablet d1cb7b9945cb47e7bb4031796f97722e (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:18.243234 31943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1cb7b9945cb47e7bb4031796f97722e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.252650 31942 tablet_service.cc:1511] Processing CreateTablet for tablet 354fd95ac625442ca0aa41c8df3c6eb6 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:18.254174 31942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 354fd95ac625442ca0aa41c8df3c6eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.264756 32017 tablet_service.cc:1511] Processing CreateTablet for tablet d1cb7b9945cb47e7bb4031796f97722e (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:18.265506 31867 tablet_service.cc:1511] Processing CreateTablet for tablet 354fd95ac625442ca0aa41c8df3c6eb6 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:18.266383 32017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1cb7b9945cb47e7bb4031796f97722e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.266911 31867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 354fd95ac625442ca0aa41c8df3c6eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.272944 32016 tablet_service.cc:1511] Processing CreateTablet for tablet 354fd95ac625442ca0aa41c8df3c6eb6 (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:18.274497 32016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 354fd95ac625442ca0aa41c8df3c6eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.275972 32074 tablet_bootstrap.cc:492] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b: Bootstrap starting.
I20260709 13:11:18.278849 31866 tablet_service.cc:1511] Processing CreateTablet for tablet 057127d733914dff839f4d0ac064177b (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:18.280301 31866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057127d733914dff839f4d0ac064177b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.286218 32074 tablet_bootstrap.cc:654] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.286422 31874 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0442e54c3b4399ac05323b9c3778ad (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:18.288375 31941 tablet_service.cc:1511] Processing CreateTablet for tablet 057127d733914dff839f4d0ac064177b (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:18.293289 31941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057127d733914dff839f4d0ac064177b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.293365 31874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0442e54c3b4399ac05323b9c3778ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.288617 32023 tablet_service.cc:1511] Processing CreateTablet for tablet 057127d733914dff839f4d0ac064177b (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:18.299630 32023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057127d733914dff839f4d0ac064177b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.302021 32022 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0442e54c3b4399ac05323b9c3778ad (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:18.303578 32022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0442e54c3b4399ac05323b9c3778ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.306185 32074 tablet_bootstrap.cc:492] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b: No bootstrap required, opened a new log
I20260709 13:11:18.307992 32074 ts_tablet_manager.cc:1403] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:11:18.308037 31940 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0442e54c3b4399ac05323b9c3778ad (DEFAULT_TABLE table=test-workload [id=749bf3b832014b10810e7c25be86436b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:18.309705 31940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0442e54c3b4399ac05323b9c3778ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.324900 32074 raft_consensus.cc:359] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.330909 32074 raft_consensus.cc:385] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.331785 32074 raft_consensus.cc:740] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.335382 32074 consensus_queue.cc:260] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.376235 32073 tablet_bootstrap.cc:492] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:18.426277 32074 ts_tablet_manager.cc:1434] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b: Time spent starting tablet: real 0.105s	user 0.030s	sys 0.064s
I20260709 13:11:18.427129 32058 heartbeater.cc:499] Master 127.19.231.190:41089 was elected leader, sending a full tablet report...
I20260709 13:11:18.427311 32074 tablet_bootstrap.cc:492] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b: Bootstrap starting.
I20260709 13:11:18.427923 32077 tablet_bootstrap.cc:492] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693: Bootstrap starting.
I20260709 13:11:18.433784 32074 tablet_bootstrap.cc:654] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.425242 32073 tablet_bootstrap.cc:654] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.447240 32074 tablet_bootstrap.cc:492] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b: No bootstrap required, opened a new log
I20260709 13:11:18.447770 32074 ts_tablet_manager.cc:1403] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.006s
I20260709 13:11:18.449988 32077 tablet_bootstrap.cc:654] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.450096 32074 raft_consensus.cc:359] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.451254 32074 raft_consensus.cc:385] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.451653 32074 raft_consensus.cc:740] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.452752 32074 consensus_queue.cc:260] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.455793 32074 ts_tablet_manager.cc:1434] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:11:18.457193 32074 tablet_bootstrap.cc:492] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b: Bootstrap starting.
I20260709 13:11:18.466578 32074 tablet_bootstrap.cc:654] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.477553 32073 tablet_bootstrap.cc:492] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: No bootstrap required, opened a new log
I20260709 13:11:18.478036 32073 ts_tablet_manager.cc:1403] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.102s	user 0.028s	sys 0.008s
I20260709 13:11:18.478120 32074 tablet_bootstrap.cc:492] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b: No bootstrap required, opened a new log
I20260709 13:11:18.478839 32074 ts_tablet_manager.cc:1403] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:11:18.480756 32073 raft_consensus.cc:359] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.481468 32073 raft_consensus.cc:385] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.481235 32074 raft_consensus.cc:359] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.481886 32073 raft_consensus.cc:740] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.482118 32074 raft_consensus.cc:385] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.482519 32074 raft_consensus.cc:740] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.482847 32073 consensus_queue.cc:260] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.483440 32074 consensus_queue.cc:260] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.484308 32077 tablet_bootstrap.cc:492] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693: No bootstrap required, opened a new log
I20260709 13:11:18.485049 32077 ts_tablet_manager.cc:1403] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693: Time spent bootstrapping tablet: real 0.057s	user 0.026s	sys 0.011s
I20260709 13:11:18.486043 32074 ts_tablet_manager.cc:1434] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:18.487607 32074 tablet_bootstrap.cc:492] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b: Bootstrap starting.
I20260709 13:11:18.489503 32077 raft_consensus.cc:359] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.490664 32077 raft_consensus.cc:385] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.491130 32077 raft_consensus.cc:740] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.492187 32077 consensus_queue.cc:260] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.493181 32073 ts_tablet_manager.cc:1434] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.012s
I20260709 13:11:18.494117 31909 heartbeater.cc:499] Master 127.19.231.190:41089 was elected leader, sending a full tablet report...
I20260709 13:11:18.494999 32074 tablet_bootstrap.cc:654] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.501888 32073 tablet_bootstrap.cc:492] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:18.507282 32074 tablet_bootstrap.cc:492] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b: No bootstrap required, opened a new log
I20260709 13:11:18.507901 32074 ts_tablet_manager.cc:1403] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:11:18.511142 32074 raft_consensus.cc:359] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.511956 32074 raft_consensus.cc:385] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.512272 32074 raft_consensus.cc:740] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.512339 31984 heartbeater.cc:499] Master 127.19.231.190:41089 was elected leader, sending a full tablet report...
I20260709 13:11:18.513252 32077 ts_tablet_manager.cc:1434] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.014s
I20260709 13:11:18.513114 32074 consensus_queue.cc:260] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.514418 32077 tablet_bootstrap.cc:492] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693: Bootstrap starting.
I20260709 13:11:18.515549 32074 ts_tablet_manager.cc:1434] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:18.516623 32074 tablet_bootstrap.cc:492] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b: Bootstrap starting.
I20260709 13:11:18.518220 32073 tablet_bootstrap.cc:654] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:18.521320 32059 tablet.cc:2406] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:18.521796 32077 tablet_bootstrap.cc:654] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.523221 32074 tablet_bootstrap.cc:654] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.547192 32073 tablet_bootstrap.cc:492] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: No bootstrap required, opened a new log
I20260709 13:11:18.547811 32073 ts_tablet_manager.cc:1403] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.011s
I20260709 13:11:18.550486 32077 tablet_bootstrap.cc:492] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693: No bootstrap required, opened a new log
I20260709 13:11:18.550971 32074 tablet_bootstrap.cc:492] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b: No bootstrap required, opened a new log
I20260709 13:11:18.551504 32074 ts_tablet_manager.cc:1403] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.017s
I20260709 13:11:18.551193 32077 ts_tablet_manager.cc:1403] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.023s
I20260709 13:11:18.552052 32073 raft_consensus.cc:359] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.561636 32073 raft_consensus.cc:385] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.554949 32074 raft_consensus.cc:359] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.562274 32073 raft_consensus.cc:740] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.555954 32077 raft_consensus.cc:359] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.562664 32074 raft_consensus.cc:385] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.562922 32077 raft_consensus.cc:385] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.563089 32074 raft_consensus.cc:740] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.563419 32073 consensus_queue.cc:260] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.565765 32073 ts_tablet_manager.cc:1434] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:11:18.564033 32074 consensus_queue.cc:260] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.566854 32073 tablet_bootstrap.cc:492] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:18.568176 32074 ts_tablet_manager.cc:1434] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 13:11:18.569283 32074 tablet_bootstrap.cc:492] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b: Bootstrap starting.
I20260709 13:11:18.573897 32073 tablet_bootstrap.cc:654] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.563484 32077 raft_consensus.cc:740] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.575865 32074 tablet_bootstrap.cc:654] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.575819 32077 consensus_queue.cc:260] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.578581 32077 ts_tablet_manager.cc:1434] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.006s
I20260709 13:11:18.579660 32077 tablet_bootstrap.cc:492] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693: Bootstrap starting.
I20260709 13:11:18.586581 32077 tablet_bootstrap.cc:654] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.603184 32074 tablet_bootstrap.cc:492] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b: No bootstrap required, opened a new log
I20260709 13:11:18.603720 32074 ts_tablet_manager.cc:1403] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.017s
I20260709 13:11:18.604214 32077 tablet_bootstrap.cc:492] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693: No bootstrap required, opened a new log
I20260709 13:11:18.604830 32077 ts_tablet_manager.cc:1403] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:11:18.604830 32073 tablet_bootstrap.cc:492] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: No bootstrap required, opened a new log
I20260709 13:11:18.605494 32073 ts_tablet_manager.cc:1403] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.008s
I20260709 13:11:18.606158 32074 raft_consensus.cc:359] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.606830 32074 raft_consensus.cc:385] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.607084 32074 raft_consensus.cc:740] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.607831 32074 consensus_queue.cc:260] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.608033 32077 raft_consensus.cc:359] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.608434 32073 raft_consensus.cc:359] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.608868 32077 raft_consensus.cc:385] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.609192 32073 raft_consensus.cc:385] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.609220 32077 raft_consensus.cc:740] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.609619 32073 raft_consensus.cc:740] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.609977 32074 ts_tablet_manager.cc:1434] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:18.610378 32073 consensus_queue.cc:260] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.610378 32077 consensus_queue.cc:260] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.613001 32077 ts_tablet_manager.cc:1434] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:11:18.613035 32073 ts_tablet_manager.cc:1434] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:18.614179 32077 tablet_bootstrap.cc:492] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693: Bootstrap starting.
I20260709 13:11:18.614238 32073 tablet_bootstrap.cc:492] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:18.611095 32074 tablet_bootstrap.cc:492] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b: Bootstrap starting.
I20260709 13:11:18.622197 32073 tablet_bootstrap.cc:654] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.623157 32076 raft_consensus.cc:493] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.623718 32074 tablet_bootstrap.cc:654] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.623679 32076 raft_consensus.cc:515] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
W20260709 13:11:18.630934 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:18.633231 32077 tablet_bootstrap.cc:654] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.633744 32076 leader_election.cc:290] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:18.648298 32074 tablet_bootstrap.cc:492] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b: No bootstrap required, opened a new log
I20260709 13:11:18.648706 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:18.649252 32074 ts_tablet_manager.cc:1403] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
W20260709 13:11:18.650188 31996 leader_election.cc:343] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0414f76a3b045f38f10808155062693 (127.19.231.130:42063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.651232 32077 tablet_bootstrap.cc:492] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693: No bootstrap required, opened a new log
I20260709 13:11:18.651757 32077 ts_tablet_manager.cc:1403] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.004s
I20260709 13:11:18.653426 32074 raft_consensus.cc:359] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.654574 32077 raft_consensus.cc:359] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.655332 32077 raft_consensus.cc:385] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.655586 32077 raft_consensus.cc:740] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.656227 32077 consensus_queue.cc:260] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.656678 32082 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.657403 32082 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.654515 32074 raft_consensus.cc:385] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.658774 32077 ts_tablet_manager.cc:1434] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:18.660830 32083 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.697041 32083 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.689159 32073 tablet_bootstrap.cc:492] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: No bootstrap required, opened a new log
I20260709 13:11:18.702618 32099 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.703289 32073 ts_tablet_manager.cc:1403] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.045s
I20260709 13:11:18.703208 32099 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.705416 32083 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:18.706579 32073 raft_consensus.cc:359] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.707442 32073 raft_consensus.cc:385] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.707806 32073 raft_consensus.cc:740] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.708632 32073 consensus_queue.cc:260] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.709473 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:18.694408 32074 raft_consensus.cc:740] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.695436 32077 tablet_bootstrap.cc:492] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693: Bootstrap starting.
I20260709 13:11:18.710134 31959 raft_consensus.cc:2468] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 0.
I20260709 13:11:18.710952 32074 consensus_queue.cc:260] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.711717 31847 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:18.700933 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:18.713177 31884 raft_consensus.cc:2468] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 0.
I20260709 13:11:18.715126 31997 leader_election.cc:304] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: f0414f76a3b045f38f10808155062693
I20260709 13:11:18.676431 32082 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:18.661289 32076 raft_consensus.cc:493] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.718456 32103 raft_consensus.cc:2804] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.718971 32103 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.719409 32103 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.720952 32074 ts_tablet_manager.cc:1434] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b: Time spent starting tablet: real 0.071s	user 0.030s	sys 0.010s
I20260709 13:11:18.722512 32074 tablet_bootstrap.cc:492] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b: Bootstrap starting.
I20260709 13:11:18.723454 32105 raft_consensus.cc:2804] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.724442 32076 raft_consensus.cc:515] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.726742 32076 leader_election.cc:290] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:18.737959 32077 tablet_bootstrap.cc:654] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.739275 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
W20260709 13:11:18.741273 31923 leader_election.cc:343] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.741320 31883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:18.744132 32073 ts_tablet_manager.cc:1434] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.040s	user 0.012s	sys 0.003s
I20260709 13:11:18.745350 32073 tablet_bootstrap.cc:492] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:18.747138 32105 raft_consensus.cc:493] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.747951 32105 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.752329 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bee2ef3424429ea381dec7bd22824a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:18.753055 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
W20260709 13:11:18.754971 31848 leader_election.cc:343] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.756649 32076 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.757148 32076 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.759305 32076 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
W20260709 13:11:18.756153 31996 leader_election.cc:343] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0414f76a3b045f38f10808155062693 (127.19.231.130:42063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.760394 32074 tablet_bootstrap.cc:654] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.761148 32103 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.761731 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:18.761669 32105 raft_consensus.cc:515] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.750341 32099 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:18.762657 31959 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 0.
I20260709 13:11:18.763144 31883 raft_consensus.cc:2393] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0414f76a3b045f38f10808155062693 in current term 1: Already voted for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in this term.
I20260709 13:11:18.764456 32105 leader_election.cc:290] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:18.765162 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bee2ef3424429ea381dec7bd22824a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:18.765130 32105 raft_consensus.cc:493] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.766005 31884 raft_consensus.cc:2468] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 0.
I20260709 13:11:18.766534 32105 raft_consensus.cc:515] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.767257 31882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:18.769212 32105 leader_election.cc:290] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:18.771495 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:18.762319 32073 tablet_bootstrap.cc:654] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.772388 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:18.772992 31959 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.769614 31882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:18.775792 31882 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.777647 31997 leader_election.cc:304] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: f0414f76a3b045f38f10808155062693
W20260709 13:11:18.779054 31997 leader_election.cc:343] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.779598 32105 raft_consensus.cc:2804] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.771288 32077 tablet_bootstrap.cc:492] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693: No bootstrap required, opened a new log
I20260709 13:11:18.770140 32099 raft_consensus.cc:493] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.782665 32077 ts_tablet_manager.cc:1403] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693: Time spent bootstrapping tablet: real 0.087s	user 0.002s	sys 0.012s
I20260709 13:11:18.783339 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:18.783169 32099 raft_consensus.cc:515] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.784147 31957 raft_consensus.cc:2468] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 0.
I20260709 13:11:18.781489 31958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:18.785203 31958 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.786466 32077 raft_consensus.cc:359] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.787355 32077 raft_consensus.cc:385] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.787734 32077 raft_consensus.cc:740] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.787462 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:18.789763 32077 consensus_queue.cc:260] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.788244 32105 raft_consensus.cc:493] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.791070 32105 raft_consensus.cc:3060] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.793982 31958 raft_consensus.cc:2468] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 1.
W20260709 13:11:18.779742 31997 leader_election.cc:343] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.765339 32106 raft_consensus.cc:493] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.795161 32106 raft_consensus.cc:515] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.795753 32103 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Requested vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:18.794945 32099 leader_election.cc:290] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:18.797387 32077 ts_tablet_manager.cc:1434] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:11:18.797572 32106 leader_election.cc:290] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:18.799121 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:18.799726 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:18.800433 32033 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 0.
W20260709 13:11:18.800678 31997 leader_election.cc:343] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.799944 32077 tablet_bootstrap.cc:492] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693: Bootstrap starting.
I20260709 13:11:18.801796 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:18.799083 31882 raft_consensus.cc:2468] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 1.
I20260709 13:11:18.803900 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:18.804689 32033 raft_consensus.cc:2393] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0414f76a3b045f38f10808155062693 in current term 1: Already voted for candidate e4c77cd4f4ed4f11a46548630b48a19b in this term.
I20260709 13:11:18.804448 31997 leader_election.cc:304] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:18.805579 31996 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:18.781823 31959 raft_consensus.cc:2468] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 1.
I20260709 13:11:18.807098 31847 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:18.807615 32073 tablet_bootstrap.cc:492] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: No bootstrap required, opened a new log
I20260709 13:11:18.808146 32103 raft_consensus.cc:2804] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.809485 32103 raft_consensus.cc:697] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 LEADER]: Becoming Leader. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Running, Role: LEADER
I20260709 13:11:18.810415 32105 raft_consensus.cc:515] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.810385 32103 consensus_queue.cc:237] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.808192 32073 ts_tablet_manager.cc:1403] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.000s
I20260709 13:11:18.815961 32074 tablet_bootstrap.cc:492] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b: No bootstrap required, opened a new log
I20260709 13:11:18.816469 32074 ts_tablet_manager.cc:1403] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b: Time spent bootstrapping tablet: real 0.094s	user 0.020s	sys 0.019s
I20260709 13:11:18.816933 31882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bee2ef3424429ea381dec7bd22824a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:18.818120 31882 raft_consensus.cc:3060] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.812911 32106 raft_consensus.cc:2804] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.819299 32106 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.819690 32106 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.820020 32074 raft_consensus.cc:359] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.820775 32074 raft_consensus.cc:385] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.821054 32074 raft_consensus.cc:740] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.821892 32074 consensus_queue.cc:260] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.827279 31882 raft_consensus.cc:2468] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 1.
I20260709 13:11:18.811865 32076 raft_consensus.cc:2804] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.826730 31779 catalog_manager.cc:5697] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.814030 32077 tablet_bootstrap.cc:654] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.812294 31996 leader_election.cc:304] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:18.818732 32105 leader_election.cc:290] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:18.830830 32076 raft_consensus.cc:697] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:18.831501 32112 raft_consensus.cc:2804] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.831799 32076 consensus_queue.cc:237] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.834329 32112 raft_consensus.cc:493] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.834909 32112 raft_consensus.cc:3060] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.827308 32106 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.817696 32073 raft_consensus.cc:359] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.836405 32073 raft_consensus.cc:385] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.836717 32073 raft_consensus.cc:740] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.837618 32073 consensus_queue.cc:260] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.841679 32073 ts_tablet_manager.cc:1434] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:11:18.843811 31997 leader_election.cc:304] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:18.843937 32073 tablet_bootstrap.cc:492] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:18.846295 32105 raft_consensus.cc:2804] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.846972 32105 raft_consensus.cc:697] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:18.848133 32105 consensus_queue.cc:237] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.851078 32106 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:18.851986 32112 raft_consensus.cc:515] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.852371 31882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:18.854413 32112 leader_election.cc:290] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:18.854727 32073 tablet_bootstrap.cc:654] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:18.854930 31997 leader_election.cc:343] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.855927 31882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:18.861801 31882 raft_consensus.cc:3060] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:18.865866 31996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.130:42063, user_credentials={real_user=slave}} blocked reactor thread for 53657us
I20260709 13:11:18.868425 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:18.870352 31923 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:18.871556 32074 ts_tablet_manager.cc:1434] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b: Time spent starting tablet: real 0.055s	user 0.024s	sys 0.031s
I20260709 13:11:18.871678 32099 raft_consensus.cc:2804] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.872334 32099 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.872677 32099 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.873129 32074 tablet_bootstrap.cc:492] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b: Bootstrap starting.
I20260709 13:11:18.872721 31781 catalog_manager.cc:5697] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.878228 32077 tablet_bootstrap.cc:492] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693: No bootstrap required, opened a new log
I20260709 13:11:18.878880 32077 ts_tablet_manager.cc:1403] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.010s
I20260709 13:11:18.881088 32099 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.885018 31958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:18.885286 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:18.885949 31957 raft_consensus.cc:3060] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.886139 31958 raft_consensus.cc:2393] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c77cd4f4ed4f11a46548630b48a19b in current term 1: Already voted for candidate f0414f76a3b045f38f10808155062693 in this term.
I20260709 13:11:18.882076 32074 tablet_bootstrap.cc:654] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:18.882401 31923 leader_election.cc:343] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.887133 31923 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:18.887239 32099 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:18.887924 32083 raft_consensus.cc:2749] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.888142 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:18.889037 31923 leader_election.cc:304] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:18.882078 32077 raft_consensus.cc:359] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.883570 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bee2ef3424429ea381dec7bd22824a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:18.889742 32083 raft_consensus.cc:2749] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.890710 32077 raft_consensus.cc:385] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.892020 32077 raft_consensus.cc:740] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.892745 32077 consensus_queue.cc:260] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
W20260709 13:11:18.890895 31848 leader_election.cc:343] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.895216 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:18.896535 32033 raft_consensus.cc:2393] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f0414f76a3b045f38f10808155062693 in current term 1: Already voted for candidate e4c77cd4f4ed4f11a46548630b48a19b in this term.
I20260709 13:11:18.896677 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
W20260709 13:11:18.897332 31996 leader_election.cc:343] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0414f76a3b045f38f10808155062693 (127.19.231.130:42063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.897882 31996 leader_election.cc:304] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693
I20260709 13:11:18.898169 32076 raft_consensus.cc:493] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.898669 32111 raft_consensus.cc:2749] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.898909 32076 raft_consensus.cc:515] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.899958 31996 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693
I20260709 13:11:18.900725 32111 raft_consensus.cc:2749] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:11:18.901945 31996 leader_election.cc:343] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0414f76a3b045f38f10808155062693 (127.19.231.130:42063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.902253 31957 raft_consensus.cc:2468] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 1.
W20260709 13:11:18.902757 31923 leader_election.cc:343] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.903223 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:18.903949 31923 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b
W20260709 13:11:18.905043 31997 leader_election.cc:343] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.905347 32083 raft_consensus.cc:2749] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.906342 31882 raft_consensus.cc:2468] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 1.
I20260709 13:11:18.906416 32076 leader_election.cc:290] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:18.907917 31997 leader_election.cc:304] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:18.909082 32076 raft_consensus.cc:2804] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.905452 32077 ts_tablet_manager.cc:1434] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:11:18.909916 32076 raft_consensus.cc:697] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:18.911232 32077 tablet_bootstrap.cc:492] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693: Bootstrap starting.
I20260709 13:11:18.911178 32076 consensus_queue.cc:237] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.917721 32073 tablet_bootstrap.cc:492] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: No bootstrap required, opened a new log
I20260709 13:11:18.918349 32073 ts_tablet_manager.cc:1403] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.002s
I20260709 13:11:18.918653 32077 tablet_bootstrap.cc:654] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.920622 32074 tablet_bootstrap.cc:492] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b: No bootstrap required, opened a new log
I20260709 13:11:18.920972 32103 raft_consensus.cc:493] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.922295 32103 raft_consensus.cc:515] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.922987 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:18.923115 32073 raft_consensus.cc:359] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.924080 32073 raft_consensus.cc:385] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.924455 32103 leader_election.cc:290] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:18.925974 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:18.928239 31957 raft_consensus.cc:2468] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 0.
W20260709 13:11:18.925993 31996 leader_election.cc:343] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0414f76a3b045f38f10808155062693 (127.19.231.130:42063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.924383 32073 raft_consensus.cc:740] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.929162 31996 leader_election.cc:304] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693
I20260709 13:11:18.930027 31847 leader_election.cc:304] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:18.931296 32103 raft_consensus.cc:2804] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.931803 32103 raft_consensus.cc:493] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.931263 32073 consensus_queue.cc:260] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.932138 32103 raft_consensus.cc:3060] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.932267 32076 raft_consensus.cc:2749] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.933538 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:18.934023 32073 ts_tablet_manager.cc:1434] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:11:18.934501 32033 raft_consensus.cc:2468] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 0.
I20260709 13:11:18.935246 32073 tablet_bootstrap.cc:492] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:18.926404 32074 ts_tablet_manager.cc:1403] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.009s
I20260709 13:11:18.942910 32073 tablet_bootstrap.cc:654] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.943713 32103 raft_consensus.cc:515] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.944953 32074 raft_consensus.cc:359] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.946995 32074 raft_consensus.cc:385] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.945458 32077 tablet_bootstrap.cc:492] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693: No bootstrap required, opened a new log
I20260709 13:11:18.947304 32074 raft_consensus.cc:740] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.947850 32077 ts_tablet_manager.cc:1403] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.018s
I20260709 13:11:18.948472 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:18.949077 32073 tablet_bootstrap.cc:492] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: No bootstrap required, opened a new log
I20260709 13:11:18.949115 31957 raft_consensus.cc:3060] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.949752 32073 ts_tablet_manager.cc:1403] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:11:18.949990 32074 consensus_queue.cc:260] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.951020 32077 raft_consensus.cc:359] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.951756 32077 raft_consensus.cc:385] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.952035 32077 raft_consensus.cc:740] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.952426 32074 ts_tablet_manager.cc:1434] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 13:11:18.952754 32073 raft_consensus.cc:359] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.953433 32074 tablet_bootstrap.cc:492] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b: Bootstrap starting.
I20260709 13:11:18.953467 32073 raft_consensus.cc:385] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.953989 32073 raft_consensus.cc:740] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.954867 32073 consensus_queue.cc:260] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.957286 32073 ts_tablet_manager.cc:1434] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:11:18.953509 32077 consensus_queue.cc:260] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.958313 32073 tablet_bootstrap.cc:492] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:18.961190 32074 tablet_bootstrap.cc:654] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.962354 32077 ts_tablet_manager.cc:1434] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:11:18.963557 32077 tablet_bootstrap.cc:492] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693: Bootstrap starting.
I20260709 13:11:18.964973 32082 raft_consensus.cc:493] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.965507 32082 raft_consensus.cc:515] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.967875 32082 leader_election.cc:290] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:18.969631 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:18.970096 32077 tablet_bootstrap.cc:654] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.970430 32033 raft_consensus.cc:2468] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 0.
I20260709 13:11:18.971896 31848 leader_election.cc:304] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:18.972091 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:18.972599 32074 tablet_bootstrap.cc:492] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b: No bootstrap required, opened a new log
I20260709 13:11:18.972771 31959 raft_consensus.cc:2468] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 0.
I20260709 13:11:18.973088 32074 ts_tablet_manager.cc:1403] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:11:18.972922 32082 raft_consensus.cc:2804] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.973582 32082 raft_consensus.cc:493] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.974022 32082 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.976019 32074 raft_consensus.cc:359] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.977170 32074 raft_consensus.cc:385] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.977427 32074 raft_consensus.cc:740] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.978216 32074 consensus_queue.cc:260] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.980701 32074 ts_tablet_manager.cc:1434] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:18.983887 32073 tablet_bootstrap.cc:654] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.988854 31957 raft_consensus.cc:2468] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 1.
I20260709 13:11:18.985483 31781 catalog_manager.cc:5697] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.990288 32082 raft_consensus.cc:515] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:18.990721 31847 leader_election.cc:304] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:18.991766 32104 raft_consensus.cc:2804] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.991531 31781 catalog_manager.cc:5697] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 1 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.998143 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:18.999269 32033 raft_consensus.cc:3060] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.000519 32103 leader_election.cc:290] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Requested vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:19.010696 32104 raft_consensus.cc:697] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 LEADER]: Becoming Leader. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Running, Role: LEADER
I20260709 13:11:19.011389 32033 raft_consensus.cc:2468] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 1.
I20260709 13:11:19.012235 32104 consensus_queue.cc:237] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.015561 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:19.016263 31957 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.025249 31957 raft_consensus.cc:2468] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 1.
I20260709 13:11:19.026480 31847 leader_election.cc:304] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:19.027539 32104 raft_consensus.cc:2804] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.028096 32104 raft_consensus.cc:697] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 LEADER]: Becoming Leader. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Running, Role: LEADER
I20260709 13:11:19.029038 32104 consensus_queue.cc:237] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.033277 31779 catalog_manager.cc:5697] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.034982 32082 leader_election.cc:290] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Requested vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:19.037395 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:19.038060 32033 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.038429 32073 tablet_bootstrap.cc:492] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: No bootstrap required, opened a new log
I20260709 13:11:19.039011 32073 ts_tablet_manager.cc:1403] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.000s
I20260709 13:11:19.040987 32077 tablet_bootstrap.cc:492] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693: No bootstrap required, opened a new log
I20260709 13:11:19.041625 32077 ts_tablet_manager.cc:1403] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.023s
I20260709 13:11:19.046136 32073 raft_consensus.cc:359] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.046931 32073 raft_consensus.cc:385] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.046892 32077 raft_consensus.cc:359] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.047415 32073 raft_consensus.cc:740] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.047715 32077 raft_consensus.cc:385] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.048007 32077 raft_consensus.cc:740] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.048285 32073 consensus_queue.cc:260] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.048768 32077 consensus_queue.cc:260] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.050768 32073 ts_tablet_manager.cc:1434] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:11:19.051779 32073 tablet_bootstrap.cc:492] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:19.053320 32033 raft_consensus.cc:2468] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 1.
I20260709 13:11:19.054096 32077 ts_tablet_manager.cc:1434] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:11:19.055284 32077 tablet_bootstrap.cc:492] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693: Bootstrap starting.
I20260709 13:11:19.055959 31780 catalog_manager.cc:5697] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.057641 32073 tablet_bootstrap.cc:654] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.061561 32077 tablet_bootstrap.cc:654] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.065778 32073 tablet_bootstrap.cc:492] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: No bootstrap required, opened a new log
I20260709 13:11:19.066361 32073 ts_tablet_manager.cc:1403] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.015s	user 0.001s	sys 0.012s
I20260709 13:11:19.067246 32077 tablet_bootstrap.cc:492] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693: No bootstrap required, opened a new log
I20260709 13:11:19.067718 32077 ts_tablet_manager.cc:1403] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:11:19.069329 32073 raft_consensus.cc:359] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.069921 32073 raft_consensus.cc:385] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.069844 32077 raft_consensus.cc:359] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.070432 32073 raft_consensus.cc:740] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.070717 32077 raft_consensus.cc:385] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.071053 32077 raft_consensus.cc:740] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.071333 32073 consensus_queue.cc:260] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.071687 32077 consensus_queue.cc:260] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.073464 32073 ts_tablet_manager.cc:1434] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:11:19.074070 32077 ts_tablet_manager.cc:1434] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:19.074410 32073 tablet_bootstrap.cc:492] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:19.075182 32077 tablet_bootstrap.cc:492] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693: Bootstrap starting.
I20260709 13:11:19.081754 32077 tablet_bootstrap.cc:654] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.082268 32073 tablet_bootstrap.cc:654] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.087110 32073 tablet_bootstrap.cc:492] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: No bootstrap required, opened a new log
I20260709 13:11:19.087466 32073 ts_tablet_manager.cc:1403] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:11:19.089325 32073 raft_consensus.cc:359] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.089809 32073 raft_consensus.cc:385] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.089979 32073 raft_consensus.cc:740] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.090549 32073 consensus_queue.cc:260] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.092495 32073 ts_tablet_manager.cc:1434] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:19.092576 32077 tablet_bootstrap.cc:492] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693: No bootstrap required, opened a new log
I20260709 13:11:19.092885 32082 raft_consensus.cc:493] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.093125 32077 ts_tablet_manager.cc:1403] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:11:19.093391 32082 raft_consensus.cc:515] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.095623 32082 leader_election.cc:290] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:19.095966 32077 raft_consensus.cc:359] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.096405 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:19.096681 32077 raft_consensus.cc:385] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.097018 32077 raft_consensus.cc:740] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.097126 31957 raft_consensus.cc:2468] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 0.
I20260709 13:11:19.097213 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:19.097942 32033 raft_consensus.cc:2468] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 0.
I20260709 13:11:19.097883 32077 consensus_queue.cc:260] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.098531 31847 leader_election.cc:304] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:19.099792 32082 raft_consensus.cc:2804] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.100140 32082 raft_consensus.cc:493] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.100462 32082 raft_consensus.cc:3060] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.104326 32077 ts_tablet_manager.cc:1434] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:11:19.107623 32082 raft_consensus.cc:515] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.109437 32082 leader_election.cc:290] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Requested vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:19.110431 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:19.110293 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:19.111049 32033 raft_consensus.cc:3060] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.111145 31957 raft_consensus.cc:3060] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.113150 32082 raft_consensus.cc:493] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.113684 32082 raft_consensus.cc:515] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.115818 32082 leader_election.cc:290] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:19.116572 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:19.116986 32033 raft_consensus.cc:2468] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 1.
I20260709 13:11:19.117565 32032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:19.117275 31959 raft_consensus.cc:2468] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 0.
I20260709 13:11:19.118467 31957 raft_consensus.cc:2468] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 1.
I20260709 13:11:19.118582 32032 raft_consensus.cc:2468] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 0.
I20260709 13:11:19.119041 31848 leader_election.cc:304] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:19.119854 32082 raft_consensus.cc:2804] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.119786 31847 leader_election.cc:304] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:19.120471 32082 raft_consensus.cc:697] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 LEADER]: Becoming Leader. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Running, Role: LEADER
I20260709 13:11:19.120754 32104 raft_consensus.cc:2804] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.121176 32104 raft_consensus.cc:493] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.121471 32104 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.121317 32082 consensus_queue.cc:237] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.128294 32104 raft_consensus.cc:515] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.128684 31779 catalog_manager.cc:5697] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.130112 32104 leader_election.cc:290] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Requested vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:19.131119 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:19.131173 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:19.131904 31957 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.131938 32033 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.138362 31957 raft_consensus.cc:2468] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 1.
I20260709 13:11:19.138952 32033 raft_consensus.cc:2468] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 1.
I20260709 13:11:19.139477 31847 leader_election.cc:304] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:19.140358 32104 raft_consensus.cc:2804] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.140858 32104 raft_consensus.cc:697] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 LEADER]: Becoming Leader. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Running, Role: LEADER
I20260709 13:11:19.141588 32104 consensus_queue.cc:237] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.149281 31779 catalog_manager.cc:5697] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.208256 32104 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.208915 32104 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.210552 32104 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:19.211467 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:19.211812 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:19.212340 31957 raft_consensus.cc:2393] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in current term 1: Already voted for candidate f0414f76a3b045f38f10808155062693 in this term.
I20260709 13:11:19.212582 32033 raft_consensus.cc:2393] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in current term 1: Already voted for candidate e4c77cd4f4ed4f11a46548630b48a19b in this term.
I20260709 13:11:19.213588 31848 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125; no voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693
I20260709 13:11:19.214211 32104 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.217996 32076 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.218497 32076 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.219589 32104 raft_consensus.cc:2749] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.220320 32076 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:19.221141 31882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:19.221421 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:19.222271 31957 raft_consensus.cc:2393] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c77cd4f4ed4f11a46548630b48a19b in current term 1: Already voted for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in this term.
I20260709 13:11:19.223138 31996 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693
I20260709 13:11:19.223821 32076 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.228935 32076 raft_consensus.cc:2749] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.244817 32104 consensus_queue.cc:1048] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.259235 32082 consensus_queue.cc:1048] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.269654 32099 raft_consensus.cc:493] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.270278 32099 raft_consensus.cc:515] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.272488 32099 leader_election.cc:290] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:19.273277 31882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bee2ef3424429ea381dec7bd22824a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:19.273756 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bee2ef3424429ea381dec7bd22824a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:19.274194 31882 raft_consensus.cc:2393] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0414f76a3b045f38f10808155062693 in current term 1: Already voted for candidate e4c77cd4f4ed4f11a46548630b48a19b in this term.
I20260709 13:11:19.275537 31923 leader_election.cc:304] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:19.276363 32099 raft_consensus.cc:3060] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.281559 32099 raft_consensus.cc:2749] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.320531 32076 consensus_queue.cc:1048] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.331130 32076 consensus_queue.cc:1048] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:19.334088 32112 consensus_queue.cc:1048] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.347791 32083 raft_consensus.cc:493] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.348312 32083 raft_consensus.cc:515] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.348577 32111 consensus_queue.cc:1048] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.350423 32083 leader_election.cc:290] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:19.351613 31882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:19.351969 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:19.352381 31882 raft_consensus.cc:2468] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 0.
I20260709 13:11:19.352689 32033 raft_consensus.cc:2468] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 0.
I20260709 13:11:19.353809 31923 leader_election.cc:304] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:19.355091 32083 raft_consensus.cc:2804] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.355549 32083 raft_consensus.cc:493] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.356491 32083 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.364369 32083 raft_consensus.cc:515] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.366344 32083 leader_election.cc:290] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:19.367007 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:19.367291 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:19.367630 31884 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.367965 32033 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.374115 31884 raft_consensus.cc:2468] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 1.
I20260709 13:11:19.374141 32033 raft_consensus.cc:2468] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 1.
I20260709 13:11:19.375361 31923 leader_election.cc:304] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:19.376153 32083 raft_consensus.cc:2804] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.376551 32083 raft_consensus.cc:697] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 1 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:19.377381 32083 consensus_queue.cc:237] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:19.384513 31780 catalog_manager.cc:5697] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.417403 32111 consensus_queue.cc:1048] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.429188 32076 consensus_queue.cc:1048] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.483397 32082 consensus_queue.cc:1048] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.494680 32082 consensus_queue.cc:1048] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.534384 32082 consensus_queue.cc:1048] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.546106 32104 consensus_queue.cc:1048] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.566744 32104 consensus_queue.cc:1048] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.577296 32103 consensus_queue.cc:1048] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:19.637157 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:19.662482 32103 consensus_queue.cc:1048] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.674661 32103 consensus_queue.cc:1048] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.844486 32083 consensus_queue.cc:1048] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:19.859417 32083 consensus_queue.cc:1048] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.520582 32113 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.521239 32113 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:20.523624 32113 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:20.524525 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:20.524909 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:20.525408 31884 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 1.
I20260709 13:11:20.525818 31957 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 1.
I20260709 13:11:20.527076 31997 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:20.527900 32113 raft_consensus.cc:2804] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:20.528216 32113 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.528503 32113 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.536510 32113 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:20.538749 32113 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:20.540278 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:20.540531 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:20.541064 31884 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.541122 31959 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.552378 31884 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 2.
I20260709 13:11:20.552846 31959 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 2.
I20260709 13:11:20.554018 31997 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:20.554971 32113 raft_consensus.cc:2804] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:20.555450 32113 raft_consensus.cc:697] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:20.556526 32113 consensus_queue.cc:237] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:20.565653 31779 catalog_manager.cc:5697] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 0 to 2, leader changed from <none> to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.940766 20382 ts_manager.cc:295] Set tserver state for 6f2d8d6e5e8e414ca119a5fcfe0ff125 to MAINTENANCE_MODE
I20260709 13:11:20.941628 20382 tablet_server.cc:179] TabletServer@127.19.231.129:0 shutting down...
I20260709 13:11:20.969069 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:20.969844 20382 tablet_replica.cc:333] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: stopping tablet replica
I20260709 13:11:20.970769 20382 raft_consensus.cc:2243] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.972155 20382 raft_consensus.cc:2272] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.974884 20382 tablet_replica.cc:333] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: stopping tablet replica
I20260709 13:11:20.975561 20382 raft_consensus.cc:2243] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.976029 20382 raft_consensus.cc:2272] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.978674 20382 tablet_replica.cc:333] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: stopping tablet replica
I20260709 13:11:20.979645 20382 raft_consensus.cc:2243] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.980624 20382 raft_consensus.cc:2272] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.983640 20382 tablet_replica.cc:333] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: stopping tablet replica
I20260709 13:11:20.984550 20382 raft_consensus.cc:2243] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.985728 20382 raft_consensus.cc:2272] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.988487 20382 tablet_replica.cc:333] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: stopping tablet replica
I20260709 13:11:20.989015 20382 raft_consensus.cc:2243] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.989382 20382 raft_consensus.cc:2272] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.991469 20382 tablet_replica.cc:333] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: stopping tablet replica
I20260709 13:11:20.991953 20382 raft_consensus.cc:2243] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.992399 20382 raft_consensus.cc:2272] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.994550 20382 tablet_replica.cc:333] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: stopping tablet replica
I20260709 13:11:20.995002 20382 raft_consensus.cc:2243] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.995827 20382 raft_consensus.cc:2272] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.998104 20382 tablet_replica.cc:333] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: stopping tablet replica
I20260709 13:11:20.998698 20382 raft_consensus.cc:2243] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.999574 20382 raft_consensus.cc:2272] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.002019 20382 tablet_replica.cc:333] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: stopping tablet replica
I20260709 13:11:21.002867 20382 raft_consensus.cc:2243] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.003504 20382 raft_consensus.cc:2272] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:21.003572 31997 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 102 similar messages]
W20260709 13:11:21.007195 31997 consensus_peers.cc:597] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.007440 20382 tablet_replica.cc:333] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: stopping tablet replica
I20260709 13:11:21.008075 20382 raft_consensus.cc:2243] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.008558 20382 raft_consensus.cc:2272] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:21.034273 31923 consensus_peers.cc:597] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.045859 20382 tablet_server.cc:196] TabletServer@127.19.231.129:0 shutdown complete.
W20260709 13:11:21.057960 31997 consensus_peers.cc:597] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.071741 31997 consensus_peers.cc:597] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.177971 31959 raft_consensus.cc:1275] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:21.179427 32113 consensus_queue.cc:1048] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:21.323336 31997 consensus_peers.cc:597] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.653015 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:21.935981 32178 raft_consensus.cc:493] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:21.936733 32178 raft_consensus.cc:515] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:21.938644 32178 leader_election.cc:290] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:21.939805 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
W20260709 13:11:21.942912 31997 leader_election.cc:336] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:21.943310 31997 leader_election.cc:304] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693
I20260709 13:11:21.943924 32178 raft_consensus.cc:2749] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:21.967552 32177 raft_consensus.cc:493] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:21.968123 32177 raft_consensus.cc:515] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:21.970141 32177 leader_election.cc:290] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:21.972607 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
W20260709 13:11:21.975171 31923 leader_election.cc:336] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:21.975534 31923 leader_election.cc:304] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:21.976272 32180 raft_consensus.cc:2749] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:22.010385 32180 raft_consensus.cc:493] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.010908 32180 raft_consensus.cc:515] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.012748 32180 leader_election.cc:290] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:22.014389 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
W20260709 13:11:22.016595 31923 leader_election.cc:336] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.016952 31923 leader_election.cc:304] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:22.017536 32180 raft_consensus.cc:2749] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:22.051782 32180 raft_consensus.cc:493] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.052297 32180 raft_consensus.cc:515] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.054147 32180 leader_election.cc:290] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:22.055817 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:22.056569 32033 raft_consensus.cc:2468] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 1.
I20260709 13:11:22.057550 31923 leader_election.cc:304] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:22.058260 32180 raft_consensus.cc:2804] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:22.058343 31923 leader_election.cc:336] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.058712 32180 raft_consensus.cc:493] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.059162 32180 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.062641 32178 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.063304 32178 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.065567 32178 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:22.066900 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:22.066697 32180 raft_consensus.cc:515] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.068948 32180 leader_election.cc:290] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
W20260709 13:11:22.069238 31997 leader_election.cc:336] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.069733 31997 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693
I20260709 13:11:22.070367 32178 raft_consensus.cc:2749] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:22.070405 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:22.071200 32033 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:22.074118 31923 leader_election.cc:336] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.077984 32033 raft_consensus.cc:2468] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 2.
I20260709 13:11:22.079336 31923 leader_election.cc:304] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:22.080060 32180 raft_consensus.cc:2804] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:22.080472 32180 raft_consensus.cc:697] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:22.081285 32180 consensus_queue.cc:237] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.088748 31780 catalog_manager.cc:5697] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 1 to 2, leader changed from 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129) to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.146615 32178 raft_consensus.cc:493] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.147276 32178 raft_consensus.cc:515] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.149158 32178 leader_election.cc:290] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:22.150424 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:22.151225 31959 raft_consensus.cc:2468] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 1.
I20260709 13:11:22.152323 31996 leader_election.cc:304] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:22.153024 32178 raft_consensus.cc:2804] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:22.153098 31997 leader_election.cc:336] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.153416 32178 raft_consensus.cc:493] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.153813 32178 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.156435 32179 raft_consensus.cc:493] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.157106 32179 raft_consensus.cc:515] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.159652 32179 leader_election.cc:290] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:22.160801 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:22.162226 32178 raft_consensus.cc:515] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
W20260709 13:11:22.163684 31997 leader_election.cc:336] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.164132 31997 leader_election.cc:304] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693
I20260709 13:11:22.164383 32178 leader_election.cc:290] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:22.164857 32179 raft_consensus.cc:2749] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:22.165524 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:22.166028 31959 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:22.169512 31997 leader_election.cc:336] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.171458 31959 raft_consensus.cc:2468] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 2.
I20260709 13:11:22.172519 31996 leader_election.cc:304] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:22.173228 32179 raft_consensus.cc:2804] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:22.173642 32179 raft_consensus.cc:697] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:22.174372 32179 consensus_queue.cc:237] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.181594 31780 catalog_manager.cc:5697] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 1 to 2, leader changed from 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129) to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.361728 32180 raft_consensus.cc:493] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.362207 32180 raft_consensus.cc:515] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.363981 32180 leader_election.cc:290] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:22.365499 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:22.366082 32033 raft_consensus.cc:2468] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 1.
I20260709 13:11:22.367146 31923 leader_election.cc:304] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:22.367898 32180 raft_consensus.cc:2804] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:22.367920 31923 leader_election.cc:336] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.368260 32180 raft_consensus.cc:493] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.368630 32180 raft_consensus.cc:3060] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.374032 32180 raft_consensus.cc:515] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.375751 32180 leader_election.cc:290] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:22.377317 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:22.377863 32033 raft_consensus.cc:3060] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:22.379312 31923 leader_election.cc:336] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.383139 32033 raft_consensus.cc:2468] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 2.
I20260709 13:11:22.384325 31923 leader_election.cc:304] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:22.385023 32180 raft_consensus.cc:2804] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:22.385433 32180 raft_consensus.cc:697] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:22.386297 32180 consensus_queue.cc:237] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.393023 31780 catalog_manager.cc:5697] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 1 to 2, leader changed from 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129) to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.426900 32180 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.427456 32180 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.429133 32180 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:22.430706 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:22.431417 32033 raft_consensus.cc:2468] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 1.
I20260709 13:11:22.432446 31923 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:22.433120 32180 raft_consensus.cc:2804] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:22.433208 31923 leader_election.cc:336] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.433530 32180 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.433951 32180 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.439589 32180 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.441421 32180 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:22.443051 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:22.443722 32033 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:22.445292 31923 leader_election.cc:336] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.449889 32033 raft_consensus.cc:2468] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 2.
I20260709 13:11:22.450888 31923 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:22.451503 32180 raft_consensus.cc:2804] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:22.451920 32180 raft_consensus.cc:697] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:22.452795 32180 consensus_queue.cc:237] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.460105 31780 catalog_manager.cc:5697] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 1 to 2, leader changed from 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129) to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.481312 32179 raft_consensus.cc:493] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.481979 32179 raft_consensus.cc:515] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.484304 32179 leader_election.cc:290] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:22.485443 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:22.486223 31959 raft_consensus.cc:2468] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 1.
I20260709 13:11:22.487236 31996 leader_election.cc:304] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:22.487954 32179 raft_consensus.cc:2804] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:22.487986 31997 leader_election.cc:336] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.488291 32179 raft_consensus.cc:493] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f2d8d6e5e8e414ca119a5fcfe0ff125)
I20260709 13:11:22.488647 32179 raft_consensus.cc:3060] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.495589 32179 raft_consensus.cc:515] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.497304 32179 leader_election.cc:290] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:22.498494 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:22.499205 31959 raft_consensus.cc:3060] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:22.501327 31997 leader_election.cc:336] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:22.506457 31959 raft_consensus.cc:2468] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 2.
I20260709 13:11:22.507614 31996 leader_election.cc:304] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:22.508379 32179 raft_consensus.cc:2804] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:22.508796 32179 raft_consensus.cc:697] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:22.509701 32179 consensus_queue.cc:237] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:22.516541 31780 catalog_manager.cc:5697] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 1 to 2, leader changed from 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129) to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:22.572937 31997 consensus_peers.cc:597] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.593051 32033 raft_consensus.cc:1275] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:22.594422 32180 consensus_queue.cc:1048] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:22.605554 31923 consensus_peers.cc:597] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:22.654044 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:22.733666 31959 raft_consensus.cc:1275] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:22.735296 32179 consensus_queue.cc:1048] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:22.775903 31923 consensus_peers.cc:597] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:22.894634 31923 consensus_peers.cc:597] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.961741 32033 raft_consensus.cc:1275] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:22.963032 32177 consensus_queue.cc:1048] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:23.025868 31959 raft_consensus.cc:1275] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:23.027424 32179 consensus_queue.cc:1048] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:23.046053 31997 consensus_peers.cc:597] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:23.046425 32033 raft_consensus.cc:1275] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:23.047879 32177 consensus_queue.cc:1048] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:23.231539 31923 consensus_peers.cc:597] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.392925 31997 consensus_peers.cc:597] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.432140 31997 consensus_peers.cc:597] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.623013 31997 consensus_peers.cc:597] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.655117 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:23.760538 31997 consensus_peers.cc:597] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:24.656217 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:24.878417 31997 consensus_peers.cc:597] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:25.163503 31923 consensus_peers.cc:597] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:25.389571 31923 consensus_peers.cc:597] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:25.497272 31923 consensus_peers.cc:597] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:25.537207 31997 consensus_peers.cc:597] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:25.634567 31997 consensus_peers.cc:597] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:25.655455 31923 consensus_peers.cc:597] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:25.657140 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:25.940653 31997 consensus_peers.cc:597] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:26.020566 31923 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111) [suppressed 102 similar messages]
I20260709 13:11:26.079244 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:26.085757 32205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:26.087831 32206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:26.089438 20382 server_base.cc:1061] running on GCE node
W20260709 13:11:26.089741 32208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:26.091121 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:26.091372 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:26.091574 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602686091559 us; error 0 us; skew 500 ppm
I20260709 13:11:26.092365 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:26.095012 20382 webserver.cc:533] Webserver started at http://127.19.231.129:46793/ using document root <none> and password file <none>
I20260709 13:11:26.095484 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:26.095636 20382 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:11:26.099555 20382 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:11:26.103668 32213 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:26.104480 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:11:26.104790 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-0-root
uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
format_stamp: "Formatted at 2026-07-09 13:11:17 on dist-test-slave-1t6m"
I20260709 13:11:26.105167 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337466250-20382-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:26.139176 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:26.140561 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:26.142086 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:26.146183 32220 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:11:26.196734 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:11:26.197088 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.052s	user 0.001s	sys 0.002s
I20260709 13:11:26.197428 20382 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:11:26.202513 32220 tablet_bootstrap.cc:492] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:26.217176 32220 tablet_bootstrap.cc:492] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.218117 32220 tablet_bootstrap.cc:492] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap complete.
I20260709 13:11:26.218698 32220 ts_tablet_manager.cc:1403] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:11:26.220976 32220 raft_consensus.cc:359] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.221537 32220 raft_consensus.cc:740] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.222229 32220 consensus_queue.cc:260] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.224597 32220 ts_tablet_manager.cc:1434] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:26.225389 32220 tablet_bootstrap.cc:492] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
W20260709 13:11:26.230471 31997 consensus_peers.cc:597] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:26.240561 20382 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:11:26.240871 32220 tablet_bootstrap.cc:492] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.240952 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.044s	user 0.042s	sys 0.000s
I20260709 13:11:26.241916 32220 tablet_bootstrap.cc:492] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap complete.
I20260709 13:11:26.242838 32220 ts_tablet_manager.cc:1403] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:11:26.245271 32220 raft_consensus.cc:359] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.245887 32220 raft_consensus.cc:740] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.246572 32220 consensus_queue.cc:260] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.248312 32220 ts_tablet_manager.cc:1434] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:26.249200 32220 tablet_bootstrap.cc:492] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:26.269450 32220 tablet_bootstrap.cc:492] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.270651 32220 tablet_bootstrap.cc:492] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap complete.
I20260709 13:11:26.271528 32220 ts_tablet_manager.cc:1403] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:11:26.273967 32220 raft_consensus.cc:359] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.274895 32220 raft_consensus.cc:740] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.275946 32220 consensus_queue.cc:260] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.278666 32220 ts_tablet_manager.cc:1434] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:26.279956 32220 tablet_bootstrap.cc:492] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:26.306246 32220 tablet_bootstrap.cc:492] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.307372 32220 tablet_bootstrap.cc:492] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap complete.
I20260709 13:11:26.308045 32220 ts_tablet_manager.cc:1403] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.008s
I20260709 13:11:26.310961 32220 raft_consensus.cc:359] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.311861 32220 raft_consensus.cc:740] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.312672 32220 consensus_queue.cc:260] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.315026 32220 ts_tablet_manager.cc:1434] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:26.316011 32220 tablet_bootstrap.cc:492] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:26.320041 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.129:36871
I20260709 13:11:26.320153 32282 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.129:36871 every 8 connection(s)
I20260709 13:11:26.342023 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:26.353710 31997 consensus_peers.cc:597] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:26.381492 32220 tablet_bootstrap.cc:492] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.382596 32220 tablet_bootstrap.cc:492] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap complete.
I20260709 13:11:26.383342 32220 ts_tablet_manager.cc:1403] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.068s	user 0.035s	sys 0.028s
I20260709 13:11:26.386072 32220 raft_consensus.cc:359] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.386412 31959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9"
dest_uuid: "f0414f76a3b045f38f10808155062693"
mode: GRACEFUL
new_leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:54046
I20260709 13:11:26.386885 32220 raft_consensus.cc:740] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.387207 31959 raft_consensus.cc:606] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 1 LEADER]: Received request to transfer leadership to TS e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:26.387603 32220 consensus_queue.cc:260] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.389420 32284 heartbeater.cc:344] Connected to a master server at 127.19.231.190:41089
I20260709 13:11:26.389915 32284 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:26.389802 32220 ts_tablet_manager.cc:1434] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:26.391067 32284 heartbeater.cc:507] Master 127.19.231.190:41089 requested a full tablet report, sending...
I20260709 13:11:26.391538 32220 tablet_bootstrap.cc:492] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:26.398532 31780 ts_manager.cc:194] Re-registered known tserver with Master: 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871)
I20260709 13:11:26.403329 32033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
mode: GRACEFUL
new_leader_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:11:26.404007 32033 raft_consensus.cc:606] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Received request to transfer leadership to TS f0414f76a3b045f38f10808155062693
I20260709 13:11:26.406843 32033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
mode: GRACEFUL
new_leader_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:11:26.407364 32033 raft_consensus.cc:606] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Received request to transfer leadership to TS f0414f76a3b045f38f10808155062693
I20260709 13:11:26.407526 32220 tablet_bootstrap.cc:492] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.408505 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:26.408519 32220 tablet_bootstrap.cc:492] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap complete.
I20260709 13:11:26.409319 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:26.410068 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:26.410339 32220 ts_tablet_manager.cc:1403] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:11:26.410496 31780 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38020
I20260709 13:11:26.412941 32220 raft_consensus.cc:359] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.413651 32220 raft_consensus.cc:740] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.414672 32284 heartbeater.cc:499] Master 127.19.231.190:41089 was elected leader, sending a full tablet report...
I20260709 13:11:26.414498 32220 consensus_queue.cc:260] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.416656 32220 ts_tablet_manager.cc:1434] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:11:26.417654 32220 tablet_bootstrap.cc:492] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:26.424276 32257 raft_consensus.cc:3060] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.431093 32220 tablet_bootstrap.cc:492] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.431886 32220 tablet_bootstrap.cc:492] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap complete.
I20260709 13:11:26.432412 32220 ts_tablet_manager.cc:1403] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:11:26.434829 32220 raft_consensus.cc:359] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.435539 32220 raft_consensus.cc:740] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.436187 32220 consensus_queue.cc:260] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.439345 32220 ts_tablet_manager.cc:1434] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:26.440198 32220 tablet_bootstrap.cc:492] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:26.455092 32220 tablet_bootstrap.cc:492] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.455850 32220 tablet_bootstrap.cc:492] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap complete.
I20260709 13:11:26.456434 32220 ts_tablet_manager.cc:1403] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:11:26.458249 32220 raft_consensus.cc:359] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.458771 32220 raft_consensus.cc:740] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.459358 32220 consensus_queue.cc:260] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.461076 32220 ts_tablet_manager.cc:1434] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:26.462013 32220 tablet_bootstrap.cc:492] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:26.474948 32220 tablet_bootstrap.cc:492] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.475591 32220 tablet_bootstrap.cc:492] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap complete.
I20260709 13:11:26.476155 32220 ts_tablet_manager.cc:1403] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:11:26.478006 32220 raft_consensus.cc:359] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.478535 32220 raft_consensus.cc:740] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.479156 32220 consensus_queue.cc:260] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.481174 32220 ts_tablet_manager.cc:1434] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:26.482023 32220 tablet_bootstrap.cc:492] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap starting.
I20260709 13:11:26.494601 32220 tablet_bootstrap.cc:492] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.495398 32220 tablet_bootstrap.cc:492] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Bootstrap complete.
I20260709 13:11:26.495985 32220 ts_tablet_manager.cc:1403] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:11:26.497821 32220 raft_consensus.cc:359] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.498360 32220 raft_consensus.cc:740] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.498983 32220 consensus_queue.cc:260] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.500895 32220 ts_tablet_manager.cc:1434] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:11:26.515632 32249 raft_consensus.cc:993] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b: : Instructing follower f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:26.516041 32257 raft_consensus.cc:3060] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.516238 32203 raft_consensus.cc:1081] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Signalling peer f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:26.517977 31959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6"
dest_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:54022
I20260709 13:11:26.518533 31959 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:26.518877 31959 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:26.525003 31959 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.527354 31959 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 3 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:26.528021 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:26.528362 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:26.528769 32257 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:26.528927 32033 raft_consensus.cc:3055] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:26.529326 32033 raft_consensus.cc:740] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:26.530090 32033 consensus_queue.cc:260] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.531359 32033 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:26.536360 32257 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 3.
I20260709 13:11:26.537591 31923 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:26.538355 32180 raft_consensus.cc:2804] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:26.538408 32033 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 3.
I20260709 13:11:26.539721 32180 raft_consensus.cc:697] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:26.540565 32180 consensus_queue.cc:237] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.547709 31780 catalog_manager.cc:5697] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 2 to 3, leader changed from e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131) to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.650934 32257 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:26.658278 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:26.670887 32257 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.689177 32257 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.752254 32249 raft_consensus.cc:993] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b: : Instructing follower f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:26.752650 32203 raft_consensus.cc:1081] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Signalling peer f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:26.754092 31959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e"
dest_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:54022
I20260709 13:11:26.754594 31959 raft_consensus.cc:493] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:26.754928 31959 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:26.759948 31959 raft_consensus.cc:515] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.761394 31959 leader_election.cc:290] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 3 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:26.762321 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:26.762455 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:26.763074 32257 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:26.763155 32033 raft_consensus.cc:3055] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:26.763550 32033 raft_consensus.cc:740] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:26.764138 32033 consensus_queue.cc:260] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.764999 32033 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:26.768567 32257 raft_consensus.cc:2468] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 3.
I20260709 13:11:26.769429 32033 raft_consensus.cc:2468] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 3.
I20260709 13:11:26.769645 31923 leader_election.cc:304] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:26.770408 32180 raft_consensus.cc:2804] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:26.770838 32180 raft_consensus.cc:697] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:26.771626 32180 consensus_queue.cc:237] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.777582 31779 catalog_manager.cc:5697] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 2 to 3, leader changed from e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131) to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.908401 32180 raft_consensus.cc:993] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693: : Instructing follower e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:26.908887 32311 raft_consensus.cc:1081] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 1 LEADER]: Signalling peer e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:26.910271 32033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:45228
I20260709 13:11:26.910728 32033 raft_consensus.cc:493] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:26.911036 32033 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.915717 32033 raft_consensus.cc:515] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.917359 32033 leader_election.cc:290] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:26.918259 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:26.918553 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:26.918995 32257 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.919142 31959 raft_consensus.cc:3055] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:26.919524 31959 raft_consensus.cc:740] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:26.920333 31959 consensus_queue.cc:260] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.921574 31959 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.926668 32257 raft_consensus.cc:2468] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 2.
I20260709 13:11:26.928030 31997 leader_election.cc:304] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:26.928514 31959 raft_consensus.cc:2468] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 2.
I20260709 13:11:26.928982 32203 raft_consensus.cc:2804] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:26.929483 32203 raft_consensus.cc:697] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:26.930392 32203 consensus_queue.cc:237] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:26.937229 31779 catalog_manager.cc:5697] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 1 to 2, leader changed from f0414f76a3b045f38f10808155062693 (127.19.231.130) to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 2 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.970348 32257 raft_consensus.cc:1275] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:26.971794 32311 consensus_queue.cc:1048] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:26.981520 32033 raft_consensus.cc:1275] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:26.983034 32180 consensus_queue.cc:1048] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.163663 32033 raft_consensus.cc:1275] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:27.164860 32180 consensus_queue.cc:1048] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:27.173333 32257 raft_consensus.cc:1275] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:27.175374 32301 consensus_queue.cc:1048] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:27.420243 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:27.427668 32033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
mode: GRACEFUL
new_leader_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:11:27.428207 32033 raft_consensus.cc:606] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Received request to transfer leadership to TS f0414f76a3b045f38f10808155062693
I20260709 13:11:27.430721 31959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a"
dest_uuid: "f0414f76a3b045f38f10808155062693"
mode: GRACEFUL
new_leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:54046
I20260709 13:11:27.431231 31959 raft_consensus.cc:606] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Received request to transfer leadership to TS e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:27.433568 31959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e"
dest_uuid: "f0414f76a3b045f38f10808155062693"
mode: GRACEFUL
new_leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:54046
I20260709 13:11:27.434055 31959 raft_consensus.cc:606] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Received request to transfer leadership to TS e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:27.435041 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:27.435508 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:27.436064 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:27.487943 32257 raft_consensus.cc:1275] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.489282 32317 consensus_queue.cc:1048] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.497241 31959 raft_consensus.cc:1275] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.498740 32249 consensus_queue.cc:1048] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.506456 32203 raft_consensus.cc:993] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b: : Instructing follower f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:27.507015 32249 raft_consensus.cc:1081] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Signalling peer f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:27.508601 31959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9"
dest_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:54022
I20260709 13:11:27.509179 31959 raft_consensus.cc:493] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.509501 31959 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:27.514580 31959 raft_consensus.cc:515] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:27.516196 31959 leader_election.cc:290] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 3 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:27.517146 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:27.517026 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:27.517812 32033 raft_consensus.cc:3055] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:27.517910 32257 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:27.518117 32033 raft_consensus.cc:740] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:27.518975 32033 consensus_queue.cc:260] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:27.520177 32033 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:27.523931 32257 raft_consensus.cc:2468] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 3.
I20260709 13:11:27.525177 31923 leader_election.cc:304] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:27.525454 32033 raft_consensus.cc:2468] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 3.
I20260709 13:11:27.525867 32301 raft_consensus.cc:2804] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:27.526463 32301 raft_consensus.cc:697] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:27.527284 32301 consensus_queue.cc:237] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:27.533203 31779 catalog_manager.cc:5697] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 2 to 3, leader changed from e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131) to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:27.659548 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:27.761053 32301 raft_consensus.cc:993] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693: : Instructing follower e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:27.761600 32301 raft_consensus.cc:1081] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Signalling peer e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:27.763057 32032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:45228
I20260709 13:11:27.763489 32032 raft_consensus.cc:493] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.763742 32032 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:27.769255 32032 raft_consensus.cc:515] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:27.771113 32032 leader_election.cc:290] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:27.771869 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:27.772231 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1cb7b9945cb47e7bb4031796f97722e" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:27.772553 32257 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:27.772812 31959 raft_consensus.cc:3055] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:27.773132 31959 raft_consensus.cc:740] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:27.773900 31959 consensus_queue.cc:260] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:27.775143 31959 raft_consensus.cc:3060] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:27.780090 32257 raft_consensus.cc:2468] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 4.
I20260709 13:11:27.781445 31997 leader_election.cc:304] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:27.782044 31959 raft_consensus.cc:2468] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 4.
I20260709 13:11:27.782231 32249 raft_consensus.cc:2804] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:27.782897 32249 raft_consensus.cc:697] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 4 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:27.783670 32249 consensus_queue.cc:237] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:27.789763 31779 catalog_manager.cc:5697] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 3 to 4, leader changed from f0414f76a3b045f38f10808155062693 (127.19.231.130) to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 4 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.814924 32180 raft_consensus.cc:993] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693: : Instructing follower e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:27.815351 32301 raft_consensus.cc:1081] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Signalling peer e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:27.816686 32032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:45228
I20260709 13:11:27.817178 32032 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.817477 32032 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:27.824038 32032 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:27.825703 32032 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:27.826547 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:27.826648 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:27.827325 32257 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:27.827409 31959 raft_consensus.cc:3055] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:27.827795 31959 raft_consensus.cc:740] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:27.828392 31959 consensus_queue.cc:260] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:27.829270 31959 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:27.832999 32257 raft_consensus.cc:2468] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 3.
I20260709 13:11:27.833871 31959 raft_consensus.cc:2468] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 3.
I20260709 13:11:27.834131 31997 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:27.834995 32249 raft_consensus.cc:2804] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:27.835426 32249 raft_consensus.cc:697] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:27.836174 32249 consensus_queue.cc:237] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:27.842917 31779 catalog_manager.cc:5697] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 2 to 3, leader changed from f0414f76a3b045f38f10808155062693 (127.19.231.130) to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 3 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.032974 32257 raft_consensus.cc:1275] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:28.034286 32301 consensus_queue.cc:1048] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:28.039161 32032 raft_consensus.cc:1275] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:28.040772 32311 consensus_queue.cc:1048] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:28.230013 31959 raft_consensus.cc:1275] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:28.231204 32249 consensus_queue.cc:1048] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:28.239485 32257 raft_consensus.cc:1275] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:28.241447 32249 consensus_queue.cc:1048] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:28.277904 32257 raft_consensus.cc:1275] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:28.279127 32249 consensus_queue.cc:1048] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:28.287302 31959 raft_consensus.cc:1275] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:28.289552 32335 consensus_queue.cc:1048] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:28.443823 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:28.450939 31959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "057127d733914dff839f4d0ac064177b"
dest_uuid: "f0414f76a3b045f38f10808155062693"
mode: GRACEFUL
new_leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:54046
I20260709 13:11:28.451406 31959 raft_consensus.cc:606] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Received request to transfer leadership to TS e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:28.453917 32032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
mode: GRACEFUL
new_leader_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:11:28.454371 32032 raft_consensus.cc:606] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Received request to transfer leadership to TS f0414f76a3b045f38f10808155062693
I20260709 13:11:28.456724 32032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
mode: GRACEFUL
new_leader_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:11:28.457182 32032 raft_consensus.cc:606] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Received request to transfer leadership to TS f0414f76a3b045f38f10808155062693
I20260709 13:11:28.458177 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:28.458638 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:28.459172 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:28.632313 32203 raft_consensus.cc:993] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b: : Instructing follower f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:28.632813 32335 raft_consensus.cc:1081] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Signalling peer f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:28.634143 31959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a"
dest_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:54022
I20260709 13:11:28.634549 31959 raft_consensus.cc:493] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:28.634824 31959 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.639361 31959 raft_consensus.cc:515] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:28.640841 31959 leader_election.cc:290] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:28.641567 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:28.641939 32032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:28.642133 32257 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.642495 32032 raft_consensus.cc:3055] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:28.642778 32032 raft_consensus.cc:740] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:28.643659 32032 consensus_queue.cc:260] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:28.644768 32032 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.647703 32257 raft_consensus.cc:2468] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 2.
I20260709 13:11:28.648754 31923 leader_election.cc:304] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:28.649526 32337 raft_consensus.cc:2804] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:28.649940 32337 raft_consensus.cc:697] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:28.650753 32337 consensus_queue.cc:237] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:28.651134 32032 raft_consensus.cc:2468] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 2.
I20260709 13:11:28.659721 31779 catalog_manager.cc:5697] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 1 to 2, leader changed from e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131) to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:28.660792 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:28.711104 32335 raft_consensus.cc:993] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b: : Instructing follower f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:28.711689 32203 raft_consensus.cc:1081] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Signalling peer f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:28.713207 31959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad"
dest_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:54022
I20260709 13:11:28.713692 31959 raft_consensus.cc:493] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:28.713981 31959 raft_consensus.cc:3060] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.718734 31959 raft_consensus.cc:515] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:28.720129 31959 leader_election.cc:290] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:28.721006 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:28.721261 32032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:28.721629 32257 raft_consensus.cc:3060] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.721860 32032 raft_consensus.cc:3055] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:28.722223 32032 raft_consensus.cc:740] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:28.723101 32032 consensus_queue.cc:260] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:28.724464 32032 raft_consensus.cc:3060] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.729018 32257 raft_consensus.cc:2468] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 2.
I20260709 13:11:28.730235 31923 leader_election.cc:304] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:28.730990 32337 raft_consensus.cc:2804] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:28.731487 32337 raft_consensus.cc:697] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:28.731741 32032 raft_consensus.cc:2468] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 2.
I20260709 13:11:28.732395 32337 consensus_queue.cc:237] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:28.739719 31779 catalog_manager.cc:5697] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 1 to 2, leader changed from e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131) to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 2 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.779791 32337 raft_consensus.cc:993] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693: : Instructing follower e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:28.780298 32327 raft_consensus.cc:1081] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Signalling peer e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:28.781724 32032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "057127d733914dff839f4d0ac064177b"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:45228
I20260709 13:11:28.782233 32032 raft_consensus.cc:493] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:28.782548 32032 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.788164 32032 raft_consensus.cc:515] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:28.790235 32032 leader_election.cc:290] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:28.791359 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:28.791249 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:28.792148 31959 raft_consensus.cc:3055] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:28.792259 32257 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.792429 31959 raft_consensus.cc:740] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:28.793246 31959 consensus_queue.cc:260] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:28.794130 31959 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.797560 32257 raft_consensus.cc:2468] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 3.
I20260709 13:11:28.798636 31959 raft_consensus.cc:2468] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 3.
I20260709 13:11:28.798723 31997 leader_election.cc:304] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:28.799664 32203 raft_consensus.cc:2804] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:28.800176 32203 raft_consensus.cc:697] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 3 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:28.800952 32203 consensus_queue.cc:237] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:28.807682 31779 catalog_manager.cc:5697] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 2 to 3, leader changed from f0414f76a3b045f38f10808155062693 (127.19.231.130) to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 3 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.160689 32032 raft_consensus.cc:1275] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.162227 32327 consensus_queue.cc:1048] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.167081 32033 raft_consensus.cc:1275] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.168365 32327 consensus_queue.cc:1048] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.175057 32257 raft_consensus.cc:1275] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.176689 32337 consensus_queue.cc:1048] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.184016 32256 raft_consensus.cc:1275] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.185622 32346 consensus_queue.cc:1048] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.327885 32257 raft_consensus.cc:1275] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:29.329242 32344 consensus_queue.cc:1048] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:29.337548 31959 raft_consensus.cc:1275] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:29.339114 32203 consensus_queue.cc:1048] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:29.465553 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:29.473636 32032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "057127d733914dff839f4d0ac064177b"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
mode: GRACEFUL
new_leader_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:11:29.474285 32032 raft_consensus.cc:606] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 3 LEADER]: Received request to transfer leadership to TS f0414f76a3b045f38f10808155062693
I20260709 13:11:29.477130 31959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9"
dest_uuid: "f0414f76a3b045f38f10808155062693"
mode: GRACEFUL
new_leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:54046
I20260709 13:11:29.477669 31959 raft_consensus.cc:606] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Received request to transfer leadership to TS e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:29.480410 31959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3"
dest_uuid: "f0414f76a3b045f38f10808155062693"
mode: GRACEFUL
new_leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:54046
I20260709 13:11:29.480912 31959 raft_consensus.cc:606] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Received request to transfer leadership to TS e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:29.482064 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:29.482614 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:29.483259 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:29.581540 32346 raft_consensus.cc:993] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693: : Instructing follower e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:29.582142 32327 raft_consensus.cc:1081] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Signalling peer e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:29.583518 32032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:45228
I20260709 13:11:29.584008 32032 raft_consensus.cc:493] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.584324 32032 raft_consensus.cc:3060] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.589432 32032 raft_consensus.cc:515] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:29.591445 32032 leader_election.cc:290] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:29.592227 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:29.592859 32257 raft_consensus.cc:3060] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.593564 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e33a09b4634ba4b5936b07b0c140a3" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:29.594178 31959 raft_consensus.cc:3055] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:29.594511 31959 raft_consensus.cc:740] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:29.595253 31959 consensus_queue.cc:260] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:29.596194 31959 raft_consensus.cc:3060] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.598398 32257 raft_consensus.cc:2468] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 3.
I20260709 13:11:29.599453 31997 leader_election.cc:304] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:29.600165 32335 raft_consensus.cc:2804] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:29.600621 32335 raft_consensus.cc:697] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:29.601354 31959 raft_consensus.cc:2468] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 3.
I20260709 13:11:29.601502 32335 consensus_queue.cc:237] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:29.608647 31779 catalog_manager.cc:5697] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 2 to 3, leader changed from f0414f76a3b045f38f10808155062693 (127.19.231.130) to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 3 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.619599 32346 raft_consensus.cc:993] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693: : Instructing follower e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:29.620105 32337 raft_consensus.cc:1081] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Signalling peer e4c77cd4f4ed4f11a46548630b48a19b to start an election
I20260709 13:11:29.621657 32033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:45228
I20260709 13:11:29.622228 32033 raft_consensus.cc:493] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.622519 32033 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.627002 32033 raft_consensus.cc:515] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:29.628468 32033 leader_election.cc:290] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:29.629295 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:29.629472 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:29.629856 32257 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.630034 31959 raft_consensus.cc:3055] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:29.630403 31959 raft_consensus.cc:740] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:29.631163 31959 consensus_queue.cc:260] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:29.632076 31959 raft_consensus.cc:3060] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.635865 32257 raft_consensus.cc:2468] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 4.
I20260709 13:11:29.636479 31959 raft_consensus.cc:2468] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 4.
I20260709 13:11:29.636988 31997 leader_election.cc:304] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:29.637846 32335 raft_consensus.cc:2804] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:29.638279 32335 raft_consensus.cc:697] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:29.639042 32335 consensus_queue.cc:237] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:29.645846 31779 catalog_manager.cc:5697] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 3 to 4, leader changed from f0414f76a3b045f38f10808155062693 (127.19.231.130) to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 4 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:29.661794 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:29.771668 32203 raft_consensus.cc:993] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b: : Instructing follower f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:29.772810 32335 raft_consensus.cc:1081] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 3 LEADER]: Signalling peer f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:29.775437 31959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "057127d733914dff839f4d0ac064177b"
dest_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:54022
I20260709 13:11:29.776400 31959 raft_consensus.cc:493] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.776881 31959 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.786252 31959 raft_consensus.cc:515] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:29.788112 31959 leader_election.cc:290] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:29.789252 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:29.789230 32257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057127d733914dff839f4d0ac064177b" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:29.790115 32033 raft_consensus.cc:3055] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:29.790319 32257 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.790405 32033 raft_consensus.cc:740] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:29.791589 32033 consensus_queue.cc:260] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:29.793031 32033 raft_consensus.cc:3060] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.797770 32257 raft_consensus.cc:2468] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 4.
I20260709 13:11:29.799222 31923 leader_election.cc:304] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:29.800081 32337 raft_consensus.cc:2804] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:29.800546 32337 raft_consensus.cc:697] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 4 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:29.801419 32033 raft_consensus.cc:2468] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 4.
I20260709 13:11:29.801936 32337 consensus_queue.cc:237] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:29.809736 31779 catalog_manager.cc:5697] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 3 to 4, leader changed from e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131) to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 4 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:30.716928 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:31.051658 32365 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c77cd4f4ed4f11a46548630b48a19b)
I20260709 13:11:31.052810 32365 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.055859 32365 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:31.302887 32366 raft_consensus.cc:493] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:31.303676 32366 raft_consensus.cc:515] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.306494 32366 leader_election.cc:290] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:31.322397 32370 raft_consensus.cc:493] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:31.323225 32370 raft_consensus.cc:515] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.325691 32370 leader_election.cc:290] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:31.327018 32365 raft_consensus.cc:493] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c77cd4f4ed4f11a46548630b48a19b)
I20260709 13:11:31.327781 32364 raft_consensus.cc:493] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c77cd4f4ed4f11a46548630b48a19b)
I20260709 13:11:31.327883 32365 raft_consensus.cc:515] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.328527 32364 raft_consensus.cc:515] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.330389 32365 leader_election.cc:290] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:31.334724 32368 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:31.335577 32368 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.336916 31957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:31.337831 32033 raft_consensus.cc:1275] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:31.339421 31955 raft_consensus.cc:1275] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:31.340116 32032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:31.341231 31953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:31.330606 32364 leader_election.cc:290] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:31.339474 32368 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:31.345172 32032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bee2ef3424429ea381dec7bd22824a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:31.345403 32252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:31.346163 32252 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 3.
I20260709 13:11:31.347210 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:31.348873 31997 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: 
I20260709 13:11:31.349234 32364 consensus_queue.cc:1048] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:31.352185 31959 raft_consensus.cc:1275] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:31.352694 31953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:31.352959 32370 raft_consensus.cc:2804] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:31.355340 32370 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting leader election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:31.355937 32370 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.356644 32255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:31.357436 32255 raft_consensus.cc:2468] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 2.
I20260709 13:11:31.358048 32366 consensus_queue.cc:1048] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:31.360666 32366 consensus_queue.cc:1048] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:31.357461 32256 raft_consensus.cc:1275] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:31.368463 32253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:31.369387 32253 raft_consensus.cc:2468] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 2.
I20260709 13:11:31.373364 32371 raft_consensus.cc:493] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c77cd4f4ed4f11a46548630b48a19b)
I20260709 13:11:31.374156 31997 leader_election.cc:304] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: f0414f76a3b045f38f10808155062693
I20260709 13:11:31.390280 31997 leader_election.cc:304] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b; no voters: f0414f76a3b045f38f10808155062693
I20260709 13:11:31.377139 32256 raft_consensus.cc:1275] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:31.380445 32253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:31.381990 32255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bee2ef3424429ea381dec7bd22824a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:31.383323 32254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:31.393543 32368 raft_consensus.cc:2804] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:31.383584 32370 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.393986 32368 raft_consensus.cc:493] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:31.387768 32373 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c77cd4f4ed4f11a46548630b48a19b)
I20260709 13:11:31.393759 32256 raft_consensus.cc:1275] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Refusing update from remote peer e4c77cd4f4ed4f11a46548630b48a19b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:31.394457 32368 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.395612 32373 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.397051 32253 raft_consensus.cc:2468] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 3.
I20260709 13:11:31.397616 32372 consensus_queue.cc:1048] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:31.399060 32366 raft_consensus.cc:2804] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:31.406435 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:31.399892 32372 consensus_queue.cc:1048] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:31.403554 32371 raft_consensus.cc:515] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.387918 32374 raft_consensus.cc:493] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:31.413514 32374 raft_consensus.cc:515] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.404176 32370 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:31.404731 32368 raft_consensus.cc:515] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.405546 32367 consensus_queue.cc:1048] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:31.410622 31923 leader_election.cc:304] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:31.406248 32366 raft_consensus.cc:493] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:31.409072 32253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:31.425487 31923 leader_election.cc:304] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:31.426364 32366 raft_consensus.cc:3060] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.440066 32367 raft_consensus.cc:2749] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:31.428339 32364 raft_consensus.cc:2749] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.443849 32368 leader_election.cc:290] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:31.407150 32373 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:31.458501 31923 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:31.459556 32365 raft_consensus.cc:2804] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:31.459959 32365 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4c77cd4f4ed4f11a46548630b48a19b)
I20260709 13:11:31.460319 32365 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.471206 32371 leader_election.cc:290] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:31.474025 31953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:31.474201 32366 raft_consensus.cc:515] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.476490 32366 leader_election.cc:290] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:31.477018 32374 leader_election.cc:290] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:31.456698 32373 raft_consensus.cc:493] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.488160 31953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:31.486994 32373 raft_consensus.cc:515] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.492118 32365 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.493248 32373 leader_election.cc:290] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:31.494354 32365 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:31.526722 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:31.528146 32256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:31.534400 31923 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:31.537746 32365 raft_consensus.cc:2749] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:31.538156 31997 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693
I20260709 13:11:31.539077 32366 raft_consensus.cc:2749] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:31.540112 32256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:31.543242 32253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:31.543895 31997 leader_election.cc:304] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693
I20260709 13:11:31.544780 32368 raft_consensus.cc:2749] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:31.545691 31997 leader_election.cc:304] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693
I20260709 13:11:31.546588 32370 raft_consensus.cc:2749] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:31.565171 32032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:31.566601 32033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bee2ef3424429ea381dec7bd22824a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:31.567364 32030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:31.569343 32031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:31.574679 31953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bee2ef3424429ea381dec7bd22824a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:31.575379 31959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:31.577157 31954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323345efe837451881ebe9ec2d0226a9" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:31.580138 31956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:31.587582 32214 leader_election.cc:304] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125; no voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693
I20260709 13:11:31.588833 32373 raft_consensus.cc:2749] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.589484 32214 leader_election.cc:304] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125; no voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693
I20260709 13:11:31.590727 32373 raft_consensus.cc:2749] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:31.591686 32214 leader_election.cc:304] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125; no voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693
I20260709 13:11:31.593446 32214 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125; no voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693
I20260709 13:11:31.594646 32371 raft_consensus.cc:2749] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:31.596423 32373 raft_consensus.cc:2749] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:31.598711 32031 raft_consensus.cc:1240] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Rejecting Update request from peer f0414f76a3b045f38f10808155062693 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:31.600404 32381 consensus_queue.cc:1059] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:31.601452 32364 raft_consensus.cc:3055] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:31.601823 32364 raft_consensus.cc:740] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:31.602895 32364 consensus_queue.cc:260] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.603965 32364 raft_consensus.cc:3060] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.651329 32031 raft_consensus.cc:1240] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Rejecting Update request from peer f0414f76a3b045f38f10808155062693 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:31.652649 32364 consensus_queue.cc:1059] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:31.653573 32367 raft_consensus.cc:3055] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:31.653895 32367 raft_consensus.cc:740] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:31.654695 32367 consensus_queue.cc:260] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.655843 32367 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:31.656567 32054 debug-util.cc:398] Leaking SignalData structure 0x7b08003848e0 after lost signal to thread 20385
W20260709 13:11:31.657840 32054 debug-util.cc:398] Leaking SignalData structure 0x7b0800377360 after lost signal to thread 31816
W20260709 13:11:31.661372 32054 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7040 after lost signal to thread 32282
W20260709 13:11:31.721011 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:31.790021 31956 raft_consensus.cc:1240] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Rejecting Update request from peer e4c77cd4f4ed4f11a46548630b48a19b for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:31.791728 32369 consensus_queue.cc:1059] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:31.792711 32372 raft_consensus.cc:3055] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:31.793027 32372 raft_consensus.cc:740] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:31.793954 32372 consensus_queue.cc:260] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.795195 32372 raft_consensus.cc:3060] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.809859 32031 raft_consensus.cc:1240] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Rejecting Update request from peer f0414f76a3b045f38f10808155062693 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:31.811393 32367 consensus_queue.cc:1059] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:31.812480 32364 raft_consensus.cc:3055] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:31.812837 32364 raft_consensus.cc:740] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:31.813740 32364 consensus_queue.cc:260] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:31.814895 32364 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.946967 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:31.955878 31956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6"
dest_uuid: "f0414f76a3b045f38f10808155062693"
mode: GRACEFUL
new_leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
 from {username='slave'} at 127.0.0.1:54046
I20260709 13:11:31.956579 31956 raft_consensus.cc:606] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Received request to transfer leadership to TS e4c77cd4f4ed4f11a46548630b48a19b
I20260709 13:11:31.956909 31956 raft_consensus.cc:614] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:31.959895 32031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
mode: GRACEFUL
new_leader_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:11:31.960480 32031 raft_consensus.cc:606] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Received request to transfer leadership to TS f0414f76a3b045f38f10808155062693
I20260709 13:11:31.963435 32031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a"
dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
mode: GRACEFUL
new_leader_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:11:31.963967 32031 raft_consensus.cc:606] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Received request to transfer leadership to TS f0414f76a3b045f38f10808155062693
I20260709 13:11:31.964287 32031 raft_consensus.cc:614] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:31.965270 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:31.965788 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:31.966526 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:32.281352 32369 raft_consensus.cc:993] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b: : Instructing follower f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:32.281929 32372 raft_consensus.cc:1081] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Signalling peer f0414f76a3b045f38f10808155062693 to start an election
I20260709 13:11:32.283490 31956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28"
dest_uuid: "f0414f76a3b045f38f10808155062693"
 from {username='slave'} at 127.0.0.1:54022
I20260709 13:11:32.284142 31956 raft_consensus.cc:493] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.284531 31956 raft_consensus.cc:3060] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:32.293504 31956 raft_consensus.cc:515] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:32.295830 31956 leader_election.cc:290] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 3 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:32.296443 32253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125"
I20260709 13:11:32.296820 32031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5448d805ce9044d6aafd6595a9acff28" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:32.297128 32253 raft_consensus.cc:3060] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:32.297454 32031 raft_consensus.cc:3055] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:32.297792 32031 raft_consensus.cc:740] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:32.298851 32031 consensus_queue.cc:260] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:32.300094 32031 raft_consensus.cc:3060] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:32.306246 32253 raft_consensus.cc:2468] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 3.
I20260709 13:11:32.307547 31923 leader_election.cc:304] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:32.307976 32031 raft_consensus.cc:2468] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 3.
I20260709 13:11:32.308396 32364 raft_consensus.cc:2804] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:32.308998 32364 raft_consensus.cc:697] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:32.309978 32364 consensus_queue.cc:237] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:32.318974 31781 catalog_manager.cc:5697] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 2 to 3, leader changed from e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131) to f0414f76a3b045f38f10808155062693 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.689800 32253 raft_consensus.cc:1275] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:32.691192 32364 consensus_queue.cc:1048] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:32.706840 32031 raft_consensus.cc:1275] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Refusing update from remote peer f0414f76a3b045f38f10808155062693: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:32.708876 32367 consensus_queue.cc:1048] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:11:32.722107 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:32.973578 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:32.993323 32402 raft_consensus.cc:493] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:32.994059 32402 raft_consensus.cc:515] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:32.998008 31956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:32.998818 31956 raft_consensus.cc:2468] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 3.
I20260709 13:11:33.002960 32402 leader_election.cc:290] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:33.003685 32214 leader_election.cc:304] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:33.004196 32031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:33.004784 32402 raft_consensus.cc:2804] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:33.005129 32031 raft_consensus.cc:2393] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in current term 3: Already voted for candidate e4c77cd4f4ed4f11a46548630b48a19b in this term.
I20260709 13:11:33.005208 32402 raft_consensus.cc:493] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:33.005813 32402 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.015874 32367 raft_consensus.cc:493] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.016347 32402 raft_consensus.cc:515] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.016556 32367 raft_consensus.cc:515] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.019207 32367 leader_election.cc:290] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:33.020262 31956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:33.020830 32253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" is_pre_election: true
I20260709 13:11:33.021555 32253 raft_consensus.cc:2468] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 2.
I20260709 13:11:33.028487 31923 leader_election.cc:304] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:33.028924 32031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:33.029373 32367 raft_consensus.cc:2804] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:33.029644 32031 raft_consensus.cc:2468] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 3.
I20260709 13:11:33.029826 32367 raft_consensus.cc:493] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.030339 32367 raft_consensus.cc:3060] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.032407 20382 tablet_server.cc:179] TabletServer@127.19.231.129:36871 shutting down...
I20260709 13:11:33.039295 32402 leader_election.cc:290] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 3 election: Requested vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:33.037989 31956 raft_consensus.cc:2468] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 3.
I20260709 13:11:33.040666 32031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:33.043535 32031 raft_consensus.cc:2393] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in current term 3: Already voted for candidate e4c77cd4f4ed4f11a46548630b48a19b in this term.
I20260709 13:11:33.044328 32214 leader_election.cc:304] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:33.045928 32402 raft_consensus.cc:2804] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:33.047601 32402 raft_consensus.cc:697] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 LEADER]: Becoming Leader. State: Replica: 6f2d8d6e5e8e414ca119a5fcfe0ff125, State: Running, Role: LEADER
I20260709 13:11:33.048847 32402 consensus_queue.cc:237] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.055531 32367 raft_consensus.cc:515] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.060900 32031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0442e54c3b4399ac05323b9c3778ad" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
W20260709 13:11:33.061173 31923 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 13:11:33.061672 32031 raft_consensus.cc:3060] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:33.079421 31923 leader_election.cc:336] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:33.082929 32367 leader_election.cc:290] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:33.082564 32031 raft_consensus.cc:2468] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 4.
I20260709 13:11:33.090561 31923 leader_election.cc:304] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:33.092175 32367 raft_consensus.cc:2804] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:33.093221 32367 raft_consensus.cc:697] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 4 LEADER]: Becoming Leader. State: Replica: f0414f76a3b045f38f10808155062693, State: Running, Role: LEADER
I20260709 13:11:33.094215 32367 consensus_queue.cc:237] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.091914 31780 catalog_manager.cc:5697] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 reported cstate change: term changed from 2 to 3, leader changed from f0414f76a3b045f38f10808155062693 (127.19.231.130) to 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129). New cstate: current_term: 3 leader_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.117700 31781 catalog_manager.cc:5697] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f0414f76a3b045f38f10808155062693" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.120180 32402 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:33.123081 32402 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.126204 31956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:33.126884 31956 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 4.
I20260709 13:11:33.127349 32031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:33.128145 32031 raft_consensus.cc:2393] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in current term 4: Already voted for candidate e4c77cd4f4ed4f11a46548630b48a19b in this term.
I20260709 13:11:33.128134 32214 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:33.129168 32410 raft_consensus.cc:2804] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:33.129531 32410 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f0414f76a3b045f38f10808155062693)
I20260709 13:11:33.129887 32410 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.130035 32402 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
W20260709 13:11:33.132120 31997 consensus_peers.cc:597] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.140594 32410 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.143613 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:33.155193 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:33.156683 20382 raft_consensus.cc:2243] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.157328 20382 raft_consensus.cc:2272] T 5448d805ce9044d6aafd6595a9acff28 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.157553 32031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b"
I20260709 13:11:33.158604 32031 raft_consensus.cc:2393] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in current term 4: Already voted for candidate e4c77cd4f4ed4f11a46548630b48a19b in this term.
I20260709 13:11:33.157423 31956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:33.162493 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:33.163821 20382 raft_consensus.cc:2243] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.164486 20382 raft_consensus.cc:2272] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.170748 32410 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 4 election: Requested vote from peers f0414f76a3b045f38f10808155062693 (127.19.231.130:42063), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:33.172291 31956 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f2d8d6e5e8e414ca119a5fcfe0ff125 in term 4.
I20260709 13:11:33.173731 32214 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125, f0414f76a3b045f38f10808155062693; no voters: e4c77cd4f4ed4f11a46548630b48a19b
W20260709 13:11:33.174613 32214 raft_consensus.cc:2686] T 354fd95ac625442ca0aa41c8df3c6eb6 P 6f2d8d6e5e8e414ca119a5fcfe0ff125: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:33.175181 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:33.176250 20382 raft_consensus.cc:2243] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.177004 20382 raft_consensus.cc:2272] T 323345efe837451881ebe9ec2d0226a9 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.180251 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:33.180878 20382 raft_consensus.cc:2243] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.181397 20382 raft_consensus.cc:2272] T 2c0442e54c3b4399ac05323b9c3778ad P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.183962 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:33.184542 20382 raft_consensus.cc:2243] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.185010 20382 raft_consensus.cc:2272] T 47e33a09b4634ba4b5936b07b0c140a3 P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.187460 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:33.188136 20382 raft_consensus.cc:2243] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.188694 20382 raft_consensus.cc:2272] T d1cb7b9945cb47e7bb4031796f97722e P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.191377 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:33.191972 20382 raft_consensus.cc:2243] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.192435 20382 raft_consensus.cc:2272] T 11bee2ef3424429ea381dec7bd22824a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.195895 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:33.196776 20382 raft_consensus.cc:2243] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.197539 20382 raft_consensus.cc:2272] T 5fe51c07e1a84727840d01c035ef734a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.198691 32369 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.199379 32369 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.200997 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:33.201854 20382 raft_consensus.cc:2243] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.202618 20382 pending_rounds.cc:70] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Trying to abort 1 pending ops.
I20260709 13:11:33.202883 20382 pending_rounds.cc:77] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636630740996096 op_type: NO_OP noop_request { }
I20260709 13:11:33.203321 20382 raft_consensus.cc:2889] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:33.203544 32369 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:33.204476 31956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:33.205224 31956 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 4.
I20260709 13:11:33.203670 20382 raft_consensus.cc:2272] T ac451bfab48b4ca5860039551bdfc59a P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.206596 31996 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 
W20260709 13:11:33.207392 31997 leader_election.cc:336] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:33.207433 32369 raft_consensus.cc:2804] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:33.207979 32369 raft_consensus.cc:493] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.208357 32369 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.209919 20382 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:33.210594 20382 raft_consensus.cc:2243] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.211145 20382 raft_consensus.cc:2272] T 057127d733914dff839f4d0ac064177b P 6f2d8d6e5e8e414ca119a5fcfe0ff125 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.218027 32369 raft_consensus.cc:515] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.220959 32369 leader_election.cc:290] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 5 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:33.223125 31956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354fd95ac625442ca0aa41c8df3c6eb6" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:33.223845 31956 raft_consensus.cc:3060] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:33.227988 31997 leader_election.cc:336] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:33.229730 31997 consensus_peers.cc:597] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.232429 31956 raft_consensus.cc:2468] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 5.
I20260709 13:11:33.233938 31996 leader_election.cc:304] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:33.235287 32369 raft_consensus.cc:2804] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:33.236063 32369 raft_consensus.cc:697] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 5 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:33.237253 32369 consensus_queue.cc:237] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.247423 31781 catalog_manager.cc:5697] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 3 to 5, leader changed from f0414f76a3b045f38f10808155062693 (127.19.231.130) to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 5 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.254045 20382 tablet_server.cc:196] TabletServer@127.19.231.129:36871 shutdown complete.
I20260709 13:11:33.260008 32369 raft_consensus.cc:493] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.260666 32369 raft_consensus.cc:515] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.263952 32369 leader_election.cc:290] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
I20260709 13:11:33.264562 31956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693" is_pre_election: true
I20260709 13:11:33.265377 31956 raft_consensus.cc:2468] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 3.
I20260709 13:11:33.266989 31996 leader_election.cc:304] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 
I20260709 13:11:33.267876 32369 raft_consensus.cc:2804] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:33.268396 32369 raft_consensus.cc:493] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.268872 32369 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.277980 32369 raft_consensus.cc:515] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
W20260709 13:11:33.281283 31997 leader_election.cc:336] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:33.286199 31956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac451bfab48b4ca5860039551bdfc59a" candidate_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0414f76a3b045f38f10808155062693"
I20260709 13:11:33.287010 31956 raft_consensus.cc:3060] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.294333 20382 tablet_server.cc:179] TabletServer@127.19.231.130:0 shutting down...
I20260709 13:11:33.295591 31956 raft_consensus.cc:2468] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c77cd4f4ed4f11a46548630b48a19b in term 4.
I20260709 13:11:33.296823 32369 leader_election.cc:290] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 election: Requested vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), f0414f76a3b045f38f10808155062693 (127.19.231.130:42063)
W20260709 13:11:33.302551 31923 consensus_peers.cc:597] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.296923 31996 leader_election.cc:304] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 
W20260709 13:11:33.303947 31997 leader_election.cc:336] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:33.305994 32369 raft_consensus.cc:2804] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:33.308593 31996 consensus_peers.cc:597] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b -> Peer f0414f76a3b045f38f10808155062693 (127.19.231.130:42063): Couldn't send request to peer f0414f76a3b045f38f10808155062693. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.309330 32369 raft_consensus.cc:697] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 LEADER]: Becoming Leader. State: Replica: e4c77cd4f4ed4f11a46548630b48a19b, State: Running, Role: LEADER
I20260709 13:11:33.310254 32369 consensus_queue.cc:237] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.328284 31781 catalog_manager.cc:5697] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b reported cstate change: term changed from 3 to 4, leader changed from 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129) to e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131). New cstate: current_term: 4 leader_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.348635 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:33.350051 20382 tablet_replica.cc:333] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693: stopping tablet replica
I20260709 13:11:33.351234 20382 raft_consensus.cc:2243] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.351778 20382 raft_consensus.cc:2272] T 323345efe837451881ebe9ec2d0226a9 P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.353197 31997 consensus_peers.cc:597] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.354575 20382 tablet_replica.cc:333] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693: stopping tablet replica
I20260709 13:11:33.355275 20382 raft_consensus.cc:2243] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.355743 20382 raft_consensus.cc:2272] T 47e33a09b4634ba4b5936b07b0c140a3 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.358182 20382 tablet_replica.cc:333] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693: stopping tablet replica
I20260709 13:11:33.358973 20382 raft_consensus.cc:2243] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.359760 20382 raft_consensus.cc:2272] T 057127d733914dff839f4d0ac064177b P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.362457 20382 tablet_replica.cc:333] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693: stopping tablet replica
I20260709 13:11:33.363161 20382 raft_consensus.cc:2243] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.363693 20382 raft_consensus.cc:2272] T d1cb7b9945cb47e7bb4031796f97722e P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.366117 20382 tablet_replica.cc:333] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693: stopping tablet replica
I20260709 13:11:33.366680 20382 raft_consensus.cc:2243] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.367533 20382 raft_consensus.cc:2272] T 5448d805ce9044d6aafd6595a9acff28 P f0414f76a3b045f38f10808155062693 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.370517 20382 tablet_replica.cc:333] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693: stopping tablet replica
I20260709 13:11:33.371398 20382 raft_consensus.cc:2243] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.371982 20382 raft_consensus.cc:2272] T 11bee2ef3424429ea381dec7bd22824a P f0414f76a3b045f38f10808155062693 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.373734 32364 raft_consensus.cc:493] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.374240 32364 raft_consensus.cc:515] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f2d8d6e5e8e414ca119a5fcfe0ff125" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36871 } } peers { permanent_uuid: "f0414f76a3b045f38f10808155062693" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42063 } } peers { permanent_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 37283 } }
I20260709 13:11:33.375272 20382 tablet_replica.cc:333] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693: stopping tablet replica
I20260709 13:11:33.376181 20382 raft_consensus.cc:2243] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.376603 32364 leader_election.cc:290] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871), e4c77cd4f4ed4f11a46548630b48a19b (127.19.231.131:37283)
I20260709 13:11:33.376832 20382 raft_consensus.cc:2272] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.380015 20382 tablet_replica.cc:333] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693: stopping tablet replica
I20260709 13:11:33.379839 32031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe51c07e1a84727840d01c035ef734a" candidate_uuid: "f0414f76a3b045f38f10808155062693" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c77cd4f4ed4f11a46548630b48a19b" is_pre_election: true
I20260709 13:11:33.380577 32031 raft_consensus.cc:2468] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0414f76a3b045f38f10808155062693 in term 4.
I20260709 13:11:33.380805 20382 raft_consensus.cc:2243] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.381345 20382 raft_consensus.cc:2272] T ac451bfab48b4ca5860039551bdfc59a P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.382663 31923 leader_election.cc:336] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111)
I20260709 13:11:33.383625 31923 leader_election.cc:304] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4c77cd4f4ed4f11a46548630b48a19b, f0414f76a3b045f38f10808155062693; no voters: 6f2d8d6e5e8e414ca119a5fcfe0ff125
I20260709 13:11:33.383955 20382 tablet_replica.cc:333] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693: stopping tablet replica
I20260709 13:11:33.384680 20382 raft_consensus.cc:2243] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:33.385133 31923 raft_consensus.cc:2686] T 5fe51c07e1a84727840d01c035ef734a P f0414f76a3b045f38f10808155062693: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:33.385141 20382 raft_consensus.cc:2272] T 354fd95ac625442ca0aa41c8df3c6eb6 P f0414f76a3b045f38f10808155062693 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.388500 20382 tablet_replica.cc:333] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693: stopping tablet replica
W20260709 13:11:33.388830 31997 consensus_peers.cc:597] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b -> Peer 6f2d8d6e5e8e414ca119a5fcfe0ff125 (127.19.231.129:36871): Couldn't send request to peer 6f2d8d6e5e8e414ca119a5fcfe0ff125. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.389062 20382 raft_consensus.cc:2243] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.389761 20382 pending_rounds.cc:70] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693: Trying to abort 1 pending ops.
I20260709 13:11:33.389950 20382 pending_rounds.cc:77] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7305636630925537280 op_type: NO_OP noop_request { }
I20260709 13:11:33.390223 20382 raft_consensus.cc:2889] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:33.390514 20382 raft_consensus.cc:2272] T 2c0442e54c3b4399ac05323b9c3778ad P f0414f76a3b045f38f10808155062693 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.410521 31996 consensus_peers.cc:597] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b -> Peer f0414f76a3b045f38f10808155062693 (127.19.231.130:42063): Couldn't send request to peer f0414f76a3b045f38f10808155062693. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.426641 20382 tablet_server.cc:196] TabletServer@127.19.231.130:0 shutdown complete.
I20260709 13:11:33.455171 20382 tablet_server.cc:179] TabletServer@127.19.231.131:0 shutting down...
I20260709 13:11:33.490526 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:33.491539 20382 tablet_replica.cc:333] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b: stopping tablet replica
I20260709 13:11:33.492548 20382 raft_consensus.cc:2243] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.493163 20382 raft_consensus.cc:2272] T 057127d733914dff839f4d0ac064177b P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.496560 20382 tablet_replica.cc:333] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b: stopping tablet replica
I20260709 13:11:33.497501 20382 raft_consensus.cc:2243] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.498627 20382 raft_consensus.cc:2272] T 323345efe837451881ebe9ec2d0226a9 P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.502018 20382 tablet_replica.cc:333] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b: stopping tablet replica
I20260709 13:11:33.502904 20382 raft_consensus.cc:2243] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.504163 20382 raft_consensus.cc:2272] T d1cb7b9945cb47e7bb4031796f97722e P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.507445 20382 tablet_replica.cc:333] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b: stopping tablet replica
I20260709 13:11:33.508291 20382 raft_consensus.cc:2243] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.508852 20382 raft_consensus.cc:2272] T 5448d805ce9044d6aafd6595a9acff28 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.512534 20382 tablet_replica.cc:333] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b: stopping tablet replica
I20260709 13:11:33.513473 20382 raft_consensus.cc:2243] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.514612 20382 raft_consensus.cc:2272] T 47e33a09b4634ba4b5936b07b0c140a3 P e4c77cd4f4ed4f11a46548630b48a19b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.517975 20382 tablet_replica.cc:333] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b: stopping tablet replica
I20260709 13:11:33.518764 20382 raft_consensus.cc:2243] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.519384 20382 raft_consensus.cc:2272] T 2c0442e54c3b4399ac05323b9c3778ad P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.522694 20382 tablet_replica.cc:333] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b: stopping tablet replica
I20260709 13:11:33.523535 20382 raft_consensus.cc:2243] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.524082 20382 raft_consensus.cc:2272] T 5fe51c07e1a84727840d01c035ef734a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.527396 20382 tablet_replica.cc:333] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b: stopping tablet replica
I20260709 13:11:33.528146 20382 raft_consensus.cc:2243] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.529299 20382 raft_consensus.cc:2272] T 11bee2ef3424429ea381dec7bd22824a P e4c77cd4f4ed4f11a46548630b48a19b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.532557 20382 tablet_replica.cc:333] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b: stopping tablet replica
I20260709 13:11:33.533254 20382 raft_consensus.cc:2243] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.534071 20382 pending_rounds.cc:70] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b: Trying to abort 1 pending ops.
I20260709 13:11:33.534299 20382 pending_rounds.cc:77] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7305636631810793472 op_type: NO_OP noop_request { }
I20260709 13:11:33.534649 20382 raft_consensus.cc:2889] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:33.535017 20382 raft_consensus.cc:2272] T ac451bfab48b4ca5860039551bdfc59a P e4c77cd4f4ed4f11a46548630b48a19b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.538146 20382 tablet_replica.cc:333] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b: stopping tablet replica
I20260709 13:11:33.538962 20382 raft_consensus.cc:2243] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.539842 20382 pending_rounds.cc:70] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b: Trying to abort 1 pending ops.
I20260709 13:11:33.540076 20382 pending_rounds.cc:77] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b: Aborting op as it isn't in flight: id { term: 5 index: 3 } timestamp: 7305636631513161728 op_type: NO_OP noop_request { }
I20260709 13:11:33.540449 20382 raft_consensus.cc:2889] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:33.540802 20382 raft_consensus.cc:2272] T 354fd95ac625442ca0aa41c8df3c6eb6 P e4c77cd4f4ed4f11a46548630b48a19b [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.723338 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:34.583654 20382 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 32054)
W20260709 13:11:34.724395 31830 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:34.778635 20382 tablet_server.cc:196] TabletServer@127.19.231.131:0 shutdown complete.
I20260709 13:11:34.803917 20382 master.cc:562] Master@127.19.231.190:41089 shutting down...
I20260709 13:11:34.825742 20382 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.826290 20382 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.826623 20382 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5279ccca571648098a39b6f107e9b9d6: stopping tablet replica
I20260709 13:11:34.847638 20382 master.cc:584] Master@127.19.231.190:41089 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (17401 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:11:34.891448 20382 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.231.190:38247
I20260709 13:11:34.892596 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:34.898669 32423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:34.898669 32424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:34.899880 32426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:34.900193 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:34.901340 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:34.901530 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:34.901649 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602694901638 us; error 0 us; skew 500 ppm
I20260709 13:11:34.902210 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:34.904732 20382 webserver.cc:533] Webserver started at http://127.19.231.190:44891/ using document root <none> and password file <none>
I20260709 13:11:34.905232 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:34.905395 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:34.905618 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:34.906869 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/master-0-root/instance:
uuid: "b1fbb30c2a104724bf6cb5c465146b22"
format_stamp: "Formatted at 2026-07-09 13:11:34 on dist-test-slave-1t6m"
I20260709 13:11:34.911549 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:11:34.915112 32431 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:34.915901 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:11:34.916227 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/master-0-root
uuid: "b1fbb30c2a104724bf6cb5c465146b22"
format_stamp: "Formatted at 2026-07-09 13:11:34 on dist-test-slave-1t6m"
I20260709 13:11:34.916531 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:34.945588 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:34.946925 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:34.986071 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.190:38247
I20260709 13:11:34.986171 32482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.190:38247 every 8 connection(s)
I20260709 13:11:34.990051 32483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.001214 32483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22: Bootstrap starting.
I20260709 13:11:35.006067 32483 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.010505 32483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22: No bootstrap required, opened a new log
I20260709 13:11:35.012748 32483 raft_consensus.cc:359] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fbb30c2a104724bf6cb5c465146b22" member_type: VOTER }
I20260709 13:11:35.013167 32483 raft_consensus.cc:385] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.013414 32483 raft_consensus.cc:740] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1fbb30c2a104724bf6cb5c465146b22, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.013998 32483 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fbb30c2a104724bf6cb5c465146b22" member_type: VOTER }
I20260709 13:11:35.014460 32483 raft_consensus.cc:399] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:35.014696 32483 raft_consensus.cc:493] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:35.015019 32483 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.020175 32483 raft_consensus.cc:515] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fbb30c2a104724bf6cb5c465146b22" member_type: VOTER }
I20260709 13:11:35.020730 32483 leader_election.cc:304] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1fbb30c2a104724bf6cb5c465146b22; no voters: 
I20260709 13:11:35.021898 32483 leader_election.cc:290] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:35.022238 32486 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:35.023625 32486 raft_consensus.cc:697] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 1 LEADER]: Becoming Leader. State: Replica: b1fbb30c2a104724bf6cb5c465146b22, State: Running, Role: LEADER
I20260709 13:11:35.024327 32486 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fbb30c2a104724bf6cb5c465146b22" member_type: VOTER }
I20260709 13:11:35.024894 32483 sys_catalog.cc:565] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:35.028558 32488 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1fbb30c2a104724bf6cb5c465146b22. Latest consensus state: current_term: 1 leader_uuid: "b1fbb30c2a104724bf6cb5c465146b22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fbb30c2a104724bf6cb5c465146b22" member_type: VOTER } }
I20260709 13:11:35.030264 32488 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:35.028759 32487 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1fbb30c2a104724bf6cb5c465146b22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fbb30c2a104724bf6cb5c465146b22" member_type: VOTER } }
I20260709 13:11:35.031057 32487 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:35.033532 32494 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:35.039778 32494 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:35.040892 20382 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:35.048792 32494 catalog_manager.cc:1383] Generated new cluster ID: 748a9e3fbef3459fac2187da89f3130d
I20260709 13:11:35.049113 32494 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:35.075384 32494 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:35.076713 32494 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:35.098240 32494 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22: Generated new TSK 0
I20260709 13:11:35.098977 32494 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:35.107957 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:35.114002 32504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.115180 32505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.117120 32507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:35.117151 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:35.118521 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:35.118749 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:35.118988 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602695118965 us; error 0 us; skew 500 ppm
I20260709 13:11:35.119540 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:35.121914 20382 webserver.cc:533] Webserver started at http://127.19.231.129:34899/ using document root <none> and password file <none>
I20260709 13:11:35.122418 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:35.122639 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:35.122949 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:35.124060 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-0-root/instance:
uuid: "223a603122eb405c964c91ce475b5b00"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-1t6m"
I20260709 13:11:35.128733 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:35.132107 32512 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.133018 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:35.133328 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-0-root
uuid: "223a603122eb405c964c91ce475b5b00"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-1t6m"
I20260709 13:11:35.133616 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:35.151842 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:35.153060 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:35.154538 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:35.156886 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:35.157100 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.157358 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:35.157552 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.199201 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.129:36773
I20260709 13:11:35.199301 32574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.129:36773 every 8 connection(s)
I20260709 13:11:35.204531 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:35.211369 32579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.212507 32580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:35.214982 20382 server_base.cc:1061] running on GCE node
W20260709 13:11:35.215003 32582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:35.216889 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:35.217157 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:35.217376 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602695217356 us; error 0 us; skew 500 ppm
I20260709 13:11:35.218063 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:35.218947 32575 heartbeater.cc:344] Connected to a master server at 127.19.231.190:38247
I20260709 13:11:35.219318 32575 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:35.220085 32575 heartbeater.cc:507] Master 127.19.231.190:38247 requested a full tablet report, sending...
I20260709 13:11:35.221112 20382 webserver.cc:533] Webserver started at http://127.19.231.130:37071/ using document root <none> and password file <none>
I20260709 13:11:35.221792 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:35.222007 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:35.222278 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:35.222414 32448 ts_manager.cc:194] Registered new tserver with Master: 223a603122eb405c964c91ce475b5b00 (127.19.231.129:36773)
I20260709 13:11:35.223610 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-1-root/instance:
uuid: "c27fc47358754e49881285e680287e94"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-1t6m"
I20260709 13:11:35.224501 32448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35150
I20260709 13:11:35.228627 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:35.232198 32587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.233028 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:35.233345 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-1-root
uuid: "c27fc47358754e49881285e680287e94"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-1t6m"
I20260709 13:11:35.233639 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:35.260581 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:35.261852 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:35.263450 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:35.265787 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:35.266016 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.266266 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:35.266435 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.307834 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.130:41085
I20260709 13:11:35.307955 32649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.130:41085 every 8 connection(s)
I20260709 13:11:35.312731 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:35.321039 32653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.321302 32654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.325470 32656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:35.325963 32650 heartbeater.cc:344] Connected to a master server at 127.19.231.190:38247
I20260709 13:11:35.326498 32650 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:35.328061 32650 heartbeater.cc:507] Master 127.19.231.190:38247 requested a full tablet report, sending...
I20260709 13:11:35.330543 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:35.331071 32448 ts_manager.cc:194] Registered new tserver with Master: c27fc47358754e49881285e680287e94 (127.19.231.130:41085)
I20260709 13:11:35.331583 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:35.331862 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:35.332051 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602695332031 us; error 0 us; skew 500 ppm
I20260709 13:11:35.332644 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:35.332710 32448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35162
I20260709 13:11:35.335769 20382 webserver.cc:533] Webserver started at http://127.19.231.131:35013/ using document root <none> and password file <none>
I20260709 13:11:35.336464 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:35.336684 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:35.336974 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:35.338145 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-2-root/instance:
uuid: "130f46492c41451da3816187668765ed"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-1t6m"
I20260709 13:11:35.342898 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:11:35.346163 32661 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.347015 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:11:35.347312 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-2-root
uuid: "130f46492c41451da3816187668765ed"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-1t6m"
I20260709 13:11:35.347615 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337466250-20382-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:35.359560 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:35.360743 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:35.362190 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:35.364437 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:35.364665 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.364908 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:35.365077 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.405400 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.131:35659
I20260709 13:11:35.405504 32723 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.131:35659 every 8 connection(s)
I20260709 13:11:35.419499 32724 heartbeater.cc:344] Connected to a master server at 127.19.231.190:38247
I20260709 13:11:35.419983 32724 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:35.420738 32724 heartbeater.cc:507] Master 127.19.231.190:38247 requested a full tablet report, sending...
I20260709 13:11:35.422756 32448 ts_manager.cc:194] Registered new tserver with Master: 130f46492c41451da3816187668765ed (127.19.231.131:35659)
I20260709 13:11:35.423370 20382 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014529894s
I20260709 13:11:35.424237 32448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35176
I20260709 13:11:35.449323 32448 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35184:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:35.451833 32448 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:35.513556 32615 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7f441cada643d2962fd667c5b8c8e3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8f963e71628c4114801babcc67a9a090]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:35.513712 32614 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf33b2ae3ca412089dafb2db8a2603b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8f963e71628c4114801babcc67a9a090]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:35.515146 32615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7f441cada643d2962fd667c5b8c8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.515075 32540 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7f441cada643d2962fd667c5b8c8e3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8f963e71628c4114801babcc67a9a090]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:35.516604 32540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7f441cada643d2962fd667c5b8c8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.517944 32689 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7f441cada643d2962fd667c5b8c8e3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8f963e71628c4114801babcc67a9a090]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:35.518183 32688 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf33b2ae3ca412089dafb2db8a2603b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8f963e71628c4114801babcc67a9a090]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:35.519392 32689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7f441cada643d2962fd667c5b8c8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.519949 32614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf33b2ae3ca412089dafb2db8a2603b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.516259 32539 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf33b2ae3ca412089dafb2db8a2603b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8f963e71628c4114801babcc67a9a090]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:35.523752 32539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf33b2ae3ca412089dafb2db8a2603b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.524276 32688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf33b2ae3ca412089dafb2db8a2603b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.548542 32739 tablet_bootstrap.cc:492] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00: Bootstrap starting.
I20260709 13:11:35.562187 32740 tablet_bootstrap.cc:492] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed: Bootstrap starting.
I20260709 13:11:35.562583 32739 tablet_bootstrap.cc:654] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.563396 32741 tablet_bootstrap.cc:492] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94: Bootstrap starting.
I20260709 13:11:35.568441 32739 tablet_bootstrap.cc:492] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00: No bootstrap required, opened a new log
I20260709 13:11:35.568995 32739 ts_tablet_manager.cc:1403] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 13:11:35.569747 32740 tablet_bootstrap.cc:654] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.570654 32741 tablet_bootstrap.cc:654] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.571533 32739 raft_consensus.cc:359] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } } peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } }
I20260709 13:11:35.572131 32739 raft_consensus.cc:385] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.572386 32739 raft_consensus.cc:740] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 223a603122eb405c964c91ce475b5b00, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.573561 32739 consensus_queue.cc:260] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } } peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } }
I20260709 13:11:35.575976 32575 heartbeater.cc:499] Master 127.19.231.190:38247 was elected leader, sending a full tablet report...
I20260709 13:11:35.576392 32740 tablet_bootstrap.cc:492] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed: No bootstrap required, opened a new log
I20260709 13:11:35.576627 32739 ts_tablet_manager.cc:1434] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:11:35.577136 32740 ts_tablet_manager.cc:1403] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:11:35.577710 32739 tablet_bootstrap.cc:492] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00: Bootstrap starting.
I20260709 13:11:35.581885 32740 raft_consensus.cc:359] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:35.582922 32740 raft_consensus.cc:385] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.583310 32740 raft_consensus.cc:740] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130f46492c41451da3816187668765ed, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.584227 32740 consensus_queue.cc:260] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:35.586335 32739 tablet_bootstrap.cc:654] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.588371 32741 tablet_bootstrap.cc:492] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94: No bootstrap required, opened a new log
I20260709 13:11:35.589115 32741 ts_tablet_manager.cc:1403] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94: Time spent bootstrapping tablet: real 0.026s	user 0.001s	sys 0.022s
I20260709 13:11:35.593438 32741 raft_consensus.cc:359] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } } peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } }
I20260709 13:11:35.594594 32741 raft_consensus.cc:385] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.595105 32741 raft_consensus.cc:740] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c27fc47358754e49881285e680287e94, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.597270 32741 consensus_queue.cc:260] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } } peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } }
I20260709 13:11:35.597826 32740 ts_tablet_manager.cc:1434] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed: Time spent starting tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 13:11:35.598470 32724 heartbeater.cc:499] Master 127.19.231.190:38247 was elected leader, sending a full tablet report...
I20260709 13:11:35.599195 32740 tablet_bootstrap.cc:492] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed: Bootstrap starting.
I20260709 13:11:35.606004 32650 heartbeater.cc:499] Master 127.19.231.190:38247 was elected leader, sending a full tablet report...
I20260709 13:11:35.607165 32741 ts_tablet_manager.cc:1434] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:11:35.608325 32741 tablet_bootstrap.cc:492] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94: Bootstrap starting.
I20260709 13:11:35.611048 32740 tablet_bootstrap.cc:654] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.615638 32741 tablet_bootstrap.cc:654] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.641433 32739 tablet_bootstrap.cc:492] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00: No bootstrap required, opened a new log
I20260709 13:11:35.642030 32739 ts_tablet_manager.cc:1403] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00: Time spent bootstrapping tablet: real 0.065s	user 0.040s	sys 0.018s
I20260709 13:11:35.642905 32740 tablet_bootstrap.cc:492] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed: No bootstrap required, opened a new log
I20260709 13:11:35.643501 32740 ts_tablet_manager.cc:1403] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.029s
I20260709 13:11:35.643778 32741 tablet_bootstrap.cc:492] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94: No bootstrap required, opened a new log
I20260709 13:11:35.644349 32741 ts_tablet_manager.cc:1403] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.009s
I20260709 13:11:35.644706 32739 raft_consensus.cc:359] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:35.645336 32739 raft_consensus.cc:385] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.645576 32739 raft_consensus.cc:740] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 223a603122eb405c964c91ce475b5b00, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.646260 32739 consensus_queue.cc:260] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:35.646431 32740 raft_consensus.cc:359] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } } peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } }
I20260709 13:11:35.647318 32740 raft_consensus.cc:385] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.647729 32740 raft_consensus.cc:740] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130f46492c41451da3816187668765ed, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.647410 32741 raft_consensus.cc:359] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:35.648269 32739 ts_tablet_manager.cc:1434] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:11:35.648336 32741 raft_consensus.cc:385] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.649029 32741 raft_consensus.cc:740] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c27fc47358754e49881285e680287e94, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.648644 32740 consensus_queue.cc:260] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } } peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } }
I20260709 13:11:35.649978 32741 consensus_queue.cc:260] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:35.651127 32740 ts_tablet_manager.cc:1434] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:35.652488 32741 ts_tablet_manager.cc:1434] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:11:35.764032 32745 raft_consensus.cc:493] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.764559 32745 raft_consensus.cc:515] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } } peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } }
I20260709 13:11:35.766562 32745 leader_election.cc:290] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 130f46492c41451da3816187668765ed (127.19.231.131:35659), c27fc47358754e49881285e680287e94 (127.19.231.130:41085)
I20260709 13:11:35.777498 32699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f441cada643d2962fd667c5b8c8e3" candidate_uuid: "223a603122eb405c964c91ce475b5b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130f46492c41451da3816187668765ed" is_pre_election: true
I20260709 13:11:35.778216 32699 raft_consensus.cc:2468] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 223a603122eb405c964c91ce475b5b00 in term 0.
I20260709 13:11:35.778925 32625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f441cada643d2962fd667c5b8c8e3" candidate_uuid: "223a603122eb405c964c91ce475b5b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c27fc47358754e49881285e680287e94" is_pre_election: true
I20260709 13:11:35.779558 32513 leader_election.cc:304] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130f46492c41451da3816187668765ed, 223a603122eb405c964c91ce475b5b00; no voters: 
I20260709 13:11:35.779722 32625 raft_consensus.cc:2468] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 223a603122eb405c964c91ce475b5b00 in term 0.
I20260709 13:11:35.780480 32745 raft_consensus.cc:2804] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:35.780892 32745 raft_consensus.cc:493] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.781193 32745 raft_consensus.cc:3060] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.786469 32745 raft_consensus.cc:515] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } } peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } }
I20260709 13:11:35.788170 32745 leader_election.cc:290] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [CANDIDATE]: Term 1 election: Requested vote from peers 130f46492c41451da3816187668765ed (127.19.231.131:35659), c27fc47358754e49881285e680287e94 (127.19.231.130:41085)
I20260709 13:11:35.789069 32699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f441cada643d2962fd667c5b8c8e3" candidate_uuid: "223a603122eb405c964c91ce475b5b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130f46492c41451da3816187668765ed"
I20260709 13:11:35.789274 32625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f441cada643d2962fd667c5b8c8e3" candidate_uuid: "223a603122eb405c964c91ce475b5b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c27fc47358754e49881285e680287e94"
I20260709 13:11:35.789637 32699 raft_consensus.cc:3060] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.789919 32625 raft_consensus.cc:3060] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.795249 32699 raft_consensus.cc:2468] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 223a603122eb405c964c91ce475b5b00 in term 1.
I20260709 13:11:35.795246 32625 raft_consensus.cc:2468] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 223a603122eb405c964c91ce475b5b00 in term 1.
I20260709 13:11:35.796486 32513 leader_election.cc:304] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130f46492c41451da3816187668765ed, 223a603122eb405c964c91ce475b5b00; no voters: 
I20260709 13:11:35.797199 32745 raft_consensus.cc:2804] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:35.798097 32745 raft_consensus.cc:697] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 1 LEADER]: Becoming Leader. State: Replica: 223a603122eb405c964c91ce475b5b00, State: Running, Role: LEADER
I20260709 13:11:35.798877 32745 consensus_queue.cc:237] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } } peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } }
I20260709 13:11:35.806495 32446 catalog_manager.cc:5697] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 223a603122eb405c964c91ce475b5b00 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "223a603122eb405c964c91ce475b5b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.831370 32748 raft_consensus.cc:493] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.831908 32748 raft_consensus.cc:515] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:35.834028 32748 leader_election.cc:290] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 223a603122eb405c964c91ce475b5b00 (127.19.231.129:36773), 130f46492c41451da3816187668765ed (127.19.231.131:35659)
I20260709 13:11:35.847317 32550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf33b2ae3ca412089dafb2db8a2603b" candidate_uuid: "c27fc47358754e49881285e680287e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "223a603122eb405c964c91ce475b5b00" is_pre_election: true
I20260709 13:11:35.848165 32550 raft_consensus.cc:2468] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c27fc47358754e49881285e680287e94 in term 0.
I20260709 13:11:35.849489 32589 leader_election.cc:304] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 223a603122eb405c964c91ce475b5b00, c27fc47358754e49881285e680287e94; no voters: 
I20260709 13:11:35.850368 32748 raft_consensus.cc:2804] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:35.850751 32748 raft_consensus.cc:493] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.850466 32699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf33b2ae3ca412089dafb2db8a2603b" candidate_uuid: "c27fc47358754e49881285e680287e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130f46492c41451da3816187668765ed" is_pre_election: true
I20260709 13:11:35.851146 32748 raft_consensus.cc:3060] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.851399 32699 raft_consensus.cc:2468] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c27fc47358754e49881285e680287e94 in term 0.
I20260709 13:11:35.858429 32748 raft_consensus.cc:515] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:35.860874 32748 leader_election.cc:290] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [CANDIDATE]: Term 1 election: Requested vote from peers 223a603122eb405c964c91ce475b5b00 (127.19.231.129:36773), 130f46492c41451da3816187668765ed (127.19.231.131:35659)
I20260709 13:11:35.861799 32550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf33b2ae3ca412089dafb2db8a2603b" candidate_uuid: "c27fc47358754e49881285e680287e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "223a603122eb405c964c91ce475b5b00"
I20260709 13:11:35.861994 32699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf33b2ae3ca412089dafb2db8a2603b" candidate_uuid: "c27fc47358754e49881285e680287e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130f46492c41451da3816187668765ed"
I20260709 13:11:35.862512 32550 raft_consensus.cc:3060] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.862742 32699 raft_consensus.cc:3060] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.871248 32550 raft_consensus.cc:2468] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c27fc47358754e49881285e680287e94 in term 1.
I20260709 13:11:35.872308 32699 raft_consensus.cc:2468] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c27fc47358754e49881285e680287e94 in term 1.
I20260709 13:11:35.872725 32589 leader_election.cc:304] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 223a603122eb405c964c91ce475b5b00, c27fc47358754e49881285e680287e94; no voters: 
I20260709 13:11:35.873816 32748 raft_consensus.cc:2804] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:35.875100 32748 raft_consensus.cc:697] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 1 LEADER]: Becoming Leader. State: Replica: c27fc47358754e49881285e680287e94, State: Running, Role: LEADER
I20260709 13:11:35.875893 32748 consensus_queue.cc:237] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:35.883594 32446 catalog_manager.cc:5697] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 reported cstate change: term changed from 0 to 1, leader changed from <none> to c27fc47358754e49881285e680287e94 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "c27fc47358754e49881285e680287e94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.000180 32446 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35188:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:36.002209 32446 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:36.026754 32539 tablet_service.cc:1511] Processing CreateTablet for tablet ce1c1ed59f0f40f2aaa9d59aa4b87a6e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a7f16a6957fa44ffbc9879dea2ab0eb1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:36.028198 32539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1c1ed59f0f40f2aaa9d59aa4b87a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.028029 32615 tablet_service.cc:1511] Processing CreateTablet for tablet ce1c1ed59f0f40f2aaa9d59aa4b87a6e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a7f16a6957fa44ffbc9879dea2ab0eb1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:36.029420 32615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1c1ed59f0f40f2aaa9d59aa4b87a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.029388 32688 tablet_service.cc:1511] Processing CreateTablet for tablet ce1c1ed59f0f40f2aaa9d59aa4b87a6e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a7f16a6957fa44ffbc9879dea2ab0eb1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:36.030907 32688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1c1ed59f0f40f2aaa9d59aa4b87a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.032274 32540 tablet_service.cc:1511] Processing CreateTablet for tablet 0028c2609f954ce59e83612bba5d17dd (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a7f16a6957fa44ffbc9879dea2ab0eb1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:36.033640 32540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0028c2609f954ce59e83612bba5d17dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.033749 32614 tablet_service.cc:1511] Processing CreateTablet for tablet 0028c2609f954ce59e83612bba5d17dd (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a7f16a6957fa44ffbc9879dea2ab0eb1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:36.035180 32614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0028c2609f954ce59e83612bba5d17dd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:36.036429 32496 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:36.039964 32689 tablet_service.cc:1511] Processing CreateTablet for tablet 0028c2609f954ce59e83612bba5d17dd (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a7f16a6957fa44ffbc9879dea2ab0eb1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:36.041378 32689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0028c2609f954ce59e83612bba5d17dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.049086 32741 tablet_bootstrap.cc:492] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94: Bootstrap starting.
I20260709 13:11:36.052894 32739 tablet_bootstrap.cc:492] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00: Bootstrap starting.
I20260709 13:11:36.055781 32741 tablet_bootstrap.cc:654] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.059971 32739 tablet_bootstrap.cc:654] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.068832 32739 tablet_bootstrap.cc:492] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00: No bootstrap required, opened a new log
I20260709 13:11:36.069329 32739 ts_tablet_manager.cc:1403] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 13:11:36.072274 32739 raft_consensus.cc:359] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.073242 32739 raft_consensus.cc:385] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.073616 32739 raft_consensus.cc:740] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 223a603122eb405c964c91ce475b5b00, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.074731 32739 consensus_queue.cc:260] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.076001 32740 tablet_bootstrap.cc:492] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed: Bootstrap starting.
I20260709 13:11:36.077678 32739 ts_tablet_manager.cc:1434] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:36.083163 32739 tablet_bootstrap.cc:492] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00: Bootstrap starting.
I20260709 13:11:36.084156 32741 tablet_bootstrap.cc:492] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94: No bootstrap required, opened a new log
I20260709 13:11:36.084726 32741 ts_tablet_manager.cc:1403] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.006s
I20260709 13:11:36.086114 32740 tablet_bootstrap.cc:654] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.090078 32739 tablet_bootstrap.cc:654] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.092064 32741 raft_consensus.cc:359] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.092901 32741 raft_consensus.cc:385] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.093225 32741 raft_consensus.cc:740] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c27fc47358754e49881285e680287e94, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.094053 32741 consensus_queue.cc:260] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.095072 32740 tablet_bootstrap.cc:492] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed: No bootstrap required, opened a new log
I20260709 13:11:36.095631 32740 ts_tablet_manager.cc:1403] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:11:36.096266 32741 ts_tablet_manager.cc:1434] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:11:36.097376 32741 tablet_bootstrap.cc:492] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94: Bootstrap starting.
I20260709 13:11:36.098699 32740 raft_consensus.cc:359] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.099522 32740 raft_consensus.cc:385] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.099825 32740 raft_consensus.cc:740] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130f46492c41451da3816187668765ed, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.100761 32740 consensus_queue.cc:260] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.104605 32741 tablet_bootstrap.cc:654] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.111868 32740 ts_tablet_manager.cc:1434] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:11:36.119805 32740 tablet_bootstrap.cc:492] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed: Bootstrap starting.
I20260709 13:11:36.121431 32739 tablet_bootstrap.cc:492] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00: No bootstrap required, opened a new log
I20260709 13:11:36.122033 32739 ts_tablet_manager.cc:1403] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.018s
I20260709 13:11:36.124892 32741 tablet_bootstrap.cc:492] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94: No bootstrap required, opened a new log
I20260709 13:11:36.125556 32741 ts_tablet_manager.cc:1403] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.018s
I20260709 13:11:36.125295 32739 raft_consensus.cc:359] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.126104 32739 raft_consensus.cc:385] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.126442 32739 raft_consensus.cc:740] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 223a603122eb405c964c91ce475b5b00, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.126940 32740 tablet_bootstrap.cc:654] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.127365 32739 consensus_queue.cc:260] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.128541 32741 raft_consensus.cc:359] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.129273 32741 raft_consensus.cc:385] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.129562 32741 raft_consensus.cc:740] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c27fc47358754e49881285e680287e94, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.129789 32739 ts_tablet_manager.cc:1434] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:36.130476 32741 consensus_queue.cc:260] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.133148 32741 ts_tablet_manager.cc:1434] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 13:11:36.135741 32740 tablet_bootstrap.cc:492] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed: No bootstrap required, opened a new log
I20260709 13:11:36.136294 32740 ts_tablet_manager.cc:1403] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.006s
I20260709 13:11:36.139431 32740 raft_consensus.cc:359] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.140244 32740 raft_consensus.cc:385] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.140532 32740 raft_consensus.cc:740] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130f46492c41451da3816187668765ed, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.141300 32740 consensus_queue.cc:260] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.143869 32740 ts_tablet_manager.cc:1434] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:11:36.222263 32745 consensus_queue.cc:1048] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.235760   305 consensus_queue.cc:1048] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.268494 32748 consensus_queue.cc:1048] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.281981   310 consensus_queue.cc:1048] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.305348 32746 raft_consensus.cc:493] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.305789 32746 raft_consensus.cc:515] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.308032 32746 leader_election.cc:290] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 223a603122eb405c964c91ce475b5b00 (127.19.231.129:36773), c27fc47358754e49881285e680287e94 (127.19.231.130:41085)
I20260709 13:11:36.314656   310 raft_consensus.cc:493] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.315290   310 raft_consensus.cc:515] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.317282   310 leader_election.cc:290] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 223a603122eb405c964c91ce475b5b00 (127.19.231.129:36773), 130f46492c41451da3816187668765ed (127.19.231.131:35659)
I20260709 13:11:36.318030 32550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0028c2609f954ce59e83612bba5d17dd" candidate_uuid: "c27fc47358754e49881285e680287e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "223a603122eb405c964c91ce475b5b00" is_pre_election: true
I20260709 13:11:36.318835 32550 raft_consensus.cc:2468] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c27fc47358754e49881285e680287e94 in term 0.
I20260709 13:11:36.319048 32699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0028c2609f954ce59e83612bba5d17dd" candidate_uuid: "c27fc47358754e49881285e680287e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130f46492c41451da3816187668765ed" is_pre_election: true
I20260709 13:11:36.319741 32699 raft_consensus.cc:2468] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c27fc47358754e49881285e680287e94 in term 0.
I20260709 13:11:36.320974 32589 leader_election.cc:304] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 223a603122eb405c964c91ce475b5b00, c27fc47358754e49881285e680287e94; no voters: 
I20260709 13:11:36.321488 32550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e" candidate_uuid: "130f46492c41451da3816187668765ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "223a603122eb405c964c91ce475b5b00" is_pre_election: true
I20260709 13:11:36.321949   310 raft_consensus.cc:2804] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.322186 32550 raft_consensus.cc:2468] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 130f46492c41451da3816187668765ed in term 0.
I20260709 13:11:36.322396   310 raft_consensus.cc:493] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.322894   310 raft_consensus.cc:3060] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.323117 32625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e" candidate_uuid: "130f46492c41451da3816187668765ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c27fc47358754e49881285e680287e94" is_pre_election: true
I20260709 13:11:36.323567 32663 leader_election.cc:304] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130f46492c41451da3816187668765ed, 223a603122eb405c964c91ce475b5b00; no voters: 
I20260709 13:11:36.323822 32625 raft_consensus.cc:2468] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 130f46492c41451da3816187668765ed in term 0.
I20260709 13:11:36.324496 32746 raft_consensus.cc:2804] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.324872 32746 raft_consensus.cc:493] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.325219 32746 raft_consensus.cc:3060] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.329299   310 raft_consensus.cc:515] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.330916 32746 raft_consensus.cc:515] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.331815   310 leader_election.cc:290] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [CANDIDATE]: Term 1 election: Requested vote from peers 223a603122eb405c964c91ce475b5b00 (127.19.231.129:36773), 130f46492c41451da3816187668765ed (127.19.231.131:35659)
I20260709 13:11:36.332255 32550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0028c2609f954ce59e83612bba5d17dd" candidate_uuid: "c27fc47358754e49881285e680287e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "223a603122eb405c964c91ce475b5b00"
I20260709 13:11:36.332608 32699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0028c2609f954ce59e83612bba5d17dd" candidate_uuid: "c27fc47358754e49881285e680287e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130f46492c41451da3816187668765ed"
I20260709 13:11:36.332923 32550 raft_consensus.cc:3060] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.333065 32746 leader_election.cc:290] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [CANDIDATE]: Term 1 election: Requested vote from peers 223a603122eb405c964c91ce475b5b00 (127.19.231.129:36773), c27fc47358754e49881285e680287e94 (127.19.231.130:41085)
I20260709 13:11:36.333945 32549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e" candidate_uuid: "130f46492c41451da3816187668765ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "223a603122eb405c964c91ce475b5b00"
I20260709 13:11:36.334339 32699 raft_consensus.cc:3060] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.334414 32625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e" candidate_uuid: "130f46492c41451da3816187668765ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c27fc47358754e49881285e680287e94"
I20260709 13:11:36.334724 32549 raft_consensus.cc:3060] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.335142 32625 raft_consensus.cc:3060] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.341508 32550 raft_consensus.cc:2468] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c27fc47358754e49881285e680287e94 in term 1.
I20260709 13:11:36.342584 32699 raft_consensus.cc:2468] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c27fc47358754e49881285e680287e94 in term 1.
I20260709 13:11:36.342896 32625 raft_consensus.cc:2468] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130f46492c41451da3816187668765ed in term 1.
I20260709 13:11:36.343145 32589 leader_election.cc:304] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 223a603122eb405c964c91ce475b5b00, c27fc47358754e49881285e680287e94; no voters: 
I20260709 13:11:36.342896 32549 raft_consensus.cc:2468] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130f46492c41451da3816187668765ed in term 1.
I20260709 13:11:36.344326   310 raft_consensus.cc:2804] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.344830   310 raft_consensus.cc:697] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 1 LEADER]: Becoming Leader. State: Replica: c27fc47358754e49881285e680287e94, State: Running, Role: LEADER
I20260709 13:11:36.344844 32665 leader_election.cc:304] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130f46492c41451da3816187668765ed, c27fc47358754e49881285e680287e94; no voters: 
I20260709 13:11:36.345953 32746 raft_consensus.cc:2804] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.345755   310 consensus_queue.cc:237] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.347424 32746 raft_consensus.cc:697] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 1 LEADER]: Becoming Leader. State: Replica: 130f46492c41451da3816187668765ed, State: Running, Role: LEADER
I20260709 13:11:36.348326 32746 consensus_queue.cc:237] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.354251 32448 catalog_manager.cc:5697] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 reported cstate change: term changed from 0 to 1, leader changed from <none> to c27fc47358754e49881285e680287e94 (127.19.231.130). New cstate: current_term: 1 leader_uuid: "c27fc47358754e49881285e680287e94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.358760 32447 catalog_manager.cc:5697] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 130f46492c41451da3816187668765ed (127.19.231.131). New cstate: current_term: 1 leader_uuid: "130f46492c41451da3816187668765ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.445802 32625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cf33b2ae3ca412089dafb2db8a2603b"
dest_uuid: "c27fc47358754e49881285e680287e94"
mode: GRACEFUL
new_leader_uuid: "130f46492c41451da3816187668765ed"
 from {username='slave'} at 127.0.0.1:50318
I20260709 13:11:36.446295 32625 raft_consensus.cc:606] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 1 LEADER]: Received request to transfer leadership to TS 130f46492c41451da3816187668765ed
I20260709 13:11:36.460988 32699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e"
dest_uuid: "130f46492c41451da3816187668765ed"
mode: GRACEFUL
new_leader_uuid: "223a603122eb405c964c91ce475b5b00"
 from {username='slave'} at 127.0.0.1:50836
I20260709 13:11:36.461505 32699 raft_consensus.cc:606] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 1 LEADER]: Received request to transfer leadership to TS 223a603122eb405c964c91ce475b5b00
I20260709 13:11:36.466773 32625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0028c2609f954ce59e83612bba5d17dd"
dest_uuid: "c27fc47358754e49881285e680287e94"
mode: GRACEFUL
new_leader_uuid: "223a603122eb405c964c91ce475b5b00"
 from {username='slave'} at 127.0.0.1:50318
I20260709 13:11:36.467358 32625 raft_consensus.cc:606] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 1 LEADER]: Received request to transfer leadership to TS 223a603122eb405c964c91ce475b5b00
I20260709 13:11:36.733481 32748 raft_consensus.cc:993] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94: : Instructing follower 130f46492c41451da3816187668765ed to start an election
I20260709 13:11:36.733950   310 raft_consensus.cc:1081] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 1 LEADER]: Signalling peer 130f46492c41451da3816187668765ed to start an election
I20260709 13:11:36.735699 32699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cf33b2ae3ca412089dafb2db8a2603b"
dest_uuid: "130f46492c41451da3816187668765ed"
 from {username='slave'} at 127.0.0.1:50830
I20260709 13:11:36.736469 32699 raft_consensus.cc:493] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:36.736784 32699 raft_consensus.cc:3060] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.742321 32699 raft_consensus.cc:515] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.744552 32699 leader_election.cc:290] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [CANDIDATE]: Term 2 election: Requested vote from peers 223a603122eb405c964c91ce475b5b00 (127.19.231.129:36773), c27fc47358754e49881285e680287e94 (127.19.231.130:41085)
I20260709 13:11:36.745293 32549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf33b2ae3ca412089dafb2db8a2603b" candidate_uuid: "130f46492c41451da3816187668765ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "223a603122eb405c964c91ce475b5b00"
I20260709 13:11:36.745910 32549 raft_consensus.cc:3060] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.746667 32746 consensus_queue.cc:1048] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:36.747063 32625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf33b2ae3ca412089dafb2db8a2603b" candidate_uuid: "130f46492c41451da3816187668765ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c27fc47358754e49881285e680287e94"
I20260709 13:11:36.747685 32625 raft_consensus.cc:3055] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:36.747993 32625 raft_consensus.cc:740] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c27fc47358754e49881285e680287e94, State: Running, Role: LEADER
I20260709 13:11:36.748818 32625 consensus_queue.cc:260] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.750844 32625 raft_consensus.cc:3060] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.753034 32549 raft_consensus.cc:2468] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130f46492c41451da3816187668765ed in term 2.
I20260709 13:11:36.754329 32663 leader_election.cc:304] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130f46492c41451da3816187668765ed, 223a603122eb405c964c91ce475b5b00; no voters: 
I20260709 13:11:36.755359 32746 raft_consensus.cc:2804] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:36.755839 32746 raft_consensus.cc:697] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 2 LEADER]: Becoming Leader. State: Replica: 130f46492c41451da3816187668765ed, State: Running, Role: LEADER
I20260709 13:11:36.756704 32746 consensus_queue.cc:237] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.760875 32625 raft_consensus.cc:2468] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130f46492c41451da3816187668765ed in term 2.
I20260709 13:11:36.767328 32448 catalog_manager.cc:5697] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed reported cstate change: term changed from 1 to 2, leader changed from c27fc47358754e49881285e680287e94 (127.19.231.130) to 130f46492c41451da3816187668765ed (127.19.231.131). New cstate: current_term: 2 leader_uuid: "130f46492c41451da3816187668765ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.770601 32746 consensus_queue.cc:1048] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:36.770920   310 consensus_queue.cc:1048] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.780874 32746 raft_consensus.cc:993] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed: : Instructing follower 223a603122eb405c964c91ce475b5b00 to start an election
I20260709 13:11:36.781510 32746 raft_consensus.cc:1081] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 1 LEADER]: Signalling peer 223a603122eb405c964c91ce475b5b00 to start an election
I20260709 13:11:36.784082 32550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e"
dest_uuid: "223a603122eb405c964c91ce475b5b00"
 from {username='slave'} at 127.0.0.1:60342
I20260709 13:11:36.784747 32550 raft_consensus.cc:493] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:36.785178 32550 raft_consensus.cc:3060] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.789774 32748 raft_consensus.cc:993] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94: : Instructing follower 223a603122eb405c964c91ce475b5b00 to start an election
I20260709 13:11:36.790355 32757 raft_consensus.cc:1081] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 1 LEADER]: Signalling peer 223a603122eb405c964c91ce475b5b00 to start an election
I20260709 13:11:36.792129 32548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0028c2609f954ce59e83612bba5d17dd"
dest_uuid: "223a603122eb405c964c91ce475b5b00"
 from {username='slave'} at 127.0.0.1:60340
I20260709 13:11:36.793643 32548 raft_consensus.cc:493] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:36.794075 32548 raft_consensus.cc:3060] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.798583 32757 consensus_queue.cc:1048] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:36.805771 32550 raft_consensus.cc:515] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.810042 32624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e" candidate_uuid: "223a603122eb405c964c91ce475b5b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c27fc47358754e49881285e680287e94"
I20260709 13:11:36.810730 32624 raft_consensus.cc:3060] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.819531 32624 raft_consensus.cc:2468] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 223a603122eb405c964c91ce475b5b00 in term 2.
I20260709 13:11:36.802206 32548 raft_consensus.cc:515] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.820998 32516 leader_election.cc:304] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 223a603122eb405c964c91ce475b5b00, c27fc47358754e49881285e680287e94; no voters: 
I20260709 13:11:36.822492   326 raft_consensus.cc:2804] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:36.823230   326 raft_consensus.cc:697] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 2 LEADER]: Becoming Leader. State: Replica: 223a603122eb405c964c91ce475b5b00, State: Running, Role: LEADER
I20260709 13:11:36.823366 32699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0028c2609f954ce59e83612bba5d17dd" candidate_uuid: "223a603122eb405c964c91ce475b5b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "130f46492c41451da3816187668765ed"
I20260709 13:11:36.824146 32699 raft_consensus.cc:3060] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.825574 32698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e" candidate_uuid: "223a603122eb405c964c91ce475b5b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "130f46492c41451da3816187668765ed"
I20260709 13:11:36.826161 32698 raft_consensus.cc:3055] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:36.826498 32698 raft_consensus.cc:740] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 130f46492c41451da3816187668765ed, State: Running, Role: LEADER
I20260709 13:11:36.824118   326 consensus_queue.cc:237] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.827325 32698 consensus_queue.cc:260] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.828341 32698 raft_consensus.cc:3060] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.831935 32699 raft_consensus.cc:2468] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 223a603122eb405c964c91ce475b5b00 in term 2.
I20260709 13:11:36.823357 32624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0028c2609f954ce59e83612bba5d17dd" candidate_uuid: "223a603122eb405c964c91ce475b5b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c27fc47358754e49881285e680287e94"
I20260709 13:11:36.833110 32624 raft_consensus.cc:3055] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:36.833561 32624 raft_consensus.cc:740] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c27fc47358754e49881285e680287e94, State: Running, Role: LEADER
I20260709 13:11:36.823654 32548 leader_election.cc:290] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [CANDIDATE]: Term 2 election: Requested vote from peers c27fc47358754e49881285e680287e94 (127.19.231.130:41085), 130f46492c41451da3816187668765ed (127.19.231.131:35659)
I20260709 13:11:36.834566 32624 consensus_queue.cc:260] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.834594 32698 raft_consensus.cc:2468] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 223a603122eb405c964c91ce475b5b00 in term 2.
I20260709 13:11:36.836257 32624 raft_consensus.cc:3060] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.824498 32550 leader_election.cc:290] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [CANDIDATE]: Term 2 election: Requested vote from peers c27fc47358754e49881285e680287e94 (127.19.231.130:41085), 130f46492c41451da3816187668765ed (127.19.231.131:35659)
I20260709 13:11:36.837507 32513 leader_election.cc:304] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130f46492c41451da3816187668765ed, 223a603122eb405c964c91ce475b5b00; no voters: 
I20260709 13:11:36.838332   305 raft_consensus.cc:2804] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:36.838838   305 raft_consensus.cc:697] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 2 LEADER]: Becoming Leader. State: Replica: 223a603122eb405c964c91ce475b5b00, State: Running, Role: LEADER
I20260709 13:11:36.839641   305 consensus_queue.cc:237] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:36.840583 32447 catalog_manager.cc:5697] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 reported cstate change: term changed from 1 to 2, leader changed from 130f46492c41451da3816187668765ed (127.19.231.131) to 223a603122eb405c964c91ce475b5b00 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "223a603122eb405c964c91ce475b5b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.843799 32624 raft_consensus.cc:2468] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 223a603122eb405c964c91ce475b5b00 in term 2.
I20260709 13:11:36.855017 32447 catalog_manager.cc:5697] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 reported cstate change: term changed from 1 to 2, leader changed from c27fc47358754e49881285e680287e94 (127.19.231.130) to 223a603122eb405c964c91ce475b5b00 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "223a603122eb405c964c91ce475b5b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.919032 20382 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:11:36.920615 20382 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:11:36.921005 20382 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:11:36.933274 32550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e"
dest_uuid: "223a603122eb405c964c91ce475b5b00"
mode: GRACEFUL
new_leader_uuid: "c27fc47358754e49881285e680287e94"
 from {username='slave'} at 127.0.0.1:60358
I20260709 13:11:36.933861 32550 raft_consensus.cc:606] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 2 LEADER]: Received request to transfer leadership to TS c27fc47358754e49881285e680287e94
I20260709 13:11:36.935077 20382 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:11:37.177333 32624 raft_consensus.cc:1275] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Refusing update from remote peer 130f46492c41451da3816187668765ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.178673   315 consensus_queue.cc:1048] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.186582 32550 raft_consensus.cc:1275] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 2 FOLLOWER]: Refusing update from remote peer 130f46492c41451da3816187668765ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.188355 32746 consensus_queue.cc:1048] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.238830 32624 raft_consensus.cc:1275] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Refusing update from remote peer 223a603122eb405c964c91ce475b5b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.240190   326 consensus_queue.cc:1048] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.245275   321 raft_consensus.cc:993] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00: : Instructing follower c27fc47358754e49881285e680287e94 to start an election
I20260709 13:11:37.245817   305 raft_consensus.cc:1081] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 2 LEADER]: Signalling peer c27fc47358754e49881285e680287e94 to start an election
I20260709 13:11:37.247421 32625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e"
dest_uuid: "c27fc47358754e49881285e680287e94"
 from {username='slave'} at 127.0.0.1:50294
I20260709 13:11:37.247996 32625 raft_consensus.cc:493] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:37.248358 32625 raft_consensus.cc:3060] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:37.251984 32698 raft_consensus.cc:1275] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 2 FOLLOWER]: Refusing update from remote peer 223a603122eb405c964c91ce475b5b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.253569   305 consensus_queue.cc:1048] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.255340 32625 raft_consensus.cc:515] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:37.259670 32550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e" candidate_uuid: "c27fc47358754e49881285e680287e94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "223a603122eb405c964c91ce475b5b00"
I20260709 13:11:37.259979 32625 leader_election.cc:290] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [CANDIDATE]: Term 3 election: Requested vote from peers 223a603122eb405c964c91ce475b5b00 (127.19.231.129:36773), 130f46492c41451da3816187668765ed (127.19.231.131:35659)
I20260709 13:11:37.260329 32550 raft_consensus.cc:3055] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:37.260679 32550 raft_consensus.cc:740] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 223a603122eb405c964c91ce475b5b00, State: Running, Role: LEADER
I20260709 13:11:37.261330 32698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1c1ed59f0f40f2aaa9d59aa4b87a6e" candidate_uuid: "c27fc47358754e49881285e680287e94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "130f46492c41451da3816187668765ed"
I20260709 13:11:37.261534 32550 consensus_queue.cc:260] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:37.261991 32698 raft_consensus.cc:3060] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:37.262766 32550 raft_consensus.cc:3060] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:37.268584 32550 raft_consensus.cc:2468] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c27fc47358754e49881285e680287e94 in term 3.
I20260709 13:11:37.269738 32698 raft_consensus.cc:2468] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c27fc47358754e49881285e680287e94 in term 3.
I20260709 13:11:37.269842 32589 leader_election.cc:304] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 223a603122eb405c964c91ce475b5b00, c27fc47358754e49881285e680287e94; no voters: 
I20260709 13:11:37.270735   310 raft_consensus.cc:2804] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:37.271250   310 raft_consensus.cc:697] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 3 LEADER]: Becoming Leader. State: Replica: c27fc47358754e49881285e680287e94, State: Running, Role: LEADER
I20260709 13:11:37.272127   310 consensus_queue.cc:237] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } }
I20260709 13:11:37.279711 32448 catalog_manager.cc:5697] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 reported cstate change: term changed from 2 to 3, leader changed from 223a603122eb405c964c91ce475b5b00 (127.19.231.129) to c27fc47358754e49881285e680287e94 (127.19.231.130). New cstate: current_term: 3 leader_uuid: "c27fc47358754e49881285e680287e94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223a603122eb405c964c91ce475b5b00" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.286907 32625 raft_consensus.cc:1275] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Refusing update from remote peer 223a603122eb405c964c91ce475b5b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.288298   305 consensus_queue.cc:1048] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c27fc47358754e49881285e680287e94" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.295961 32698 raft_consensus.cc:1275] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 2 FOLLOWER]: Refusing update from remote peer 223a603122eb405c964c91ce475b5b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.297756   321 consensus_queue.cc:1048] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "130f46492c41451da3816187668765ed" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.552296 20382 tablet_server.cc:179] TabletServer@127.19.231.129:0 shutting down...
I20260709 13:11:37.571231 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:37.571949 20382 tablet_replica.cc:333] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00: stopping tablet replica
I20260709 13:11:37.572615 20382 raft_consensus.cc:2243] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:37.573501 20382 raft_consensus.cc:2272] T 0028c2609f954ce59e83612bba5d17dd P 223a603122eb405c964c91ce475b5b00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.575798 20382 tablet_replica.cc:333] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00: stopping tablet replica
I20260709 13:11:37.576400 20382 raft_consensus.cc:2243] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.576828 20382 raft_consensus.cc:2272] T 0cf33b2ae3ca412089dafb2db8a2603b P 223a603122eb405c964c91ce475b5b00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.579082 20382 tablet_replica.cc:333] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00: stopping tablet replica
I20260709 13:11:37.579605 20382 raft_consensus.cc:2243] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.580039 20382 raft_consensus.cc:2272] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 223a603122eb405c964c91ce475b5b00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.582295 20382 tablet_replica.cc:333] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00: stopping tablet replica
I20260709 13:11:37.582847 20382 raft_consensus.cc:2243] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:37.583626 20382 raft_consensus.cc:2272] T 5d7f441cada643d2962fd667c5b8c8e3 P 223a603122eb405c964c91ce475b5b00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.596698 20382 tablet_server.cc:196] TabletServer@127.19.231.129:0 shutdown complete.
I20260709 13:11:37.608764 20382 tablet_server.cc:179] TabletServer@127.19.231.130:0 shutting down...
I20260709 13:11:37.626286 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:37.627031 20382 tablet_replica.cc:333] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94: stopping tablet replica
I20260709 13:11:37.627622 20382 raft_consensus.cc:2243] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.628108 20382 raft_consensus.cc:2272] T 0028c2609f954ce59e83612bba5d17dd P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.630472 20382 tablet_replica.cc:333] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94: stopping tablet replica
I20260709 13:11:37.631127 20382 raft_consensus.cc:2243] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.631577 20382 raft_consensus.cc:2272] T 0cf33b2ae3ca412089dafb2db8a2603b P c27fc47358754e49881285e680287e94 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.634171 20382 tablet_replica.cc:333] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94: stopping tablet replica
I20260709 13:11:37.634737 20382 raft_consensus.cc:2243] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:37.635461 20382 pending_rounds.cc:70] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94: Trying to abort 1 pending ops.
I20260709 13:11:37.635684 20382 pending_rounds.cc:77] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636648035241984 op_type: NO_OP noop_request { }
I20260709 13:11:37.636076 20382 raft_consensus.cc:2889] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:37.636368 20382 raft_consensus.cc:2272] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P c27fc47358754e49881285e680287e94 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.639051 20382 tablet_replica.cc:333] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94: stopping tablet replica
I20260709 13:11:37.639721 20382 raft_consensus.cc:2243] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.640190 20382 raft_consensus.cc:2272] T 5d7f441cada643d2962fd667c5b8c8e3 P c27fc47358754e49881285e680287e94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:37.640472 32665 consensus_peers.cc:597] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed -> Peer c27fc47358754e49881285e680287e94 (127.19.231.130:41085): Couldn't send request to peer c27fc47358754e49881285e680287e94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:37.652305 20382 tablet_server.cc:196] TabletServer@127.19.231.130:0 shutdown complete.
I20260709 13:11:37.664783 20382 tablet_server.cc:179] TabletServer@127.19.231.131:0 shutting down...
W20260709 13:11:37.677619 32663 consensus_peers.cc:597] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed -> Peer 223a603122eb405c964c91ce475b5b00 (127.19.231.129:36773): Couldn't send request to peer 223a603122eb405c964c91ce475b5b00. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:37.689808 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:37.690536 20382 tablet_replica.cc:333] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed: stopping tablet replica
I20260709 13:11:37.691121 20382 raft_consensus.cc:2243] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.691610 20382 raft_consensus.cc:2272] T ce1c1ed59f0f40f2aaa9d59aa4b87a6e P 130f46492c41451da3816187668765ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.693734 20382 tablet_replica.cc:333] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed: stopping tablet replica
I20260709 13:11:37.694283 20382 raft_consensus.cc:2243] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.694702 20382 raft_consensus.cc:2272] T 5d7f441cada643d2962fd667c5b8c8e3 P 130f46492c41451da3816187668765ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.696617 20382 tablet_replica.cc:333] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed: stopping tablet replica
I20260709 13:11:37.697120 20382 raft_consensus.cc:2243] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.697551 20382 raft_consensus.cc:2272] T 0028c2609f954ce59e83612bba5d17dd P 130f46492c41451da3816187668765ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.699739 20382 tablet_replica.cc:333] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed: stopping tablet replica
I20260709 13:11:37.700232 20382 raft_consensus.cc:2243] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:37.701058 20382 raft_consensus.cc:2272] T 0cf33b2ae3ca412089dafb2db8a2603b P 130f46492c41451da3816187668765ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.725037 20382 tablet_server.cc:196] TabletServer@127.19.231.131:0 shutdown complete.
I20260709 13:11:37.737126 20382 master.cc:562] Master@127.19.231.190:38247 shutting down...
I20260709 13:11:37.752593 20382 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:37.753103 20382 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.753368 20382 tablet_replica.cc:333] T 00000000000000000000000000000000 P b1fbb30c2a104724bf6cb5c465146b22: stopping tablet replica
I20260709 13:11:37.771922 20382 master.cc:584] Master@127.19.231.190:38247 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2909 ms)
[----------] 6 tests from LeaderRebalancerTest (360165 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:11:37.800513 20382 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.231.190:42585
I20260709 13:11:37.801550 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:37.806453   332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:37.806725   333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:37.808322   335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:37.809417 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:37.810240 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:37.810452 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:37.810613 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602697810578 us; error 0 us; skew 500 ppm
I20260709 13:11:37.811331 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:37.813558 20382 webserver.cc:533] Webserver started at http://127.19.231.190:37855/ using document root <none> and password file <none>
I20260709 13:11:37.814031 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:37.814221 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:37.814491 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:37.815629 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/master-0-root/instance:
uuid: "2fb413f820b341afb7bf7627571c0ab3"
format_stamp: "Formatted at 2026-07-09 13:11:37 on dist-test-slave-1t6m"
I20260709 13:11:37.819998 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:11:37.823369   340 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:37.824131 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:11:37.824431 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/master-0-root
uuid: "2fb413f820b341afb7bf7627571c0ab3"
format_stamp: "Formatted at 2026-07-09 13:11:37 on dist-test-slave-1t6m"
I20260709 13:11:37.824687 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:37.839732 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:37.840751 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:37.876236 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.190:42585
I20260709 13:11:37.876344   391 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.190:42585 every 8 connection(s)
I20260709 13:11:37.880270   392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.890776   392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3: Bootstrap starting.
I20260709 13:11:37.895232   392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.899252   392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3: No bootstrap required, opened a new log
I20260709 13:11:37.901281   392 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb413f820b341afb7bf7627571c0ab3" member_type: VOTER }
I20260709 13:11:37.901664   392 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.901852   392 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb413f820b341afb7bf7627571c0ab3, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.902328   392 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb413f820b341afb7bf7627571c0ab3" member_type: VOTER }
I20260709 13:11:37.902747   392 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:37.903066   392 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:37.903280   392 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.908061   392 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb413f820b341afb7bf7627571c0ab3" member_type: VOTER }
I20260709 13:11:37.908560   392 leader_election.cc:304] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fb413f820b341afb7bf7627571c0ab3; no voters: 
I20260709 13:11:37.909655   392 leader_election.cc:290] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:37.910009   395 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:37.911487   395 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb413f820b341afb7bf7627571c0ab3, State: Running, Role: LEADER
I20260709 13:11:37.912098   395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb413f820b341afb7bf7627571c0ab3" member_type: VOTER }
I20260709 13:11:37.912688   392 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:37.914997   396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fb413f820b341afb7bf7627571c0ab3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb413f820b341afb7bf7627571c0ab3" member_type: VOTER } }
I20260709 13:11:37.915005   397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fb413f820b341afb7bf7627571c0ab3. Latest consensus state: current_term: 1 leader_uuid: "2fb413f820b341afb7bf7627571c0ab3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb413f820b341afb7bf7627571c0ab3" member_type: VOTER } }
I20260709 13:11:37.915877   396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:37.915951   397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:37.922883   400 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:37.927798   400 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:37.929008 20382 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:37.936568   400 catalog_manager.cc:1383] Generated new cluster ID: c892bb2e96c84806877a5c3207542839
I20260709 13:11:37.936898   400 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:37.955053   400 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:37.956432   400 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:37.976619   400 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3: Generated new TSK 0
I20260709 13:11:37.977267   400 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:37.995841 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:38.001825   413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:38.002979   414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:38.005072   416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:38.007474 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:38.008368 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:38.008579 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:38.008769 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602698008749 us; error 0 us; skew 500 ppm
I20260709 13:11:38.009320 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:38.011639 20382 webserver.cc:533] Webserver started at http://127.19.231.129:36061/ using document root <none> and password file <none>
I20260709 13:11:38.012123 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:38.012333 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:38.012598 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:38.013720 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-0-root/instance:
uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
format_stamp: "Formatted at 2026-07-09 13:11:38 on dist-test-slave-1t6m"
I20260709 13:11:38.018462 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:11:38.022033   421 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:38.022891 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:38.023224 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-0-root
uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
format_stamp: "Formatted at 2026-07-09 13:11:38 on dist-test-slave-1t6m"
I20260709 13:11:38.023509 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:38.039399 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:38.040586 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:38.042054 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:38.044520 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:38.044718 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:38.045269 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:38.045457 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:38.084335 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.129:36021
I20260709 13:11:38.084461   484 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.129:36021 every 8 connection(s)
I20260709 13:11:38.089367 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:38.098147   489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:38.098515   490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:38.102070 20382 server_base.cc:1061] running on GCE node
W20260709 13:11:38.102972   492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:38.103924 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:38.104127 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:38.104338 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602698104317 us; error 0 us; skew 500 ppm
I20260709 13:11:38.104857 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:38.107597 20382 webserver.cc:533] Webserver started at http://127.19.231.130:43833/ using document root <none> and password file <none>
I20260709 13:11:38.108275 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:38.108498 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:38.108773 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:38.110060 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-1-root/instance:
uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
format_stamp: "Formatted at 2026-07-09 13:11:38 on dist-test-slave-1t6m"
I20260709 13:11:38.110075   485 heartbeater.cc:344] Connected to a master server at 127.19.231.190:42585
I20260709 13:11:38.110571   485 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:38.111320   485 heartbeater.cc:507] Master 127.19.231.190:42585 requested a full tablet report, sending...
I20260709 13:11:38.113545   357 ts_manager.cc:194] Registered new tserver with Master: 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021)
I20260709 13:11:38.115363 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:11:38.116063   357 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46156
I20260709 13:11:38.119550   497 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:38.120368 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:11:38.120677 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-1-root
uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
format_stamp: "Formatted at 2026-07-09 13:11:38 on dist-test-slave-1t6m"
I20260709 13:11:38.120966 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:38.139871 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:38.140966 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:38.142563 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:38.144872 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:38.145056 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:38.145365 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:38.145511 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:38.184484 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.130:42921
I20260709 13:11:38.184587   559 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.130:42921 every 8 connection(s)
I20260709 13:11:38.189469 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:38.197266   563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:38.198418   564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:38.202050   566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:38.202780   560 heartbeater.cc:344] Connected to a master server at 127.19.231.190:42585
I20260709 13:11:38.203256   560 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:38.203282 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:38.204449   560 heartbeater.cc:507] Master 127.19.231.190:42585 requested a full tablet report, sending...
I20260709 13:11:38.204645 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:38.204957 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:38.205137 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602698205119 us; error 0 us; skew 500 ppm
I20260709 13:11:38.205833 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:38.206843   357 ts_manager.cc:194] Registered new tserver with Master: 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:38.208555   357 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46162
I20260709 13:11:38.208585 20382 webserver.cc:533] Webserver started at http://127.19.231.131:40039/ using document root <none> and password file <none>
I20260709 13:11:38.209327 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:38.209580 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:38.209889 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:38.211067 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-2-root/instance:
uuid: "4d2692ff97134a10b619aba0249bea10"
format_stamp: "Formatted at 2026-07-09 13:11:38 on dist-test-slave-1t6m"
I20260709 13:11:38.215659 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:11:38.218909   571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:38.219624 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:11:38.219967 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-2-root
uuid: "4d2692ff97134a10b619aba0249bea10"
format_stamp: "Formatted at 2026-07-09 13:11:38 on dist-test-slave-1t6m"
I20260709 13:11:38.220265 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337466250-20382-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:38.230638 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:38.231705 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:38.233139 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:38.235472 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:38.235711 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:38.235968 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:38.236150 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:38.274060 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.131:43431
I20260709 13:11:38.274181   633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.131:43431 every 8 connection(s)
I20260709 13:11:38.288292   634 heartbeater.cc:344] Connected to a master server at 127.19.231.190:42585
I20260709 13:11:38.288756   634 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:38.289443   634 heartbeater.cc:507] Master 127.19.231.190:42585 requested a full tablet report, sending...
I20260709 13:11:38.291477   357 ts_manager.cc:194] Registered new tserver with Master: 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:38.292048 20382 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014792925s
I20260709 13:11:38.293226   357 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46178
I20260709 13:11:38.318223   357 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46182:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:38.320935   357 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:38.394418   450 tablet_service.cc:1511] Processing CreateTablet for tablet a6eed78c960a41709cccbf17aea1c2dc (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:38.395936   450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6eed78c960a41709cccbf17aea1c2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.396677   524 tablet_service.cc:1511] Processing CreateTablet for tablet a8f161f5589f47c1b1b4b03560887117 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:38.397372   449 tablet_service.cc:1511] Processing CreateTablet for tablet a8f161f5589f47c1b1b4b03560887117 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:38.397840   525 tablet_service.cc:1511] Processing CreateTablet for tablet a6eed78c960a41709cccbf17aea1c2dc (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:38.398840   449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f161f5589f47c1b1b4b03560887117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.398187   524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f161f5589f47c1b1b4b03560887117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.400281   523 tablet_service.cc:1511] Processing CreateTablet for tablet 217ec655ac044b46b9c2eb5b7353506c (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:38.401731   523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217ec655ac044b46b9c2eb5b7353506c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.402177   598 tablet_service.cc:1511] Processing CreateTablet for tablet a8f161f5589f47c1b1b4b03560887117 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:38.403640   598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f161f5589f47c1b1b4b03560887117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.403923   599 tablet_service.cc:1511] Processing CreateTablet for tablet a6eed78c960a41709cccbf17aea1c2dc (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:38.405282   599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6eed78c960a41709cccbf17aea1c2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.408438   597 tablet_service.cc:1511] Processing CreateTablet for tablet 217ec655ac044b46b9c2eb5b7353506c (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:38.410508   597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217ec655ac044b46b9c2eb5b7353506c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.401733   447 tablet_service.cc:1511] Processing CreateTablet for tablet c982530741064ceca257d7c535960729 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:38.395992   448 tablet_service.cc:1511] Processing CreateTablet for tablet 217ec655ac044b46b9c2eb5b7353506c (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:38.412732   525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6eed78c960a41709cccbf17aea1c2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.418747   447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c982530741064ceca257d7c535960729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.419464   448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217ec655ac044b46b9c2eb5b7353506c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.441334   522 tablet_service.cc:1511] Processing CreateTablet for tablet c982530741064ceca257d7c535960729 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:38.444140   596 tablet_service.cc:1511] Processing CreateTablet for tablet c982530741064ceca257d7c535960729 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:38.445652   596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c982530741064ceca257d7c535960729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.446816   521 tablet_service.cc:1511] Processing CreateTablet for tablet e2d36296bf974c88b980c5306e809b0d (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:38.448613   522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c982530741064ceca257d7c535960729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.451934   446 tablet_service.cc:1511] Processing CreateTablet for tablet e2d36296bf974c88b980c5306e809b0d (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:38.453353   446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d36296bf974c88b980c5306e809b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.462003   595 tablet_service.cc:1511] Processing CreateTablet for tablet e2d36296bf974c88b980c5306e809b0d (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:38.462939   521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d36296bf974c88b980c5306e809b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.463537   595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d36296bf974c88b980c5306e809b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.482990   650 tablet_bootstrap.cc:492] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:38.483355   649 tablet_bootstrap.cc:492] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:38.489725   651 tablet_bootstrap.cc:492] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:38.491902   524 tablet_service.cc:1511] Processing CreateTablet for tablet b8b4aee61d8849e3bfe722f93a1f2cf5 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:38.505120   448 tablet_service.cc:1511] Processing CreateTablet for tablet b8b4aee61d8849e3bfe722f93a1f2cf5 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:38.521646   524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b4aee61d8849e3bfe722f93a1f2cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.530021   650 tablet_bootstrap.cc:654] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:38.533138   341 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.19.231.129:36021, user_credentials={real_user=slave}} blocked reactor thread for 46333.7us
I20260709 13:11:38.539059   651 tablet_bootstrap.cc:654] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.538810   525 tablet_service.cc:1511] Processing CreateTablet for tablet 617a70efb1b149e2985601949d593e1b (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:38.540176   525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617a70efb1b149e2985601949d593e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.541702   599 tablet_service.cc:1511] Processing CreateTablet for tablet 617a70efb1b149e2985601949d593e1b (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:38.544008   448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b4aee61d8849e3bfe722f93a1f2cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.546319   522 tablet_service.cc:1511] Processing CreateTablet for tablet fc5370fb2d7c47f2b35965c63e0ba186 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:38.547765   522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc5370fb2d7c47f2b35965c63e0ba186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.548089   649 tablet_bootstrap.cc:654] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.543206   599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617a70efb1b149e2985601949d593e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.552161   446 tablet_service.cc:1511] Processing CreateTablet for tablet fc5370fb2d7c47f2b35965c63e0ba186 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:38.553615   650 tablet_bootstrap.cc:492] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:38.554044   449 tablet_service.cc:1511] Processing CreateTablet for tablet 617a70efb1b149e2985601949d593e1b (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:38.555394   446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc5370fb2d7c47f2b35965c63e0ba186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.563323   450 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6b93de432d4d42b11386c5446d96e4 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:38.567770   523 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6b93de432d4d42b11386c5446d96e4 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:38.568531   598 tablet_service.cc:1511] Processing CreateTablet for tablet fc5370fb2d7c47f2b35965c63e0ba186 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:38.569164   523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6b93de432d4d42b11386c5446d96e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.569943   598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc5370fb2d7c47f2b35965c63e0ba186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.558629   650 ts_tablet_manager.cc:1403] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.014s
I20260709 13:11:38.578003   650 raft_consensus.cc:359] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.583331   650 raft_consensus.cc:385] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.583757   650 raft_consensus.cc:740] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.585057   650 consensus_queue.cc:260] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.552161   597 tablet_service.cc:1511] Processing CreateTablet for tablet b8b4aee61d8849e3bfe722f93a1f2cf5 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:38.582574   596 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6b93de432d4d42b11386c5446d96e4 (DEFAULT_TABLE table=test-workload [id=559031bbab72471fabe7530e48634725]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:38.588454   649 tablet_bootstrap.cc:492] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:38.590258   450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6b93de432d4d42b11386c5446d96e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.591992   649 ts_tablet_manager.cc:1403] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.000s
I20260709 13:11:38.592232   449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617a70efb1b149e2985601949d593e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.590430   597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b4aee61d8849e3bfe722f93a1f2cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.595759   596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6b93de432d4d42b11386c5446d96e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.606932   649 raft_consensus.cc:359] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.607617   651 tablet_bootstrap.cc:492] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:38.607748   649 raft_consensus.cc:385] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.609287   649 raft_consensus.cc:740] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.610725   651 ts_tablet_manager.cc:1403] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.007s
I20260709 13:11:38.617951   651 raft_consensus.cc:359] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.618992   651 raft_consensus.cc:385] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.620004   651 raft_consensus.cc:740] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.614216   649 consensus_queue.cc:260] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.621572   651 consensus_queue.cc:260] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.627254   650 ts_tablet_manager.cc:1434] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.003s
I20260709 13:11:38.627523   634 heartbeater.cc:499] Master 127.19.231.190:42585 was elected leader, sending a full tablet report...
I20260709 13:11:38.628396   650 tablet_bootstrap.cc:492] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:38.634526   650 tablet_bootstrap.cc:654] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.641803   485 heartbeater.cc:499] Master 127.19.231.190:42585 was elected leader, sending a full tablet report...
I20260709 13:11:38.650074   651 ts_tablet_manager.cc:1434] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.013s
I20260709 13:11:38.657617   650 tablet_bootstrap.cc:492] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:38.657708   651 tablet_bootstrap.cc:492] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:38.658484   650 ts_tablet_manager.cc:1403] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.004s
I20260709 13:11:38.661602   650 raft_consensus.cc:359] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.662427   650 raft_consensus.cc:385] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.662748   650 raft_consensus.cc:740] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.664620   560 heartbeater.cc:499] Master 127.19.231.190:42585 was elected leader, sending a full tablet report...
I20260709 13:11:38.665167   649 ts_tablet_manager.cc:1434] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.073s	user 0.011s	sys 0.020s
I20260709 13:11:38.665619   650 consensus_queue.cc:260] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.666344   649 tablet_bootstrap.cc:492] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:38.668068   650 ts_tablet_manager.cc:1434] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:38.669183   650 tablet_bootstrap.cc:492] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:38.672871   649 tablet_bootstrap.cc:654] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.675482   651 tablet_bootstrap.cc:654] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.675570   650 tablet_bootstrap.cc:654] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.685464   651 tablet_bootstrap.cc:492] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:38.686723   649 tablet_bootstrap.cc:492] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:38.687469   651 ts_tablet_manager.cc:1403] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.002s
I20260709 13:11:38.687572   649 ts_tablet_manager.cc:1403] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:11:38.690248   649 raft_consensus.cc:359] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.690909   649 raft_consensus.cc:385] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.690714   651 raft_consensus.cc:359] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.691366   649 raft_consensus.cc:740] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.691587   651 raft_consensus.cc:385] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.691991   651 raft_consensus.cc:740] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.692373   649 consensus_queue.cc:260] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.693186   650 tablet_bootstrap.cc:492] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:38.692848   651 consensus_queue.cc:260] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.695009   649 ts_tablet_manager.cc:1434] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:38.695319   651 ts_tablet_manager.cc:1434] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:38.696115   649 tablet_bootstrap.cc:492] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:38.696345   651 tablet_bootstrap.cc:492] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:38.702591   649 tablet_bootstrap.cc:654] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.702688   651 tablet_bootstrap.cc:654] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.693838   650 ts_tablet_manager.cc:1403] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.011s
I20260709 13:11:38.707345   650 raft_consensus.cc:359] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.708278   650 raft_consensus.cc:385] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.708508   651 tablet_bootstrap.cc:492] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:38.708640   650 raft_consensus.cc:740] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.709523   651 ts_tablet_manager.cc:1403] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:11:38.710006   650 consensus_queue.cc:260] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.712615   649 tablet_bootstrap.cc:492] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:38.713200   649 ts_tablet_manager.cc:1403] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 13:11:38.713608   651 raft_consensus.cc:359] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.714416   651 raft_consensus.cc:385] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.714697   650 ts_tablet_manager.cc:1434] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:11:38.714811   651 raft_consensus.cc:740] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.715950   651 consensus_queue.cc:260] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.716325   649 raft_consensus.cc:359] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.717061   649 raft_consensus.cc:385] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.717357   649 raft_consensus.cc:740] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.718036   651 ts_tablet_manager.cc:1434] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:38.716171   650 tablet_bootstrap.cc:492] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:38.718674   649 consensus_queue.cc:260] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.721457   649 ts_tablet_manager.cc:1434] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:11:38.722805   649 tablet_bootstrap.cc:492] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:38.724995   651 tablet_bootstrap.cc:492] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:38.728435   650 tablet_bootstrap.cc:654] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.728977   649 tablet_bootstrap.cc:654] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.732194   651 tablet_bootstrap.cc:654] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.742887   650 tablet_bootstrap.cc:492] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:38.743443   650 ts_tablet_manager.cc:1403] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.008s
I20260709 13:11:38.743556   651 tablet_bootstrap.cc:492] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:38.743319   655 raft_consensus.cc:493] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.744458   651 ts_tablet_manager.cc:1403] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 13:11:38.744590   649 tablet_bootstrap.cc:492] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:38.744338   655 raft_consensus.cc:515] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.745290   649 ts_tablet_manager.cc:1403] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.013s
I20260709 13:11:38.746845   650 raft_consensus.cc:359] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.747659   650 raft_consensus.cc:385] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.747968   650 raft_consensus.cc:740] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.748010   651 raft_consensus.cc:359] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.748462   649 raft_consensus.cc:359] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.748945   651 raft_consensus.cc:385] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.749284   649 raft_consensus.cc:385] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.748955   650 consensus_queue.cc:260] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.749568   651 raft_consensus.cc:740] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.749763   649 raft_consensus.cc:740] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.750739   649 consensus_queue.cc:260] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.752699   650 ts_tablet_manager.cc:1434] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:11:38.753101   649 ts_tablet_manager.cc:1434] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:38.754210   649 tablet_bootstrap.cc:492] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:38.754280   650 tablet_bootstrap.cc:492] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:38.760993   649 tablet_bootstrap.cc:654] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.761439   650 tablet_bootstrap.cc:654] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.750751   651 consensus_queue.cc:260] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.765236   651 ts_tablet_manager.cc:1434] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 13:11:38.766324   651 tablet_bootstrap.cc:492] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:38.766611   655 leader_election.cc:290] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:38.767204   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6eed78c960a41709cccbf17aea1c2dc" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
W20260709 13:11:38.771714   572 leader_election.cc:343] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.774458   651 tablet_bootstrap.cc:654] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.781281   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6eed78c960a41709cccbf17aea1c2dc" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:38.782140   535 raft_consensus.cc:2468] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 0.
I20260709 13:11:38.784881   573 leader_election.cc:304] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:38.786154   655 raft_consensus.cc:2804] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.786540   655 raft_consensus.cc:493] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.786885   655 raft_consensus.cc:3060] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.795101   649 tablet_bootstrap.cc:492] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:38.795769   649 ts_tablet_manager.cc:1403] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.021s
I20260709 13:11:38.795710   655 raft_consensus.cc:515] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.797170   651 tablet_bootstrap.cc:492] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:38.797323   650 tablet_bootstrap.cc:492] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:38.797756   651 ts_tablet_manager.cc:1403] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.004s
I20260709 13:11:38.797888   650 ts_tablet_manager.cc:1403] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.000s
I20260709 13:11:38.799341   649 raft_consensus.cc:359] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.800159   649 raft_consensus.cc:385] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.800493   649 raft_consensus.cc:740] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.800505   650 raft_consensus.cc:359] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.800968   651 raft_consensus.cc:359] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.801542   650 raft_consensus.cc:385] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.801540   649 consensus_queue.cc:260] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.802340   650 raft_consensus.cc:740] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.802812   655 leader_election.cc:290] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:38.802909   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6eed78c960a41709cccbf17aea1c2dc" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:38.803370   650 consensus_queue.cc:260] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.804924   649 ts_tablet_manager.cc:1434] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:11:38.805012   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6eed78c960a41709cccbf17aea1c2dc" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:38.805823   535 raft_consensus.cc:3060] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.806066   650 ts_tablet_manager.cc:1434] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:38.807643   650 tablet_bootstrap.cc:492] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:38.801798   651 raft_consensus.cc:385] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.806241   649 tablet_bootstrap.cc:492] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:38.814899   650 tablet_bootstrap.cc:654] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.817498   649 tablet_bootstrap.cc:654] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.810331   651 raft_consensus.cc:740] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.819641   651 consensus_queue.cc:260] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.821883   460 raft_consensus.cc:3060] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.828939   651 ts_tablet_manager.cc:1434] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.005s
I20260709 13:11:38.830224   650 tablet_bootstrap.cc:492] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:38.830544   651 tablet_bootstrap.cc:492] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:38.830996   650 ts_tablet_manager.cc:1403] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 13:11:38.834421   650 raft_consensus.cc:359] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.835304   650 raft_consensus.cc:385] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.835661   650 raft_consensus.cc:740] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.836501   650 consensus_queue.cc:260] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.839326   650 ts_tablet_manager.cc:1434] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:38.840474   650 tablet_bootstrap.cc:492] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:38.840740   651 tablet_bootstrap.cc:654] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.843211   649 tablet_bootstrap.cc:492] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:38.843775   649 ts_tablet_manager.cc:1403] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.021s
I20260709 13:11:38.846921   657 raft_consensus.cc:493] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.847675   650 tablet_bootstrap.cc:654] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.847427   657 raft_consensus.cc:515] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.848507   649 raft_consensus.cc:359] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.849390   649 raft_consensus.cc:385] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.849695   649 raft_consensus.cc:740] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.850450   649 consensus_queue.cc:260] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.856559   649 ts_tablet_manager.cc:1434] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:11:38.858860   535 raft_consensus.cc:2468] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:38.860447   649 tablet_bootstrap.cc:492] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:38.861202   657 leader_election.cc:290] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:38.862216   573 leader_election.cc:304] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:38.863552   656 raft_consensus.cc:493] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.864295   656 raft_consensus.cc:515] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.868718   655 raft_consensus.cc:2804] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:38.869326   655 raft_consensus.cc:697] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:38.870398   650 tablet_bootstrap.cc:492] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:38.870175   655 consensus_queue.cc:237] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.870484   649 tablet_bootstrap.cc:654] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.873708   667 raft_consensus.cc:493] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.874011   650 ts_tablet_manager.cc:1403] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.034s	user 0.026s	sys 0.003s
I20260709 13:11:38.874348   667 raft_consensus.cc:515] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.876672   667 leader_election.cc:290] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:38.877650   650 raft_consensus.cc:359] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.878558   650 raft_consensus.cc:385] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.878676   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f161f5589f47c1b1b4b03560887117" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:38.878980   650 raft_consensus.cc:740] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.879465   459 raft_consensus.cc:2468] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 0.
I20260709 13:11:38.879984   650 consensus_queue.cc:260] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.882685   572 leader_election.cc:304] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:38.880005   651 tablet_bootstrap.cc:492] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:38.884048   651 ts_tablet_manager.cc:1403] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.006s
I20260709 13:11:38.885751   655 raft_consensus.cc:2804] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.886199   655 raft_consensus.cc:493] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.888224   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f161f5589f47c1b1b4b03560887117" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:38.888936   534 raft_consensus.cc:2468] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 0.
I20260709 13:11:38.889189   650 ts_tablet_manager.cc:1434] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:11:38.886579   655 raft_consensus.cc:3060] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.894156   650 tablet_bootstrap.cc:492] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:38.894925   460 raft_consensus.cc:2468] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:38.895480   649 tablet_bootstrap.cc:492] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:38.890898   656 leader_election.cc:290] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:38.911247   651 raft_consensus.cc:359] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.912160   651 raft_consensus.cc:385] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.912484   651 raft_consensus.cc:740] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.913842   650 tablet_bootstrap.cc:654] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.913364   651 consensus_queue.cc:260] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.915968   651 ts_tablet_manager.cc:1434] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.005s
I20260709 13:11:38.905593   649 ts_tablet_manager.cc:1403] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.003s
I20260709 13:11:38.921192   651 tablet_bootstrap.cc:492] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
W20260709 13:11:38.932310   405 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:38.932405   649 raft_consensus.cc:359] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.933389   649 raft_consensus.cc:385] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.933727   649 raft_consensus.cc:740] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.934537   649 consensus_queue.cc:260] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.939255   681 raft_consensus.cc:493] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.939836   681 raft_consensus.cc:515] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.934477   355 catalog_manager.cc:5697] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.943820   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c982530741064ceca257d7c535960729" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:38.944526   534 raft_consensus.cc:2468] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 0.
I20260709 13:11:38.944594   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f161f5589f47c1b1b4b03560887117" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:38.946630   573 leader_election.cc:304] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:38.947644   667 raft_consensus.cc:2804] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.948010   667 raft_consensus.cc:493] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.948336   667 raft_consensus.cc:3060] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.949149   651 tablet_bootstrap.cc:654] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.950987   681 leader_election.cc:290] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:38.956126   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:38.956940   656 raft_consensus.cc:493] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.957626   656 raft_consensus.cc:515] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.959038   667 raft_consensus.cc:515] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.953644   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:38.953975   655 raft_consensus.cc:515] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.960335   459 raft_consensus.cc:2468] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 0.
I20260709 13:11:38.960716   609 raft_consensus.cc:2393] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b2f8e9217a44d879d7c4bbe28f9838c in current term 1: Already voted for candidate 4d2692ff97134a10b619aba0249bea10 in this term.
I20260709 13:11:38.961385   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:38.961911   498 leader_election.cc:304] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:38.954924   677 raft_consensus.cc:493] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.962860   657 raft_consensus.cc:2804] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.962719   677 raft_consensus.cc:515] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.963371   657 raft_consensus.cc:493] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.963780   657 raft_consensus.cc:3060] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.964811   650 tablet_bootstrap.cc:492] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:38.965057   677 leader_election.cc:290] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:38.965333   650 ts_tablet_manager.cc:1403] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.002s
I20260709 13:11:38.965590   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c982530741064ceca257d7c535960729" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:38.966226   459 raft_consensus.cc:3060] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.967814   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d36296bf974c88b980c5306e809b0d" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:38.968007   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d36296bf974c88b980c5306e809b0d" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:38.968307   650 raft_consensus.cc:359] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.968576   458 raft_consensus.cc:2468] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 0.
I20260709 13:11:38.968691   607 raft_consensus.cc:2468] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 0.
I20260709 13:11:38.968986   650 raft_consensus.cc:385] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.957015   608 raft_consensus.cc:2468] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 0.
I20260709 13:11:38.969323   650 raft_consensus.cc:740] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.970136   501 leader_election.cc:304] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:38.970379   650 consensus_queue.cc:260] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.972071   677 raft_consensus.cc:2804] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.972451   677 raft_consensus.cc:493] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.951207   649 ts_tablet_manager.cc:1434] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 13:11:38.959614   656 leader_election.cc:290] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:38.945016   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c982530741064ceca257d7c535960729" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:38.973129   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f161f5589f47c1b1b4b03560887117" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:38.973778   458 raft_consensus.cc:3060] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.974288   459 raft_consensus.cc:2468] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:38.975065   650 ts_tablet_manager.cc:1434] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:11:38.976832   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c982530741064ceca257d7c535960729" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:38.977578   534 raft_consensus.cc:3060] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.976939   649 tablet_bootstrap.cc:492] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:38.979411   655 leader_election.cc:290] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:38.979481   572 leader_election.cc:304] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:38.972795   677 raft_consensus.cc:3060] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.982602   650 tablet_bootstrap.cc:492] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:38.982997   655 raft_consensus.cc:2804] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:38.985910   533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f161f5589f47c1b1b4b03560887117" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:38.986491   655 raft_consensus.cc:697] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:38.986896   533 raft_consensus.cc:2468] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 0.
I20260709 13:11:38.987461   655 consensus_queue.cc:237] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.988250   532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:38.988467   458 raft_consensus.cc:2468] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:38.990321   423 leader_election.cc:304] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 4d2692ff97134a10b619aba0249bea10
I20260709 13:11:38.991227   656 raft_consensus.cc:2764] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:38.991298   657 raft_consensus.cc:515] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:38.991699   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f161f5589f47c1b1b4b03560887117" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:38.992416   651 tablet_bootstrap.cc:492] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:38.992614   532 raft_consensus.cc:2393] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b2f8e9217a44d879d7c4bbe28f9838c in current term 1: Already voted for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in this term.
I20260709 13:11:38.992973   572 leader_election.cc:304] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:38.992365   535 raft_consensus.cc:3060] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.995698   681 raft_consensus.cc:2804] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:38.996950   649 tablet_bootstrap.cc:654] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.998111   650 tablet_bootstrap.cc:654] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.002305   681 raft_consensus.cc:697] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:39.003728   681 consensus_queue.cc:237] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.005555   650 tablet_bootstrap.cc:492] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:39.006150   650 ts_tablet_manager.cc:1403] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:11:39.007426   423 leader_election.cc:304] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c; no voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:39.008589   656 raft_consensus.cc:3060] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.993016   651 ts_tablet_manager.cc:1403] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.011s
I20260709 13:11:39.012068   534 raft_consensus.cc:2468] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:39.011983   667 leader_election.cc:290] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:39.002215   535 raft_consensus.cc:2468] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:39.014817   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:39.016883   656 raft_consensus.cc:2749] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:39.017565   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.018612   607 raft_consensus.cc:3060] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.018503   657 leader_election.cc:290] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.011961   677 raft_consensus.cc:515] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.028057   458 raft_consensus.cc:2468] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:39.030298   651 raft_consensus.cc:359] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.031390   651 raft_consensus.cc:385] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.031772   651 raft_consensus.cc:740] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.034955   657 raft_consensus.cc:493] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.035564   657 raft_consensus.cc:515] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.029681   650 raft_consensus.cc:359] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.038084   650 raft_consensus.cc:385] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.038481   650 raft_consensus.cc:740] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.038305   498 leader_election.cc:304] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.039577   650 consensus_queue.cc:260] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.038695   651 consensus_queue.cc:260] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.048404   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d36296bf974c88b980c5306e809b0d" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.049332   608 raft_consensus.cc:3060] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.049839   651 ts_tablet_manager.cc:1434] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.003s
I20260709 13:11:39.051131   651 tablet_bootstrap.cc:492] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:39.050736   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6b93de432d4d42b11386c5446d96e4" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:39.041977   607 raft_consensus.cc:2468] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:39.053759   609 raft_consensus.cc:2468] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 0.
I20260709 13:11:39.056216   501 leader_election.cc:304] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.047389   649 tablet_bootstrap.cc:492] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:39.059463   649 ts_tablet_manager.cc:1403] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.085s	user 0.032s	sys 0.022s
I20260709 13:11:39.061151   651 tablet_bootstrap.cc:654] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.063694   649 raft_consensus.cc:359] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.064823   649 raft_consensus.cc:385] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.065191   649 raft_consensus.cc:740] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.067443   656 raft_consensus.cc:493] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.068174   656 raft_consensus.cc:515] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.069332   608 raft_consensus.cc:2468] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:39.071278   696 raft_consensus.cc:2804] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.071310   501 leader_election.cc:304] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.071930   656 leader_election.cc:290] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.071830   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b4aee61d8849e3bfe722f93a1f2cf5" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:39.072712   650 ts_tablet_manager.cc:1434] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 13:11:39.072861   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b4aee61d8849e3bfe722f93a1f2cf5" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:39.073460   657 leader_election.cc:290] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
W20260709 13:11:39.073537   423 leader_election.cc:343] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.073699   608 raft_consensus.cc:2468] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 0.
I20260709 13:11:39.074450   677 leader_election.cc:290] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.075193   677 raft_consensus.cc:2804] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.075667   677 raft_consensus.cc:697] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:39.075570   425 leader_election.cc:304] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:39.077525   656 raft_consensus.cc:2804] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.077069   677 consensus_queue.cc:237] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.078092   656 raft_consensus.cc:493] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.078615   656 raft_consensus.cc:3060] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.078899   696 raft_consensus.cc:697] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:39.080299   696 consensus_queue.cc:237] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.066169   649 consensus_queue.cc:260] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
W20260709 13:11:39.083793   498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.231.129:36021, user_credentials={real_user=slave}} blocked reactor thread for 45581.9us
I20260709 13:11:39.086287   649 ts_tablet_manager.cc:1434] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:11:39.074167   657 raft_consensus.cc:2804] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.087199   657 raft_consensus.cc:493] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.087476   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d36296bf974c88b980c5306e809b0d" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:39.087654   657 raft_consensus.cc:3060] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.088156   458 raft_consensus.cc:3060] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.100114   656 raft_consensus.cc:515] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.102599   656 leader_election.cc:290] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.103451   649 tablet_bootstrap.cc:492] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:39.103473   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b4aee61d8849e3bfe722f93a1f2cf5" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:39.104034   681 raft_consensus.cc:493] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.105188   423 leader_election.cc:343] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.104826   681 raft_consensus.cc:515] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.108403   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b4aee61d8849e3bfe722f93a1f2cf5" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.110477   681 leader_election.cc:290] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:39.111179   655 raft_consensus.cc:493] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.111858   458 raft_consensus.cc:2468] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:39.110387   608 raft_consensus.cc:3060] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.111683   655 raft_consensus.cc:515] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.110354   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:39.113363   459 raft_consensus.cc:2468] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 0.
I20260709 13:11:39.114674   572 leader_election.cc:304] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:39.112655   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:39.115648   681 raft_consensus.cc:2804] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.115723   535 raft_consensus.cc:2468] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 0.
I20260709 13:11:39.116752   681 raft_consensus.cc:493] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.117282   681 raft_consensus.cc:3060] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.119297   651 tablet_bootstrap.cc:492] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:39.119817   651 ts_tablet_manager.cc:1403] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.069s	user 0.030s	sys 0.000s
I20260709 13:11:39.115501   354 catalog_manager.cc:5697] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 1 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.123131   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617a70efb1b149e2985601949d593e1b" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:39.123683   655 leader_election.cc:290] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:39.123046   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6b93de432d4d42b11386c5446d96e4" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
W20260709 13:11:39.124612   572 leader_election.cc:343] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:39.126701   498 leader_election.cc:343] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.127264   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617a70efb1b149e2985601949d593e1b" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:39.130055   535 raft_consensus.cc:2468] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 0.
I20260709 13:11:39.127415   651 raft_consensus.cc:359] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.130897   651 raft_consensus.cc:385] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.131198   651 raft_consensus.cc:740] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.131016   657 raft_consensus.cc:515] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.131997   651 consensus_queue.cc:260] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.133389   657 leader_election.cc:290] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.134034   651 ts_tablet_manager.cc:1434] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:11:39.133448   649 tablet_bootstrap.cc:654] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.135223   573 leader_election.cc:304] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:39.135466   651 tablet_bootstrap.cc:492] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:39.136240   655 raft_consensus.cc:2804] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.136660   655 raft_consensus.cc:493] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.137008   655 raft_consensus.cc:3060] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.134557   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6b93de432d4d42b11386c5446d96e4" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.138010   609 raft_consensus.cc:3060] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.142096   651 tablet_bootstrap.cc:654] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.129283   608 raft_consensus.cc:2468] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 1.
I20260709 13:11:39.143544   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6b93de432d4d42b11386c5446d96e4" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:39.144174   458 raft_consensus.cc:3060] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.145670   681 raft_consensus.cc:515] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.144186   425 leader_election.cc:304] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:39.148577   656 raft_consensus.cc:2804] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.160394   651 tablet_bootstrap.cc:492] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:39.161993   609 raft_consensus.cc:2468] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:39.161651   681 leader_election.cc:290] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:39.162444   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:39.162374   651 ts_tablet_manager.cc:1403] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.000s
I20260709 13:11:39.162926   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:39.163177   459 raft_consensus.cc:3060] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.163619   535 raft_consensus.cc:3060] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.166056   651 raft_consensus.cc:359] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.168318   651 raft_consensus.cc:385] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.168641   651 raft_consensus.cc:740] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.169391   651 consensus_queue.cc:260] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.170101   501 leader_election.cc:304] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.171051   657 raft_consensus.cc:2804] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.171557   657 raft_consensus.cc:697] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:39.172293   651 ts_tablet_manager.cc:1434] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:11:39.172417   657 consensus_queue.cc:237] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.173566   655 raft_consensus.cc:515] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.173350   356 catalog_manager.cc:5697] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.175348   356 catalog_manager.cc:5697] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.176946   458 raft_consensus.cc:2468] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:39.178160   535 raft_consensus.cc:2468] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:39.179437   573 leader_election.cc:304] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.180661   681 raft_consensus.cc:2804] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.181218   681 raft_consensus.cc:697] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:39.182443   706 raft_consensus.cc:493] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.182137   681 consensus_queue.cc:237] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.182996   706 raft_consensus.cc:515] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.181046   459 raft_consensus.cc:2468] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:39.186205   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617a70efb1b149e2985601949d593e1b" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:39.186941   535 raft_consensus.cc:2468] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 0.
I20260709 13:11:39.185572   355 catalog_manager.cc:5697] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 1 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.188171   423 leader_election.cc:304] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.191486   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617a70efb1b149e2985601949d593e1b" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:39.193413   535 raft_consensus.cc:3060] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.192171   655 leader_election.cc:290] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:39.197888   705 raft_consensus.cc:2804] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.198333   705 raft_consensus.cc:493] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.198652   705 raft_consensus.cc:3060] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.199143   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617a70efb1b149e2985601949d593e1b" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:39.201092   535 raft_consensus.cc:2468] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:39.202519   573 leader_election.cc:304] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.202894   656 raft_consensus.cc:697] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:39.203857   656 consensus_queue.cc:237] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.208595   706 leader_election.cc:290] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.207701   655 raft_consensus.cc:2804] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.214986   649 tablet_bootstrap.cc:492] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:39.211835   655 raft_consensus.cc:697] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:39.215523   649 ts_tablet_manager.cc:1403] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.112s	user 0.026s	sys 0.009s
I20260709 13:11:39.216120   655 consensus_queue.cc:237] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.216620   705 raft_consensus.cc:515] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.211062   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617a70efb1b149e2985601949d593e1b" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:39.221328   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617a70efb1b149e2985601949d593e1b" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.222225   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617a70efb1b149e2985601949d593e1b" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:39.223052   535 raft_consensus.cc:2393] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b2f8e9217a44d879d7c4bbe28f9838c in current term 1: Already voted for candidate 4d2692ff97134a10b619aba0249bea10 in this term.
I20260709 13:11:39.218441   649 raft_consensus.cc:359] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.225248   423 leader_election.cc:304] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c; no voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:39.225817   649 raft_consensus.cc:385] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.226421   706 raft_consensus.cc:2749] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:39.226586   649 raft_consensus.cc:740] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.226737   356 catalog_manager.cc:5697] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 1 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.228024   649 consensus_queue.cc:260] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.229168   459 raft_consensus.cc:2393] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d2692ff97134a10b619aba0249bea10 in current term 1: Already voted for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in this term.
I20260709 13:11:39.225164   705 leader_election.cc:290] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.233326   649 ts_tablet_manager.cc:1434] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:11:39.236943   354 catalog_manager.cc:5697] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 1 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.248751   355 catalog_manager.cc:5697] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.250296   355 catalog_manager.cc:5697] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.336985   608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6eed78c960a41709cccbf17aea1c2dc"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
mode: GRACEFUL
new_leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:36730
I20260709 13:11:39.337728   608 raft_consensus.cc:606] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Received request to transfer leadership to TS 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:39.344408   608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f161f5589f47c1b1b4b03560887117"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
mode: GRACEFUL
new_leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:36730
I20260709 13:11:39.345060   608 raft_consensus.cc:606] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Received request to transfer leadership to TS 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:39.357661   535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c"
dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
mode: GRACEFUL
new_leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:46258
I20260709 13:11:39.358266   535 raft_consensus.cc:606] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Received request to transfer leadership to TS 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:39.363945   608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c982530741064ceca257d7c535960729"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
mode: GRACEFUL
new_leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:36730
I20260709 13:11:39.364508   608 raft_consensus.cc:606] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Received request to transfer leadership to TS 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:39.381042   459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b4aee61d8849e3bfe722f93a1f2cf5"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
mode: GRACEFUL
new_leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
 from {username='slave'} at 127.0.0.1:44248
I20260709 13:11:39.381619   459 raft_consensus.cc:606] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Received request to transfer leadership to TS 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:39.387215   608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "617a70efb1b149e2985601949d593e1b"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
mode: GRACEFUL
new_leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
 from {username='slave'} at 127.0.0.1:36730
I20260709 13:11:39.387771   608 raft_consensus.cc:606] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Received request to transfer leadership to TS 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:39.392957   608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
mode: GRACEFUL
new_leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
 from {username='slave'} at 127.0.0.1:36730
I20260709 13:11:39.393496   608 raft_consensus.cc:606] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Received request to transfer leadership to TS 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:39.398859   535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e6b93de432d4d42b11386c5446d96e4"
dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
mode: GRACEFUL
new_leader_uuid: "4d2692ff97134a10b619aba0249bea10"
 from {username='slave'} at 127.0.0.1:46258
I20260709 13:11:39.399448   535 raft_consensus.cc:606] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Received request to transfer leadership to TS 4d2692ff97134a10b619aba0249bea10
I20260709 13:11:39.415863   655 consensus_queue.cc:1048] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.422255   681 raft_consensus.cc:993] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10: : Instructing follower 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:39.422802   667 raft_consensus.cc:1081] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Signalling peer 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:39.424736   458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f161f5589f47c1b1b4b03560887117"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:44228
I20260709 13:11:39.427563   458 raft_consensus.cc:493] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.428033   458 raft_consensus.cc:3060] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.431941   688 consensus_queue.cc:1048] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.435678   458 raft_consensus.cc:515] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.437955   688 consensus_queue.cc:1048] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.442342   533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f161f5589f47c1b1b4b03560887117" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:39.445188   688 consensus_queue.cc:1048] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.446583   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f161f5589f47c1b1b4b03560887117" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.447494   608 raft_consensus.cc:3055] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:39.447944   608 raft_consensus.cc:740] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:39.449084   608 consensus_queue.cc:260] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.450443   608 raft_consensus.cc:3060] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.452826   458 leader_election.cc:290] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.465629   688 consensus_queue.cc:1048] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.472788   608 raft_consensus.cc:2468] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:39.474602   425 leader_election.cc:304] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:39.475785   705 raft_consensus.cc:2804] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.476358   705 raft_consensus.cc:697] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:39.477401   705 consensus_queue.cc:237] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.481804   688 consensus_queue.cc:1048] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.484362   688 raft_consensus.cc:993] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10: : Instructing follower 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:39.484846   667 raft_consensus.cc:1081] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Signalling peer 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:39.491910   458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c982530741064ceca257d7c535960729"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:44228
I20260709 13:11:39.492551   458 raft_consensus.cc:493] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.492976   458 raft_consensus.cc:3060] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.500726   458 raft_consensus.cc:515] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.504145   533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c982530741064ceca257d7c535960729" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:39.504204   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c982530741064ceca257d7c535960729" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.504823   533 raft_consensus.cc:3060] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.504913   608 raft_consensus.cc:3055] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:39.505396   608 raft_consensus.cc:740] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:39.506176   608 consensus_queue.cc:260] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.507126   608 raft_consensus.cc:3060] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.507601   667 raft_consensus.cc:993] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10: : Instructing follower 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:39.508097   667 raft_consensus.cc:1081] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Signalling peer 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:39.511018   459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6eed78c960a41709cccbf17aea1c2dc"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:44228
I20260709 13:11:39.511610   459 raft_consensus.cc:493] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.511955   459 raft_consensus.cc:3060] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.512890   533 raft_consensus.cc:2468] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:39.513408   458 leader_election.cc:290] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.514876   423 leader_election.cc:304] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.515697   705 raft_consensus.cc:2804] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.516191   705 raft_consensus.cc:697] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:39.517028   705 consensus_queue.cc:237] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.518355   356 catalog_manager.cc:5697] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 1 to 2, leader changed from 4d2692ff97134a10b619aba0249bea10 (127.19.231.131) to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 2 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.521845   459 raft_consensus.cc:515] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.522313   608 raft_consensus.cc:2468] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:39.523175   458 raft_consensus.cc:1240] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Rejecting Update request from peer 4d2692ff97134a10b619aba0249bea10 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:39.524789   459 leader_election.cc:290] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.525249   533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6eed78c960a41709cccbf17aea1c2dc" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:39.526360   533 raft_consensus.cc:3060] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.525367   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6eed78c960a41709cccbf17aea1c2dc" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.528441   608 raft_consensus.cc:3055] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:39.528755   608 raft_consensus.cc:740] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:39.529732   608 consensus_queue.cc:260] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.532111   688 consensus_queue.cc:1059] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.533674   608 raft_consensus.cc:3060] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.533999   533 raft_consensus.cc:2468] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:39.535187   423 leader_election.cc:304] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.535905   705 raft_consensus.cc:2804] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.536388   705 raft_consensus.cc:697] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:39.537123   705 consensus_queue.cc:237] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.537195   355 catalog_manager.cc:5697] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 1 to 2, leader changed from 4d2692ff97134a10b619aba0249bea10 (127.19.231.131) to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 2 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.541301   608 raft_consensus.cc:2468] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:39.550737   355 catalog_manager.cc:5697] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 1 to 2, leader changed from 4d2692ff97134a10b619aba0249bea10 (127.19.231.131) to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 2 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.555450   657 consensus_queue.cc:1048] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.566756   657 consensus_queue.cc:1048] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.575909   677 raft_consensus.cc:993] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb: : Instructing follower 4d2692ff97134a10b619aba0249bea10 to start an election
I20260709 13:11:39.576468   657 raft_consensus.cc:1081] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Signalling peer 4d2692ff97134a10b619aba0249bea10 to start an election
I20260709 13:11:39.578086   608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e6b93de432d4d42b11386c5446d96e4"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
 from {username='slave'} at 127.0.0.1:36714
I20260709 13:11:39.578751   608 raft_consensus.cc:493] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.579152   608 raft_consensus.cc:3060] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.584854   608 raft_consensus.cc:515] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.586764   608 leader_election.cc:290] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 2 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:39.587785   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6b93de432d4d42b11386c5446d96e4" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:39.587949   533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6b93de432d4d42b11386c5446d96e4" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:39.588554   458 raft_consensus.cc:3060] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.588649   533 raft_consensus.cc:3055] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:39.589154   533 raft_consensus.cc:740] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:39.590198   533 consensus_queue.cc:260] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.591593   533 raft_consensus.cc:3060] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.594664   458 raft_consensus.cc:2468] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 2.
I20260709 13:11:39.595873   572 leader_election.cc:304] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:39.596657   688 raft_consensus.cc:2804] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.597077   688 raft_consensus.cc:697] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 2 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:39.597801   533 raft_consensus.cc:2468] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 2.
I20260709 13:11:39.597937   688 consensus_queue.cc:237] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.604987   356 catalog_manager.cc:5697] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 1 to 2, leader changed from 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130) to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 2 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.631686   533 raft_consensus.cc:3060] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.637739   657 consensus_queue.cc:1048] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.638463   705 consensus_queue.cc:1048] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.644786   688 consensus_queue.cc:1048] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.647558   706 raft_consensus.cc:993] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c: : Instructing follower 7a69fc7e4a7f49beab9821f7b3bb17eb to start an election
I20260709 13:11:39.648109   706 raft_consensus.cc:1081] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Signalling peer 7a69fc7e4a7f49beab9821f7b3bb17eb to start an election
I20260709 13:11:39.653036   656 consensus_queue.cc:1048] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.658937   532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8b4aee61d8849e3bfe722f93a1f2cf5"
dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
 from {username='slave'} at 127.0.0.1:46242
I20260709 13:11:39.659672   532 raft_consensus.cc:493] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.660107   532 raft_consensus.cc:3060] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.662500   693 consensus_queue.cc:1048] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.665416   655 raft_consensus.cc:993] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10: : Instructing follower 7a69fc7e4a7f49beab9821f7b3bb17eb to start an election
I20260709 13:11:39.666272   655 raft_consensus.cc:1081] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Signalling peer 7a69fc7e4a7f49beab9821f7b3bb17eb to start an election
I20260709 13:11:39.672251   535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "617a70efb1b149e2985601949d593e1b"
dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
 from {username='slave'} at 127.0.0.1:46226
I20260709 13:11:39.672851   535 raft_consensus.cc:493] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.673249   535 raft_consensus.cc:3060] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.677958   657 consensus_queue.cc:1048] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.680323   667 consensus_queue.cc:1048] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.700330   657 consensus_queue.cc:1048] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.700624   532 raft_consensus.cc:515] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.701985   534 raft_consensus.cc:1240] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Rejecting Update request from peer 4b2f8e9217a44d879d7c4bbe28f9838c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:39.693223   667 consensus_queue.cc:1048] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:11:39.711570   535 raft_consensus.cc:515] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.713299   533 raft_consensus.cc:1240] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Rejecting Update request from peer 4d2692ff97134a10b619aba0249bea10 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:39.716291   667 consensus_queue.cc:1059] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.717301   688 raft_consensus.cc:3055] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:39.717669   688 raft_consensus.cc:740] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:39.718536   688 consensus_queue.cc:260] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.719491   688 raft_consensus.cc:3060] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.719901   657 raft_consensus.cc:993] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb: : Instructing follower 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:39.720431   657 raft_consensus.cc:1081] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Signalling peer 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:39.720494   535 leader_election.cc:290] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 2 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.723951   458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:11:39.725265   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617a70efb1b149e2985601949d593e1b" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:39.726037   459 raft_consensus.cc:3060] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.726852   458 raft_consensus.cc:493] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.727527   458 raft_consensus.cc:3060] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.727620   706 consensus_queue.cc:1059] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.728601   706 raft_consensus.cc:3055] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:39.728932   706 raft_consensus.cc:740] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:39.729749   706 consensus_queue.cc:260] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.730836   706 raft_consensus.cc:3060] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.735325   457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b4aee61d8849e3bfe722f93a1f2cf5" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:39.735826   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b4aee61d8849e3bfe722f93a1f2cf5" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.734088   532 leader_election.cc:290] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 2 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.736706   609 raft_consensus.cc:3060] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.739176   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617a70efb1b149e2985601949d593e1b" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.744915   609 raft_consensus.cc:2468] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 2.
I20260709 13:11:39.746488   501 leader_election.cc:304] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.747637   693 raft_consensus.cc:2804] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.748306   693 raft_consensus.cc:697] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:39.749419   693 consensus_queue.cc:237] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.746338   459 raft_consensus.cc:2468] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 2.
I20260709 13:11:39.759310   458 raft_consensus.cc:515] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.762274   457 raft_consensus.cc:2468] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 2.
I20260709 13:11:39.766336   608 raft_consensus.cc:2468] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 2.
I20260709 13:11:39.772477   356 catalog_manager.cc:5697] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 1 to 2, leader changed from 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129) to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 2 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.768929   458 leader_election.cc:290] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.764201   667 raft_consensus.cc:993] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10: : Instructing follower 7a69fc7e4a7f49beab9821f7b3bb17eb to start an election
I20260709 13:11:39.773888   681 consensus_queue.cc:1048] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.775036   667 raft_consensus.cc:1081] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Signalling peer 7a69fc7e4a7f49beab9821f7b3bb17eb to start an election
I20260709 13:11:39.765797   498 leader_election.cc:304] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.778821   535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186"
dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
 from {username='slave'} at 127.0.0.1:46226
I20260709 13:11:39.779440   535 raft_consensus.cc:493] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.779838   535 raft_consensus.cc:3060] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.780753   693 raft_consensus.cc:2804] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.770241   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.780941   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:39.781837   534 raft_consensus.cc:3055] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:39.781925   693 raft_consensus.cc:697] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:39.782367   534 raft_consensus.cc:740] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:39.782974   693 consensus_queue.cc:237] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.781574   609 raft_consensus.cc:3060] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.785818   534 consensus_queue.cc:260] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.787355   534 raft_consensus.cc:3060] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.787550   535 raft_consensus.cc:515] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.791188   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:39.791842   607 raft_consensus.cc:3055] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:39.792165   607 raft_consensus.cc:740] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:39.793104   607 consensus_queue.cc:260] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.795398   534 raft_consensus.cc:2468] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:39.796694   423 leader_election.cc:304] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:39.797572   706 raft_consensus.cc:2804] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.798048   706 raft_consensus.cc:697] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:39.798913   706 consensus_queue.cc:237] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.799937   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:39.794490   607 raft_consensus.cc:3060] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.806381   354 catalog_manager.cc:5697] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 1 to 2, leader changed from 4d2692ff97134a10b619aba0249bea10 (127.19.231.131) to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 2 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.808094   609 raft_consensus.cc:2468] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:39.812002   607 raft_consensus.cc:2468] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 2.
I20260709 13:11:39.813095   535 leader_election.cc:290] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 2 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:39.815683   501 leader_election.cc:304] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:39.816740   693 raft_consensus.cc:2804] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.817217   693 raft_consensus.cc:697] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:39.818043   693 consensus_queue.cc:237] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:39.871928   355 catalog_manager.cc:5697] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 1 to 2, leader changed from 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130) to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 2 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.885223   354 catalog_manager.cc:5697] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 1 to 2, leader changed from 4d2692ff97134a10b619aba0249bea10 (127.19.231.131) to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 2 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.924105   535 raft_consensus.cc:1275] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:39.926553   656 consensus_queue.cc:1048] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:39.942390   607 raft_consensus.cc:1275] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:39.945842   656 consensus_queue.cc:1048] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:39.997327   535 raft_consensus.cc:1275] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:39.998778   735 consensus_queue.cc:1048] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:40.009385   607 raft_consensus.cc:1275] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.010991   656 consensus_queue.cc:1048] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:40.045661   607 raft_consensus.cc:1275] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.047079   656 consensus_queue.cc:1048] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:40.058171   535 raft_consensus.cc:3060] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.085299   535 raft_consensus.cc:1275] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.209362   735 consensus_queue.cc:1048] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:40.260409   460 raft_consensus.cc:1275] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Refusing update from remote peer 4d2692ff97134a10b619aba0249bea10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.287843   607 raft_consensus.cc:1275] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.288856   667 consensus_queue.cc:1048] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:40.300308   532 raft_consensus.cc:1275] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.302929   535 raft_consensus.cc:1275] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Refusing update from remote peer 4d2692ff97134a10b619aba0249bea10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.305401   667 consensus_queue.cc:1048] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:40.308444   735 consensus_queue.cc:1048] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:40.314046   705 consensus_queue.cc:1048] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:40.314716   460 raft_consensus.cc:1275] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Refusing update from remote peer 7a69fc7e4a7f49beab9821f7b3bb17eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.319947   677 consensus_queue.cc:1048] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:40.327746   459 raft_consensus.cc:1275] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Refusing update from remote peer 7a69fc7e4a7f49beab9821f7b3bb17eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.305976   607 raft_consensus.cc:1275] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 7a69fc7e4a7f49beab9821f7b3bb17eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.329506   677 consensus_queue.cc:1048] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:40.337589   677 consensus_queue.cc:1048] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:11:40.358119   608 raft_consensus.cc:1275] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 7a69fc7e4a7f49beab9821f7b3bb17eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.359951   460 raft_consensus.cc:3060] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.361680   740 consensus_queue.cc:1048] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:40.388276   608 raft_consensus.cc:1275] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 7a69fc7e4a7f49beab9821f7b3bb17eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.391614   693 consensus_queue.cc:1048] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:40.398398   460 raft_consensus.cc:1275] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Refusing update from remote peer 7a69fc7e4a7f49beab9821f7b3bb17eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.400470   741 consensus_queue.cc:1048] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:41.264070   630 debug-util.cc:398] Leaking SignalData structure 0x7b08000353c0 after lost signal to thread 20385
W20260709 13:11:41.265415   630 debug-util.cc:398] Leaking SignalData structure 0x7b08002df8c0 after lost signal to thread 391
W20260709 13:11:41.266861   630 debug-util.cc:398] Leaking SignalData structure 0x7b08002b6600 after lost signal to thread 484
W20260709 13:11:41.268087   630 debug-util.cc:398] Leaking SignalData structure 0x7b080005c460 after lost signal to thread 559
W20260709 13:11:41.269323   630 debug-util.cc:398] Leaking SignalData structure 0x7b0800016240 after lost signal to thread 633
I20260709 13:11:42.558568   355 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46192:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:42.561312   355 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:42.616104   449 tablet_service.cc:1511] Processing CreateTablet for tablet ecefbc74130943d3b1ca8c0f94a86610 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:42.618026   449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecefbc74130943d3b1ca8c0f94a86610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.619601   597 tablet_service.cc:1511] Processing CreateTablet for tablet ecefbc74130943d3b1ca8c0f94a86610 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:42.621239   597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecefbc74130943d3b1ca8c0f94a86610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.620770   450 tablet_service.cc:1511] Processing CreateTablet for tablet f1c491e2ce5848669fbe38103fee1267 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:42.622383   450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c491e2ce5848669fbe38103fee1267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.624959   524 tablet_service.cc:1511] Processing CreateTablet for tablet ecefbc74130943d3b1ca8c0f94a86610 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:42.626487   524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecefbc74130943d3b1ca8c0f94a86610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.628075   522 tablet_service.cc:1511] Processing CreateTablet for tablet f1c491e2ce5848669fbe38103fee1267 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:42.629638   446 tablet_service.cc:1511] Processing CreateTablet for tablet bbeec1aa12944bb3ae0f774181833b74 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:42.631142   446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeec1aa12944bb3ae0f774181833b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.635155   522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c491e2ce5848669fbe38103fee1267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.644744   521 tablet_service.cc:1511] Processing CreateTablet for tablet bbeec1aa12944bb3ae0f774181833b74 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:42.646320   521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeec1aa12944bb3ae0f774181833b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.644752   448 tablet_service.cc:1511] Processing CreateTablet for tablet e29a8603398f4d4f9499ec5f6690002f (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:42.648449   448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29a8603398f4d4f9499ec5f6690002f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.654693   525 tablet_service.cc:1511] Processing CreateTablet for tablet e29a8603398f4d4f9499ec5f6690002f (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:42.656280   525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29a8603398f4d4f9499ec5f6690002f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.656898   447 tablet_service.cc:1511] Processing CreateTablet for tablet b356b344b9a44056b2bb6ba50f4d4f59 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:42.658365   447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b356b344b9a44056b2bb6ba50f4d4f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.660940   523 tablet_service.cc:1511] Processing CreateTablet for tablet b356b344b9a44056b2bb6ba50f4d4f59 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:42.662454   523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b356b344b9a44056b2bb6ba50f4d4f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.664562   445 tablet_service.cc:1511] Processing CreateTablet for tablet 3da7a1593c344878993dd4a1afbb408d (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:42.666075   445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da7a1593c344878993dd4a1afbb408d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.675477   596 tablet_service.cc:1511] Processing CreateTablet for tablet f1c491e2ce5848669fbe38103fee1267 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:42.677186   596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c491e2ce5848669fbe38103fee1267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.685294   598 tablet_service.cc:1511] Processing CreateTablet for tablet bbeec1aa12944bb3ae0f774181833b74 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:42.686352   520 tablet_service.cc:1511] Processing CreateTablet for tablet 3da7a1593c344878993dd4a1afbb408d (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:42.686972   598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeec1aa12944bb3ae0f774181833b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.687791   520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da7a1593c344878993dd4a1afbb408d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.694172   444 tablet_service.cc:1511] Processing CreateTablet for tablet 6f938bb0106a4193ab5cb9986e11b725 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:42.695771   444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f938bb0106a4193ab5cb9986e11b725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.702643   519 tablet_service.cc:1511] Processing CreateTablet for tablet 6f938bb0106a4193ab5cb9986e11b725 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:42.704334   519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f938bb0106a4193ab5cb9986e11b725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.720901   599 tablet_service.cc:1511] Processing CreateTablet for tablet e29a8603398f4d4f9499ec5f6690002f (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:42.722421   599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29a8603398f4d4f9499ec5f6690002f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.723533   443 tablet_service.cc:1511] Processing CreateTablet for tablet c190b22af4904fcc8a6ff10fe618bbe3 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:42.724992   443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c190b22af4904fcc8a6ff10fe618bbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.725771   518 tablet_service.cc:1511] Processing CreateTablet for tablet c190b22af4904fcc8a6ff10fe618bbe3 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:42.727891   518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c190b22af4904fcc8a6ff10fe618bbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.733614   595 tablet_service.cc:1511] Processing CreateTablet for tablet b356b344b9a44056b2bb6ba50f4d4f59 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:42.737262   594 tablet_service.cc:1511] Processing CreateTablet for tablet 3da7a1593c344878993dd4a1afbb408d (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:42.743134   593 tablet_service.cc:1511] Processing CreateTablet for tablet 6f938bb0106a4193ab5cb9986e11b725 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:42.744767   595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b356b344b9a44056b2bb6ba50f4d4f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.752904   517 tablet_service.cc:1511] Processing CreateTablet for tablet b567f5136566427c978e9efb600ec989 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:42.754356   517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b567f5136566427c978e9efb600ec989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.765477   592 tablet_service.cc:1511] Processing CreateTablet for tablet c190b22af4904fcc8a6ff10fe618bbe3 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:42.752319   594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da7a1593c344878993dd4a1afbb408d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.780946   753 tablet_bootstrap.cc:492] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:42.783174   591 tablet_service.cc:1511] Processing CreateTablet for tablet b567f5136566427c978e9efb600ec989 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:42.784215   592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c190b22af4904fcc8a6ff10fe618bbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.783838   448 tablet_service.cc:1511] Processing CreateTablet for tablet b567f5136566427c978e9efb600ec989 (DEFAULT_TABLE table=soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:42.784997   591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b567f5136566427c978e9efb600ec989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.785329   448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b567f5136566427c978e9efb600ec989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.786123   593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f938bb0106a4193ab5cb9986e11b725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.842029   753 tablet_bootstrap.cc:654] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.848294   754 tablet_bootstrap.cc:492] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:42.854374   755 tablet_bootstrap.cc:492] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:42.906550   754 tablet_bootstrap.cc:654] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.917287   753 tablet_bootstrap.cc:492] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:42.918067   753 ts_tablet_manager.cc:1403] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.009s
I20260709 13:11:42.936087   755 tablet_bootstrap.cc:654] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.939498   753 raft_consensus.cc:359] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:42.940418   753 raft_consensus.cc:385] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.940763   753 raft_consensus.cc:740] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.941636   753 consensus_queue.cc:260] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:42.943608   755 tablet_bootstrap.cc:492] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:42.944196   755 ts_tablet_manager.cc:1403] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.095s	user 0.007s	sys 0.013s
I20260709 13:11:42.944599   753 ts_tablet_manager.cc:1434] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:11:42.945750   753 tablet_bootstrap.cc:492] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:42.948005   755 raft_consensus.cc:359] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:42.948765   755 raft_consensus.cc:385] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.949045   755 raft_consensus.cc:740] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.949793   755 consensus_queue.cc:260] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:42.952437   755 ts_tablet_manager.cc:1434] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:42.953559   755 tablet_bootstrap.cc:492] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:42.953600   753 tablet_bootstrap.cc:654] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.965798   754 tablet_bootstrap.cc:492] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:42.966393   754 ts_tablet_manager.cc:1403] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.118s	user 0.003s	sys 0.017s
I20260709 13:11:42.967173   755 tablet_bootstrap.cc:654] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.969805   754 raft_consensus.cc:359] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:42.970773   754 raft_consensus.cc:385] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.971122   754 raft_consensus.cc:740] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.971940   754 consensus_queue.cc:260] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:42.974882   754 ts_tablet_manager.cc:1434] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:11:42.976030   754 tablet_bootstrap.cc:492] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:42.984858   753 tablet_bootstrap.cc:492] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:42.985627   753 ts_tablet_manager.cc:1403] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.005s
I20260709 13:11:42.984843   755 tablet_bootstrap.cc:492] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:42.986954   755 ts_tablet_manager.cc:1403] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.005s
W20260709 13:11:42.987927   405 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:42.990427   755 raft_consensus.cc:359] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:42.991360   755 raft_consensus.cc:385] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.991675   755 raft_consensus.cc:740] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.994457   755 consensus_queue.cc:260] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:42.994596   753 raft_consensus.cc:359] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:42.995527   753 raft_consensus.cc:385] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.995878   753 raft_consensus.cc:740] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.997109   755 ts_tablet_manager.cc:1434] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:42.996719   753 consensus_queue.cc:260] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:42.999533   753 ts_tablet_manager.cc:1434] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:11:43.000602   753 tablet_bootstrap.cc:492] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:43.012458   753 tablet_bootstrap.cc:654] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.016450   754 tablet_bootstrap.cc:654] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.022859   755 tablet_bootstrap.cc:492] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:43.022881   753 tablet_bootstrap.cc:492] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:43.024693   753 ts_tablet_manager.cc:1403] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 13:11:43.027951   753 raft_consensus.cc:359] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.028751   753 raft_consensus.cc:385] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.029060   753 raft_consensus.cc:740] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.029819   753 consensus_queue.cc:260] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.031217   755 tablet_bootstrap.cc:654] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.037165   753 ts_tablet_manager.cc:1434] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 13:11:43.038481   753 tablet_bootstrap.cc:492] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:43.042131   755 tablet_bootstrap.cc:492] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:43.045254   755 ts_tablet_manager.cc:1403] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:11:43.054339   753 tablet_bootstrap.cc:654] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.054749   754 tablet_bootstrap.cc:492] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:43.055374   754 ts_tablet_manager.cc:1403] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.002s
I20260709 13:11:43.056521   755 raft_consensus.cc:359] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.057401   755 raft_consensus.cc:385] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.057756   755 raft_consensus.cc:740] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.058741   755 consensus_queue.cc:260] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.059435   754 raft_consensus.cc:359] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.077732   754 raft_consensus.cc:385] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.078114   754 raft_consensus.cc:740] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.079556   754 consensus_queue.cc:260] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.080029   753 tablet_bootstrap.cc:492] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:43.082711   753 ts_tablet_manager.cc:1403] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.011s
I20260709 13:11:43.084615   754 ts_tablet_manager.cc:1434] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.029s	user 0.018s	sys 0.007s
I20260709 13:11:43.085851   754 tablet_bootstrap.cc:492] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:43.086310   753 raft_consensus.cc:359] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.087226   753 raft_consensus.cc:385] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.087558   753 raft_consensus.cc:740] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.088435   753 consensus_queue.cc:260] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.091493   753 ts_tablet_manager.cc:1434] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:11:43.092656   753 tablet_bootstrap.cc:492] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:43.093677   754 tablet_bootstrap.cc:654] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.081920   755 ts_tablet_manager.cc:1434] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.005s
I20260709 13:11:43.099915   755 tablet_bootstrap.cc:492] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:43.107069   755 tablet_bootstrap.cc:654] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.109171   655 raft_consensus.cc:493] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.110188   753 tablet_bootstrap.cc:654] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.109975   655 raft_consensus.cc:515] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.116449   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec1aa12944bb3ae0f774181833b74" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:43.117436   460 raft_consensus.cc:2468] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 0.
I20260709 13:11:43.119894   572 leader_election.cc:304] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:43.121973   769 raft_consensus.cc:2804] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.122958   769 raft_consensus.cc:493] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.123329   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec1aa12944bb3ae0f774181833b74" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:43.123797   769 raft_consensus.cc:3060] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.124554   755 tablet_bootstrap.cc:492] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:43.125216   755 ts_tablet_manager.cc:1403] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.003s
W20260709 13:11:43.125802   573 leader_election.cc:343] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.126664   655 leader_election.cc:290] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:43.128579   755 raft_consensus.cc:359] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.129356   755 raft_consensus.cc:385] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.129673   755 raft_consensus.cc:740] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.130501   755 consensus_queue.cc:260] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.132859   755 ts_tablet_manager.cc:1434] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:43.133896   755 tablet_bootstrap.cc:492] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:43.147543   769 raft_consensus.cc:515] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.153717   761 raft_consensus.cc:493] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.153877   769 leader_election.cc:290] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:43.148336   755 tablet_bootstrap.cc:654] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.156790   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec1aa12944bb3ae0f774181833b74" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:43.157704   460 raft_consensus.cc:3060] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.159329   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec1aa12944bb3ae0f774181833b74" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
W20260709 13:11:43.161379   573 leader_election.cc:343] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.154451   761 raft_consensus.cc:515] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.165805   755 tablet_bootstrap.cc:492] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:43.166409   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a8603398f4d4f9499ec5f6690002f" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:43.167456   608 raft_consensus.cc:2468] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 0.
I20260709 13:11:43.166481   755 ts_tablet_manager.cc:1403] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.033s	user 0.002s	sys 0.010s
I20260709 13:11:43.169644   425 leader_election.cc:304] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:43.171173   742 raft_consensus.cc:2804] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.171684   742 raft_consensus.cc:493] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.172179   742 raft_consensus.cc:3060] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.171929   755 raft_consensus.cc:359] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.172852   755 raft_consensus.cc:385] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.173190   755 raft_consensus.cc:740] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.176311   769 raft_consensus.cc:493] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.177165   769 raft_consensus.cc:515] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.179359   755 consensus_queue.cc:260] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.181102   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:43.182111   755 ts_tablet_manager.cc:1434] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:11:43.181151   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
W20260709 13:11:43.184053   573 leader_election.cc:343] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:43.185339   572 leader_election.cc:343] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.185796   572 leader_election.cc:304] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10; no voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:43.187512   755 tablet_bootstrap.cc:492] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:43.190725   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a8603398f4d4f9499ec5f6690002f" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:43.196501   655 raft_consensus.cc:2749] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.197458   761 leader_election.cc:290] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.199599   769 leader_election.cc:290] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
W20260709 13:11:43.199661   423 leader_election.cc:343] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.202574   755 tablet_bootstrap.cc:654] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.215746   755 tablet_bootstrap.cc:492] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:43.216354   755 ts_tablet_manager.cc:1403] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.002s
I20260709 13:11:43.216899   677 raft_consensus.cc:493] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.217679   677 raft_consensus.cc:515] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.219700   755 raft_consensus.cc:359] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.220582   755 raft_consensus.cc:385] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.220916   755 raft_consensus.cc:740] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.221802   755 consensus_queue.cc:260] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.222028   677 leader_election.cc:290] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.223754   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecefbc74130943d3b1ca8c0f94a86610" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:43.224368   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecefbc74130943d3b1ca8c0f94a86610" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:43.225049   608 raft_consensus.cc:2468] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 0.
W20260709 13:11:43.225572   498 leader_election.cc:343] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.226596   501 leader_election.cc:304] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:43.228470   677 raft_consensus.cc:2804] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.228976   677 raft_consensus.cc:493] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.229408   677 raft_consensus.cc:3060] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.233069   755 ts_tablet_manager.cc:1434] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 13:11:43.234382   755 tablet_bootstrap.cc:492] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:43.249529   755 tablet_bootstrap.cc:654] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.254379   742 raft_consensus.cc:515] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.258775   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a8603398f4d4f9499ec5f6690002f" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
W20260709 13:11:43.260949   423 leader_election.cc:343] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.263067   755 tablet_bootstrap.cc:492] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:43.263724   755 ts_tablet_manager.cc:1403] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.003s
I20260709 13:11:43.264781   460 raft_consensus.cc:2468] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:43.266607   572 leader_election.cc:304] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:43.267161   755 raft_consensus.cc:359] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.268036   755 raft_consensus.cc:385] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.268361   755 raft_consensus.cc:740] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.268604   771 raft_consensus.cc:2804] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.269151   755 consensus_queue.cc:260] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.271826   755 ts_tablet_manager.cc:1434] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:11:43.269191   771 raft_consensus.cc:697] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:43.272220   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a8603398f4d4f9499ec5f6690002f" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:43.272825   608 raft_consensus.cc:3060] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.273023   755 tablet_bootstrap.cc:492] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:43.273120   771 consensus_queue.cc:237] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.281129   755 tablet_bootstrap.cc:654] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.282949   742 leader_election.cc:290] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.289690   753 tablet_bootstrap.cc:492] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:43.290517   753 ts_tablet_manager.cc:1403] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.198s	user 0.041s	sys 0.041s
I20260709 13:11:43.293071   755 tablet_bootstrap.cc:492] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:43.293679   755 ts_tablet_manager.cc:1403] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:11:43.295358   753 raft_consensus.cc:359] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.296487   753 raft_consensus.cc:385] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.296867   753 raft_consensus.cc:740] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.296757   755 raft_consensus.cc:359] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.297605   755 raft_consensus.cc:385] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.297906   755 raft_consensus.cc:740] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.297950   771 raft_consensus.cc:493] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.298570   771 raft_consensus.cc:515] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.298677   755 consensus_queue.cc:260] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.301437   755 ts_tablet_manager.cc:1434] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:43.302222   771 leader_election.cc:290] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:43.303475   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f938bb0106a4193ab5cb9986e11b725" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
W20260709 13:11:43.304795   572 leader_election.cc:343] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.302472   755 tablet_bootstrap.cc:492] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10: Bootstrap starting.
I20260709 13:11:43.308470   761 raft_consensus.cc:493] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.309062   761 raft_consensus.cc:515] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.312021   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c491e2ce5848669fbe38103fee1267" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:43.298347   753 consensus_queue.cc:260] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.313053   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c491e2ce5848669fbe38103fee1267" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
W20260709 13:11:43.313477   423 leader_election.cc:343] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.313752   607 raft_consensus.cc:2468] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 0.
I20260709 13:11:43.314088   742 raft_consensus.cc:493] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.315061   755 tablet_bootstrap.cc:654] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.315196   425 leader_election.cc:304] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:43.317921   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f938bb0106a4193ab5cb9986e11b725" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:43.322170   779 raft_consensus.cc:2804] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.322762   779 raft_consensus.cc:493] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.323223   779 raft_consensus.cc:3060] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.323362   608 raft_consensus.cc:2468] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 1.
I20260709 13:11:43.325176   425 leader_election.cc:304] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:43.322171   742 raft_consensus.cc:515] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.312098   761 leader_election.cc:290] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.328375   677 raft_consensus.cc:515] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.330729   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:43.331539   607 raft_consensus.cc:2468] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 0.
W20260709 13:11:43.331688   573 leader_election.cc:343] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.332150   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:43.332854   425 leader_election.cc:304] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:43.332216   573 leader_election.cc:304] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10; no voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:43.333958   781 raft_consensus.cc:2804] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.334323   781 raft_consensus.cc:493] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.334666   781 raft_consensus.cc:3060] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.334767   769 raft_consensus.cc:2749] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.330605   761 raft_consensus.cc:2804] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.336995   761 raft_consensus.cc:697] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:43.338155   761 consensus_queue.cc:237] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.342931   742 leader_election.cc:290] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.345023   754 tablet_bootstrap.cc:492] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:43.346819   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecefbc74130943d3b1ca8c0f94a86610" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:43.347285   754 ts_tablet_manager.cc:1403] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.262s	user 0.044s	sys 0.099s
W20260709 13:11:43.351121   498 leader_election.cc:343] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.352340   677 leader_election.cc:290] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.354113   754 raft_consensus.cc:359] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.355216   754 raft_consensus.cc:385] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.355540   754 raft_consensus.cc:740] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.356312   754 consensus_queue.cc:260] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.361666   754 ts_tablet_manager.cc:1434] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:11:43.362666   754 tablet_bootstrap.cc:492] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:43.364563   677 raft_consensus.cc:493] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.365242   677 raft_consensus.cc:515] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.368585   677 leader_election.cc:290] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.370121   779 raft_consensus.cc:515] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.371423   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c491e2ce5848669fbe38103fee1267" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:43.372610   460 raft_consensus.cc:2393] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in current term 1: Already voted for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in this term.
I20260709 13:11:43.373461   779 leader_election.cc:290] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.375607   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c491e2ce5848669fbe38103fee1267" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:43.377743   754 tablet_bootstrap.cc:654] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.376494   608 raft_consensus.cc:3060] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.383323   755 tablet_bootstrap.cc:492] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10: No bootstrap required, opened a new log
I20260709 13:11:43.383796   755 ts_tablet_manager.cc:1403] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.020s
I20260709 13:11:43.386181   753 ts_tablet_manager.cc:1434] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.095s	user 0.015s	sys 0.007s
I20260709 13:11:43.387534   753 tablet_bootstrap.cc:492] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:43.388631   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c491e2ce5848669fbe38103fee1267" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:43.389279   534 raft_consensus.cc:3060] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:43.388208   423 leader_election.cc:343] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.378691   781 raft_consensus.cc:515] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
W20260709 13:11:43.382365   501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:43431, user_credentials={real_user=slave}} blocked reactor thread for 70280.4us
I20260709 13:11:43.397505   608 raft_consensus.cc:2468] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 1.
I20260709 13:11:43.399174   425 leader_election.cc:304] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:43.400043   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c491e2ce5848669fbe38103fee1267" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:43.400924   607 raft_consensus.cc:2393] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in current term 1: Already voted for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in this term.
I20260709 13:11:43.401417   778 raft_consensus.cc:2804] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.401309   755 raft_consensus.cc:359] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.402112   778 raft_consensus.cc:697] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:43.402143   755 raft_consensus.cc:385] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.403009   755 raft_consensus.cc:740] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.403196   778 consensus_queue.cc:237] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.404027   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:43.403865   755 consensus_queue.cc:260] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.404623   607 raft_consensus.cc:3060] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.406044   755 ts_tablet_manager.cc:1434] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.005s
I20260709 13:11:43.409278   534 raft_consensus.cc:2468] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 1.
I20260709 13:11:43.410158   501 leader_election.cc:304] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10
I20260709 13:11:43.411281   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:43.412539   781 leader_election.cc:290] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.414870   776 raft_consensus.cc:2749] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.419438   779 raft_consensus.cc:493] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.420704   779 raft_consensus.cc:515] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.421200   753 tablet_bootstrap.cc:654] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.422976   357 catalog_manager.cc:5697] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.426352   779 leader_election.cc:290] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.428710   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da7a1593c344878993dd4a1afbb408d" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:43.429726   609 raft_consensus.cc:2468] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 0.
I20260709 13:11:43.429044   754 tablet_bootstrap.cc:492] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:43.431026   425 leader_election.cc:304] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:43.431237   754 ts_tablet_manager.cc:1403] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.014s
I20260709 13:11:43.437960   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecefbc74130943d3b1ca8c0f94a86610" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:43.438663   608 raft_consensus.cc:3060] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.439399   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da7a1593c344878993dd4a1afbb408d" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:43.440253   535 raft_consensus.cc:2468] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 0.
I20260709 13:11:43.435652   779 raft_consensus.cc:2804] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.447610   779 raft_consensus.cc:493] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.447716   608 raft_consensus.cc:2468] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:43.452135   779 raft_consensus.cc:3060] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.449589   607 raft_consensus.cc:2468] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 1.
I20260709 13:11:43.453487   501 leader_election.cc:304] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:43.454274   425 leader_election.cc:304] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:43.454953   777 raft_consensus.cc:2804] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.455519   777 raft_consensus.cc:697] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:43.456434   777 consensus_queue.cc:237] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
W20260709 13:11:43.457100   423 leader_election.cc:343] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.447351   754 raft_consensus.cc:359] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.451920   356 catalog_manager.cc:5697] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 1 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.458946   754 raft_consensus.cc:385] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.459234   781 raft_consensus.cc:2804] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.459319   754 raft_consensus.cc:740] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.459869   781 raft_consensus.cc:697] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:43.460211   754 consensus_queue.cc:260] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.461699   781 consensus_queue.cc:237] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.460057   779 raft_consensus.cc:515] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.467949   779 leader_election.cc:290] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.469646   754 ts_tablet_manager.cc:1434] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260709 13:11:43.470477   753 tablet_bootstrap.cc:492] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:43.470914   754 tablet_bootstrap.cc:492] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:43.471261   753 ts_tablet_manager.cc:1403] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.016s
I20260709 13:11:43.473600   355 catalog_manager.cc:5697] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 1 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.475579   753 raft_consensus.cc:359] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.471338   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da7a1593c344878993dd4a1afbb408d" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:43.477309   534 raft_consensus.cc:3060] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.476679   753 raft_consensus.cc:385] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.478212   753 raft_consensus.cc:740] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.484344   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da7a1593c344878993dd4a1afbb408d" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:43.487213   607 raft_consensus.cc:3060] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.487792   753 consensus_queue.cc:260] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.491310   753 ts_tablet_manager.cc:1434] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:11:43.492875   753 tablet_bootstrap.cc:492] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:43.496385   607 raft_consensus.cc:2468] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 1.
I20260709 13:11:43.494227   754 tablet_bootstrap.cc:654] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.498347   425 leader_election.cc:304] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:43.499442   779 raft_consensus.cc:2804] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.499961   779 raft_consensus.cc:697] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:43.500850   779 consensus_queue.cc:237] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.502683   534 raft_consensus.cc:2468] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 1.
I20260709 13:11:43.514292   753 tablet_bootstrap.cc:654] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.519513   754 tablet_bootstrap.cc:492] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:43.520071   754 ts_tablet_manager.cc:1403] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.003s
I20260709 13:11:43.525236   754 raft_consensus.cc:359] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.525990   754 raft_consensus.cc:385] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.526278   754 raft_consensus.cc:740] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.527019   754 consensus_queue.cc:260] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.529464   754 ts_tablet_manager.cc:1434] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:43.530555   754 tablet_bootstrap.cc:492] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:43.536908   357 catalog_manager.cc:5697] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 1 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.539446   754 tablet_bootstrap.cc:654] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.546417   753 tablet_bootstrap.cc:492] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:43.546990   753 ts_tablet_manager.cc:1403] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.006s
I20260709 13:11:43.546875   357 catalog_manager.cc:5697] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 1 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.549876   753 raft_consensus.cc:359] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.549172   357 catalog_manager.cc:5697] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 1 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.550531   753 raft_consensus.cc:385] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.550930   753 raft_consensus.cc:740] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.551707   753 consensus_queue.cc:260] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.553596   753 ts_tablet_manager.cc:1434] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:11:43.554567   753 tablet_bootstrap.cc:492] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:43.557224   754 tablet_bootstrap.cc:492] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:43.557796   754 ts_tablet_manager.cc:1403] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.001s
I20260709 13:11:43.561821   754 raft_consensus.cc:359] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.562593   754 raft_consensus.cc:385] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.562958   754 raft_consensus.cc:740] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.563791   754 consensus_queue.cc:260] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.565533   753 tablet_bootstrap.cc:654] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.566536   754 ts_tablet_manager.cc:1434] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:43.574363   754 tablet_bootstrap.cc:492] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:43.581574   754 tablet_bootstrap.cc:654] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.586697   754 tablet_bootstrap.cc:492] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:43.587303   754 ts_tablet_manager.cc:1403] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:11:43.589546   754 raft_consensus.cc:359] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.590117   754 raft_consensus.cc:385] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.590493   754 raft_consensus.cc:740] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.591347   754 consensus_queue.cc:260] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.592695   753 tablet_bootstrap.cc:492] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:43.593472   753 ts_tablet_manager.cc:1403] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.000s
I20260709 13:11:43.593706   754 ts_tablet_manager.cc:1434] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:11:43.594852   754 tablet_bootstrap.cc:492] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:43.596341   753 raft_consensus.cc:359] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.597122   753 raft_consensus.cc:385] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.597415   753 raft_consensus.cc:740] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.598111   753 consensus_queue.cc:260] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.600409   753 ts_tablet_manager.cc:1434] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:43.602020   754 tablet_bootstrap.cc:654] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.602545   753 tablet_bootstrap.cc:492] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c: Bootstrap starting.
I20260709 13:11:43.610239   753 tablet_bootstrap.cc:654] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.631031   776 raft_consensus.cc:493] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.632820   776 raft_consensus.cc:515] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.635041   754 tablet_bootstrap.cc:492] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:43.635254   776 leader_election.cc:290] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.635623   754 ts_tablet_manager.cc:1403] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.015s
I20260709 13:11:43.635723   753 tablet_bootstrap.cc:492] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c: No bootstrap required, opened a new log
I20260709 13:11:43.636056   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c190b22af4904fcc8a6ff10fe618bbe3" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:43.636286   753 ts_tablet_manager.cc:1403] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.013s
I20260709 13:11:43.636777   460 raft_consensus.cc:2468] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 0.
I20260709 13:11:43.636934   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c190b22af4904fcc8a6ff10fe618bbe3" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:43.637578   607 raft_consensus.cc:2468] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 0.
I20260709 13:11:43.638302   498 leader_election.cc:304] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:43.638516   754 raft_consensus.cc:359] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.639251   754 raft_consensus.cc:385] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.639103   753 raft_consensus.cc:359] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.639322   776 raft_consensus.cc:2804] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.639626   754 raft_consensus.cc:740] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.639899   753 raft_consensus.cc:385] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.640237   753 raft_consensus.cc:740] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.640084   776 raft_consensus.cc:493] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.640846   776 raft_consensus.cc:3060] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.640494   754 consensus_queue.cc:260] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.640962   753 consensus_queue.cc:260] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.643183   753 ts_tablet_manager.cc:1434] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:43.646605   754 ts_tablet_manager.cc:1434] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:11:43.647686   754 tablet_bootstrap.cc:492] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Bootstrap starting.
I20260709 13:11:43.649325   776 raft_consensus.cc:515] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.652824   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c190b22af4904fcc8a6ff10fe618bbe3" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:43.653424   460 raft_consensus.cc:3060] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.653595   754 tablet_bootstrap.cc:654] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.661624   460 raft_consensus.cc:2468] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:43.664711   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c190b22af4904fcc8a6ff10fe618bbe3" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:43.671902   607 raft_consensus.cc:3060] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.679787   776 leader_election.cc:290] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.680235   498 leader_election.cc:304] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:43.681450   776 raft_consensus.cc:2804] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.681968   776 raft_consensus.cc:697] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:43.682425   607 raft_consensus.cc:2468] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:43.682874   776 consensus_queue.cc:237] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.684382   754 tablet_bootstrap.cc:492] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb: No bootstrap required, opened a new log
I20260709 13:11:43.684902   754 ts_tablet_manager.cc:1403] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.020s
I20260709 13:11:43.688171   754 raft_consensus.cc:359] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.689136   754 raft_consensus.cc:385] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.689476   754 raft_consensus.cc:740] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.690742   771 consensus_queue.cc:1048] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.690366   754 consensus_queue.cc:260] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.693742   754 ts_tablet_manager.cc:1434] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:43.707146   355 catalog_manager.cc:5697] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 1 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.710834   534 raft_consensus.cc:3060] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.723930   771 consensus_queue.cc:1048] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.732364   776 raft_consensus.cc:493] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.732870   776 raft_consensus.cc:515] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.735062   776 leader_election.cc:290] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.735991   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:43.736596   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:43.737408   607 raft_consensus.cc:2393] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in current term 1: Already voted for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in this term.
I20260709 13:11:43.738427   501 leader_election.cc:304] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10
I20260709 13:11:43.739269   776 raft_consensus.cc:3060] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.739625   771 raft_consensus.cc:493] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.740168   771 raft_consensus.cc:515] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.742304   771 leader_election.cc:290] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:43.744765   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b567f5136566427c978e9efb600ec989" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:43.745510   460 raft_consensus.cc:2468] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 0.
I20260709 13:11:43.746624   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b567f5136566427c978e9efb600ec989" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" is_pre_election: true
I20260709 13:11:43.746765   572 leader_election.cc:304] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:43.747738   771 raft_consensus.cc:2804] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.747836   534 raft_consensus.cc:2468] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 0.
I20260709 13:11:43.748147   771 raft_consensus.cc:493] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.748533   771 raft_consensus.cc:3060] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.749805   776 raft_consensus.cc:2749] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.754850   771 raft_consensus.cc:515] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.756644   771 leader_election.cc:290] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:43.757607   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b567f5136566427c978e9efb600ec989" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:43.757817   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b567f5136566427c978e9efb600ec989" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:43.758188   460 raft_consensus.cc:3060] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.758575   534 raft_consensus.cc:3060] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.764206   460 raft_consensus.cc:2468] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:43.765383   572 leader_election.cc:304] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:43.766103   771 raft_consensus.cc:2804] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.766573   771 raft_consensus.cc:697] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:43.766942   534 raft_consensus.cc:2468] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 1.
I20260709 13:11:43.767884   771 consensus_queue.cc:237] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.777603   357 catalog_manager.cc:5697] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.805500   779 consensus_queue.cc:1048] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.809036   776 raft_consensus.cc:493] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.809693   776 raft_consensus.cc:515] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.813364   776 leader_election.cc:290] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.813308   779 consensus_queue.cc:1048] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.814153   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f938bb0106a4193ab5cb9986e11b725" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" is_pre_election: true
I20260709 13:11:43.814903   460 raft_consensus.cc:2468] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 0.
I20260709 13:11:43.816993   498 leader_election.cc:304] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:43.820261   776 raft_consensus.cc:2804] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.820678   776 raft_consensus.cc:493] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.821020   776 raft_consensus.cc:3060] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.815192   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f938bb0106a4193ab5cb9986e11b725" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10" is_pre_election: true
I20260709 13:11:43.822687   607 raft_consensus.cc:2468] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 0.
I20260709 13:11:43.830920   778 consensus_queue.cc:1048] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.837230   776 raft_consensus.cc:515] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.840888   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f938bb0106a4193ab5cb9986e11b725" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:43.841553   460 raft_consensus.cc:3060] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.855504   534 raft_consensus.cc:3060] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.865336   776 leader_election.cc:290] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:43.866222   460 raft_consensus.cc:2468] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:43.866640   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f938bb0106a4193ab5cb9986e11b725" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:43.867375   608 raft_consensus.cc:3060] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.869130   498 leader_election.cc:304] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:43.870445   777 raft_consensus.cc:2804] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.871024   777 raft_consensus.cc:697] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:43.871970   777 consensus_queue.cc:237] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:43.873395   781 consensus_queue.cc:1048] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.874890   460 raft_consensus.cc:3060] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.889166   781 consensus_queue.cc:1048] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.889437   677 consensus_queue.cc:1048] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.892318   608 raft_consensus.cc:2468] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 1.
I20260709 13:11:43.907179   355 catalog_manager.cc:5697] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 1 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.926950   781 consensus_queue.cc:1048] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.927788   677 consensus_queue.cc:1048] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.997781   782 consensus_queue.cc:1048] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:44.016829   779 consensus_queue.cc:1048] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:44.068293   532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecefbc74130943d3b1ca8c0f94a86610"
dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
mode: GRACEFUL
new_leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:46258
I20260709 13:11:44.068938   532 raft_consensus.cc:606] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Received request to transfer leadership to TS 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:44.077450   608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbeec1aa12944bb3ae0f774181833b74"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
mode: GRACEFUL
new_leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:36730
I20260709 13:11:44.077976   608 raft_consensus.cc:606] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Received request to transfer leadership to TS 4b2f8e9217a44d879d7c4bbe28f9838c
I20260709 13:11:44.089102   460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
mode: GRACEFUL
new_leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
 from {username='slave'} at 127.0.0.1:44248
I20260709 13:11:44.089825   460 raft_consensus.cc:606] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Received request to transfer leadership to TS 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:44.096316   460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3da7a1593c344878993dd4a1afbb408d"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
mode: GRACEFUL
new_leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
 from {username='slave'} at 127.0.0.1:44248
I20260709 13:11:44.097015   460 raft_consensus.cc:606] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Received request to transfer leadership to TS 7a69fc7e4a7f49beab9821f7b3bb17eb
I20260709 13:11:44.211269   776 consensus_queue.cc:1048] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:44.227931   677 consensus_queue.cc:1048] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:44.250365   769 raft_consensus.cc:993] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10: : Instructing follower 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:44.250850   771 raft_consensus.cc:1081] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Signalling peer 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:44.252630   460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbeec1aa12944bb3ae0f774181833b74"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:44228
I20260709 13:11:44.253218   460 raft_consensus.cc:493] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.253590   460 raft_consensus.cc:3060] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.261847   460 raft_consensus.cc:515] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.264047   460 leader_election.cc:290] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:44.264632   532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec1aa12944bb3ae0f774181833b74" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:44.264694   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec1aa12944bb3ae0f774181833b74" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:44.265383   532 raft_consensus.cc:3060] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.265499   608 raft_consensus.cc:3055] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.265935   608 raft_consensus.cc:740] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:44.266768   608 consensus_queue.cc:260] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.267930   608 raft_consensus.cc:3060] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.271395   532 raft_consensus.cc:2468] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:44.272724   423 leader_election.cc:304] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:44.273602   782 raft_consensus.cc:2804] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:44.274071   782 raft_consensus.cc:697] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:44.274879   782 consensus_queue.cc:237] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.276033   608 raft_consensus.cc:2468] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:44.283061   769 consensus_queue.cc:1048] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:44.286394   355 catalog_manager.cc:5697] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 1 to 2, leader changed from 4d2692ff97134a10b619aba0249bea10 (127.19.231.131) to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 2 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.309055   655 consensus_queue.cc:1048] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:44.315294   781 raft_consensus.cc:993] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c: : Instructing follower 7a69fc7e4a7f49beab9821f7b3bb17eb to start an election
I20260709 13:11:44.315868   781 raft_consensus.cc:1081] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Signalling peer 7a69fc7e4a7f49beab9821f7b3bb17eb to start an election
I20260709 13:11:44.322568   534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59"
dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
 from {username='slave'} at 127.0.0.1:46242
I20260709 13:11:44.323508   534 raft_consensus.cc:493] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.323997   534 raft_consensus.cc:3060] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.325457   777 consensus_queue.cc:1048] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:44.346529   534 raft_consensus.cc:515] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.357153   534 leader_election.cc:290] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 2 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:44.358433   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:44.359174   459 raft_consensus.cc:3055] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.359525   459 raft_consensus.cc:740] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:44.360400   459 consensus_queue.cc:260] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.362214   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:44.362921   609 raft_consensus.cc:3060] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.369867   459 raft_consensus.cc:3060] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.372613   609 raft_consensus.cc:2468] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 2.
I20260709 13:11:44.374100   501 leader_election.cc:304] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:44.375072   776 raft_consensus.cc:2804] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:44.375592   776 raft_consensus.cc:697] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:44.376473   776 consensus_queue.cc:237] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.381606   459 raft_consensus.cc:2468] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 2.
I20260709 13:11:44.384349   776 consensus_queue.cc:1048] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:44.390110   777 raft_consensus.cc:993] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb: : Instructing follower 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:44.389290   355 catalog_manager.cc:5697] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 1 to 2, leader changed from 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129) to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 2 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.390830   821 raft_consensus.cc:1081] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Signalling peer 4b2f8e9217a44d879d7c4bbe28f9838c to start an election
I20260709 13:11:44.395604   458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecefbc74130943d3b1ca8c0f94a86610"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:11:44.396358   458 raft_consensus.cc:493] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.396770   458 raft_consensus.cc:3060] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.405882   458 raft_consensus.cc:515] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.409971   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecefbc74130943d3b1ca8c0f94a86610" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:44.411338   534 raft_consensus.cc:3055] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.412098   458 leader_election.cc:290] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Requested vote from peers 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:44.412591   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecefbc74130943d3b1ca8c0f94a86610" candidate_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:44.413177   608 raft_consensus.cc:3060] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.411664   534 raft_consensus.cc:740] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:44.416105   534 consensus_queue.cc:260] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.422878   608 raft_consensus.cc:2468] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:44.423609   534 raft_consensus.cc:3060] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.424556   425 leader_election.cc:304] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:44.425565   782 raft_consensus.cc:2804] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:44.426062   782 raft_consensus.cc:697] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Becoming Leader. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:44.426903   782 consensus_queue.cc:237] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.433249   534 raft_consensus.cc:2468] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f8e9217a44d879d7c4bbe28f9838c in term 2.
I20260709 13:11:44.434767   355 catalog_manager.cc:5697] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c reported cstate change: term changed from 1 to 2, leader changed from 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130) to 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129). New cstate: current_term: 2 leader_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.445513   781 raft_consensus.cc:993] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c: : Instructing follower 7a69fc7e4a7f49beab9821f7b3bb17eb to start an election
I20260709 13:11:44.446064   781 raft_consensus.cc:1081] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Signalling peer 7a69fc7e4a7f49beab9821f7b3bb17eb to start an election
I20260709 13:11:44.447885   534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3da7a1593c344878993dd4a1afbb408d"
dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
 from {username='slave'} at 127.0.0.1:46242
I20260709 13:11:44.448575   534 raft_consensus.cc:493] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.449014   534 raft_consensus.cc:3060] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.457500   534 raft_consensus.cc:515] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.459786   534 leader_election.cc:290] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 2 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 4d2692ff97134a10b619aba0249bea10 (127.19.231.131:43431)
I20260709 13:11:44.460697   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da7a1593c344878993dd4a1afbb408d" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:44.460958   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da7a1593c344878993dd4a1afbb408d" candidate_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d2692ff97134a10b619aba0249bea10"
I20260709 13:11:44.461419   458 raft_consensus.cc:3055] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.461464   608 raft_consensus.cc:3060] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.461916   458 raft_consensus.cc:740] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:44.463012   458 consensus_queue.cc:260] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.464121   458 raft_consensus.cc:3060] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.469240   458 raft_consensus.cc:2468] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 2.
I20260709 13:11:44.470515   498 leader_election.cc:304] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:44.470535   608 raft_consensus.cc:2468] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a69fc7e4a7f49beab9821f7b3bb17eb in term 2.
I20260709 13:11:44.471436   776 raft_consensus.cc:2804] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:44.472203   776 raft_consensus.cc:697] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Becoming Leader. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:44.472999   776 consensus_queue.cc:237] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:44.481693   355 catalog_manager.cc:5697] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb reported cstate change: term changed from 1 to 2, leader changed from 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129) to 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130). New cstate: current_term: 2 leader_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.688445   608 raft_consensus.cc:1275] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.689762   781 consensus_queue.cc:1048] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.697935   534 raft_consensus.cc:1275] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.699417   781 consensus_queue.cc:1048] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.830916   458 raft_consensus.cc:1275] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Refusing update from remote peer 7a69fc7e4a7f49beab9821f7b3bb17eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.832245   776 consensus_queue.cc:1048] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.846529   608 raft_consensus.cc:1275] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 7a69fc7e4a7f49beab9821f7b3bb17eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.848258   777 consensus_queue.cc:1048] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.886379   532 raft_consensus.cc:1275] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.892776   781 consensus_queue.cc:1048] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.903368   608 raft_consensus.cc:1275] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 4b2f8e9217a44d879d7c4bbe28f9838c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.905133   779 consensus_queue.cc:1048] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.917037   458 raft_consensus.cc:1275] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Refusing update from remote peer 7a69fc7e4a7f49beab9821f7b3bb17eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.918592   777 consensus_queue.cc:1048] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.929867   608 raft_consensus.cc:1275] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Refusing update from remote peer 7a69fc7e4a7f49beab9821f7b3bb17eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.931825   776 consensus_queue.cc:1048] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:47.111304   357 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46192:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:11:47.131554   357 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46192:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:11:47.212519 20382 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:11:47.294893   873 tablet.cc:1724] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.306020   869 tablet.cc:1724] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:47.337474   423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:42921, user_credentials={real_user=slave}} blocked reactor thread for 88096.8us
W20260709 13:11:47.345713   425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:43431, user_credentials={real_user=slave}} blocked reactor thread for 50163.2us
W20260709 13:11:47.368038   868 log.cc:927] Time spent T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb: Append to log took a long time: real 0.063s	user 0.003s	sys 0.000s
I20260709 13:11:47.329386   881 tablet.cc:1724] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.392760   887 tablet.cc:1724] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.400638   885 tablet.cc:1724] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:47.420316   486 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:f1c491e2ce5848669fbe38103fee1267)
W20260709 13:11:47.425525   872 log.cc:927] Time spent T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
W20260709 13:11:47.427740   860 log.cc:927] Time spent T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c: Append to log took a long time: real 0.129s	user 0.002s	sys 0.006s
W20260709 13:11:47.426524   839 log.cc:927] Time spent T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c: Append to log took a long time: real 0.128s	user 0.003s	sys 0.000s
W20260709 13:11:47.435086   486 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:f1c491e2ce5848669fbe38103fee1267)
W20260709 13:11:47.441542   486 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:f1c491e2ce5848669fbe38103fee1267)
W20260709 13:11:47.427734   877 log.cc:927] Time spent T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:11:47.468473   535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59"
dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
mode: GRACEFUL
new_leader_uuid: "4d2692ff97134a10b619aba0249bea10"
 from {username='slave'} at 127.0.0.1:46264
I20260709 13:11:47.469538   535 raft_consensus.cc:606] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Received request to transfer leadership to TS 4d2692ff97134a10b619aba0249bea10
W20260709 13:11:47.492537   501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:43431, user_credentials={real_user=slave}} blocked reactor thread for 52325.6us
W20260709 13:11:47.500149   876 log.cc:927] Time spent T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c: Append to log took a long time: real 0.198s	user 0.003s	sys 0.000s
I20260709 13:11:47.452699   890 tablet.cc:1724] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.526669   893 tablet.cc:1724] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.530957   885 tablet.cc:1724] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.533622   896 tablet.cc:1724] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.577363   869 tablet.cc:1724] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.580163   885 tablet.cc:1724] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.557777   887 tablet.cc:1724] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.505511   892 tablet.cc:1724] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:47.597935   423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.130:42921, user_credentials={real_user=slave}} blocked reactor thread for 63275.1us
I20260709 13:11:47.598609   902 tablet.cc:1724] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:47.607618   498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.129:36021, user_credentials={real_user=slave}} blocked reactor thread for 155134us
W20260709 13:11:47.610908   501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:43431, user_credentials={real_user=slave}} blocked reactor thread for 79600.5us
I20260709 13:11:47.611042   885 tablet.cc:1724] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.558285   881 tablet.cc:1724] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.628455   906 tablet.cc:1724] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.635156   893 tablet.cc:1724] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.560827   873 tablet.cc:1724] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.657832   905 tablet.cc:1724] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.661906   896 tablet.cc:1724] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.672792   885 tablet.cc:1724] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.676290   893 tablet.cc:1724] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.688908   881 tablet.cc:1724] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.691376   890 tablet.cc:1724] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.671221   869 tablet.cc:1724] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.703830   881 tablet.cc:1724] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:47.739895   456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c491e2ce5848669fbe38103fee1267"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
mode: GRACEFUL
new_leader_uuid: "4d2692ff97134a10b619aba0249bea10"
 from {username='slave'} at 127.0.0.1:44260
I20260709 13:11:47.740578   456 raft_consensus.cc:606] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Received request to transfer leadership to TS 4d2692ff97134a10b619aba0249bea10
I20260709 13:11:47.742141 20382 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:11:47.742856 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:47.747157   357 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3: soft_deleted_table [id=efc6ad93afab4d079c7629de6bfb0d2b] alter complete (version 1)
I20260709 13:11:47.754877   456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c"
dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
mode: GRACEFUL
new_leader_uuid: "4d2692ff97134a10b619aba0249bea10"
 from {username='slave'} at 127.0.0.1:44260
I20260709 13:11:47.755561   456 raft_consensus.cc:606] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Received request to transfer leadership to TS 4d2692ff97134a10b619aba0249bea10
I20260709 13:11:47.758893   532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186"
dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
mode: GRACEFUL
new_leader_uuid: "4d2692ff97134a10b619aba0249bea10"
 from {username='slave'} at 127.0.0.1:46264
I20260709 13:11:47.759557   532 raft_consensus.cc:606] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Received request to transfer leadership to TS 4d2692ff97134a10b619aba0249bea10
I20260709 13:11:47.761166 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:47.761731 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:47.768713   895 raft_consensus.cc:993] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c: : Instructing follower 4d2692ff97134a10b619aba0249bea10 to start an election
I20260709 13:11:47.769228   895 raft_consensus.cc:1081] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Signalling peer 4d2692ff97134a10b619aba0249bea10 to start an election
I20260709 13:11:47.771317   608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1c491e2ce5848669fbe38103fee1267"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
 from {username='slave'} at 127.0.0.1:36720
I20260709 13:11:47.771859   608 raft_consensus.cc:493] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:47.772195   608 raft_consensus.cc:3060] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.779620   608 raft_consensus.cc:515] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:47.781622   608 leader_election.cc:290] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 2 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:47.782456   456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c491e2ce5848669fbe38103fee1267" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:47.783221   456 raft_consensus.cc:3055] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:47.783293   532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c491e2ce5848669fbe38103fee1267" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:47.783598   456 raft_consensus.cc:740] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:47.783960   532 raft_consensus.cc:3060] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.784562   456 consensus_queue.cc:260] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:47.786154   456 raft_consensus.cc:3060] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.792457   532 raft_consensus.cc:2468] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 2.
I20260709 13:11:47.794135   456 raft_consensus.cc:2468] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 2.
I20260709 13:11:47.795207   573 leader_election.cc:304] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:47.796130   828 raft_consensus.cc:2804] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:47.796581   828 raft_consensus.cc:697] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 2 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:47.797319   828 consensus_queue.cc:237] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:47.805502   354 catalog_manager.cc:5697] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 1 to 2, leader changed from 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129) to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 2 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.890250   882 raft_consensus.cc:993] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb: : Instructing follower 4d2692ff97134a10b619aba0249bea10 to start an election
I20260709 13:11:47.890905   899 raft_consensus.cc:1081] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Signalling peer 4d2692ff97134a10b619aba0249bea10 to start an election
I20260709 13:11:47.892511   608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
 from {username='slave'} at 127.0.0.1:36714
I20260709 13:11:47.893003   608 raft_consensus.cc:493] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:47.893299   608 raft_consensus.cc:3060] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.897893   608 raft_consensus.cc:515] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:47.899979   608 leader_election.cc:290] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 3 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:47.900449   456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:47.900689   532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b356b344b9a44056b2bb6ba50f4d4f59" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:47.901321   456 raft_consensus.cc:3060] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.901371   532 raft_consensus.cc:3055] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:47.901997   532 raft_consensus.cc:740] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:47.902989   532 consensus_queue.cc:260] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:47.904295   532 raft_consensus.cc:3060] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.910234   456 raft_consensus.cc:2468] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 3.
I20260709 13:11:47.910230   532 raft_consensus.cc:2468] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 3.
I20260709 13:11:47.911660   572 leader_election.cc:304] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:47.912463   828 raft_consensus.cc:2804] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:47.913173   828 raft_consensus.cc:697] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 3 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:47.913908   828 consensus_queue.cc:237] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:47.923049   354 catalog_manager.cc:5697] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 2 to 3, leader changed from 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130) to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 3 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.017593   882 raft_consensus.cc:993] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb: : Instructing follower 4d2692ff97134a10b619aba0249bea10 to start an election
I20260709 13:11:48.018026   899 raft_consensus.cc:1081] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Signalling peer 4d2692ff97134a10b619aba0249bea10 to start an election
I20260709 13:11:48.019524   608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
 from {username='slave'} at 127.0.0.1:36714
I20260709 13:11:48.019933   608 raft_consensus.cc:493] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:48.020159   608 raft_consensus.cc:3060] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.025666   608 raft_consensus.cc:515] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:48.027423   608 leader_election.cc:290] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 3 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:48.029184   532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:48.029189   456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc5370fb2d7c47f2b35965c63e0ba186" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:48.030004   532 raft_consensus.cc:3055] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:48.030300   456 raft_consensus.cc:3060] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.030495   532 raft_consensus.cc:740] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a69fc7e4a7f49beab9821f7b3bb17eb, State: Running, Role: LEADER
I20260709 13:11:48.031529   532 consensus_queue.cc:260] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:48.032799   532 raft_consensus.cc:3060] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.038461   456 raft_consensus.cc:2468] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 3.
I20260709 13:11:48.039898   572 leader_election.cc:304] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f8e9217a44d879d7c4bbe28f9838c, 4d2692ff97134a10b619aba0249bea10; no voters: 
I20260709 13:11:48.040362   532 raft_consensus.cc:2468] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 3.
I20260709 13:11:48.040709   828 raft_consensus.cc:2804] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:48.041289   828 raft_consensus.cc:697] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 3 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:48.042692   828 consensus_queue.cc:237] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:48.050700   354 catalog_manager.cc:5697] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 2 to 3, leader changed from 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130) to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 3 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.182135   879 raft_consensus.cc:993] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c: : Instructing follower 4d2692ff97134a10b619aba0249bea10 to start an election
I20260709 13:11:48.182610   895 raft_consensus.cc:1081] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Signalling peer 4d2692ff97134a10b619aba0249bea10 to start an election
I20260709 13:11:48.184125   608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c"
dest_uuid: "4d2692ff97134a10b619aba0249bea10"
 from {username='slave'} at 127.0.0.1:36720
I20260709 13:11:48.184597   608 raft_consensus.cc:493] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:48.184880   608 raft_consensus.cc:3060] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.189848   608 raft_consensus.cc:515] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:48.191465   608 leader_election.cc:290] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 3 election: Requested vote from peers 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021), 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921)
I20260709 13:11:48.192386   456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c"
I20260709 13:11:48.192531   532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217ec655ac044b46b9c2eb5b7353506c" candidate_uuid: "4d2692ff97134a10b619aba0249bea10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb"
I20260709 13:11:48.193126   456 raft_consensus.cc:3055] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:48.193138   532 raft_consensus.cc:3060] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.193536   456 raft_consensus.cc:740] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b2f8e9217a44d879d7c4bbe28f9838c, State: Running, Role: LEADER
I20260709 13:11:48.194521   456 consensus_queue.cc:260] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:48.195652   456 raft_consensus.cc:3060] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.200475   532 raft_consensus.cc:2468] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 3.
I20260709 13:11:48.201844   573 leader_election.cc:304] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2692ff97134a10b619aba0249bea10, 7a69fc7e4a7f49beab9821f7b3bb17eb; no voters: 
I20260709 13:11:48.202507   828 raft_consensus.cc:2804] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:48.202884   456 raft_consensus.cc:2468] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2692ff97134a10b619aba0249bea10 in term 3.
I20260709 13:11:48.202983   828 raft_consensus.cc:697] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 3 LEADER]: Becoming Leader. State: Replica: 4d2692ff97134a10b619aba0249bea10, State: Running, Role: LEADER
I20260709 13:11:48.204015   828 consensus_queue.cc:237] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } }
I20260709 13:11:48.212008   354 catalog_manager.cc:5697] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 reported cstate change: term changed from 2 to 3, leader changed from 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129) to 4d2692ff97134a10b619aba0249bea10 (127.19.231.131). New cstate: current_term: 3 leader_uuid: "4d2692ff97134a10b619aba0249bea10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d2692ff97134a10b619aba0249bea10" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 43431 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.293540   532 raft_consensus.cc:1275] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Refusing update from remote peer 4d2692ff97134a10b619aba0249bea10: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:48.294732   828 consensus_queue.cc:1048] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:48.303475   456 raft_consensus.cc:1275] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Refusing update from remote peer 4d2692ff97134a10b619aba0249bea10: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:48.305251   913 consensus_queue.cc:1048] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:48.325089   532 raft_consensus.cc:1275] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Refusing update from remote peer 4d2692ff97134a10b619aba0249bea10: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:48.327019   889 consensus_queue.cc:1048] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:48.335083   456 raft_consensus.cc:1275] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Refusing update from remote peer 4d2692ff97134a10b619aba0249bea10: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:48.336644   828 consensus_queue.cc:1048] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:48.618181   456 raft_consensus.cc:1275] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Refusing update from remote peer 4d2692ff97134a10b619aba0249bea10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:48.619554   828 consensus_queue.cc:1048] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:48.628453   532 raft_consensus.cc:1275] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Refusing update from remote peer 4d2692ff97134a10b619aba0249bea10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:48.630318   913 consensus_queue.cc:1048] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:48.737924   456 raft_consensus.cc:1275] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Refusing update from remote peer 4d2692ff97134a10b619aba0249bea10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:48.739240   913 consensus_queue.cc:1048] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f8e9217a44d879d7c4bbe28f9838c" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 36021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:48.750464   532 raft_consensus.cc:1275] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Refusing update from remote peer 4d2692ff97134a10b619aba0249bea10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:48.751885   889 consensus_queue.cc:1048] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a69fc7e4a7f49beab9821f7b3bb17eb" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:48.823501 20382 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:11:48.829358 20382 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:11:48.829839 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:48.834744 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:11:48.835274 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:49.864951 20382 tablet_server.cc:179] TabletServer@127.19.231.129:0 shutting down...
I20260709 13:11:49.927212 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:49.933511 20382 tablet_replica.cc:333] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
W20260709 13:11:49.932483   572 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
I20260709 13:11:49.938588 20382 raft_consensus.cc:2243] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.940449 20382 raft_consensus.cc:2272] T c190b22af4904fcc8a6ff10fe618bbe3 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.941236   572 consensus_peers.cc:597] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.942370   498 consensus_peers.cc:597] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.944612 20382 tablet_replica.cc:333] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.945930 20382 raft_consensus.cc:2243] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.946761 20382 raft_consensus.cc:2272] T 6f938bb0106a4193ab5cb9986e11b725 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.949857 20382 tablet_replica.cc:333] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.950832 20382 raft_consensus.cc:2243] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.951578 20382 raft_consensus.cc:2272] T b356b344b9a44056b2bb6ba50f4d4f59 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.954605 20382 tablet_replica.cc:333] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.955495 20382 raft_consensus.cc:2243] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.956293 20382 raft_consensus.cc:2272] T 3da7a1593c344878993dd4a1afbb408d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.959547 20382 tablet_replica.cc:333] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.960253 20382 raft_consensus.cc:2243] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.961598 20382 raft_consensus.cc:2272] T a6eed78c960a41709cccbf17aea1c2dc P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.964653 20382 tablet_replica.cc:333] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.965711 20382 raft_consensus.cc:2243] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.967262 20382 raft_consensus.cc:2272] T e29a8603398f4d4f9499ec5f6690002f P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.970090 20382 tablet_replica.cc:333] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.970887 20382 raft_consensus.cc:2243] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.972527 20382 raft_consensus.cc:2272] T bbeec1aa12944bb3ae0f774181833b74 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.975545 20382 tablet_replica.cc:333] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.976372 20382 raft_consensus.cc:2243] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.977012 20382 raft_consensus.cc:2272] T f1c491e2ce5848669fbe38103fee1267 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.981508 20382 tablet_replica.cc:333] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.982542 20382 raft_consensus.cc:2243] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.983790 20382 raft_consensus.cc:2272] T 617a70efb1b149e2985601949d593e1b P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.984254   498 consensus_peers.cc:597] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.986311   498 consensus_peers.cc:597] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.988281 20382 tablet_replica.cc:333] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.989496 20382 raft_consensus.cc:2243] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.990303 20382 raft_consensus.cc:2272] T fc5370fb2d7c47f2b35965c63e0ba186 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.993425 20382 tablet_replica.cc:333] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.994110 20382 raft_consensus.cc:2243] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.995668 20382 raft_consensus.cc:2272] T a8f161f5589f47c1b1b4b03560887117 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.998605 20382 tablet_replica.cc:333] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:49.999295 20382 raft_consensus.cc:2243] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.999890 20382 raft_consensus.cc:2272] T e2d36296bf974c88b980c5306e809b0d P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.002571 20382 tablet_replica.cc:333] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:50.003268 20382 raft_consensus.cc:2243] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.003875 20382 raft_consensus.cc:2272] T 217ec655ac044b46b9c2eb5b7353506c P 4b2f8e9217a44d879d7c4bbe28f9838c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.006731 20382 tablet_replica.cc:333] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:50.007397 20382 raft_consensus.cc:2243] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.008028 20382 raft_consensus.cc:2272] T 6e6b93de432d4d42b11386c5446d96e4 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.011126 20382 tablet_replica.cc:333] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:50.012156 20382 raft_consensus.cc:2243] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.013159 20382 raft_consensus.cc:2272] T b567f5136566427c978e9efb600ec989 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.017690 20382 tablet_replica.cc:333] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:50.018308 20382 raft_consensus.cc:2243] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.019055 20382 raft_consensus.cc:2272] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.021828 20382 tablet_replica.cc:333] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:50.022514 20382 raft_consensus.cc:2243] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.023689 20382 raft_consensus.cc:2272] T ecefbc74130943d3b1ca8c0f94a86610 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.026439 20382 tablet_replica.cc:333] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c: stopping tablet replica
I20260709 13:11:50.027066 20382 raft_consensus.cc:2243] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.028569 20382 raft_consensus.cc:2272] T c982530741064ceca257d7c535960729 P 4b2f8e9217a44d879d7c4bbe28f9838c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:50.038105   572 consensus_peers.cc:597] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:50.066915   498 consensus_peers.cc:597] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.081106 20382 tablet_server.cc:196] TabletServer@127.19.231.129:0 shutdown complete.
W20260709 13:11:50.082659   572 consensus_peers.cc:597] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:50.107456   572 consensus_peers.cc:597] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.152184 20382 tablet_server.cc:179] TabletServer@127.19.231.130:0 shutting down...
W20260709 13:11:50.168977   498 consensus_peers.cc:597] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.191059 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:50.192157 20382 tablet_replica.cc:333] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.193210 20382 raft_consensus.cc:2243] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.194665 20382 raft_consensus.cc:2272] T c190b22af4904fcc8a6ff10fe618bbe3 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:50.197309   572 consensus_peers.cc:597] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.198489 20382 tablet_replica.cc:333] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.199334 20382 raft_consensus.cc:2243] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.199879 20382 raft_consensus.cc:2272] T b356b344b9a44056b2bb6ba50f4d4f59 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.202114 20382 tablet_replica.cc:333] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.202733 20382 raft_consensus.cc:2243] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.203413 20382 raft_consensus.cc:2272] T bbeec1aa12944bb3ae0f774181833b74 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.205660 20382 tablet_replica.cc:333] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.206271 20382 raft_consensus.cc:2243] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.207432 20382 raft_consensus.cc:2272] T 6f938bb0106a4193ab5cb9986e11b725 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.210083 20382 tablet_replica.cc:333] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.211264 20382 raft_consensus.cc:2243] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.213316 20382 raft_consensus.cc:2272] T 3da7a1593c344878993dd4a1afbb408d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:50.216460   572 consensus_peers.cc:597] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 -> Peer 4b2f8e9217a44d879d7c4bbe28f9838c (127.19.231.129:36021): Couldn't send request to peer 4b2f8e9217a44d879d7c4bbe28f9838c. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:36021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.217038 20382 tablet_replica.cc:333] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.217736 20382 raft_consensus.cc:2243] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.218397 20382 raft_consensus.cc:2272] T fc5370fb2d7c47f2b35965c63e0ba186 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.221029 20382 tablet_replica.cc:333] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.221827 20382 raft_consensus.cc:2243] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.222517 20382 raft_consensus.cc:2272] T f1c491e2ce5848669fbe38103fee1267 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.224926 20382 tablet_replica.cc:333] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.225525 20382 raft_consensus.cc:2243] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.226688 20382 raft_consensus.cc:2272] T 617a70efb1b149e2985601949d593e1b P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.229131 20382 tablet_replica.cc:333] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.229712 20382 raft_consensus.cc:2243] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.230329 20382 raft_consensus.cc:2272] T ecefbc74130943d3b1ca8c0f94a86610 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.232831 20382 tablet_replica.cc:333] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.233399 20382 raft_consensus.cc:2243] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.233973 20382 raft_consensus.cc:2272] T c982530741064ceca257d7c535960729 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.236393 20382 tablet_replica.cc:333] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.237010 20382 raft_consensus.cc:2243] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.237567 20382 raft_consensus.cc:2272] T e29a8603398f4d4f9499ec5f6690002f P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.239925 20382 tablet_replica.cc:333] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.240490 20382 raft_consensus.cc:2243] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.241030 20382 raft_consensus.cc:2272] T a6eed78c960a41709cccbf17aea1c2dc P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.243682 20382 tablet_replica.cc:333] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.244261 20382 raft_consensus.cc:2243] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.244848 20382 raft_consensus.cc:2272] T 217ec655ac044b46b9c2eb5b7353506c P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.247182 20382 tablet_replica.cc:333] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.247756 20382 raft_consensus.cc:2243] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.248317 20382 raft_consensus.cc:2272] T 6e6b93de432d4d42b11386c5446d96e4 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.251463 20382 tablet_replica.cc:333] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.252209 20382 raft_consensus.cc:2243] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.253007 20382 raft_consensus.cc:2272] T b567f5136566427c978e9efb600ec989 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:50.253038   573 consensus_peers.cc:597] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 -> Peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Couldn't send request to peer 7a69fc7e4a7f49beab9821f7b3bb17eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.255671 20382 tablet_replica.cc:333] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.256208 20382 raft_consensus.cc:2243] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.257309 20382 raft_consensus.cc:2272] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.259730 20382 tablet_replica.cc:333] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.260461 20382 raft_consensus.cc:2243] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.261600 20382 raft_consensus.cc:2272] T e2d36296bf974c88b980c5306e809b0d P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:50.264679   573 consensus_peers.cc:597] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 -> Peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Couldn't send request to peer 7a69fc7e4a7f49beab9821f7b3bb17eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.264876 20382 tablet_replica.cc:333] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb: stopping tablet replica
I20260709 13:11:50.265509 20382 raft_consensus.cc:2243] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.266074 20382 raft_consensus.cc:2272] T a8f161f5589f47c1b1b4b03560887117 P 7a69fc7e4a7f49beab9821f7b3bb17eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.311244 20382 tablet_server.cc:196] TabletServer@127.19.231.130:0 shutdown complete.
I20260709 13:11:50.355540 20382 tablet_server.cc:179] TabletServer@127.19.231.131:0 shutting down...
W20260709 13:11:50.378844   573 consensus_peers.cc:597] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 -> Peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Couldn't send request to peer 7a69fc7e4a7f49beab9821f7b3bb17eb. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:42921: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.389482 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:50.390345 20382 tablet_replica.cc:333] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.391270 20382 raft_consensus.cc:2243] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.391975 20382 raft_consensus.cc:2272] T 3da7a1593c344878993dd4a1afbb408d P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.394349 20382 tablet_replica.cc:333] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.395004 20382 raft_consensus.cc:2243] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.395558 20382 raft_consensus.cc:2272] T c190b22af4904fcc8a6ff10fe618bbe3 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.397686 20382 tablet_replica.cc:333] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.398249 20382 raft_consensus.cc:2243] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.398823 20382 raft_consensus.cc:2272] T 6f938bb0106a4193ab5cb9986e11b725 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.401043 20382 tablet_replica.cc:333] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.401610 20382 raft_consensus.cc:2243] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.402485 20382 raft_consensus.cc:2272] T b356b344b9a44056b2bb6ba50f4d4f59 P 4d2692ff97134a10b619aba0249bea10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.404649 20382 tablet_replica.cc:333] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.405172 20382 raft_consensus.cc:2243] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.405731 20382 raft_consensus.cc:2272] T bbeec1aa12944bb3ae0f774181833b74 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.407945 20382 tablet_replica.cc:333] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.408510 20382 raft_consensus.cc:2243] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.409519 20382 raft_consensus.cc:2272] T fc5370fb2d7c47f2b35965c63e0ba186 P 4d2692ff97134a10b619aba0249bea10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.411643 20382 tablet_replica.cc:333] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.412204 20382 raft_consensus.cc:2243] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.413089 20382 raft_consensus.cc:2272] T f1c491e2ce5848669fbe38103fee1267 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.415411 20382 tablet_replica.cc:333] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.415997 20382 raft_consensus.cc:2243] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.416525 20382 raft_consensus.cc:2272] T 617a70efb1b149e2985601949d593e1b P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.418746 20382 tablet_replica.cc:333] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.419534 20382 raft_consensus.cc:2243] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.420100 20382 raft_consensus.cc:2272] T a8f161f5589f47c1b1b4b03560887117 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.422605 20382 tablet_replica.cc:333] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.423216 20382 raft_consensus.cc:2243] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.423650 20382 raft_consensus.cc:2272] T e2d36296bf974c88b980c5306e809b0d P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.426007 20382 tablet_replica.cc:333] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.426529 20382 raft_consensus.cc:2243] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.427073 20382 raft_consensus.cc:2272] T ecefbc74130943d3b1ca8c0f94a86610 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.429328 20382 tablet_replica.cc:333] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.429895 20382 raft_consensus.cc:2243] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.430483 20382 raft_consensus.cc:2272] T c982530741064ceca257d7c535960729 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.433586 20382 tablet_replica.cc:333] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.434327 20382 raft_consensus.cc:2243] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:50.435109   573 consensus_peers.cc:597] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 -> Peer 7a69fc7e4a7f49beab9821f7b3bb17eb (127.19.231.130:42921): Couldn't send request to peer 7a69fc7e4a7f49beab9821f7b3bb17eb. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:42921: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.435595 20382 raft_consensus.cc:2272] T b567f5136566427c978e9efb600ec989 P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.437887 20382 tablet_replica.cc:333] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.438484 20382 raft_consensus.cc:2243] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.439100 20382 raft_consensus.cc:2272] T b8b4aee61d8849e3bfe722f93a1f2cf5 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.441157 20382 tablet_replica.cc:333] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.441694 20382 raft_consensus.cc:2243] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.442584 20382 raft_consensus.cc:2272] T 217ec655ac044b46b9c2eb5b7353506c P 4d2692ff97134a10b619aba0249bea10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.444826 20382 tablet_replica.cc:333] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.445339 20382 raft_consensus.cc:2243] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.446184 20382 raft_consensus.cc:2272] T 6e6b93de432d4d42b11386c5446d96e4 P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.448683 20382 tablet_replica.cc:333] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.449220 20382 raft_consensus.cc:2243] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.449743 20382 raft_consensus.cc:2272] T e29a8603398f4d4f9499ec5f6690002f P 4d2692ff97134a10b619aba0249bea10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.451930 20382 tablet_replica.cc:333] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10: stopping tablet replica
I20260709 13:11:50.452450 20382 raft_consensus.cc:2243] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.453053 20382 raft_consensus.cc:2272] T a6eed78c960a41709cccbf17aea1c2dc P 4d2692ff97134a10b619aba0249bea10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.512698 20382 tablet_server.cc:196] TabletServer@127.19.231.131:0 shutdown complete.
I20260709 13:11:50.552599 20382 master.cc:562] Master@127.19.231.190:42585 shutting down...
I20260709 13:11:50.582154 20382 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.582880 20382 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.583251 20382 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2fb413f820b341afb7bf7627571c0ab3: stopping tablet replica
I20260709 13:11:50.604377 20382 master.cc:584] Master@127.19.231.190:42585 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12859 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:11:50.660591 20382 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.231.190:36393
I20260709 13:11:50.661845 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:50.668496   930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:50.668546   929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:50.669279   932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:50.669600 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:50.670660 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:50.670955 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:50.671128 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602710671094 us; error 0 us; skew 500 ppm
I20260709 13:11:50.671728 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:50.674255 20382 webserver.cc:533] Webserver started at http://127.19.231.190:46873/ using document root <none> and password file <none>
I20260709 13:11:50.674831 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:50.675014 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:50.675230 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:50.676426 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/master-0-root/instance:
uuid: "9bf764d5d09040f897194b01793e5a6b"
format_stamp: "Formatted at 2026-07-09 13:11:50 on dist-test-slave-1t6m"
I20260709 13:11:50.681290 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:50.684815   937 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:50.685638 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:11:50.685984 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/master-0-root
uuid: "9bf764d5d09040f897194b01793e5a6b"
format_stamp: "Formatted at 2026-07-09 13:11:50 on dist-test-slave-1t6m"
I20260709 13:11:50.686287 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:50.700114 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:50.701390 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:50.740551 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.190:36393
I20260709 13:11:50.740660   988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.190:36393 every 8 connection(s)
I20260709 13:11:50.744546   989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:50.756729   989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b: Bootstrap starting.
I20260709 13:11:50.761718   989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:50.766047   989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b: No bootstrap required, opened a new log
I20260709 13:11:50.768430   989 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf764d5d09040f897194b01793e5a6b" member_type: VOTER }
I20260709 13:11:50.768852   989 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:50.769102   989 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf764d5d09040f897194b01793e5a6b, State: Initialized, Role: FOLLOWER
I20260709 13:11:50.769796   989 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf764d5d09040f897194b01793e5a6b" member_type: VOTER }
I20260709 13:11:50.770287   989 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:50.770514   989 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:50.770823   989 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:50.776525   989 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf764d5d09040f897194b01793e5a6b" member_type: VOTER }
I20260709 13:11:50.777088   989 leader_election.cc:304] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bf764d5d09040f897194b01793e5a6b; no voters: 
I20260709 13:11:50.778214   989 leader_election.cc:290] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:50.778827   992 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:50.780256   992 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 1 LEADER]: Becoming Leader. State: Replica: 9bf764d5d09040f897194b01793e5a6b, State: Running, Role: LEADER
I20260709 13:11:50.780984   992 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf764d5d09040f897194b01793e5a6b" member_type: VOTER }
I20260709 13:11:50.781215   989 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:50.788383   993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9bf764d5d09040f897194b01793e5a6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf764d5d09040f897194b01793e5a6b" member_type: VOTER } }
I20260709 13:11:50.788286   994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bf764d5d09040f897194b01793e5a6b. Latest consensus state: current_term: 1 leader_uuid: "9bf764d5d09040f897194b01793e5a6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf764d5d09040f897194b01793e5a6b" member_type: VOTER } }
I20260709 13:11:50.789273   993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:50.789496   994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:50.791208  1002 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:50.799067  1002 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:50.800073 20382 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:50.808553  1002 catalog_manager.cc:1383] Generated new cluster ID: c7aecdde05a6467cbbbf28ef72c07642
I20260709 13:11:50.808866  1002 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:50.823812  1002 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:50.825193  1002 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:50.841333  1002 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b: Generated new TSK 0
I20260709 13:11:50.841949  1002 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:50.866667 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:50.873329  1010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:50.874198  1011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:50.875942  1013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:50.876190 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:50.877281 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:50.877493 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:50.877686 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602710877667 us; error 0 us; skew 500 ppm
I20260709 13:11:50.878243 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:50.880654 20382 webserver.cc:533] Webserver started at http://127.19.231.129:37841/ using document root <none> and password file <none>
I20260709 13:11:50.881157 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:50.881345 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:50.881599 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:50.883807 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-0-root/instance:
uuid: "29ead33c064b4d25ba7dd2f540e91b41"
format_stamp: "Formatted at 2026-07-09 13:11:50 on dist-test-slave-1t6m"
I20260709 13:11:50.888370 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:50.891748  1018 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:50.892546 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:50.892853 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-0-root
uuid: "29ead33c064b4d25ba7dd2f540e91b41"
format_stamp: "Formatted at 2026-07-09 13:11:50 on dist-test-slave-1t6m"
I20260709 13:11:50.893146 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:50.919109 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:50.920385 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:50.921865 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:50.924209 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:50.924450 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:50.924703 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:50.924903 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:50.965932 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.129:45573
I20260709 13:11:50.966068  1080 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.129:45573 every 8 connection(s)
I20260709 13:11:50.971132 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:50.978756  1085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:50.979621  1086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:50.984834 20382 server_base.cc:1061] running on GCE node
W20260709 13:11:50.985669  1089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:50.987977 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:50.988564 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:50.988811 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602710988789 us; error 0 us; skew 500 ppm
I20260709 13:11:50.989606 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:50.989773  1081 heartbeater.cc:344] Connected to a master server at 127.19.231.190:36393
I20260709 13:11:50.990288  1081 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:50.991631  1081 heartbeater.cc:507] Master 127.19.231.190:36393 requested a full tablet report, sending...
I20260709 13:11:50.993062 20382 webserver.cc:533] Webserver started at http://127.19.231.130:46803/ using document root <none> and password file <none>
I20260709 13:11:50.993848 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:50.994114 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:50.994455 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:50.994880   954 ts_manager.cc:194] Registered new tserver with Master: 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573)
I20260709 13:11:50.996366 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-1-root/instance:
uuid: "ab9de91bb9514190bf5545811a96bb4a"
format_stamp: "Formatted at 2026-07-09 13:11:50 on dist-test-slave-1t6m"
I20260709 13:11:50.997721   954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51838
I20260709 13:11:51.003367 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:11:51.008965  1093 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.010162 20382 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:11:51.010608 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-1-root
uuid: "ab9de91bb9514190bf5545811a96bb4a"
format_stamp: "Formatted at 2026-07-09 13:11:50 on dist-test-slave-1t6m"
I20260709 13:11:51.011004 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:51.035513 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:51.036737 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:51.038177 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:51.040457 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:51.040663 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.040920 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:51.041074 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.081377 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.130:42911
I20260709 13:11:51.081475  1155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.130:42911 every 8 connection(s)
I20260709 13:11:51.086169 20382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:51.093797  1159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:51.095032  1160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:51.098383  1162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:51.099133 20382 server_base.cc:1061] running on GCE node
I20260709 13:11:51.099515  1156 heartbeater.cc:344] Connected to a master server at 127.19.231.190:36393
I20260709 13:11:51.100003  1156 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:51.100097 20382 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:51.100353 20382 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:51.100489 20382 hybrid_clock.cc:648] HybridClock initialized: now 1783602711100478 us; error 0 us; skew 500 ppm
I20260709 13:11:51.100908  1156 heartbeater.cc:507] Master 127.19.231.190:36393 requested a full tablet report, sending...
I20260709 13:11:51.101027 20382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:51.103565   954 ts_manager.cc:194] Registered new tserver with Master: ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:51.103797 20382 webserver.cc:533] Webserver started at http://127.19.231.131:43185/ using document root <none> and password file <none>
I20260709 13:11:51.104513 20382 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:51.104754 20382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:51.105084 20382 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:51.105499   954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51848
I20260709 13:11:51.106734 20382 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-2-root/instance:
uuid: "791b04a8e9d14243b2bf72a5792f4a54"
format_stamp: "Formatted at 2026-07-09 13:11:51 on dist-test-slave-1t6m"
I20260709 13:11:51.111526 20382 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:11:51.115135  1167 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.115881 20382 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:11:51.116182 20382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-2-root
uuid: "791b04a8e9d14243b2bf72a5792f4a54"
format_stamp: "Formatted at 2026-07-09 13:11:51 on dist-test-slave-1t6m"
I20260709 13:11:51.116461 20382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskXDPzYl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337466250-20382-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:51.131176 20382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:51.132433 20382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:51.133925 20382 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:51.136164 20382 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:51.136399 20382 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.136641 20382 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:51.136806 20382 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.177601 20382 rpc_server.cc:307] RPC server started. Bound to: 127.19.231.131:36705
I20260709 13:11:51.177706  1229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.231.131:36705 every 8 connection(s)
I20260709 13:11:51.191953  1230 heartbeater.cc:344] Connected to a master server at 127.19.231.190:36393
I20260709 13:11:51.192384  1230 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:51.193080  1230 heartbeater.cc:507] Master 127.19.231.190:36393 requested a full tablet report, sending...
I20260709 13:11:51.195293   954 ts_manager.cc:194] Registered new tserver with Master: 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.195430 20382 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014768563s
I20260709 13:11:51.197198   954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51856
I20260709 13:11:51.221675   954 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51864:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:51.224588   954 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:51.300940  1121 tablet_service.cc:1511] Processing CreateTablet for tablet bb092e0a7a844c0799648a4e60e66661 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:51.301712  1119 tablet_service.cc:1511] Processing CreateTablet for tablet 12cdff375baf4e0ab50f38017273441a (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:51.302461  1121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb092e0a7a844c0799648a4e60e66661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.304455  1118 tablet_service.cc:1511] Processing CreateTablet for tablet 4126deadcedd4e2896ec44d2c373749e (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:51.305959  1118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4126deadcedd4e2896ec44d2c373749e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.307426  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cdff375baf4e0ab50f38017273441a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.308073  1120 tablet_service.cc:1511] Processing CreateTablet for tablet 25ab6a4f40514e389c793cf077740c30 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:51.309605  1120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ab6a4f40514e389c793cf077740c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.312598  1117 tablet_service.cc:1511] Processing CreateTablet for tablet 6af0f71d7d7843f797565fe08cfeb65e (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:51.314152  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af0f71d7d7843f797565fe08cfeb65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.319936  1116 tablet_service.cc:1511] Processing CreateTablet for tablet c98a36cfa7c74dcf99411c648cf52a39 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:51.321448  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98a36cfa7c74dcf99411c648cf52a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.324059  1046 tablet_service.cc:1511] Processing CreateTablet for tablet bb092e0a7a844c0799648a4e60e66661 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:51.325627  1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb092e0a7a844c0799648a4e60e66661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.327942  1041 tablet_service.cc:1511] Processing CreateTablet for tablet c98a36cfa7c74dcf99411c648cf52a39 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:51.329487  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98a36cfa7c74dcf99411c648cf52a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.332728  1042 tablet_service.cc:1511] Processing CreateTablet for tablet 6af0f71d7d7843f797565fe08cfeb65e (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:51.333675  1043 tablet_service.cc:1511] Processing CreateTablet for tablet 4126deadcedd4e2896ec44d2c373749e (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:51.334261  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af0f71d7d7843f797565fe08cfeb65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.336057  1039 tablet_service.cc:1511] Processing CreateTablet for tablet df084483bce74b11a9e2bc379be7e47b (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:51.337504  1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df084483bce74b11a9e2bc379be7e47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.339807  1045 tablet_service.cc:1511] Processing CreateTablet for tablet 25ab6a4f40514e389c793cf077740c30 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:51.341295  1045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ab6a4f40514e389c793cf077740c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.344051  1038 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5cceb435424717adbb505c0c94eec8 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:51.346146  1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5cceb435424717adbb505c0c94eec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.345817  1044 tablet_service.cc:1511] Processing CreateTablet for tablet 12cdff375baf4e0ab50f38017273441a (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:51.327942  1040 tablet_service.cc:1511] Processing CreateTablet for tablet 7a70c0e21cb44923b248fa502083b885 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:51.348106  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cdff375baf4e0ab50f38017273441a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.348846  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4126deadcedd4e2896ec44d2c373749e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.349737  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a70c0e21cb44923b248fa502083b885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.359289  1115 tablet_service.cc:1511] Processing CreateTablet for tablet 7a70c0e21cb44923b248fa502083b885 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:51.360970  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a70c0e21cb44923b248fa502083b885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.368204  1114 tablet_service.cc:1511] Processing CreateTablet for tablet df084483bce74b11a9e2bc379be7e47b (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:51.369771  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df084483bce74b11a9e2bc379be7e47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.375592  1113 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5cceb435424717adbb505c0c94eec8 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:51.377277  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5cceb435424717adbb505c0c94eec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.438047  1190 tablet_service.cc:1511] Processing CreateTablet for tablet c98a36cfa7c74dcf99411c648cf52a39 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:51.444190  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98a36cfa7c74dcf99411c648cf52a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.444363  1192 tablet_service.cc:1511] Processing CreateTablet for tablet 4126deadcedd4e2896ec44d2c373749e (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:51.445935  1192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4126deadcedd4e2896ec44d2c373749e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.450033  1189 tablet_service.cc:1511] Processing CreateTablet for tablet 7a70c0e21cb44923b248fa502083b885 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:51.451689  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a70c0e21cb44923b248fa502083b885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.442477  1195 tablet_service.cc:1511] Processing CreateTablet for tablet bb092e0a7a844c0799648a4e60e66661 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:51.442639  1191 tablet_service.cc:1511] Processing CreateTablet for tablet 6af0f71d7d7843f797565fe08cfeb65e (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:51.456941  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af0f71d7d7843f797565fe08cfeb65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.456754  1194 tablet_service.cc:1511] Processing CreateTablet for tablet 25ab6a4f40514e389c793cf077740c30 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:51.457154  1193 tablet_service.cc:1511] Processing CreateTablet for tablet 12cdff375baf4e0ab50f38017273441a (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:51.458305  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ab6a4f40514e389c793cf077740c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.458623  1188 tablet_service.cc:1511] Processing CreateTablet for tablet df084483bce74b11a9e2bc379be7e47b (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:51.458891  1187 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5cceb435424717adbb505c0c94eec8 (DEFAULT_TABLE table=test-workload [id=2f5190f6cf73459cbd329507800aef82]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:51.460079  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df084483bce74b11a9e2bc379be7e47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.460952  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5cceb435424717adbb505c0c94eec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.463168  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cdff375baf4e0ab50f38017273441a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.467334  1195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb092e0a7a844c0799648a4e60e66661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.451699  1246 tablet_bootstrap.cc:492] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:51.483992  1245 tablet_bootstrap.cc:492] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:51.492348  1245 tablet_bootstrap.cc:654] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.492714  1246 tablet_bootstrap.cc:654] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.530875  1248 tablet_bootstrap.cc:492] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:51.540436  1248 tablet_bootstrap.cc:654] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.541397  1245 tablet_bootstrap.cc:492] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:51.541759  1246 tablet_bootstrap.cc:492] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:51.541975  1245 ts_tablet_manager.cc:1403] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.011s
I20260709 13:11:51.542477  1246 ts_tablet_manager.cc:1403] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.091s	user 0.003s	sys 0.019s
I20260709 13:11:51.545207  1245 raft_consensus.cc:359] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.546049  1245 raft_consensus.cc:385] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.546448  1245 raft_consensus.cc:740] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.545660  1246 raft_consensus.cc:359] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.547118  1246 raft_consensus.cc:385] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.547627  1246 raft_consensus.cc:740] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.547369  1245 consensus_queue.cc:260] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.548969  1246 consensus_queue.cc:260] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.550006  1156 heartbeater.cc:499] Master 127.19.231.190:36393 was elected leader, sending a full tablet report...
I20260709 13:11:51.550573  1245 ts_tablet_manager.cc:1434] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:11:51.551617  1245 tablet_bootstrap.cc:492] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:51.557896  1248 tablet_bootstrap.cc:492] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:51.558818  1248 ts_tablet_manager.cc:1403] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.003s
I20260709 13:11:51.560127  1245 tablet_bootstrap.cc:654] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.563170  1248 raft_consensus.cc:359] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.564149  1248 raft_consensus.cc:385] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.564448  1248 raft_consensus.cc:740] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.564553  1081 heartbeater.cc:499] Master 127.19.231.190:36393 was elected leader, sending a full tablet report...
I20260709 13:11:51.565059  1246 ts_tablet_manager.cc:1434] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.010s
I20260709 13:11:51.565413  1248 consensus_queue.cc:260] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.566202  1246 tablet_bootstrap.cc:492] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:51.570106  1245 tablet_bootstrap.cc:492] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:51.570698  1245 ts_tablet_manager.cc:1403] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:11:51.573794  1245 raft_consensus.cc:359] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.574564  1245 raft_consensus.cc:385] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.574882  1245 raft_consensus.cc:740] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.575381  1246 tablet_bootstrap.cc:654] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.575874  1245 consensus_queue.cc:260] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.578435  1245 ts_tablet_manager.cc:1434] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:11:51.579594  1245 tablet_bootstrap.cc:492] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:51.583958  1230 heartbeater.cc:499] Master 127.19.231.190:36393 was elected leader, sending a full tablet report...
I20260709 13:11:51.584941  1248 ts_tablet_manager.cc:1434] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.015s
I20260709 13:11:51.586526  1248 tablet_bootstrap.cc:492] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:51.587267  1245 tablet_bootstrap.cc:654] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:51.589385  1157 tablet.cc:2406] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:51.592399  1246 tablet_bootstrap.cc:492] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:51.593017  1246 ts_tablet_manager.cc:1403] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 13:11:51.596342  1246 raft_consensus.cc:359] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.597131  1246 raft_consensus.cc:385] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.597456  1246 raft_consensus.cc:740] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.598258  1246 consensus_queue.cc:260] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.599865  1248 tablet_bootstrap.cc:654] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.600620  1246 ts_tablet_manager.cc:1434] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:51.601296  1245 tablet_bootstrap.cc:492] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:51.601720  1246 tablet_bootstrap.cc:492] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:51.601877  1245 ts_tablet_manager.cc:1403] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.005s
I20260709 13:11:51.605227  1245 raft_consensus.cc:359] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.606014  1245 raft_consensus.cc:385] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.606333  1245 raft_consensus.cc:740] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.607399  1245 consensus_queue.cc:260] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.609848  1245 ts_tablet_manager.cc:1434] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:51.610743  1246 tablet_bootstrap.cc:654] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.611029  1245 tablet_bootstrap.cc:492] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:51.611496  1248 tablet_bootstrap.cc:492] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:51.612128  1248 ts_tablet_manager.cc:1403] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.003s
I20260709 13:11:51.615850  1248 raft_consensus.cc:359] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.616885  1248 raft_consensus.cc:385] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.617274  1248 raft_consensus.cc:740] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.618691  1245 tablet_bootstrap.cc:654] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.618566  1248 consensus_queue.cc:260] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.621743  1248 ts_tablet_manager.cc:1434] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:51.623095  1248 tablet_bootstrap.cc:492] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:51.628031  1246 tablet_bootstrap.cc:492] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:51.628657  1246 ts_tablet_manager.cc:1403] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.003s
I20260709 13:11:51.628783  1254 raft_consensus.cc:493] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.629317  1254 raft_consensus.cc:515] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.630625  1245 tablet_bootstrap.cc:492] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:51.631218  1245 ts_tablet_manager.cc:1403] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 13:11:51.631932  1246 raft_consensus.cc:359] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.632728  1246 raft_consensus.cc:385] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.633065  1246 raft_consensus.cc:740] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.633912  1246 consensus_queue.cc:260] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.636250  1246 ts_tablet_manager.cc:1434] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:51.637339  1246 tablet_bootstrap.cc:492] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:51.634459  1245 raft_consensus.cc:359] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:51.637713  1245 raft_consensus.cc:385] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.638037  1245 raft_consensus.cc:740] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.639065  1245 consensus_queue.cc:260] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:51.641433  1245 ts_tablet_manager.cc:1434] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:11:51.642539  1245 tablet_bootstrap.cc:492] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:51.643949  1246 tablet_bootstrap.cc:654] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.646310  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:51.647588  1056 raft_consensus.cc:2468] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 0.
I20260709 13:11:51.649663  1245 tablet_bootstrap.cc:654] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.649616  1169 leader_election.cc:304] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: 
I20260709 13:11:51.655359  1254 leader_election.cc:290] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:51.656129  1254 raft_consensus.cc:2804] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:51.657001  1254 raft_consensus.cc:493] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.657451  1254 raft_consensus.cc:3060] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.660622  1246 tablet_bootstrap.cc:492] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:51.661280  1246 ts_tablet_manager.cc:1403] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 13:11:51.664526  1246 raft_consensus.cc:359] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.665355  1246 raft_consensus.cc:385] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.665674  1246 raft_consensus.cc:740] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.666594  1246 consensus_queue.cc:260] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.669047  1246 ts_tablet_manager.cc:1434] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:51.666687  1254 raft_consensus.cc:515] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.673995  1246 tablet_bootstrap.cc:492] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:51.672758  1248 tablet_bootstrap.cc:654] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.679119  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:51.679896  1056 raft_consensus.cc:3060] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.681185  1246 tablet_bootstrap.cc:654] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.671231  1245 tablet_bootstrap.cc:492] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:51.683032  1245 ts_tablet_manager.cc:1403] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.041s	user 0.004s	sys 0.010s
I20260709 13:11:51.683359  1254 leader_election.cc:290] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:51.684520  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:51.686101  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:51.686321  1245 raft_consensus.cc:359] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.687109  1245 raft_consensus.cc:385] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.687412  1245 raft_consensus.cc:740] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
W20260709 13:11:51.687618  1168 leader_election.cc:343] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.688201  1245 consensus_queue.cc:260] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.689320  1130 raft_consensus.cc:3060] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.690773  1245 ts_tablet_manager.cc:1434] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:51.691936  1245 tablet_bootstrap.cc:492] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:51.697789  1130 raft_consensus.cc:2468] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 1.
I20260709 13:11:51.699905  1056 raft_consensus.cc:2468] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 1.
I20260709 13:11:51.701186  1245 tablet_bootstrap.cc:654] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.701879  1169 leader_election.cc:304] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: 
I20260709 13:11:51.703433  1254 raft_consensus.cc:2804] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:51.703974  1254 raft_consensus.cc:697] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Becoming Leader. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Running, Role: LEADER
I20260709 13:11:51.704878  1254 consensus_queue.cc:237] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.706852  1246 tablet_bootstrap.cc:492] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:51.707175  1251 raft_consensus.cc:493] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.707921  1251 raft_consensus.cc:515] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.710736  1245 tablet_bootstrap.cc:492] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:51.710688  1251 leader_election.cc:290] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.707428  1246 ts_tablet_manager.cc:1403] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.004s
I20260709 13:11:51.711437  1245 ts_tablet_manager.cc:1403] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 13:11:51.715005  1248 tablet_bootstrap.cc:492] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:51.715811  1248 ts_tablet_manager.cc:1403] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.010s
I20260709 13:11:51.715081  1246 raft_consensus.cc:359] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.719816  1246 raft_consensus.cc:385] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.720144  1246 raft_consensus.cc:740] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.720897  1246 consensus_queue.cc:260] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.722930  1246 ts_tablet_manager.cc:1434] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:11:51.723762  1246 tablet_bootstrap.cc:492] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:51.727321  1248 raft_consensus.cc:359] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.727586  1245 raft_consensus.cc:359] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.728181  1248 raft_consensus.cc:385] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.728406  1245 raft_consensus.cc:385] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.728637  1248 raft_consensus.cc:740] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.728796  1245 raft_consensus.cc:740] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.729512  1248 consensus_queue.cc:260] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.729619  1245 consensus_queue.cc:260] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.731768  1248 ts_tablet_manager.cc:1434] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:11:51.728003   954 catalog_manager.cc:5697] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "791b04a8e9d14243b2bf72a5792f4a54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.732025  1245 ts_tablet_manager.cc:1434] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:11:51.732846  1248 tablet_bootstrap.cc:492] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:51.733772  1245 tablet_bootstrap.cc:492] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:51.743713  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4126deadcedd4e2896ec44d2c373749e" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:51.744504  1245 tablet_bootstrap.cc:654] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.742532  1252 raft_consensus.cc:493] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.745137  1246 tablet_bootstrap.cc:654] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.745183  1252 raft_consensus.cc:515] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.749591  1248 tablet_bootstrap.cc:654] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.744525  1056 raft_consensus.cc:2468] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 0.
I20260709 13:11:51.751541  1095 leader_election.cc:304] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:51.754539  1252 leader_election.cc:290] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.755321  1251 raft_consensus.cc:2804] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:51.755931  1251 raft_consensus.cc:493] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.756388  1251 raft_consensus.cc:3060] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.772974  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4126deadcedd4e2896ec44d2c373749e" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
W20260709 13:11:51.775252  1095 leader_election.cc:343] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.775897  1246 tablet_bootstrap.cc:492] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:51.776522  1246 ts_tablet_manager.cc:1403] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.005s
I20260709 13:11:51.779588  1246 raft_consensus.cc:359] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:51.780380  1246 raft_consensus.cc:385] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.780669  1246 raft_consensus.cc:740] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.781391  1246 consensus_queue.cc:260] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:51.785940  1251 raft_consensus.cc:515] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.790233  1246 ts_tablet_manager.cc:1434] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:11:51.791872  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df084483bce74b11a9e2bc379be7e47b" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
W20260709 13:11:51.792551  1001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:51.792217  1246 tablet_bootstrap.cc:492] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
W20260709 13:11:51.793411  1020 leader_election.cc:343] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.799036  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4126deadcedd4e2896ec44d2c373749e" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:51.799809  1056 raft_consensus.cc:3060] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.800403  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4126deadcedd4e2896ec44d2c373749e" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
W20260709 13:11:51.801759  1095 leader_election.cc:343] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.804790  1248 tablet_bootstrap.cc:492] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:51.805478  1248 ts_tablet_manager.cc:1403] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.010s
I20260709 13:11:51.805729  1251 leader_election.cc:290] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.807518  1056 raft_consensus.cc:2468] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 1.
I20260709 13:11:51.808300  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df084483bce74b11a9e2bc379be7e47b" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:51.809003  1130 raft_consensus.cc:2468] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:51.808946  1251 raft_consensus.cc:493] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.810034  1251 raft_consensus.cc:515] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:51.810264  1248 raft_consensus.cc:359] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.810520  1019 leader_election.cc:304] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:51.808840  1246 tablet_bootstrap.cc:654] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.811365  1245 tablet_bootstrap.cc:492] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:51.811988  1252 raft_consensus.cc:2804] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:51.812610  1252 raft_consensus.cc:493] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.812630  1251 leader_election.cc:290] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705), 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573)
I20260709 13:11:51.812944  1252 raft_consensus.cc:3060] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.808840  1095 leader_election.cc:304] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:51.812033  1245 ts_tablet_manager.cc:1403] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.021s
I20260709 13:11:51.816951  1246 tablet_bootstrap.cc:492] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:51.817589  1246 ts_tablet_manager.cc:1403] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.001s
I20260709 13:11:51.817380  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb092e0a7a844c0799648a4e60e66661" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:51.818109  1245 raft_consensus.cc:359] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.818915  1245 raft_consensus.cc:385] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.819227  1245 raft_consensus.cc:740] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.819768  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb092e0a7a844c0799648a4e60e66661" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:51.820057  1248 raft_consensus.cc:385] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.820393  1248 raft_consensus.cc:740] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.820457  1056 raft_consensus.cc:2468] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 0.
W20260709 13:11:51.819276  1095 leader_election.cc:343] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.821527  1252 raft_consensus.cc:515] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.821573  1245 consensus_queue.cc:260] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.821318  1248 consensus_queue.cc:260] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.822715  1095 leader_election.cc:304] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:51.824175  1251 raft_consensus.cc:2804] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:51.824779  1248 ts_tablet_manager.cc:1434] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:11:51.825999  1248 tablet_bootstrap.cc:492] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:51.832484  1248 tablet_bootstrap.cc:654] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.834267  1251 raft_consensus.cc:697] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:51.835649  1251 consensus_queue.cc:237] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.821308  1246 raft_consensus.cc:359] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.841313  1246 raft_consensus.cc:385] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.841743  1246 raft_consensus.cc:740] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.842918  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df084483bce74b11a9e2bc379be7e47b" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:51.843580  1130 raft_consensus.cc:3060] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.843990  1246 consensus_queue.cc:260] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.843541  1252 leader_election.cc:290] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.846915  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df084483bce74b11a9e2bc379be7e47b" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:51.847519  1277 raft_consensus.cc:2804] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:51.847985  1277 raft_consensus.cc:493] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.848301  1277 raft_consensus.cc:3060] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:51.848435  1020 leader_election.cc:343] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.857446  1130 raft_consensus.cc:2468] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:51.860396  1278 raft_consensus.cc:493] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.861116  1278 raft_consensus.cc:515] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.864988  1281 raft_consensus.cc:493] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.865111  1019 leader_election.cc:304] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:51.858121  1277 raft_consensus.cc:515] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:51.865692  1281 raft_consensus.cc:515] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.866425  1252 raft_consensus.cc:2804] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:51.867049  1252 raft_consensus.cc:697] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:51.868142  1252 consensus_queue.cc:237] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.868839  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb092e0a7a844c0799648a4e60e66661" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:51.870983  1281 leader_election.cc:290] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.874670  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af0f71d7d7843f797565fe08cfeb65e" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:51.875630  1056 raft_consensus.cc:2468] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 0.
I20260709 13:11:51.875751  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af0f71d7d7843f797565fe08cfeb65e" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:51.877667  1280 raft_consensus.cc:493] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:51.877830  1095 leader_election.cc:343] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.878473  1280 raft_consensus.cc:515] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
W20260709 13:11:51.878989  1095 leader_election.cc:343] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.880106  1095 leader_election.cc:304] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:51.881703  1281 raft_consensus.cc:2804] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:51.882095  1281 raft_consensus.cc:493] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.882156  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5cceb435424717adbb505c0c94eec8" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:51.882527  1281 raft_consensus.cc:3060] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.883733  1246 ts_tablet_manager.cc:1434] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.066s	user 0.012s	sys 0.005s
W20260709 13:11:51.883884  1019 leader_election.cc:343] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.885489  1246 tablet_bootstrap.cc:492] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:51.888490  1277 leader_election.cc:290] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Requested vote from peers 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705), 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573)
I20260709 13:11:51.891008  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb092e0a7a844c0799648a4e60e66661" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:51.891899  1056 raft_consensus.cc:3060] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.896044  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5cceb435424717adbb505c0c94eec8" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:51.897017  1205 raft_consensus.cc:2468] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:51.898761  1020 leader_election.cc:304] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:51.900015  1252 raft_consensus.cc:2804] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:51.900507  1252 raft_consensus.cc:493] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.900918  1252 raft_consensus.cc:3060] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.912091  1280 leader_election.cc:290] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.919274  1248 tablet_bootstrap.cc:492] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:51.919981  1248 ts_tablet_manager.cc:1403] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.094s	user 0.045s	sys 0.035s
I20260709 13:11:51.920161  1245 ts_tablet_manager.cc:1434] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.105s	user 0.021s	sys 0.016s
I20260709 13:11:51.921172  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cdff375baf4e0ab50f38017273441a" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
W20260709 13:11:51.922832  1095 leader_election.cc:343] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.924742  1056 raft_consensus.cc:2468] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 1.
I20260709 13:11:51.925031  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cdff375baf4e0ab50f38017273441a" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:51.924614   951 catalog_manager.cc:5697] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.925801  1205 raft_consensus.cc:2468] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 0.
I20260709 13:11:51.926098  1095 leader_election.cc:304] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:51.926975  1245 tablet_bootstrap.cc:492] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:51.927775  1095 leader_election.cc:304] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:51.928640  1277 raft_consensus.cc:2804] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:51.928850  1276 raft_consensus.cc:2804] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:51.929152  1277 raft_consensus.cc:697] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:51.929369  1276 raft_consensus.cc:493] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.929806  1276 raft_consensus.cc:3060] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.930141  1277 consensus_queue.cc:237] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:51.930919  1278 leader_election.cc:290] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.932421  1280 raft_consensus.cc:493] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.932958  1280 raft_consensus.cc:515] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.936074  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70c0e21cb44923b248fa502083b885" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
W20260709 13:11:51.937474  1019 leader_election.cc:343] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.938314  1246 tablet_bootstrap.cc:654] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.940212  1252 raft_consensus.cc:515] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.943535  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5cceb435424717adbb505c0c94eec8" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:51.943239  1248 raft_consensus.cc:359] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.945161  1248 raft_consensus.cc:385] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:51.945916  1019 leader_election.cc:343] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.948575  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70c0e21cb44923b248fa502083b885" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:51.951925   951 catalog_manager.cc:5697] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 0 to 1, leader changed from <none> to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 1 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.952713  1205 raft_consensus.cc:2468] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:51.953922  1245 tablet_bootstrap.cc:654] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.954376  1020 leader_election.cc:304] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:51.949111  1280 leader_election.cc:290] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.950014  1276 raft_consensus.cc:515] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.950965  1281 raft_consensus.cc:515] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.960081  1280 raft_consensus.cc:2804] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:51.960556  1280 raft_consensus.cc:493] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.958580  1248 raft_consensus.cc:740] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.960888  1280 raft_consensus.cc:3060] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.961778  1248 consensus_queue.cc:260] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.962469  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cdff375baf4e0ab50f38017273441a" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:51.964105  1248 ts_tablet_manager.cc:1434] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
W20260709 13:11:51.965314  1095 leader_election.cc:343] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.966410  1276 leader_election.cc:290] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.967104  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af0f71d7d7843f797565fe08cfeb65e" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:51.967747  1056 raft_consensus.cc:3060] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.969105  1248 tablet_bootstrap.cc:492] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:51.970531  1281 leader_election.cc:290] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.972939  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cdff375baf4e0ab50f38017273441a" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:51.973572  1205 raft_consensus.cc:3060] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.975483  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af0f71d7d7843f797565fe08cfeb65e" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:51.976929  1246 tablet_bootstrap.cc:492] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:51.977468  1246 ts_tablet_manager.cc:1403] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.013s
I20260709 13:11:51.980393  1246 raft_consensus.cc:359] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.969563  1280 raft_consensus.cc:515] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
W20260709 13:11:51.981016  1095 leader_election.cc:343] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.981061  1246 raft_consensus.cc:385] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.982332  1246 raft_consensus.cc:740] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.981709  1056 raft_consensus.cc:2468] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 1.
I20260709 13:11:51.984956  1252 leader_election.cc:290] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.986151  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5cceb435424717adbb505c0c94eec8" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:51.986820  1204 raft_consensus.cc:3060] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:51.987622  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70c0e21cb44923b248fa502083b885" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
W20260709 13:11:51.989270  1019 leader_election.cc:343] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.992015  1245 tablet_bootstrap.cc:492] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:51.992559  1245 ts_tablet_manager.cc:1403] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.004s
I20260709 13:11:51.992938  1205 raft_consensus.cc:2468] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 1.
I20260709 13:11:51.995244  1245 raft_consensus.cc:359] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.995272  1280 leader_election.cc:290] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.996045  1245 raft_consensus.cc:385] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.998093  1245 raft_consensus.cc:740] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.998024  1095 leader_election.cc:304] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:51.999104  1281 raft_consensus.cc:2804] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:51.999065  1245 consensus_queue.cc:260] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:51.999722  1281 raft_consensus.cc:697] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:51.996402  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70c0e21cb44923b248fa502083b885" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:52.000547  1205 raft_consensus.cc:3060] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.000777  1281 consensus_queue.cc:237] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.001684  1245 ts_tablet_manager.cc:1434] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:52.002650  1245 tablet_bootstrap.cc:492] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:51.997087  1204 raft_consensus.cc:2468] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:51.995805   951 catalog_manager.cc:5697] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 0 to 1, leader changed from <none> to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 1 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.005885  1020 leader_election.cc:304] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.006708  1280 raft_consensus.cc:2804] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.007236  1280 raft_consensus.cc:697] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:52.007737  1205 raft_consensus.cc:2468] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:52.008069  1280 consensus_queue.cc:237] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.009069  1020 leader_election.cc:304] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.010427  1248 tablet_bootstrap.cc:654] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.010457  1252 raft_consensus.cc:2804] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.011052  1095 leader_election.cc:304] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:52.011201  1252 raft_consensus.cc:697] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:52.012547  1252 consensus_queue.cc:237] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.017884  1277 raft_consensus.cc:2804] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.018559  1277 raft_consensus.cc:697] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:52.018762  1248 tablet_bootstrap.cc:492] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:52.019456  1248 ts_tablet_manager.cc:1403] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.001s
I20260709 13:11:52.019549  1277 consensus_queue.cc:237] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.022912  1245 tablet_bootstrap.cc:654] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.022680  1248 raft_consensus.cc:359] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:52.023497  1248 raft_consensus.cc:385] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.023830  1248 raft_consensus.cc:740] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.024646  1248 consensus_queue.cc:260] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:52.026437   951 catalog_manager.cc:5697] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.027392  1248 ts_tablet_manager.cc:1434] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:52.028709  1248 tablet_bootstrap.cc:492] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:52.037894  1248 tablet_bootstrap.cc:654] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.039546  1276 raft_consensus.cc:493] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.040328  1276 raft_consensus.cc:515] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.044059  1276 leader_election.cc:290] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:51.983209  1246 consensus_queue.cc:260] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.045997  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:52.046430  1246 ts_tablet_manager.cc:1434] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:11:52.046823  1056 raft_consensus.cc:2468] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 0.
I20260709 13:11:52.047506  1246 tablet_bootstrap.cc:492] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:52.049218  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:52.050518  1095 leader_election.cc:304] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:52.052140  1276 raft_consensus.cc:2804] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.052558  1276 raft_consensus.cc:493] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.052889  1276 raft_consensus.cc:3060] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:52.059422  1095 leader_election.cc:343] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:52.065099  1276 raft_consensus.cc:515] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.073765  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:52.074404  1056 raft_consensus.cc:3060] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.078987   954 catalog_manager.cc:5697] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.082938  1056 raft_consensus.cc:2468] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 1.
I20260709 13:11:52.084425  1095 leader_election.cc:304] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:52.085357  1277 raft_consensus.cc:2804] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.085865  1277 raft_consensus.cc:697] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:52.086697  1277 consensus_queue.cc:237] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.091401  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
W20260709 13:11:52.093495  1095 leader_election.cc:343] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:52.090317  1276 leader_election.cc:290] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:52.096179  1248 tablet_bootstrap.cc:492] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:52.096745  1248 ts_tablet_manager.cc:1403] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.032s
I20260709 13:11:52.094344  1246 tablet_bootstrap.cc:654] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.099944  1248 raft_consensus.cc:359] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.100745  1248 raft_consensus.cc:385] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.101061  1248 raft_consensus.cc:740] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.102398  1245 tablet_bootstrap.cc:492] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:52.103876  1245 ts_tablet_manager.cc:1403] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.101s	user 0.030s	sys 0.046s
I20260709 13:11:52.104107   951 catalog_manager.cc:5697] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 0 to 1, leader changed from <none> to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 1 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.105681   951 catalog_manager.cc:5697] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 0 to 1, leader changed from <none> to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 1 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.106032  1245 raft_consensus.cc:359] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.101977  1248 consensus_queue.cc:260] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.106652  1245 raft_consensus.cc:385] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.107072  1245 raft_consensus.cc:740] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.107820  1245 consensus_queue.cc:260] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.109129  1248 ts_tablet_manager.cc:1434] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:11:52.109860  1245 ts_tablet_manager.cc:1434] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:11:52.110567  1248 tablet_bootstrap.cc:492] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:52.111996  1246 tablet_bootstrap.cc:492] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:52.112493  1246 ts_tablet_manager.cc:1403] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 13:11:52.115382  1246 raft_consensus.cc:359] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.116343  1246 raft_consensus.cc:385] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.116639  1246 raft_consensus.cc:740] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.117345  1246 consensus_queue.cc:260] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.118628  1248 tablet_bootstrap.cc:654] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.119256  1246 ts_tablet_manager.cc:1434] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:52.125626  1248 tablet_bootstrap.cc:492] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:52.126250  1248 ts_tablet_manager.cc:1403] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:11:52.128968  1248 raft_consensus.cc:359] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.129674  1248 raft_consensus.cc:385] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.129948  1248 raft_consensus.cc:740] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.130614  1248 consensus_queue.cc:260] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.132694  1248 ts_tablet_manager.cc:1434] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:11:52.134142  1248 tablet_bootstrap.cc:492] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:52.139590  1248 tablet_bootstrap.cc:654] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.144155  1248 tablet_bootstrap.cc:492] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:52.144682  1248 ts_tablet_manager.cc:1403] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:11:52.143776   952 catalog_manager.cc:5697] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 0 to 1, leader changed from <none> to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 1 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.147228  1248 raft_consensus.cc:359] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.147953  1248 raft_consensus.cc:385] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.148269  1248 raft_consensus.cc:740] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.149061  1248 consensus_queue.cc:260] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.151219  1248 ts_tablet_manager.cc:1434] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:52.184311  1254 consensus_queue.cc:1048] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.196708  1254 consensus_queue.cc:1048] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.218896  1254 raft_consensus.cc:493] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.219525  1254 raft_consensus.cc:515] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.219880  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb092e0a7a844c0799648a4e60e66661"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
mode: GRACEFUL
new_leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
 from {username='slave'} at 127.0.0.1:37770
I20260709 13:11:52.220614  1130 raft_consensus.cc:606] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Received request to transfer leadership to TS 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:52.221946  1254 leader_election.cc:290] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:52.222345  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df084483bce74b11a9e2bc379be7e47b" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:52.222532  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df084483bce74b11a9e2bc379be7e47b" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:52.223325  1130 raft_consensus.cc:2393] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791b04a8e9d14243b2bf72a5792f4a54 in current term 1: Already voted for candidate 29ead33c064b4d25ba7dd2f540e91b41 in this term.
I20260709 13:11:52.224262  1168 leader_election.cc:304] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54; no voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.224963  1254 raft_consensus.cc:3060] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.226994  1277 raft_consensus.cc:493] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.227398  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
mode: GRACEFUL
new_leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
 from {username='slave'} at 127.0.0.1:37770
I20260709 13:11:52.227551  1277 raft_consensus.cc:515] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.228060  1130 raft_consensus.cc:606] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Received request to transfer leadership to TS 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:52.229719  1277 leader_election.cc:290] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:52.231287  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5cceb435424717adbb505c0c94eec8" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:52.231642  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5cceb435424717adbb505c0c94eec8" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:52.232471  1204 raft_consensus.cc:2393] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9de91bb9514190bf5545811a96bb4a in current term 1: Already voted for candidate 29ead33c064b4d25ba7dd2f540e91b41 in this term.
I20260709 13:11:52.233628  1262 raft_consensus.cc:493] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.233639  1095 leader_election.cc:304] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9de91bb9514190bf5545811a96bb4a; no voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:52.234215  1254 raft_consensus.cc:2749] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.234308  1262 raft_consensus.cc:515] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.235014  1277 raft_consensus.cc:3060] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.236747  1262 leader_election.cc:290] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:52.236802  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12cdff375baf4e0ab50f38017273441a"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
mode: GRACEFUL
new_leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
 from {username='slave'} at 127.0.0.1:37770
I20260709 13:11:52.237205  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4126deadcedd4e2896ec44d2c373749e" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:52.237573  1130 raft_consensus.cc:606] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Received request to transfer leadership to TS 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:52.237999  1056 raft_consensus.cc:2393] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791b04a8e9d14243b2bf72a5792f4a54 in current term 1: Already voted for candidate ab9de91bb9514190bf5545811a96bb4a in this term.
I20260709 13:11:52.238422  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4126deadcedd4e2896ec44d2c373749e" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:52.239722  1168 leader_election.cc:304] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54; no voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.240513  1262 raft_consensus.cc:3060] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.243002  1277 raft_consensus.cc:2749] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.246265  1262 raft_consensus.cc:2749] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.247941  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4126deadcedd4e2896ec44d2c373749e"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
mode: GRACEFUL
new_leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
 from {username='slave'} at 127.0.0.1:37770
I20260709 13:11:52.248533  1130 raft_consensus.cc:606] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Received request to transfer leadership to TS 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:52.264168  1204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39"
dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
mode: GRACEFUL
new_leader_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:54396
I20260709 13:11:52.264745  1204 raft_consensus.cc:606] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Received request to transfer leadership to TS ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.278494  1056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a70c0e21cb44923b248fa502083b885"
dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
mode: GRACEFUL
new_leader_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:58024
I20260709 13:11:52.279096  1056 raft_consensus.cc:606] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Received request to transfer leadership to TS ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.284466  1056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df084483bce74b11a9e2bc379be7e47b"
dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
mode: GRACEFUL
new_leader_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:58024
I20260709 13:11:52.285005  1056 raft_consensus.cc:606] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Received request to transfer leadership to TS ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.289139  1252 consensus_queue.cc:1048] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.290931  1056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c5cceb435424717adbb505c0c94eec8"
dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
mode: GRACEFUL
new_leader_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
 from {username='slave'} at 127.0.0.1:58024
I20260709 13:11:52.291610  1056 raft_consensus.cc:606] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Received request to transfer leadership to TS 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:52.296672  1280 raft_consensus.cc:993] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41: : Instructing follower ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:52.297185  1280 raft_consensus.cc:1081] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Signalling peer ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:52.299691  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df084483bce74b11a9e2bc379be7e47b"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:37764
I20260709 13:11:52.300351  1131 raft_consensus.cc:493] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:52.300756  1131 raft_consensus.cc:3060] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.304435  1308 consensus_queue.cc:1048] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.309725  1131 raft_consensus.cc:515] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.313520  1131 leader_election.cc:290] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:52.314206  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df084483bce74b11a9e2bc379be7e47b" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:52.314955  1056 raft_consensus.cc:3055] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.315317  1056 raft_consensus.cc:740] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:52.315410  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df084483bce74b11a9e2bc379be7e47b" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:52.316144  1204 raft_consensus.cc:3060] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.316205  1056 consensus_queue.cc:260] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.317458  1056 raft_consensus.cc:3060] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.323308  1204 raft_consensus.cc:2468] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:52.324448  1262 raft_consensus.cc:493] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.324569  1095 leader_election.cc:304] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:52.324862  1056 raft_consensus.cc:2468] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:52.325275  1262 raft_consensus.cc:515] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.325626  1277 raft_consensus.cc:2804] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.327607  1277 raft_consensus.cc:697] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:52.328380  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af0f71d7d7843f797565fe08cfeb65e" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:52.328693  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af0f71d7d7843f797565fe08cfeb65e" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:52.329397  1055 raft_consensus.cc:2393] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791b04a8e9d14243b2bf72a5792f4a54 in current term 1: Already voted for candidate ab9de91bb9514190bf5545811a96bb4a in this term.
I20260709 13:11:52.329118  1276 consensus_queue.cc:1048] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.330260  1262 leader_election.cc:290] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:52.330704  1169 leader_election.cc:304] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54; no voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.328491  1277 consensus_queue.cc:237] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.335081  1262 raft_consensus.cc:3060] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.339255  1277 raft_consensus.cc:993] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a: : Instructing follower 29ead33c064b4d25ba7dd2f540e91b41 to start an election
I20260709 13:11:52.339978  1204 raft_consensus.cc:3060] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.343456  1282 raft_consensus.cc:1081] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Signalling peer 29ead33c064b4d25ba7dd2f540e91b41 to start an election
I20260709 13:11:52.342712   952 catalog_manager.cc:5697] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 1 to 2, leader changed from 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129) to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 2 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.345156  1262 raft_consensus.cc:2749] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.345397  1056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4126deadcedd4e2896ec44d2c373749e"
dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
 from {username='slave'} at 127.0.0.1:58022
I20260709 13:11:52.346050  1056 raft_consensus.cc:493] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:52.346428  1056 raft_consensus.cc:3060] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.350864  1282 consensus_queue.cc:1048] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.355124  1282 consensus_queue.cc:1048] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.357582  1056 raft_consensus.cc:515] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.361425  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4126deadcedd4e2896ec44d2c373749e" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:52.361984  1056 leader_election.cc:290] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:52.362062  1205 raft_consensus.cc:3060] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.364148  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4126deadcedd4e2896ec44d2c373749e" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:52.364769  1131 raft_consensus.cc:3055] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.365090  1131 raft_consensus.cc:740] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:52.368818  1131 consensus_queue.cc:260] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.369997  1131 raft_consensus.cc:3060] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.370373  1205 raft_consensus.cc:2468] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 2.
I20260709 13:11:52.371762  1020 leader_election.cc:304] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: 
I20260709 13:11:52.372686  1308 raft_consensus.cc:2804] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.373138  1308 raft_consensus.cc:697] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:52.373952  1308 consensus_queue.cc:237] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.377305  1204 raft_consensus.cc:1240] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Rejecting Update request from peer ab9de91bb9514190bf5545811a96bb4a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:11:52.382261   952 catalog_manager.cc:5697] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 1 to 2, leader changed from ab9de91bb9514190bf5545811a96bb4a (127.19.231.130) to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.377786  1252 raft_consensus.cc:493] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.378526  1282 consensus_queue.cc:1048] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.383764  1252 raft_consensus.cc:515] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.388509  1131 raft_consensus.cc:2468] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 2.
I20260709 13:11:52.390112  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cdff375baf4e0ab50f38017273441a" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:52.393141  1252 leader_election.cc:290] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:52.393353  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cdff375baf4e0ab50f38017273441a" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:52.394585  1205 raft_consensus.cc:2393] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29ead33c064b4d25ba7dd2f540e91b41 in current term 1: Already voted for candidate ab9de91bb9514190bf5545811a96bb4a in this term.
I20260709 13:11:52.395704  1020 leader_election.cc:304] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41; no voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.396515  1252 raft_consensus.cc:3060] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.402349  1282 consensus_queue.cc:1048] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.403347  1251 raft_consensus.cc:993] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a: : Instructing follower 29ead33c064b4d25ba7dd2f540e91b41 to start an election
I20260709 13:11:52.403905  1282 raft_consensus.cc:1081] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Signalling peer 29ead33c064b4d25ba7dd2f540e91b41 to start an election
I20260709 13:11:52.405252  1252 raft_consensus.cc:2749] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.407330  1056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb092e0a7a844c0799648a4e60e66661"
dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
 from {username='slave'} at 127.0.0.1:58022
I20260709 13:11:52.408038  1056 raft_consensus.cc:493] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:52.408433  1056 raft_consensus.cc:3060] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.415359  1251 consensus_queue.cc:1048] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.416150  1056 raft_consensus.cc:515] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:52.418848  1056 leader_election.cc:290] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:52.419588  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb092e0a7a844c0799648a4e60e66661" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:52.420047  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb092e0a7a844c0799648a4e60e66661" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:52.420264  1131 raft_consensus.cc:3055] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.420630  1131 raft_consensus.cc:740] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:52.420660  1204 raft_consensus.cc:3060] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.421698  1131 consensus_queue.cc:260] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:52.423216  1131 raft_consensus.cc:3060] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.429733  1204 raft_consensus.cc:2468] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 2.
I20260709 13:11:52.431083  1020 leader_election.cc:304] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: 
I20260709 13:11:52.431871  1131 raft_consensus.cc:2468] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 2.
I20260709 13:11:52.432034  1252 raft_consensus.cc:2804] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.432654  1252 raft_consensus.cc:697] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:52.433287  1252 consensus_queue.cc:237] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } }
I20260709 13:11:52.440716   952 catalog_manager.cc:5697] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 1 to 2, leader changed from ab9de91bb9514190bf5545811a96bb4a (127.19.231.130) to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.491935  1282 consensus_queue.cc:1048] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.498492  1252 consensus_queue.cc:1048] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.499241  1251 raft_consensus.cc:993] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a: : Instructing follower 29ead33c064b4d25ba7dd2f540e91b41 to start an election
I20260709 13:11:52.499843  1251 raft_consensus.cc:1081] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Signalling peer 29ead33c064b4d25ba7dd2f540e91b41 to start an election
I20260709 13:11:52.505940  1056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12cdff375baf4e0ab50f38017273441a"
dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
 from {username='slave'} at 127.0.0.1:58022
I20260709 13:11:52.506642  1056 raft_consensus.cc:493] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:52.507174  1056 raft_consensus.cc:3060] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.511668  1282 consensus_queue.cc:1048] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.513444  1280 consensus_queue.cc:1048] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.520761  1056 raft_consensus.cc:515] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.525003  1282 raft_consensus.cc:493] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.525627  1282 raft_consensus.cc:515] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.527815  1282 leader_election.cc:290] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:52.529762  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70c0e21cb44923b248fa502083b885" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:52.530750  1203 raft_consensus.cc:2393] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9de91bb9514190bf5545811a96bb4a in current term 1: Already voted for candidate 29ead33c064b4d25ba7dd2f540e91b41 in this term.
I20260709 13:11:52.531828  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70c0e21cb44923b248fa502083b885" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:52.534642  1095 leader_election.cc:304] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9de91bb9514190bf5545811a96bb4a; no voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:52.536774  1282 raft_consensus.cc:3060] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.537917  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cdff375baf4e0ab50f38017273441a" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:52.538632  1131 raft_consensus.cc:3055] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.539026  1131 raft_consensus.cc:740] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:52.539898  1131 consensus_queue.cc:260] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.540904  1131 raft_consensus.cc:3060] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.547083  1280 raft_consensus.cc:993] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41: : Instructing follower 791b04a8e9d14243b2bf72a5792f4a54 to start an election
I20260709 13:11:52.547693  1280 raft_consensus.cc:1081] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Signalling peer 791b04a8e9d14243b2bf72a5792f4a54 to start an election
I20260709 13:11:52.548272  1282 raft_consensus.cc:2749] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.549682  1205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c5cceb435424717adbb505c0c94eec8"
dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
 from {username='slave'} at 127.0.0.1:54388
I20260709 13:11:52.550357  1205 raft_consensus.cc:493] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:52.549610  1056 leader_election.cc:290] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:52.550776  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cdff375baf4e0ab50f38017273441a" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:52.551183  1131 raft_consensus.cc:2468] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 2.
I20260709 13:11:52.552757  1019 leader_election.cc:304] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:52.550771  1205 raft_consensus.cc:3060] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.553664  1287 raft_consensus.cc:2804] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.554232  1287 raft_consensus.cc:697] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:52.555224  1287 consensus_queue.cc:237] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.559887  1205 raft_consensus.cc:515] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.562023  1205 leader_election.cc:290] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 2 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:52.563146  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5cceb435424717adbb505c0c94eec8" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:52.563903  1131 raft_consensus.cc:3060] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.563234   952 catalog_manager.cc:5697] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 1 to 2, leader changed from ab9de91bb9514190bf5545811a96bb4a (127.19.231.130) to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.567149  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5cceb435424717adbb505c0c94eec8" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:52.567763  1056 raft_consensus.cc:3055] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.568087  1056 raft_consensus.cc:740] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:52.568245  1205 raft_consensus.cc:3060] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.569096  1056 consensus_queue.cc:260] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.570696  1056 raft_consensus.cc:3060] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.571188  1131 raft_consensus.cc:2468] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 2.
I20260709 13:11:52.572487  1168 leader_election.cc:304] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:52.573279  1254 raft_consensus.cc:2804] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.575793  1287 consensus_queue.cc:1048] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.581730  1056 raft_consensus.cc:2468] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 2.
I20260709 13:11:52.582358  1262 raft_consensus.cc:493] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.582996  1262 raft_consensus.cc:515] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.583796  1282 consensus_queue.cc:1048] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.584908  1254 raft_consensus.cc:697] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 LEADER]: Becoming Leader. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Running, Role: LEADER
I20260709 13:11:52.585884  1254 consensus_queue.cc:237] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.590941  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:52.594007  1262 leader_election.cc:290] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:52.594915  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:52.595640  1056 raft_consensus.cc:2468] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 1.
I20260709 13:11:52.596801  1169 leader_election.cc:304] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.598591  1254 raft_consensus.cc:2804] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:52.599005  1254 raft_consensus.cc:493] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab9de91bb9514190bf5545811a96bb4a)
I20260709 13:11:52.599351  1254 raft_consensus.cc:3060] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.599530   952 catalog_manager.cc:5697] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 reported cstate change: term changed from 1 to 2, leader changed from 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129) to 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131). New cstate: current_term: 2 leader_uuid: "791b04a8e9d14243b2bf72a5792f4a54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.609196  1287 consensus_queue.cc:1048] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.614205  1254 raft_consensus.cc:515] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.614399  1276 consensus_queue.cc:1048] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.616389  1203 raft_consensus.cc:1240] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Rejecting Update request from peer ab9de91bb9514190bf5545811a96bb4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:52.622031  1254 leader_election.cc:290] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 2 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:52.623291  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:52.625284  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:52.625878  1276 consensus_queue.cc:1059] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.626974  1276 raft_consensus.cc:3055] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.627313  1276 raft_consensus.cc:740] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:52.628155  1276 consensus_queue.cc:260] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.628523  1168 leader_election.cc:304] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54; no voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:52.632228  1262 raft_consensus.cc:2749] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:52.633561  1276 raft_consensus.cc:3060] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.636447  1280 raft_consensus.cc:993] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41: : Instructing follower ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:52.636579  1254 raft_consensus.cc:993] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54: : Instructing follower ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:52.637024  1287 raft_consensus.cc:1081] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Signalling peer ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:52.637128  1320 raft_consensus.cc:1081] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Signalling peer ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:52.639040  1130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:37756
I20260709 13:11:52.639618  1130 raft_consensus.cc:493] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:52.640013  1130 raft_consensus.cc:3060] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.640741  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a70c0e21cb44923b248fa502083b885"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:37764
I20260709 13:11:52.641299  1131 raft_consensus.cc:493] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:52.641664  1131 raft_consensus.cc:3060] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.649348  1131 raft_consensus.cc:515] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.652468  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70c0e21cb44923b248fa502083b885" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:52.652077  1130 raft_consensus.cc:515] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.655652  1131 leader_election.cc:290] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:52.655462  1056 raft_consensus.cc:3055] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.658098  1056 raft_consensus.cc:740] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:52.658028  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70c0e21cb44923b248fa502083b885" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:52.659715  1203 raft_consensus.cc:3060] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.660424  1130 leader_election.cc:290] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:52.660176  1056 consensus_queue.cc:260] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.661175  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:52.661511  1056 raft_consensus.cc:3060] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.661823  1055 raft_consensus.cc:3060] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.667390  1203 raft_consensus.cc:2468] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:52.669498  1056 raft_consensus.cc:2468] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:52.669543  1055 raft_consensus.cc:2468] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:52.670147  1095 leader_election.cc:304] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:52.671121  1276 raft_consensus.cc:2804] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.671648  1276 raft_consensus.cc:697] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:52.671700  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:52.671888  1095 leader_election.cc:304] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:52.672398  1203 raft_consensus.cc:3055] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.672837  1251 raft_consensus.cc:2804] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.672789  1203 raft_consensus.cc:740] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Running, Role: LEADER
I20260709 13:11:52.672618  1276 consensus_queue.cc:237] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.673416  1251 raft_consensus.cc:697] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:52.673863  1203 consensus_queue.cc:260] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.674220  1251 consensus_queue.cc:237] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:52.675303  1203 raft_consensus.cc:3060] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.682426  1203 raft_consensus.cc:2468] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:52.681675   951 catalog_manager.cc:5697] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 1 to 2, leader changed from 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129) to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 2 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.694846   951 catalog_manager.cc:5697] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 1 to 2, leader changed from 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131) to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 2 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.784368  1203 raft_consensus.cc:1275] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Refusing update from remote peer 29ead33c064b4d25ba7dd2f540e91b41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.785573  1287 consensus_queue.cc:1048] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.801123  1130 raft_consensus.cc:1275] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Refusing update from remote peer 29ead33c064b4d25ba7dd2f540e91b41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.804276  1280 consensus_queue.cc:1048] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.812129  1203 raft_consensus.cc:1275] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.813544  1251 consensus_queue.cc:1048] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.819269  1205 raft_consensus.cc:1275] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Refusing update from remote peer 29ead33c064b4d25ba7dd2f540e91b41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.820773  1280 consensus_queue.cc:1048] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.825258  1056 raft_consensus.cc:1275] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.826583  1276 consensus_queue.cc:1048] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.840076  1130 raft_consensus.cc:1275] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Refusing update from remote peer 29ead33c064b4d25ba7dd2f540e91b41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.842311  1280 consensus_queue.cc:1048] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.982626  1056 raft_consensus.cc:1275] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Refusing update from remote peer 791b04a8e9d14243b2bf72a5792f4a54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.984086  1254 consensus_queue.cc:1048] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.992451  1130 raft_consensus.cc:1275] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Refusing update from remote peer 791b04a8e9d14243b2bf72a5792f4a54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.994360  1320 consensus_queue.cc:1048] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.999485  1131 raft_consensus.cc:1275] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Refusing update from remote peer 29ead33c064b4d25ba7dd2f540e91b41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:53.001609  1280 consensus_queue.cc:1048] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:53.009301  1205 raft_consensus.cc:3060] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:53.017148  1205 raft_consensus.cc:1275] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Refusing update from remote peer 29ead33c064b4d25ba7dd2f540e91b41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:53.018540  1308 consensus_queue.cc:1048] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:53.084612  1205 raft_consensus.cc:1275] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:53.085879  1276 consensus_queue.cc:1048] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:53.093627  1056 raft_consensus.cc:1275] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:53.095675  1281 consensus_queue.cc:1048] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:53.160936  1205 raft_consensus.cc:1275] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:53.162397  1281 consensus_queue.cc:1048] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:53.169871  1056 raft_consensus.cc:1275] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:53.171721  1251 consensus_queue.cc:1048] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.118167  1308 raft_consensus.cc:493] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab9de91bb9514190bf5545811a96bb4a)
I20260709 13:11:54.118741  1308 raft_consensus.cc:515] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:54.120474  1308 leader_election.cc:290] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:54.121506  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:54.121454  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:54.122458  1130 raft_consensus.cc:2468] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 2.
I20260709 13:11:54.122577  1205 raft_consensus.cc:2393] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29ead33c064b4d25ba7dd2f540e91b41 in current term 2: Already voted for candidate 791b04a8e9d14243b2bf72a5792f4a54 in this term.
I20260709 13:11:54.123893  1019 leader_election.cc:304] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:54.124596  1308 raft_consensus.cc:2804] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:54.124984  1308 raft_consensus.cc:493] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab9de91bb9514190bf5545811a96bb4a)
I20260709 13:11:54.125346  1308 raft_consensus.cc:3060] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.131253  1308 raft_consensus.cc:515] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:54.132864  1308 leader_election.cc:290] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:54.133781  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:54.133816  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:54.134644  1205 raft_consensus.cc:2393] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 29ead33c064b4d25ba7dd2f540e91b41 in current term 2: Already voted for candidate 791b04a8e9d14243b2bf72a5792f4a54 in this term.
I20260709 13:11:54.139129  1130 raft_consensus.cc:2468] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 2.
I20260709 13:11:54.140309  1019 leader_election.cc:304] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:54.141041  1308 raft_consensus.cc:2804] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.141937  1308 raft_consensus.cc:697] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:54.143039  1308 consensus_queue.cc:237] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:54.149948   952 catalog_manager.cc:5697] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 1 to 2, leader changed from ab9de91bb9514190bf5545811a96bb4a (127.19.231.130) to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.434707  1254 raft_consensus.cc:493] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.435254  1254 raft_consensus.cc:515] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:54.436957  1254 leader_election.cc:290] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:54.437729  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:54.437908  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:54.438583  1130 raft_consensus.cc:2468] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 2.
I20260709 13:11:54.439941  1168 leader_election.cc:304] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:54.440708  1254 raft_consensus.cc:2804] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:54.441051  1254 raft_consensus.cc:493] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.441332  1254 raft_consensus.cc:3060] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.446632  1254 raft_consensus.cc:515] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:54.448391  1254 leader_election.cc:290] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 3 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:54.449405  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:54.449630  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ab6a4f40514e389c793cf077740c30" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:54.450332  1130 raft_consensus.cc:3060] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.456122  1130 raft_consensus.cc:2468] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 3.
I20260709 13:11:54.457115  1168 leader_election.cc:304] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:54.457854  1254 raft_consensus.cc:2804] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:54.458760  1254 raft_consensus.cc:697] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 3 LEADER]: Becoming Leader. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Running, Role: LEADER
I20260709 13:11:54.459522  1254 consensus_queue.cc:237] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:54.467121   952 catalog_manager.cc:5697] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 reported cstate change: term changed from 2 to 3, leader changed from 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129) to 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131). New cstate: current_term: 3 leader_uuid: "791b04a8e9d14243b2bf72a5792f4a54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.531347  1130 raft_consensus.cc:1240] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 3 FOLLOWER]: Rejecting Update request from peer 29ead33c064b4d25ba7dd2f540e91b41 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:54.532722  1308 consensus_queue.cc:1059] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.533401  1327 raft_consensus.cc:3055] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:54.533687  1327 raft_consensus.cc:740] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:54.534327  1327 consensus_queue.cc:260] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:54.535245  1327 raft_consensus.cc:3060] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.938148  1056 raft_consensus.cc:1275] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 3 FOLLOWER]: Refusing update from remote peer 791b04a8e9d14243b2bf72a5792f4a54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:54.938468  1056 pending_rounds.cc:85] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41: Aborting all ops after (but not including) 1
I20260709 13:11:54.938608  1056 pending_rounds.cc:107] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:54.938769  1056 raft_consensus.cc:2889] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:54.940258  1254 consensus_queue.cc:1048] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.950966  1130 raft_consensus.cc:1275] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 3 FOLLOWER]: Refusing update from remote peer 791b04a8e9d14243b2bf72a5792f4a54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:54.952638  1336 consensus_queue.cc:1048] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.318166   952 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51874:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:55.320528   952 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:55.369189  1044 tablet_service.cc:1511] Processing CreateTablet for tablet 890eeb71908f4a0ebdfc2d559b2556fc (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:55.370555  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890eeb71908f4a0ebdfc2d559b2556fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.370463  1113 tablet_service.cc:1511] Processing CreateTablet for tablet 890eeb71908f4a0ebdfc2d559b2556fc (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:55.371901  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890eeb71908f4a0ebdfc2d559b2556fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.373271  1045 tablet_service.cc:1511] Processing CreateTablet for tablet 27e26cbe994b4eb3a4da06808954924e (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:55.374660  1045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e26cbe994b4eb3a4da06808954924e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.375768  1191 tablet_service.cc:1511] Processing CreateTablet for tablet 890eeb71908f4a0ebdfc2d559b2556fc (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:55.377032  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890eeb71908f4a0ebdfc2d559b2556fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.381228  1115 tablet_service.cc:1511] Processing CreateTablet for tablet 27e26cbe994b4eb3a4da06808954924e (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:55.382691  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e26cbe994b4eb3a4da06808954924e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.384749  1117 tablet_service.cc:1511] Processing CreateTablet for tablet fd29287780344c8fbf06f5df2e33bc98 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:55.386111  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd29287780344c8fbf06f5df2e33bc98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.385874  1192 tablet_service.cc:1511] Processing CreateTablet for tablet 27e26cbe994b4eb3a4da06808954924e (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:55.387187  1192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e26cbe994b4eb3a4da06808954924e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.387789  1114 tablet_service.cc:1511] Processing CreateTablet for tablet a121fc5aa833417b8e9bb4c62fedff65 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:55.389109  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a121fc5aa833417b8e9bb4c62fedff65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.390000  1038 tablet_service.cc:1511] Processing CreateTablet for tablet fd29287780344c8fbf06f5df2e33bc98 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:55.391386  1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd29287780344c8fbf06f5df2e33bc98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.391043  1194 tablet_service.cc:1511] Processing CreateTablet for tablet fd29287780344c8fbf06f5df2e33bc98 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:55.392331  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd29287780344c8fbf06f5df2e33bc98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.408824  1040 tablet_service.cc:1511] Processing CreateTablet for tablet a121fc5aa833417b8e9bb4c62fedff65 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:55.410295  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a121fc5aa833417b8e9bb4c62fedff65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.415180  1195 tablet_service.cc:1511] Processing CreateTablet for tablet a121fc5aa833417b8e9bb4c62fedff65 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:55.416651  1195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a121fc5aa833417b8e9bb4c62fedff65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.417826  1046 tablet_service.cc:1511] Processing CreateTablet for tablet e9373fdc20d74ffcb36f10177518f53c (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:55.422235  1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9373fdc20d74ffcb36f10177518f53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.422560  1119 tablet_service.cc:1511] Processing CreateTablet for tablet e9373fdc20d74ffcb36f10177518f53c (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:55.423900  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9373fdc20d74ffcb36f10177518f53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.426501  1116 tablet_service.cc:1511] Processing CreateTablet for tablet c7abd3f0f55e4334a2301d81120014cf (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:55.428565  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7abd3f0f55e4334a2301d81120014cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.435817  1121 tablet_service.cc:1511] Processing CreateTablet for tablet d05d1743734640d7bfac270b387c4c69 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:55.437283  1121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05d1743734640d7bfac270b387c4c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.437651  1188 tablet_service.cc:1511] Processing CreateTablet for tablet c7abd3f0f55e4334a2301d81120014cf (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:55.438825  1192 tablet_service.cc:1511] Processing CreateTablet for tablet e9373fdc20d74ffcb36f10177518f53c (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:55.439219  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7abd3f0f55e4334a2301d81120014cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.440192  1192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9373fdc20d74ffcb36f10177518f53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.444419  1043 tablet_service.cc:1511] Processing CreateTablet for tablet c7abd3f0f55e4334a2301d81120014cf (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:55.445849  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7abd3f0f55e4334a2301d81120014cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.447811  1039 tablet_service.cc:1511] Processing CreateTablet for tablet d05d1743734640d7bfac270b387c4c69 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:55.457209  1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05d1743734640d7bfac270b387c4c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.460959  1193 tablet_service.cc:1511] Processing CreateTablet for tablet d05d1743734640d7bfac270b387c4c69 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:55.464026  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05d1743734640d7bfac270b387c4c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.484426  1042 tablet_service.cc:1511] Processing CreateTablet for tablet a1a32380fecc416b9a9ed2c10270b845 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:55.485888  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a32380fecc416b9a9ed2c10270b845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.490216  1119 tablet_service.cc:1511] Processing CreateTablet for tablet a1a32380fecc416b9a9ed2c10270b845 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:55.493044  1194 tablet_service.cc:1511] Processing CreateTablet for tablet a1a32380fecc416b9a9ed2c10270b845 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:55.494535  1041 tablet_service.cc:1511] Processing CreateTablet for tablet 638b02d6d70d49dfb30915251d3e1f84 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:55.495977  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 638b02d6d70d49dfb30915251d3e1f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.500778  1120 tablet_service.cc:1511] Processing CreateTablet for tablet 638b02d6d70d49dfb30915251d3e1f84 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:55.503037  1190 tablet_service.cc:1511] Processing CreateTablet for tablet 638b02d6d70d49dfb30915251d3e1f84 (DEFAULT_TABLE table=soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:55.505897  1120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 638b02d6d70d49dfb30915251d3e1f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.495957  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a32380fecc416b9a9ed2c10270b845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.518723  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a32380fecc416b9a9ed2c10270b845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.529829  1350 tablet_bootstrap.cc:492] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:55.531646  1349 tablet_bootstrap.cc:492] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:55.530493  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 638b02d6d70d49dfb30915251d3e1f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.541510  1351 tablet_bootstrap.cc:492] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:55.571941  1351 tablet_bootstrap.cc:654] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.581703  1349 tablet_bootstrap.cc:654] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.611402  1350 tablet_bootstrap.cc:654] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.624660  1351 tablet_bootstrap.cc:492] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:55.625314  1351 ts_tablet_manager.cc:1403] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.084s	user 0.003s	sys 0.012s
I20260709 13:11:55.628371  1351 raft_consensus.cc:359] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.633035  1351 raft_consensus.cc:385] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.633466  1351 raft_consensus.cc:740] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.634373  1351 consensus_queue.cc:260] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.639464  1349 tablet_bootstrap.cc:492] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:55.640174  1349 ts_tablet_manager.cc:1403] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.005s
I20260709 13:11:55.640179  1351 ts_tablet_manager.cc:1434] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:11:55.641770  1351 tablet_bootstrap.cc:492] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:55.642969  1350 tablet_bootstrap.cc:492] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:55.643620  1350 ts_tablet_manager.cc:1403] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.114s	user 0.016s	sys 0.001s
I20260709 13:11:55.643611  1349 raft_consensus.cc:359] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.644508  1349 raft_consensus.cc:385] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.644903  1349 raft_consensus.cc:740] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.645843  1349 consensus_queue.cc:260] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.647322  1350 raft_consensus.cc:359] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.648403  1350 raft_consensus.cc:385] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.648754  1350 raft_consensus.cc:740] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.649729  1350 consensus_queue.cc:260] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.648825  1351 tablet_bootstrap.cc:654] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.653591  1349 ts_tablet_manager.cc:1434] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:55.654841  1349 tablet_bootstrap.cc:492] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:55.652031  1350 ts_tablet_manager.cc:1434] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:11:55.658205  1350 tablet_bootstrap.cc:492] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:55.664994  1350 tablet_bootstrap.cc:654] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.665359  1351 tablet_bootstrap.cc:492] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:55.666004  1351 ts_tablet_manager.cc:1403] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:11:55.668674  1351 raft_consensus.cc:359] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.669428  1351 raft_consensus.cc:385] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.669751  1351 raft_consensus.cc:740] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.670502  1351 consensus_queue.cc:260] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.671756  1349 tablet_bootstrap.cc:654] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.672928  1351 ts_tablet_manager.cc:1434] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:55.674340  1351 tablet_bootstrap.cc:492] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:55.681432  1351 tablet_bootstrap.cc:654] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.694489  1351 tablet_bootstrap.cc:492] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:55.695139  1351 ts_tablet_manager.cc:1403] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:11:55.697162  1349 tablet_bootstrap.cc:492] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:55.697712  1349 ts_tablet_manager.cc:1403] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.009s
I20260709 13:11:55.698204  1351 raft_consensus.cc:359] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.699177  1351 raft_consensus.cc:385] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.699548  1351 raft_consensus.cc:740] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.700330  1351 consensus_queue.cc:260] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.701797  1350 tablet_bootstrap.cc:492] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:55.702310  1350 ts_tablet_manager.cc:1403] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.010s
I20260709 13:11:55.700510  1349 raft_consensus.cc:359] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.702661  1351 ts_tablet_manager.cc:1434] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:11:55.703060  1349 raft_consensus.cc:385] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.703418  1349 raft_consensus.cc:740] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.703909  1351 tablet_bootstrap.cc:492] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:55.704373  1349 consensus_queue.cc:260] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.705287  1350 raft_consensus.cc:359] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.706071  1350 raft_consensus.cc:385] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.706408  1350 raft_consensus.cc:740] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.706905  1349 ts_tablet_manager.cc:1434] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:11:55.707316  1350 consensus_queue.cc:260] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.708649  1349 tablet_bootstrap.cc:492] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:55.709904  1350 ts_tablet_manager.cc:1434] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:11:55.713032  1350 tablet_bootstrap.cc:492] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:55.713339  1351 tablet_bootstrap.cc:654] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.715974  1349 tablet_bootstrap.cc:654] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.726082  1350 tablet_bootstrap.cc:654] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.728467  1349 tablet_bootstrap.cc:492] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:55.728471  1351 tablet_bootstrap.cc:492] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:55.729128  1349 ts_tablet_manager.cc:1403] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:11:55.729288  1351 ts_tablet_manager.cc:1403] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.001s
I20260709 13:11:55.732144  1350 tablet_bootstrap.cc:492] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:55.732085  1349 raft_consensus.cc:359] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.732445  1351 raft_consensus.cc:359] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.732837  1350 ts_tablet_manager.cc:1403] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 13:11:55.732890  1349 raft_consensus.cc:385] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.733258  1351 raft_consensus.cc:385] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.733428  1349 raft_consensus.cc:740] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.733652  1351 raft_consensus.cc:740] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.734251  1349 consensus_queue.cc:260] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.736145  1350 raft_consensus.cc:359] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.734553  1351 consensus_queue.cc:260] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.736634  1349 ts_tablet_manager.cc:1434] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:55.738976  1351 ts_tablet_manager.cc:1434] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:11:55.739682  1349 tablet_bootstrap.cc:492] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:55.740113  1351 tablet_bootstrap.cc:492] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:55.736965  1350 raft_consensus.cc:385] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.744794  1350 raft_consensus.cc:740] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.745656  1350 consensus_queue.cc:260] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.747388  1351 tablet_bootstrap.cc:654] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.748116  1350 ts_tablet_manager.cc:1434] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:11:55.750761  1349 tablet_bootstrap.cc:654] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.754498  1350 tablet_bootstrap.cc:492] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:55.758767  1351 tablet_bootstrap.cc:492] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:55.759610  1351 ts_tablet_manager.cc:1403] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 13:11:55.761842  1350 tablet_bootstrap.cc:654] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.774400  1351 raft_consensus.cc:359] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.775444  1351 raft_consensus.cc:385] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.775758  1351 raft_consensus.cc:740] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.776435  1349 tablet_bootstrap.cc:492] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:55.777132  1349 ts_tablet_manager.cc:1403] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.016s
I20260709 13:11:55.776558  1351 consensus_queue.cc:260] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.777277  1350 tablet_bootstrap.cc:492] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:55.777909  1350 ts_tablet_manager.cc:1403] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
I20260709 13:11:55.778302  1327 raft_consensus.cc:493] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.779227  1351 ts_tablet_manager.cc:1434] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:11:55.778929  1327 raft_consensus.cc:515] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.780844  1350 raft_consensus.cc:359] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.781620  1350 raft_consensus.cc:385] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.781913  1350 raft_consensus.cc:740] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.782253  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd29287780344c8fbf06f5df2e33bc98" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:55.782619  1349 raft_consensus.cc:359] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.783169  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd29287780344c8fbf06f5df2e33bc98" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:55.782752  1350 consensus_queue.cc:260] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.783444  1349 raft_consensus.cc:385] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.783463  1327 leader_election.cc:290] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:55.783983  1349 raft_consensus.cc:740] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.783910  1130 raft_consensus.cc:2468] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:55.785583  1350 ts_tablet_manager.cc:1434] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:55.785449  1349 consensus_queue.cc:260] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.786368  1019 leader_election.cc:304] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:55.786736  1350 tablet_bootstrap.cc:492] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:55.782961  1203 raft_consensus.cc:2468] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:55.788327  1349 ts_tablet_manager.cc:1434] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:11:55.789047  1327 raft_consensus.cc:2804] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:55.789561  1349 tablet_bootstrap.cc:492] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:55.789530  1327 raft_consensus.cc:493] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.792104  1351 tablet_bootstrap.cc:492] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:55.792490  1327 raft_consensus.cc:3060] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.793392  1350 tablet_bootstrap.cc:654] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.798408  1349 tablet_bootstrap.cc:654] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.808952  1360 raft_consensus.cc:493] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.809798  1360 raft_consensus.cc:515] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.815657  1351 tablet_bootstrap.cc:654] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.815510  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9373fdc20d74ffcb36f10177518f53c" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:55.816263  1130 raft_consensus.cc:2468] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:55.817585  1019 leader_election.cc:304] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:55.818917  1360 leader_election.cc:290] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:55.823998  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9373fdc20d74ffcb36f10177518f53c" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
W20260709 13:11:55.827195  1020 leader_election.cc:343] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:55.831278  1360 raft_consensus.cc:2804] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:55.834690  1360 raft_consensus.cc:493] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.836090  1360 raft_consensus.cc:3060] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:55.837610  1001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:55.835970  1373 raft_consensus.cc:493] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.838083  1327 raft_consensus.cc:515] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.838723  1373 raft_consensus.cc:515] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.840584  1327 leader_election.cc:290] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:55.840973  1373 leader_election.cc:290] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:55.842830  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd29287780344c8fbf06f5df2e33bc98" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:55.843230  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121fc5aa833417b8e9bb4c62fedff65" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:55.843505  1130 raft_consensus.cc:3060] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.843988  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121fc5aa833417b8e9bb4c62fedff65" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
W20260709 13:11:55.844761  1019 leader_election.cc:343] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:55.844918  1205 raft_consensus.cc:2468] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:55.847211  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd29287780344c8fbf06f5df2e33bc98" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:55.848371  1203 raft_consensus.cc:3060] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.851109  1020 leader_election.cc:304] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:55.853341  1130 raft_consensus.cc:2468] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:55.854317  1373 raft_consensus.cc:2804] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:55.854866  1373 raft_consensus.cc:493] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.854707  1019 leader_election.cc:304] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:55.855374  1373 raft_consensus.cc:3060] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.854995  1360 raft_consensus.cc:515] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.855619  1203 raft_consensus.cc:2468] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:55.856130  1327 raft_consensus.cc:2804] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:55.858701  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9373fdc20d74ffcb36f10177518f53c" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:55.859207  1360 leader_election.cc:290] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:55.859761  1130 raft_consensus.cc:3060] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.859815  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9373fdc20d74ffcb36f10177518f53c" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:55.860358  1327 raft_consensus.cc:697] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
W20260709 13:11:55.862208  1020 leader_election.cc:343] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:55.858870  1351 tablet_bootstrap.cc:492] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:55.864122  1351 ts_tablet_manager.cc:1403] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.024s
I20260709 13:11:55.864530  1350 tablet_bootstrap.cc:492] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:55.865231  1350 ts_tablet_manager.cc:1403] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.026s
I20260709 13:11:55.862725  1327 consensus_queue.cc:237] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.866539  1349 tablet_bootstrap.cc:492] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:55.867347  1349 ts_tablet_manager.cc:1403] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.078s	user 0.030s	sys 0.007s
I20260709 13:11:55.868294  1350 raft_consensus.cc:359] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.869088  1350 raft_consensus.cc:385] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.869477  1350 raft_consensus.cc:740] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.870213  1349 raft_consensus.cc:359] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.870254  1350 consensus_queue.cc:260] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.871158  1349 raft_consensus.cc:385] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.871603  1349 raft_consensus.cc:740] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.868849  1351 raft_consensus.cc:359] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.872391  1351 raft_consensus.cc:385] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.872704  1351 raft_consensus.cc:740] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.873026  1350 ts_tablet_manager.cc:1434] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:11:55.872706  1349 consensus_queue.cc:260] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.874552  1351 consensus_queue.cc:260] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.875846  1349 ts_tablet_manager.cc:1434] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:55.877017  1349 tablet_bootstrap.cc:492] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:55.879043  1350 tablet_bootstrap.cc:492] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:55.877013  1351 ts_tablet_manager.cc:1434] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:11:55.885247  1351 tablet_bootstrap.cc:492] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:55.892140  1350 tablet_bootstrap.cc:654] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.890654  1349 tablet_bootstrap.cc:654] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.899370  1351 tablet_bootstrap.cc:654] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.900346  1130 raft_consensus.cc:2468] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:55.900599   954 catalog_manager.cc:5697] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:55.901789  1350 tablet_bootstrap.cc:492] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:55.902727  1373 raft_consensus.cc:515] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.903379  1350 ts_tablet_manager.cc:1403] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.005s
I20260709 13:11:55.904420  1349 tablet_bootstrap.cc:492] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:55.904954  1349 ts_tablet_manager.cc:1403] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.001s
I20260709 13:11:55.906065  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121fc5aa833417b8e9bb4c62fedff65" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:55.906703  1131 raft_consensus.cc:3060] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.906577  1350 raft_consensus.cc:359] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.907420  1350 raft_consensus.cc:385] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.907729  1350 raft_consensus.cc:740] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.908802  1349 raft_consensus.cc:359] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.909132  1350 consensus_queue.cc:260] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.909835  1349 raft_consensus.cc:385] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.910225  1349 raft_consensus.cc:740] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.911839  1350 ts_tablet_manager.cc:1434] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:11:55.911481  1349 consensus_queue.cc:260] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.914309  1349 ts_tablet_manager.cc:1434] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:11:55.915771  1349 tablet_bootstrap.cc:492] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:55.915952  1350 tablet_bootstrap.cc:492] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:55.917387  1351 tablet_bootstrap.cc:492] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:55.918032  1351 ts_tablet_manager.cc:1403] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.007s
I20260709 13:11:55.921705  1351 raft_consensus.cc:359] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.922103  1019 leader_election.cc:304] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:11:55.922562  1351 raft_consensus.cc:385] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.923035  1351 raft_consensus.cc:740] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.923178  1349 tablet_bootstrap.cc:654] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.923624  1327 raft_consensus.cc:2804] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:55.924185  1327 raft_consensus.cc:697] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:55.924045  1351 consensus_queue.cc:260] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.925144  1327 consensus_queue.cc:237] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.926671  1351 ts_tablet_manager.cc:1434] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:11:55.928874  1351 tablet_bootstrap.cc:492] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:55.933454  1350 tablet_bootstrap.cc:654] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.936425  1351 tablet_bootstrap.cc:654] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.943868  1374 raft_consensus.cc:493] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.944831  1374 raft_consensus.cc:515] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:55.952092  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121fc5aa833417b8e9bb4c62fedff65" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:55.957860  1203 raft_consensus.cc:3060] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.954824  1373 leader_election.cc:290] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:55.959431  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890eeb71908f4a0ebdfc2d559b2556fc" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:55.960300  1130 raft_consensus.cc:2468] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:55.961486  1374 leader_election.cc:290] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:55.967350  1019 leader_election.cc:304] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:55.973559  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890eeb71908f4a0ebdfc2d559b2556fc" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:55.974668  1205 raft_consensus.cc:2468] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:55.977656  1374 raft_consensus.cc:2804] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:55.978308  1374 raft_consensus.cc:493] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.978837  1374 raft_consensus.cc:3060] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.984035  1203 raft_consensus.cc:2468] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:55.993439  1020 leader_election.cc:304] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: 
I20260709 13:11:55.996425  1373 raft_consensus.cc:2804] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:55.997097  1373 raft_consensus.cc:697] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:56.000840  1336 raft_consensus.cc:493] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.001605  1336 raft_consensus.cc:515] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.005475  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e26cbe994b4eb3a4da06808954924e" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:56.006340  1056 raft_consensus.cc:2468] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 0.
I20260709 13:11:56.008303  1169 leader_election.cc:304] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: 
I20260709 13:11:56.009580  1354 raft_consensus.cc:2804] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.010124  1354 raft_consensus.cc:493] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.010581  1354 raft_consensus.cc:3060] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.998241  1373 consensus_queue.cc:237] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.024698  1336 leader_election.cc:290] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:56.027173  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e26cbe994b4eb3a4da06808954924e" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:56.028191  1130 raft_consensus.cc:2468] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 0.
I20260709 13:11:56.033239  1131 raft_consensus.cc:2468] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:56.033950  1360 raft_consensus.cc:493] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.034703  1360 raft_consensus.cc:515] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.038363  1360 leader_election.cc:290] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.040333  1336 raft_consensus.cc:493] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.042475  1277 raft_consensus.cc:493] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.044144  1336 raft_consensus.cc:515] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.065495  1350 tablet_bootstrap.cc:492] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:56.052084  1277 raft_consensus.cc:515] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.075467  1349 tablet_bootstrap.cc:492] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:56.076167  1349 ts_tablet_manager.cc:1403] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.161s	user 0.011s	sys 0.007s
I20260709 13:11:56.053356  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:56.079970  1349 raft_consensus.cc:359] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.087456  1349 raft_consensus.cc:385] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.088861  1349 raft_consensus.cc:740] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.068581  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:56.096308  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:56.097177  1056 raft_consensus.cc:2468] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 0.
I20260709 13:11:56.094725  1336 leader_election.cc:290] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:56.086705  1277 leader_election.cc:290] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.098681  1169 leader_election.cc:304] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: 
I20260709 13:11:56.090006  1349 consensus_queue.cc:260] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.088145  1350 ts_tablet_manager.cc:1403] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.175s	user 0.046s	sys 0.062s
I20260709 13:11:56.108350  1349 ts_tablet_manager.cc:1434] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:11:56.108949  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:56.110394  1360 raft_consensus.cc:493] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.110957  1360 raft_consensus.cc:515] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.111749  1350 raft_consensus.cc:359] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.112375  1350 raft_consensus.cc:385] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.102769  1203 raft_consensus.cc:2468] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:56.112875  1350 raft_consensus.cc:740] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.104029  1131 raft_consensus.cc:2468] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:56.113723  1020 leader_election.cc:304] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: 
I20260709 13:11:56.113786  1350 consensus_queue.cc:260] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.122320  1374 raft_consensus.cc:515] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.123368  1388 raft_consensus.cc:2804] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.125763  1388 raft_consensus.cc:493] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.126243  1388 raft_consensus.cc:3060] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.126286  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7abd3f0f55e4334a2301d81120014cf" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:56.127130  1205 raft_consensus.cc:2468] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:56.128103  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7abd3f0f55e4334a2301d81120014cf" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:56.128810  1056 raft_consensus.cc:2468] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 0.
I20260709 13:11:56.113951  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7abd3f0f55e4334a2301d81120014cf" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:56.118579  1336 raft_consensus.cc:2804] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.132709  1130 raft_consensus.cc:2468] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:56.134087  1350 ts_tablet_manager.cc:1434] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:11:56.133884  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7abd3f0f55e4334a2301d81120014cf" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:56.134418  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890eeb71908f4a0ebdfc2d559b2556fc" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:56.135022  1205 raft_consensus.cc:2468] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 0.
I20260709 13:11:56.135057  1131 raft_consensus.cc:3060] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.135288  1350 tablet_bootstrap.cc:492] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:56.113898  1360 leader_election.cc:290] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.112299  1354 raft_consensus.cc:515] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.146525  1336 raft_consensus.cc:493] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.149770  1351 tablet_bootstrap.cc:492] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:56.150400  1351 ts_tablet_manager.cc:1403] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.222s	user 0.011s	sys 0.011s
I20260709 13:11:56.151487  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e26cbe994b4eb3a4da06808954924e" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:56.152192  1129 raft_consensus.cc:3060] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.153458  1351 raft_consensus.cc:359] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.154166  1351 raft_consensus.cc:385] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.154422  1351 raft_consensus.cc:740] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.149891  1336 raft_consensus.cc:3060] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.159763  1019 leader_election.cc:304] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:56.161159  1373 raft_consensus.cc:2804] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.161574  1373 raft_consensus.cc:493] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.161898  1373 raft_consensus.cc:3060] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.150130  1354 leader_election.cc:290] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:56.165853  1095 leader_election.cc:304] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:56.166857  1277 raft_consensus.cc:2804] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.168263  1351 consensus_queue.cc:260] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.167327  1277 raft_consensus.cc:493] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.172695  1277 raft_consensus.cc:3060] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.172962  1129 raft_consensus.cc:2468] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 1.
I20260709 13:11:56.174245  1168 leader_election.cc:304] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:56.175156  1354 raft_consensus.cc:2804] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.175822  1354 raft_consensus.cc:697] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Becoming Leader. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Running, Role: LEADER
I20260709 13:11:56.176649  1354 consensus_queue.cc:237] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.151539  1349 tablet_bootstrap.cc:492] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:56.180526  1277 raft_consensus.cc:515] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.150084  1374 leader_election.cc:290] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.183274  1351 ts_tablet_manager.cc:1434] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:11:56.185185  1351 tablet_bootstrap.cc:492] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41: Bootstrap starting.
I20260709 13:11:56.190100  1373 raft_consensus.cc:515] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.194144  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7abd3f0f55e4334a2301d81120014cf" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:56.195070  1129 raft_consensus.cc:2393] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29ead33c064b4d25ba7dd2f540e91b41 in current term 1: Already voted for candidate ab9de91bb9514190bf5545811a96bb4a in this term.
I20260709 13:11:56.198635  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e26cbe994b4eb3a4da06808954924e" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:56.199314  1056 raft_consensus.cc:3060] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.202226  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890eeb71908f4a0ebdfc2d559b2556fc" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:56.197667  1131 raft_consensus.cc:2468] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:56.205423   951 catalog_manager.cc:5697] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "791b04a8e9d14243b2bf72a5792f4a54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.207418  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7abd3f0f55e4334a2301d81120014cf" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:56.207041  1205 raft_consensus.cc:3060] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.208089  1203 raft_consensus.cc:3060] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.198683  1277 leader_election.cc:290] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.207126  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7abd3f0f55e4334a2301d81120014cf" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:56.210024  1055 raft_consensus.cc:2393] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9de91bb9514190bf5545811a96bb4a in current term 1: Already voted for candidate 29ead33c064b4d25ba7dd2f540e91b41 in this term.
I20260709 13:11:56.211418  1350 tablet_bootstrap.cc:654] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.224221  1203 raft_consensus.cc:2468] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 1.
I20260709 13:11:56.226133  1095 leader_election.cc:304] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:56.227288  1277 raft_consensus.cc:2804] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.227818  1277 raft_consensus.cc:697] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:56.228719  1277 consensus_queue.cc:237] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.234359  1019 leader_election.cc:304] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:56.233492  1373 leader_election.cc:290] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.235756  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7abd3f0f55e4334a2301d81120014cf" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:56.236014  1373 raft_consensus.cc:2804] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.236800  1203 raft_consensus.cc:2393] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29ead33c064b4d25ba7dd2f540e91b41 in current term 1: Already voted for candidate ab9de91bb9514190bf5545811a96bb4a in this term.
I20260709 13:11:56.237202  1373 raft_consensus.cc:697] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:56.238133  1336 raft_consensus.cc:515] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.238178  1020 leader_election.cc:304] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41; no voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:56.247819  1327 raft_consensus.cc:2749] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.249778  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:56.240125  1388 raft_consensus.cc:515] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.250679  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:56.251185  1055 raft_consensus.cc:2393] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 791b04a8e9d14243b2bf72a5792f4a54 in current term 1: Already voted for candidate 29ead33c064b4d25ba7dd2f540e91b41 in this term.
I20260709 13:11:56.251362  1131 raft_consensus.cc:3060] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.249272  1373 consensus_queue.cc:237] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.240163  1349 tablet_bootstrap.cc:654] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.242437  1351 tablet_bootstrap.cc:654] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.252954  1327 raft_consensus.cc:493] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.253476  1327 raft_consensus.cc:515] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.255491  1336 leader_election.cc:290] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:56.245934  1205 raft_consensus.cc:2468] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:56.231632  1056 raft_consensus.cc:2468] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 1.
I20260709 13:11:56.255800  1327 leader_election.cc:290] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.257230  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638b02d6d70d49dfb30915251d3e1f84" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
W20260709 13:11:56.258878  1019 leader_election.cc:343] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.264524  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638b02d6d70d49dfb30915251d3e1f84" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
W20260709 13:11:56.266074  1020 leader_election.cc:343] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.269183  1020 leader_election.cc:304] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41; no voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:56.270342  1327 raft_consensus.cc:2749] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.280613  1388 leader_election.cc:290] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.280787  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:56.285748  1350 tablet_bootstrap.cc:492] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:56.286648  1350 ts_tablet_manager.cc:1403] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.152s	user 0.030s	sys 0.044s
I20260709 13:11:56.291003  1351 tablet_bootstrap.cc:492] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41: No bootstrap required, opened a new log
I20260709 13:11:56.291647  1351 ts_tablet_manager.cc:1403] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent bootstrapping tablet: real 0.107s	user 0.016s	sys 0.008s
I20260709 13:11:56.291422  1350 raft_consensus.cc:359] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.292251  1350 raft_consensus.cc:385] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.292562  1350 raft_consensus.cc:740] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.285749  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:56.293272  1350 consensus_queue.cc:260] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.294064  1205 raft_consensus.cc:2393] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29ead33c064b4d25ba7dd2f540e91b41 in current term 1: Already voted for candidate 791b04a8e9d14243b2bf72a5792f4a54 in this term.
I20260709 13:11:56.295531  1350 ts_tablet_manager.cc:1434] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:56.295444  1020 leader_election.cc:304] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41; no voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:56.297624  1350 tablet_bootstrap.cc:492] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54: Bootstrap starting.
I20260709 13:11:56.298259  1388 raft_consensus.cc:2749] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.298547  1349 tablet_bootstrap.cc:492] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:56.301530  1388 consensus_queue.cc:1048] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:56.304253  1350 tablet_bootstrap.cc:654] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.286087  1131 raft_consensus.cc:2468] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 1.
I20260709 13:11:56.313484  1168 leader_election.cc:304] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:56.313568  1351 raft_consensus.cc:359] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.314451  1351 raft_consensus.cc:385] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.314806  1351 raft_consensus.cc:740] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.314870  1336 raft_consensus.cc:2804] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.315418  1336 raft_consensus.cc:697] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Becoming Leader. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Running, Role: LEADER
I20260709 13:11:56.316272  1336 consensus_queue.cc:237] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.319793   953 catalog_manager.cc:5697] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 0 to 1, leader changed from <none> to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 1 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.315663  1351 consensus_queue.cc:260] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.329396  1349 ts_tablet_manager.cc:1403] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.178s	user 0.019s	sys 0.007s
I20260709 13:11:56.332329  1349 raft_consensus.cc:359] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.333011  1349 raft_consensus.cc:385] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.333268  1349 raft_consensus.cc:740] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.333920  1349 consensus_queue.cc:260] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.342846  1349 ts_tablet_manager.cc:1434] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:56.343853  1349 tablet_bootstrap.cc:492] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a: Bootstrap starting.
I20260709 13:11:56.346709  1336 raft_consensus.cc:493] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.347504  1336 raft_consensus.cc:515] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.351135  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9373fdc20d74ffcb36f10177518f53c" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:56.355355  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9373fdc20d74ffcb36f10177518f53c" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:56.356215  1131 raft_consensus.cc:2393] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791b04a8e9d14243b2bf72a5792f4a54 in current term 1: Already voted for candidate 29ead33c064b4d25ba7dd2f540e91b41 in this term.
I20260709 13:11:56.357455  1168 leader_election.cc:304] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54; no voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:56.358863  1354 raft_consensus.cc:3060] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.365012   954 catalog_manager.cc:5697] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.368104  1351 ts_tablet_manager.cc:1434] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 13:11:56.371337  1336 leader_election.cc:290] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:56.372993   954 catalog_manager.cc:5697] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.374895   954 catalog_manager.cc:5697] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.378532  1354 raft_consensus.cc:2749] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.375598  1350 tablet_bootstrap.cc:492] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54: No bootstrap required, opened a new log
I20260709 13:11:56.379827  1350 ts_tablet_manager.cc:1403] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent bootstrapping tablet: real 0.082s	user 0.037s	sys 0.015s
I20260709 13:11:56.383888  1388 consensus_queue.cc:1048] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:56.382694  1350 raft_consensus.cc:359] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.385701  1350 raft_consensus.cc:385] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.386386  1350 raft_consensus.cc:740] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.387461  1350 consensus_queue.cc:260] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.392444  1350 ts_tablet_manager.cc:1434] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:11:56.396456  1373 consensus_queue.cc:1048] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:56.401562  1349 tablet_bootstrap.cc:654] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.406674   951 catalog_manager.cc:5697] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "791b04a8e9d14243b2bf72a5792f4a54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.422680  1349 tablet_bootstrap.cc:492] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a: No bootstrap required, opened a new log
I20260709 13:11:56.423353  1349 ts_tablet_manager.cc:1403] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.005s
I20260709 13:11:56.432725  1349 raft_consensus.cc:359] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.433508  1349 raft_consensus.cc:385] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.433787  1349 raft_consensus.cc:740] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.440435  1349 consensus_queue.cc:260] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.442368  1374 consensus_queue.cc:1048] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:56.444984  1349 ts_tablet_manager.cc:1434] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:11:56.459090  1354 raft_consensus.cc:493] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.459690  1354 raft_consensus.cc:515] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.462991  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638b02d6d70d49dfb30915251d3e1f84" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41" is_pre_election: true
I20260709 13:11:56.462991  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638b02d6d70d49dfb30915251d3e1f84" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:56.463690  1056 raft_consensus.cc:2468] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 0.
I20260709 13:11:56.463726  1131 raft_consensus.cc:2468] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 0.
I20260709 13:11:56.465289  1168 leader_election.cc:304] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:56.466143  1336 raft_consensus.cc:2804] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.466516  1336 raft_consensus.cc:493] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.466854  1336 raft_consensus.cc:3060] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.469892  1354 leader_election.cc:290] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:56.477252  1336 raft_consensus.cc:515] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.481050  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638b02d6d70d49dfb30915251d3e1f84" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:56.481554  1056 raft_consensus.cc:3060] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.481709  1336 leader_election.cc:290] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:11:56.481949  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638b02d6d70d49dfb30915251d3e1f84" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:56.482659  1131 raft_consensus.cc:3060] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.488756  1056 raft_consensus.cc:2468] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 1.
I20260709 13:11:56.489988  1131 raft_consensus.cc:2468] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 1.
I20260709 13:11:56.490115  1169 leader_election.cc:304] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: 
I20260709 13:11:56.491119  1336 raft_consensus.cc:2804] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.491611  1336 raft_consensus.cc:697] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Becoming Leader. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Running, Role: LEADER
I20260709 13:11:56.492412  1336 consensus_queue.cc:237] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.501117   954 catalog_manager.cc:5697] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131). New cstate: current_term: 1 leader_uuid: "791b04a8e9d14243b2bf72a5792f4a54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.553821  1374 consensus_queue.cc:1048] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:56.570009  1373 consensus_queue.cc:1048] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:56.597743  1373 raft_consensus.cc:493] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.598234  1373 raft_consensus.cc:515] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.601079  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a32380fecc416b9a9ed2c10270b845" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a" is_pre_election: true
I20260709 13:11:56.601202  1373 leader_election.cc:290] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.601429  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a32380fecc416b9a9ed2c10270b845" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54" is_pre_election: true
I20260709 13:11:56.601816  1129 raft_consensus.cc:2468] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:56.602176  1203 raft_consensus.cc:2468] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 0.
I20260709 13:11:56.603122  1019 leader_election.cc:304] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:56.604001  1373 raft_consensus.cc:2804] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.604336  1373 raft_consensus.cc:493] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.604606  1373 raft_consensus.cc:3060] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.609674  1373 raft_consensus.cc:515] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.611658  1373 leader_election.cc:290] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.612685  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a32380fecc416b9a9ed2c10270b845" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:56.612973  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a32380fecc416b9a9ed2c10270b845" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:56.613384  1129 raft_consensus.cc:3060] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.613713  1203 raft_consensus.cc:3060] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.621143  1129 raft_consensus.cc:2468] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:56.622507  1019 leader_election.cc:304] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:56.622996  1203 raft_consensus.cc:2468] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 1.
I20260709 13:11:56.623327  1373 raft_consensus.cc:2804] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.623989  1373 raft_consensus.cc:697] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:56.624811  1373 consensus_queue.cc:237] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.633729   954 catalog_manager.cc:5697] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 1 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.710855  1277 consensus_queue.cc:1048] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:56.716023  1336 consensus_queue.cc:1048] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:56.724725  1277 consensus_queue.cc:1048] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:56.736637  1336 consensus_queue.cc:1048] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:56.742108  1354 consensus_queue.cc:1048] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:56.758579  1336 consensus_queue.cc:1048] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:56.761178  1390 consensus_queue.cc:1048] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:56.774008  1327 consensus_queue.cc:1048] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:56.824199  1203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27e26cbe994b4eb3a4da06808954924e"
dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
mode: GRACEFUL
new_leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
 from {username='slave'} at 127.0.0.1:54396
I20260709 13:11:56.824705  1203 raft_consensus.cc:606] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Received request to transfer leadership to TS 29ead33c064b4d25ba7dd2f540e91b41
I20260709 13:11:56.835214  1056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9373fdc20d74ffcb36f10177518f53c"
dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
mode: GRACEFUL
new_leader_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:58024
I20260709 13:11:56.835686  1056 raft_consensus.cc:606] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Received request to transfer leadership to TS ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:56.843804  1373 raft_consensus.cc:993] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41: : Instructing follower ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:56.844275  1373 raft_consensus.cc:1081] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Signalling peer ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:56.844589  1203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69"
dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
mode: GRACEFUL
new_leader_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:54396
I20260709 13:11:56.845265  1203 raft_consensus.cc:606] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Received request to transfer leadership to TS ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:56.846338  1129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9373fdc20d74ffcb36f10177518f53c"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:37764
I20260709 13:11:56.847288  1129 raft_consensus.cc:493] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:56.847669  1129 raft_consensus.cc:3060] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.851349  1056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1a32380fecc416b9a9ed2c10270b845"
dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
mode: GRACEFUL
new_leader_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:58024
I20260709 13:11:56.852053  1056 raft_consensus.cc:606] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Received request to transfer leadership to TS ab9de91bb9514190bf5545811a96bb4a
I20260709 13:11:56.857779  1129 raft_consensus.cc:515] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.860040  1129 leader_election.cc:290] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:56.861465  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9373fdc20d74ffcb36f10177518f53c" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:56.861465  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9373fdc20d74ffcb36f10177518f53c" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:56.862214  1203 raft_consensus.cc:3060] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.862277  1056 raft_consensus.cc:3055] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:56.862859  1056 raft_consensus.cc:740] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:56.863550  1056 consensus_queue.cc:260] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.864434  1056 raft_consensus.cc:3060] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.869167  1056 raft_consensus.cc:2468] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:56.870270  1095 leader_election.cc:304] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:56.870283  1203 raft_consensus.cc:2468] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:56.871112  1413 raft_consensus.cc:2804] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:56.871599  1413 raft_consensus.cc:697] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:56.872525  1413 consensus_queue.cc:237] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:56.879990   951 catalog_manager.cc:5697] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 1 to 2, leader changed from 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129) to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 2 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.921599  1336 consensus_queue.cc:1048] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:56.933065  1418 consensus_queue.cc:1048] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.121428  1327 consensus_queue.cc:1048] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.128603  1373 raft_consensus.cc:993] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41: : Instructing follower ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:57.129096  1373 raft_consensus.cc:1081] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Signalling peer ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:57.133656  1373 consensus_queue.cc:1048] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.135279  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1a32380fecc416b9a9ed2c10270b845"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:37764
I20260709 13:11:57.136020  1131 raft_consensus.cc:493] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.136451  1131 raft_consensus.cc:3060] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.144532  1131 raft_consensus.cc:515] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:57.145622  1129 raft_consensus.cc:1240] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Rejecting Update request from peer 29ead33c064b4d25ba7dd2f540e91b41 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:57.147682  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a32380fecc416b9a9ed2c10270b845" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:57.148010  1131 leader_election.cc:290] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:57.147979  1373 consensus_queue.cc:1059] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:57.148052  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a32380fecc416b9a9ed2c10270b845" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:57.149226  1203 raft_consensus.cc:3060] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.149307  1056 raft_consensus.cc:3055] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:57.149770  1056 raft_consensus.cc:740] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:57.150599  1056 consensus_queue.cc:260] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:57.151865  1056 raft_consensus.cc:3060] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.157204  1203 raft_consensus.cc:2468] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:57.157941  1056 raft_consensus.cc:2468] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
W20260709 13:11:57.158488  1373 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:11:57.158485  1095 leader_election.cc:304] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791b04a8e9d14243b2bf72a5792f4a54, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:57.159569  1386 raft_consensus.cc:2804] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:57.160123  1386 raft_consensus.cc:697] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:57.160995  1386 consensus_queue.cc:237] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:57.168653   951 catalog_manager.cc:5697] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 1 to 2, leader changed from 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129) to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 2 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.258281  1418 raft_consensus.cc:993] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54: : Instructing follower 29ead33c064b4d25ba7dd2f540e91b41 to start an election
I20260709 13:11:57.258912  1354 raft_consensus.cc:1081] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Signalling peer 29ead33c064b4d25ba7dd2f540e91b41 to start an election
I20260709 13:11:57.260551  1056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27e26cbe994b4eb3a4da06808954924e"
dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
 from {username='slave'} at 127.0.0.1:58006
I20260709 13:11:57.261070  1056 raft_consensus.cc:493] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.261363  1056 raft_consensus.cc:3060] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.267372  1056 raft_consensus.cc:515] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:57.269305  1056 leader_election.cc:290] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 election: Requested vote from peers ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:57.270294  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e26cbe994b4eb3a4da06808954924e" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:11:57.270999  1131 raft_consensus.cc:3060] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.271515  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e26cbe994b4eb3a4da06808954924e" candidate_uuid: "29ead33c064b4d25ba7dd2f540e91b41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:57.272428  1203 raft_consensus.cc:3055] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:57.272774  1203 raft_consensus.cc:740] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Running, Role: LEADER
I20260709 13:11:57.273675  1203 consensus_queue.cc:260] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:57.275243  1203 raft_consensus.cc:3060] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.279554  1417 raft_consensus.cc:993] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54: : Instructing follower ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:57.280187  1417 raft_consensus.cc:1081] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Signalling peer ab9de91bb9514190bf5545811a96bb4a to start an election
I20260709 13:11:57.280668  1131 raft_consensus.cc:2468] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 2.
I20260709 13:11:57.282042  1019 leader_election.cc:304] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:57.282931  1373 raft_consensus.cc:2804] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:57.283457  1373 raft_consensus.cc:697] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Becoming Leader. State: Replica: 29ead33c064b4d25ba7dd2f540e91b41, State: Running, Role: LEADER
I20260709 13:11:57.283766  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
 from {username='slave'} at 127.0.0.1:37756
I20260709 13:11:57.283191  1203 raft_consensus.cc:2468] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ead33c064b4d25ba7dd2f540e91b41 in term 2.
I20260709 13:11:57.284353  1131 raft_consensus.cc:493] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.284803  1131 raft_consensus.cc:3060] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.284435  1373 consensus_queue.cc:237] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:57.292142  1131 raft_consensus.cc:515] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:57.293783  1131 leader_election.cc:290] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131:36705)
I20260709 13:11:57.294544  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:11:57.293804   953 catalog_manager.cc:5697] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 reported cstate change: term changed from 1 to 2, leader changed from 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131) to 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129). New cstate: current_term: 2 leader_uuid: "29ead33c064b4d25ba7dd2f540e91b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.295186  1056 raft_consensus.cc:3060] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.295646  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d1743734640d7bfac270b387c4c69" candidate_uuid: "ab9de91bb9514190bf5545811a96bb4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
I20260709 13:11:57.296224  1203 raft_consensus.cc:3055] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:57.296531  1203 raft_consensus.cc:740] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Running, Role: LEADER
I20260709 13:11:57.297263  1203 consensus_queue.cc:260] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:57.298440  1203 raft_consensus.cc:3060] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.302151  1056 raft_consensus.cc:2468] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:57.303849  1095 leader_election.cc:304] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, ab9de91bb9514190bf5545811a96bb4a; no voters: 
I20260709 13:11:57.304647  1413 raft_consensus.cc:2804] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:57.305101  1413 raft_consensus.cc:697] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Becoming Leader. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:11:57.305337  1203 raft_consensus.cc:2468] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9de91bb9514190bf5545811a96bb4a in term 2.
I20260709 13:11:57.305892  1413 consensus_queue.cc:237] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:11:57.313166   953 catalog_manager.cc:5697] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a reported cstate change: term changed from 1 to 2, leader changed from 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131) to ab9de91bb9514190bf5545811a96bb4a (127.19.231.130). New cstate: current_term: 2 leader_uuid: "ab9de91bb9514190bf5545811a96bb4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.397760  1203 raft_consensus.cc:1275] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.399224  1413 consensus_queue.cc:1048] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.408728  1056 raft_consensus.cc:1275] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.410106  1413 consensus_queue.cc:1048] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.575563  1056 raft_consensus.cc:1275] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.576844  1413 consensus_queue.cc:1048] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.587014  1205 raft_consensus.cc:1275] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.588989  1429 consensus_queue.cc:1048] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.720115  1205 raft_consensus.cc:1275] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.721403  1429 consensus_queue.cc:1048] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.729233  1055 raft_consensus.cc:1275] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Refusing update from remote peer ab9de91bb9514190bf5545811a96bb4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.731151  1428 consensus_queue.cc:1048] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.780051  1131 raft_consensus.cc:1275] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Refusing update from remote peer 29ead33c064b4d25ba7dd2f540e91b41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.781358  1373 consensus_queue.cc:1048] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.791158  1205 raft_consensus.cc:1275] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Refusing update from remote peer 29ead33c064b4d25ba7dd2f540e91b41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.793145  1327 consensus_queue.cc:1048] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:59.862888   951 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51874:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:11:59.882023   951 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51874:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:11:59.918310 20382 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:00.012158  1467 tablet.cc:1724] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:00.146523  1450 log.cc:927] Time spent T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 13:12:00.246904  1476 tablet.cc:1724] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.322837  1498 tablet.cc:1724] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.387743  1467 tablet.cc:1724] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:00.423909  1488 log.cc:927] Time spent T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a: Append to log took a long time: real 0.151s	user 0.005s	sys 0.000s
I20260709 13:12:00.423244  1500 tablet.cc:1724] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:00.393920  1020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.231.131:36705, user_credentials={real_user=slave}} blocked reactor thread for 82724.8us
I20260709 13:12:00.446663  1128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39"
dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
mode: GRACEFUL
new_leader_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
 from {username='slave'} at 127.0.0.1:50042
W20260709 13:12:00.448000  1494 log.cc:927] Time spent T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54: Append to log took a long time: real 0.102s	user 0.003s	sys 0.000s
I20260709 13:12:00.447852  1128 raft_consensus.cc:606] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Received request to transfer leadership to TS 791b04a8e9d14243b2bf72a5792f4a54
I20260709 13:12:00.451359 20382 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:12:00.452536 20382 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:00.473330  1506 tablet.cc:1724] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.474633  1503 tablet.cc:1724] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:00.477952  1501 log.cc:927] Time spent T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 13:12:00.510717  1510 tablet.cc:1724] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.512633  1467 tablet.cc:1724] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.478876  1507 tablet.cc:1724] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.501780  1504 tablet.cc:1724] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.510630  1512 tablet.cc:1724] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.521733  1509 tablet.cc:1724] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.531212  1476 tablet.cc:1724] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.559042  1498 tablet.cc:1724] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.589673  1511 tablet.cc:1724] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.592124  1504 tablet.cc:1724] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.567737  1500 tablet.cc:1724] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.595708  1506 tablet.cc:1724] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.610558  1476 tablet.cc:1724] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.615267  1509 tablet.cc:1724] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.615653  1511 tablet.cc:1724] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.619532  1512 tablet.cc:1724] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.637918  1503 tablet.cc:1724] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.643267  1507 tablet.cc:1724] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.622466  1510 tablet.cc:1724] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.664570  1506 tablet.cc:1724] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:00.674849   953 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b: soft_deleted_table [id=3126e7ba983b4b77bc673a6bc1bc0c22] alter complete (version 1)
I20260709 13:12:00.758476  1473 raft_consensus.cc:993] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a: : Instructing follower 791b04a8e9d14243b2bf72a5792f4a54 to start an election
I20260709 13:12:00.759133  1480 raft_consensus.cc:1081] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Signalling peer 791b04a8e9d14243b2bf72a5792f4a54 to start an election
I20260709 13:12:00.760785  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39"
dest_uuid: "791b04a8e9d14243b2bf72a5792f4a54"
 from {username='slave'} at 127.0.0.1:54382
I20260709 13:12:00.761320  1199 raft_consensus.cc:493] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:00.761662  1199 raft_consensus.cc:3060] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.767753  1199 raft_consensus.cc:515] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:12:00.769611  1199 leader_election.cc:290] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 3 election: Requested vote from peers 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573), ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911)
I20260709 13:12:00.770700  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29ead33c064b4d25ba7dd2f540e91b41"
I20260709 13:12:00.771127  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98a36cfa7c74dcf99411c648cf52a39" candidate_uuid: "791b04a8e9d14243b2bf72a5792f4a54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab9de91bb9514190bf5545811a96bb4a"
I20260709 13:12:00.771660  1055 raft_consensus.cc:3060] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.771773  1128 raft_consensus.cc:3055] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:00.772244  1128 raft_consensus.cc:740] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab9de91bb9514190bf5545811a96bb4a, State: Running, Role: LEADER
I20260709 13:12:00.773325  1128 consensus_queue.cc:260] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:12:00.774955  1128 raft_consensus.cc:3060] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.780880  1055 raft_consensus.cc:2468] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 3.
I20260709 13:12:00.782585  1169 leader_election.cc:304] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ead33c064b4d25ba7dd2f540e91b41, 791b04a8e9d14243b2bf72a5792f4a54; no voters: 
I20260709 13:12:00.783269  1128 raft_consensus.cc:2468] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791b04a8e9d14243b2bf72a5792f4a54 in term 3.
I20260709 13:12:00.783710  1489 raft_consensus.cc:2804] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:00.784329  1489 raft_consensus.cc:697] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 3 LEADER]: Becoming Leader. State: Replica: 791b04a8e9d14243b2bf72a5792f4a54, State: Running, Role: LEADER
I20260709 13:12:00.785183  1489 consensus_queue.cc:237] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } }
I20260709 13:12:00.795289   951 catalog_manager.cc:5697] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 reported cstate change: term changed from 2 to 3, leader changed from ab9de91bb9514190bf5545811a96bb4a (127.19.231.130) to 791b04a8e9d14243b2bf72a5792f4a54 (127.19.231.131). New cstate: current_term: 3 leader_uuid: "791b04a8e9d14243b2bf72a5792f4a54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791b04a8e9d14243b2bf72a5792f4a54" member_type: VOTER last_known_addr { host: "127.19.231.131" port: 36705 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:01.191679  1128 raft_consensus.cc:1275] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 3 FOLLOWER]: Refusing update from remote peer 791b04a8e9d14243b2bf72a5792f4a54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:01.192950  1489 consensus_queue.cc:1048] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9de91bb9514190bf5545811a96bb4a" member_type: VOTER last_known_addr { host: "127.19.231.130" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:01.218204  1055 raft_consensus.cc:1275] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 3 FOLLOWER]: Refusing update from remote peer 791b04a8e9d14243b2bf72a5792f4a54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:01.221951  1489 consensus_queue.cc:1048] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ead33c064b4d25ba7dd2f540e91b41" member_type: VOTER last_known_addr { host: "127.19.231.129" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:01.515161 20382 tablet_server.cc:179] TabletServer@127.19.231.129:0 shutting down...
I20260709 13:12:01.545212 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:01.546168 20382 tablet_replica.cc:333] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.547468 20382 raft_consensus.cc:2243] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.548154 20382 raft_consensus.cc:2272] T c7abd3f0f55e4334a2301d81120014cf P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.551426 20382 tablet_replica.cc:333] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.552084 20382 raft_consensus.cc:2243] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.552881 20382 raft_consensus.cc:2272] T fd29287780344c8fbf06f5df2e33bc98 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.555073 20382 tablet_replica.cc:333] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.555586 20382 raft_consensus.cc:2243] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.556039 20382 raft_consensus.cc:2272] T e9373fdc20d74ffcb36f10177518f53c P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.558846 20382 tablet_replica.cc:333] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.559516 20382 raft_consensus.cc:2243] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.560286 20382 raft_consensus.cc:2272] T 890eeb71908f4a0ebdfc2d559b2556fc P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.562536 20382 tablet_replica.cc:333] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.563378 20382 raft_consensus.cc:2243] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:01.564018  1169 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
I20260709 13:12:01.564392 20382 raft_consensus.cc:2272] T a121fc5aa833417b8e9bb4c62fedff65 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.567551 20382 tablet_replica.cc:333] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
W20260709 13:12:01.567584  1169 consensus_peers.cc:597] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 -> Peer 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573): Couldn't send request to peer 29ead33c064b4d25ba7dd2f540e91b41. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:01.568410 20382 raft_consensus.cc:2243] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.569099 20382 raft_consensus.cc:2272] T 7a70c0e21cb44923b248fa502083b885 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.572072 20382 tablet_replica.cc:333] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.572832 20382 raft_consensus.cc:2243] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.573935 20382 raft_consensus.cc:2272] T 27e26cbe994b4eb3a4da06808954924e P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:01.573997  1095 consensus_peers.cc:597] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a -> Peer 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573): Couldn't send request to peer 29ead33c064b4d25ba7dd2f540e91b41. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:01.577196 20382 tablet_replica.cc:333] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.577903 20382 raft_consensus.cc:2243] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.578982 20382 raft_consensus.cc:2272] T bb092e0a7a844c0799648a4e60e66661 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.581171 20382 tablet_replica.cc:333] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.581748 20382 raft_consensus.cc:2243] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.582207 20382 raft_consensus.cc:2272] T a1a32380fecc416b9a9ed2c10270b845 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.585273 20382 tablet_replica.cc:333] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.586050 20382 raft_consensus.cc:2243] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.586627 20382 raft_consensus.cc:2272] T 25ab6a4f40514e389c793cf077740c30 P 29ead33c064b4d25ba7dd2f540e91b41 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.589617 20382 tablet_replica.cc:333] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.590243 20382 raft_consensus.cc:2243] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.590889 20382 raft_consensus.cc:2272] T 6c5cceb435424717adbb505c0c94eec8 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.593068 20382 tablet_replica.cc:333] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.593647 20382 raft_consensus.cc:2243] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.594153 20382 raft_consensus.cc:2272] T df084483bce74b11a9e2bc379be7e47b P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.596469 20382 tablet_replica.cc:333] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.597048 20382 raft_consensus.cc:2243] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.597501 20382 raft_consensus.cc:2272] T 6af0f71d7d7843f797565fe08cfeb65e P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.599881 20382 tablet_replica.cc:333] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.600458 20382 raft_consensus.cc:2243] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.601624 20382 raft_consensus.cc:2272] T 12cdff375baf4e0ab50f38017273441a P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.604579 20382 tablet_replica.cc:333] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.605145 20382 raft_consensus.cc:2243] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.605571 20382 raft_consensus.cc:2272] T c98a36cfa7c74dcf99411c648cf52a39 P 29ead33c064b4d25ba7dd2f540e91b41 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.608168 20382 tablet_replica.cc:333] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.608749 20382 raft_consensus.cc:2243] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.609229 20382 raft_consensus.cc:2272] T 638b02d6d70d49dfb30915251d3e1f84 P 29ead33c064b4d25ba7dd2f540e91b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.612383 20382 tablet_replica.cc:333] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.613025 20382 raft_consensus.cc:2243] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.613633 20382 raft_consensus.cc:2272] T d05d1743734640d7bfac270b387c4c69 P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.616899 20382 tablet_replica.cc:333] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41: stopping tablet replica
I20260709 13:12:01.617498 20382 raft_consensus.cc:2243] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.618429 20382 raft_consensus.cc:2272] T 4126deadcedd4e2896ec44d2c373749e P 29ead33c064b4d25ba7dd2f540e91b41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.659363 20382 tablet_server.cc:196] TabletServer@127.19.231.129:0 shutdown complete.
W20260709 13:12:01.702484  1095 consensus_peers.cc:597] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a -> Peer 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573): Couldn't send request to peer 29ead33c064b4d25ba7dd2f540e91b41. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:45573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:01.703986 20382 tablet_server.cc:179] TabletServer@127.19.231.130:0 shutting down...
W20260709 13:12:01.730093  1169 consensus_peers.cc:597] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 -> Peer 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573): Couldn't send request to peer 29ead33c064b4d25ba7dd2f540e91b41. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:45573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:01.737789 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:01.738698 20382 tablet_replica.cc:333] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.739574 20382 raft_consensus.cc:2243] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.740470 20382 raft_consensus.cc:2272] T c7abd3f0f55e4334a2301d81120014cf P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.742616 20382 tablet_replica.cc:333] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.743297 20382 raft_consensus.cc:2243] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.743834 20382 raft_consensus.cc:2272] T 27e26cbe994b4eb3a4da06808954924e P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.745970 20382 tablet_replica.cc:333] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.746557 20382 raft_consensus.cc:2243] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.747059 20382 raft_consensus.cc:2272] T fd29287780344c8fbf06f5df2e33bc98 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.749111 20382 tablet_replica.cc:333] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.749689 20382 raft_consensus.cc:2243] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.750473 20382 raft_consensus.cc:2272] T e9373fdc20d74ffcb36f10177518f53c P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.752588 20382 tablet_replica.cc:333] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.753216 20382 raft_consensus.cc:2243] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.754046 20382 raft_consensus.cc:2272] T 7a70c0e21cb44923b248fa502083b885 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.756211 20382 tablet_replica.cc:333] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.756806 20382 raft_consensus.cc:2243] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.757686 20382 raft_consensus.cc:2272] T 6af0f71d7d7843f797565fe08cfeb65e P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.760104 20382 tablet_replica.cc:333] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.760746 20382 raft_consensus.cc:2243] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.761251 20382 raft_consensus.cc:2272] T 12cdff375baf4e0ab50f38017273441a P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.763559 20382 tablet_replica.cc:333] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.764132 20382 raft_consensus.cc:2243] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.764547 20382 raft_consensus.cc:2272] T c98a36cfa7c74dcf99411c648cf52a39 P ab9de91bb9514190bf5545811a96bb4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.767256 20382 tablet_replica.cc:333] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.767906 20382 raft_consensus.cc:2243] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.768371 20382 raft_consensus.cc:2272] T a121fc5aa833417b8e9bb4c62fedff65 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.770422 20382 tablet_replica.cc:333] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.771066 20382 raft_consensus.cc:2243] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.771733 20382 raft_consensus.cc:2272] T 890eeb71908f4a0ebdfc2d559b2556fc P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.773999 20382 tablet_replica.cc:333] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.774552 20382 raft_consensus.cc:2243] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.775074 20382 raft_consensus.cc:2272] T bb092e0a7a844c0799648a4e60e66661 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.777247 20382 tablet_replica.cc:333] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.777954 20382 raft_consensus.cc:2243] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.778566 20382 raft_consensus.cc:2272] T 6c5cceb435424717adbb505c0c94eec8 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.781306 20382 tablet_replica.cc:333] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
W20260709 13:12:01.781682  1168 consensus_peers.cc:597] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 -> Peer ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911): Couldn't send request to peer ab9de91bb9514190bf5545811a96bb4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:01.782166 20382 raft_consensus.cc:2243] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.783185 20382 raft_consensus.cc:2272] T df084483bce74b11a9e2bc379be7e47b P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.785365 20382 tablet_replica.cc:333] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.785866 20382 raft_consensus.cc:2243] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.786656 20382 raft_consensus.cc:2272] T a1a32380fecc416b9a9ed2c10270b845 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.789170 20382 tablet_replica.cc:333] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.789759 20382 raft_consensus.cc:2243] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.790369 20382 raft_consensus.cc:2272] T 25ab6a4f40514e389c793cf077740c30 P ab9de91bb9514190bf5545811a96bb4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.793851 20382 tablet_replica.cc:333] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.794601 20382 raft_consensus.cc:2243] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.795244 20382 raft_consensus.cc:2272] T 638b02d6d70d49dfb30915251d3e1f84 P ab9de91bb9514190bf5545811a96bb4a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:01.795290  1169 consensus_peers.cc:597] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 -> Peer 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573): Couldn't send request to peer 29ead33c064b4d25ba7dd2f540e91b41. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:45573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:01.798291 20382 tablet_replica.cc:333] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.799129 20382 raft_consensus.cc:2243] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.799996 20382 raft_consensus.cc:2272] T d05d1743734640d7bfac270b387c4c69 P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.802590 20382 tablet_replica.cc:333] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a: stopping tablet replica
I20260709 13:12:01.803328 20382 raft_consensus.cc:2243] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.804018 20382 raft_consensus.cc:2272] T 4126deadcedd4e2896ec44d2c373749e P ab9de91bb9514190bf5545811a96bb4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.845866 20382 tablet_server.cc:196] TabletServer@127.19.231.130:0 shutdown complete.
W20260709 13:12:01.874820  1168 consensus_peers.cc:597] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 -> Peer ab9de91bb9514190bf5545811a96bb4a (127.19.231.130:42911): Couldn't send request to peer ab9de91bb9514190bf5545811a96bb4a. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.130:42911: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:01.882519  1169 consensus_peers.cc:597] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 -> Peer 29ead33c064b4d25ba7dd2f540e91b41 (127.19.231.129:45573): Couldn't send request to peer 29ead33c064b4d25ba7dd2f540e91b41. Status: Network error: Client connection negotiation failed: client connection to 127.19.231.129:45573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:01.885869 20382 tablet_server.cc:179] TabletServer@127.19.231.131:0 shutting down...
I20260709 13:12:01.916682 20382 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:01.917521 20382 tablet_replica.cc:333] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.918690 20382 raft_consensus.cc:2243] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.919371 20382 raft_consensus.cc:2272] T e9373fdc20d74ffcb36f10177518f53c P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.921579 20382 tablet_replica.cc:333] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.922176 20382 raft_consensus.cc:2243] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.922636 20382 raft_consensus.cc:2272] T c7abd3f0f55e4334a2301d81120014cf P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.924695 20382 tablet_replica.cc:333] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.925246 20382 raft_consensus.cc:2243] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.925666 20382 raft_consensus.cc:2272] T a121fc5aa833417b8e9bb4c62fedff65 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.927811 20382 tablet_replica.cc:333] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.928418 20382 raft_consensus.cc:2243] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.928869 20382 raft_consensus.cc:2272] T 890eeb71908f4a0ebdfc2d559b2556fc P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.930974 20382 tablet_replica.cc:333] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.931476 20382 raft_consensus.cc:2243] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.931948 20382 raft_consensus.cc:2272] T fd29287780344c8fbf06f5df2e33bc98 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.934024 20382 tablet_replica.cc:333] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.934597 20382 raft_consensus.cc:2243] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.935104 20382 raft_consensus.cc:2272] T 6af0f71d7d7843f797565fe08cfeb65e P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.937325 20382 tablet_replica.cc:333] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.937915 20382 raft_consensus.cc:2243] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.938884 20382 raft_consensus.cc:2272] T 638b02d6d70d49dfb30915251d3e1f84 P 791b04a8e9d14243b2bf72a5792f4a54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.941013 20382 tablet_replica.cc:333] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.941604 20382 raft_consensus.cc:2243] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.942121 20382 raft_consensus.cc:2272] T d05d1743734640d7bfac270b387c4c69 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.944437 20382 tablet_replica.cc:333] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.945137 20382 raft_consensus.cc:2243] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.945636 20382 raft_consensus.cc:2272] T 4126deadcedd4e2896ec44d2c373749e P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.947889 20382 tablet_replica.cc:333] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.948444 20382 raft_consensus.cc:2243] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.948990 20382 raft_consensus.cc:2272] T 27e26cbe994b4eb3a4da06808954924e P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.952483 20382 tablet_replica.cc:333] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.953064 20382 raft_consensus.cc:2243] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.953562 20382 raft_consensus.cc:2272] T bb092e0a7a844c0799648a4e60e66661 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.956056 20382 tablet_replica.cc:333] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.956632 20382 raft_consensus.cc:2243] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.957115 20382 raft_consensus.cc:2272] T a1a32380fecc416b9a9ed2c10270b845 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.959167 20382 tablet_replica.cc:333] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.959733 20382 raft_consensus.cc:2243] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.960563 20382 raft_consensus.cc:2272] T 25ab6a4f40514e389c793cf077740c30 P 791b04a8e9d14243b2bf72a5792f4a54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.962648 20382 tablet_replica.cc:333] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.963277 20382 raft_consensus.cc:2243] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.964107 20382 raft_consensus.cc:2272] T 6c5cceb435424717adbb505c0c94eec8 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.966341 20382 tablet_replica.cc:333] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.968372 20382 raft_consensus.cc:2243] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.968907 20382 raft_consensus.cc:2272] T df084483bce74b11a9e2bc379be7e47b P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.971304 20382 tablet_replica.cc:333] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.971858 20382 raft_consensus.cc:2243] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.972682 20382 raft_consensus.cc:2272] T c98a36cfa7c74dcf99411c648cf52a39 P 791b04a8e9d14243b2bf72a5792f4a54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.975219 20382 tablet_replica.cc:333] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.975793 20382 raft_consensus.cc:2243] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.976284 20382 raft_consensus.cc:2272] T 12cdff375baf4e0ab50f38017273441a P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.978406 20382 tablet_replica.cc:333] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54: stopping tablet replica
I20260709 13:12:01.979030 20382 raft_consensus.cc:2243] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.979516 20382 raft_consensus.cc:2272] T 7a70c0e21cb44923b248fa502083b885 P 791b04a8e9d14243b2bf72a5792f4a54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:02.023476 20382 tablet_server.cc:196] TabletServer@127.19.231.131:0 shutdown complete.
I20260709 13:12:02.058719 20382 master.cc:562] Master@127.19.231.190:36393 shutting down...
I20260709 13:12:02.081455 20382 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:02.082028 20382 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:02.082402 20382 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9bf764d5d09040f897194b01793e5a6b: stopping tablet replica
I20260709 13:12:02.104025 20382 master.cc:584] Master@127.19.231.190:36393 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11496 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24356 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (384522 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:12:02.160600 20382 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 397 messages since previous log ~14 seconds ago
I20260709 13:12:02.160872 20382 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 397 messages since previous log ~14 seconds ago
I20260709 13:12:02.161063 20382 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 387 messages since previous log ~14 seconds ago
I20260709 13:12:02.161258 20382 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:12:02.161468 20382 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:12:02.161710 20382 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~82 seconds ago
I20260709 13:12:02.161962 20382 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~136 seconds ago
I20260709 13:12:02.162156 20382 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~153 seconds ago
I20260709 13:12:02.162362 20382 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~153 seconds ago
I20260709 13:12:02.162631 20382 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:12:02.163185 20382 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
